SR-CACO-2: A Dataset for Confocal Fluorescence Microscopy Image Super-Resolution

TL;DR

This paper introduces SR-CACO-2, a large publicly available dataset of confocal microscopy images for evaluating super-resolution methods, highlighting current limitations of existing algorithms in restoring high-resolution textures.

Contribution

The paper provides the first large-scale confocal microscopy dataset with paired low- and high-resolution images for super-resolution research, enabling better benchmarking and development.

Findings

Existing SISR methods have limited success in restoring textures in confocal microscopy images.

The dataset enables comprehensive benchmarking of 16 state-of-the-art SISR methods.

Results highlight the need for improved algorithms tailored to microscopy image characteristics.

Abstract

Confocal fluorescence microscopy is one of the most accessible and widely used imaging techniques for the study of biological processes at the cellular and subcellular levels. Scanning confocal microscopy allows the capture of high-quality images from thick three-dimensional (3D) samples, yet suffers from well-known limitations such as photobleaching and phototoxicity of specimens caused by intense light exposure, limiting its applications. Cellular damage can be alleviated by changing imaging parameters to reduce light exposure, often at the expense of image quality. Machine/deep learning methods for single-image super-resolution (SISR) can be applied to restore image quality by upscaling lower-resolution (LR) images to yield high-resolution images (HR). These SISR methods have been successfully applied to photo-realistic images due partly to the abundance of publicly available data. In contrast, the lack of publicly available data partly limits their application and success in scanning confocal microscopy. In this paper, we introduce a large scanning confocal microscopy dataset named SR-CACO-2 that is comprised of low- and high-resolution image pairs marked for three different fluorescent markers. It allows the evaluation of performance of SISR methods on three different upscaling levels (X2, X4, X8). SR-CACO-2 contains the human epithelial cell line Caco-2 (ATCC HTB-37), and it is composed of 2,200 unique images, captured with four resolutions and three markers, forming 9,937 image patches for SISR methods. We provide benchmarking results for 16 state-of-the-art methods of the main SISR families. Results show that these methods have limited success in producing high-resolution textures. The dataset is freely accessible under a Creative Commons license (CC BY-NC-SA 4.0). Our dataset, code and pretrained weights for SISR methods are available: https://github.com/sbelharbi/sr-caco-2.