Hyperspectral image reconstruction by deep learning with super-Rayleigh speckles

TL;DR

This paper introduces GISCnet with super-Rayleigh speckle modulation, a deep learning approach that enhances 3D hyperspectral image reconstruction quality in ghost imaging systems, achieving higher signal-to-noise ratios.

Contribution

It proposes a novel end-to-end deep learning model combined with super-Rayleigh speckle modulation to significantly improve hyperspectral image reconstruction in ghost imaging.

Findings

Average PSNR increased from 27 dB to 31 dB

Super-Rayleigh speckles provide more detail in reconstructions

Effective joint optimization of light-field modulation and reconstruction

Abstract

Ghost imaging via sparsity constraints (GISC) spectral camera modulates the three-dimensional (3D) hyperspectral image into a two-dimensional (2D) compressive image with speckles in a single shot. It obtains a 3D hyperspectral image (HSI) by reconstruction algorithms. The rapid development of deep learning has provided a new method for 3D HSI reconstruction. Moreover, the imaging performance of the GISC spectral camera can be improved by optimizing the speckle modulation. In this paper, we propose an end-to-end GISCnet with super-Rayleigh speckle modulation to improve the imaging quality of the GISC spectral camera. The structure of GISCnet is very simple but effective, and we can easily adjust the network structure parameters to improve the image reconstruction quality. Relative to Rayleigh speckles, our super-Rayleigh speckles modulation exhibits a wealth of detail in reconstructing 3D HSIs. After evaluating 648 3D HSIs, it was found that the average peak signal-to-noise ratio increased from 27 dB to 31 dB. Overall, the proposed GISCnet with super-Rayleigh speckle modulation can effectively improve the imaging quality of the GISC spectral camera by taking advantage of both optimized super-Rayleigh modulation and deep-learning image reconstruction, inspiring joint optimization of light-field modulation and image reconstruction to improve ghost imaging performance.