Modeling Mask Uncertainty in Hyperspectral Image Reconstruction

TL;DR

This paper introduces a Bayesian approach to model mask uncertainty in hyperspectral image reconstruction, enabling robust performance across different hardware configurations and addressing miscalibration issues.

Contribution

It proposes a novel variational Bayesian framework with a graph-based self-tuning network to explicitly model mask uncertainty in hyperspectral imaging.

Findings

Achieves over 33/30 dB reconstruction quality under miscalibration scenarios.

Demonstrates superior robustness compared to state-of-the-art methods.

Validates effectiveness through extensive experiments.

Abstract

Recently, hyperspectral imaging (HSI) has attracted increasing research attention, especially for the ones based on a coded aperture snapshot spectral imaging (CASSI) system. Existing deep HSI reconstruction models are generally trained on paired data to retrieve original signals upon 2D compressed measurements given by a particular optical hardware mask in CASSI, during which the mask largely impacts the reconstruction performance and could work as a "model hyperparameter" governing on data augmentations. This mask-specific training style will lead to a hardware miscalibration issue, which sets up barriers to deploying deep HSI models among different hardware and noisy environments. To address this challenge, we introduce mask uncertainty for HSI with a complete variational Bayesian learning treatment and explicitly model it through a mask decomposition inspired by real hardware. Specifically, we propose a novel Graph-based Self-Tuning (GST) network to reason uncertainties adapting to varying spatial structures of masks among different hardware. Moreover, we develop a bilevel optimization framework to balance HSI reconstruction and uncertainty estimation, accounting for the hyperparameter property of masks. Extensive experimental results and model discussions validate the effectiveness (over 33/30 dB) of the proposed GST method under two miscalibration scenarios and demonstrate a highly competitive performance compared with the state-of-the-art well-calibrated methods. Our code and pre-trained model are available at https://github.com/Jiamian-Wang/mask_uncertainty_spectral_SCI