MetaH2: A Snapshot Metasurface HDR Hyperspectral Camera

TL;DR

MetaH2 introduces a snapshot metasurface camera capable of capturing high-dynamic range and hyperspectral images simultaneously, utilizing integrated optical design and deep learning for accurate reconstruction in real-world scenes.

Contribution

The paper presents a novel metasurface camera that combines HDR and hyperspectral imaging in a single snapshot using multiplexed projections and deep reconstruction.

Findings

Achieves 60 dB dynamic range in real-world scenes

Provides 10 nm spectral resolution from 600 nm to 700 nm

Outperforms previous snapshot hyperspectral imaging methods

Abstract

We present a metasurface camera that jointly performs high-dynamic range (HDR) and hyperspectral imaging in a snapshot. The system integrates exposure bracketing and computed tomography imaging spectrometry (CTIS) by simultaneously forming multiple spatially multiplexed projections with unique power ratios and chromatic aberrations on a photosensor. The measurements are subsequently processed through a deep reconstruction model to generate an HDR image and a hyperspectral datacube. Our simulation studies show that the proposed system achieves higher reconstruction accuracy than previous snapshot hyperspectral imaging methods on benchmark datasets. We assemble a working prototype and demonstrate snapshot reconstruction of 60 dB dynamic range and 10 nm spectral resolution from 600 nm to 700 nm on real-world scenes from a monochrome photosensor.