Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution

TL;DR

This paper introduces a novel implicit neural representation model for hyperspectral image super-resolution that effectively captures spatial and spectral details, achieving competitive results without auxiliary images.

Contribution

The paper proposes a continuous function-based HSI reconstruction model using INRs with a hypernetwork and spatial encoding, advancing super-resolution techniques.

Findings

Achieves competitive reconstruction performance on multiple datasets.

Effectively captures high-frequency details through spatial encoding.

Demonstrates the efficacy of INR-based models for HSI super-resolution.

Abstract

Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is a fundamental issue. Recently, Implicit Neural Representations (INRs) are making strides as a novel and effective representation, especially in the reconstruction task. Therefore, in this work, we propose a novel HSI reconstruction model based on INR which represents HSI by a continuous function mapping a spatial coordinate to its corresponding spectral radiance values. In particular, as a specific implementation of INR, the parameters of parametric model are predicted by a hypernetwork that operates on feature extraction using convolution network. It makes the continuous functions map the spatial coordinates to pixel values in a content-aware manner. Moreover, periodic spatial encoding are deeply integrated with the reconstruction procedure, which makes our model capable of recovering more high frequency details. To verify the efficacy of our model, we conduct experiments on three HSI datasets (CAVE, NUS, and NTIRE2018). Experimental results show that the proposed model can achieve competitive reconstruction performance in comparison with the state-of-the-art methods. In addition, we provide an ablation study on the effect of individual components of our model. We hope this paper could server as a potent reference for future research.