Spatial-Spectral Residual Network for Hyperspectral Image Super-Resolution

TL;DR

This paper introduces SSRNet, a novel hyperspectral image super-resolution model that effectively combines spatial and spectral information using 3D convolutions and a residual module, outperforming existing methods.

Contribution

The paper proposes a spectral-spatial residual network with 3D convolutions and a residual module for improved hyperspectral image super-resolution.

Findings

Achieves superior super-resolution performance on benchmark datasets.

Reduces memory usage and computational cost with separable 3D convolutions.

Outperforms state-of-the-art methods in accuracy and efficiency.

Abstract

Deep learning-based hyperspectral image super-resolution (SR) methods have achieved great success recently. However, most existing models can not effectively explore spatial information and spectral information between bands simultaneously, obtaining relatively low performance. To address this issue, in this paper, we propose a novel spectral-spatial residual network for hyperspectral image super-resolution (SSRNet). Our method can effectively explore spatial-spectral information by using 3D convolution instead of 2D convolution, which enables the network to better extract potential information. Furthermore, we design a spectral-spatial residual module (SSRM) to adaptively learn more effective features from all the hierarchical features in units through local feature fusion, significantly improving the performance of the algorithm. In each unit, we employ spatial and temporal separable 3D convolution to extract spatial and spectral information, which not only reduces unaffordable memory usage and high computational cost, but also makes the network easier to train. Extensive evaluations and comparisons on three benchmark datasets demonstrate that the proposed approach achieves superior performance in comparison to existing state-of-the-art methods.