Hyperspectral Image Cross-Domain Object Detection Method based on Spectral-Spatial Feature Alignment

TL;DR

This paper introduces an unsupervised cross-domain object detection method for hyperspectral images that aligns spectral-spatial features to address domain shift, supported by a new dataset and promising experimental results.

Contribution

It is the first to propose spectral-spatial feature alignment for cross-domain hyperspectral image object detection, effectively handling domain shifts in spectral and spatial resolutions.

Findings

Effective domain-invariant feature extraction

Successful spectral domain alignment

Significant improvement over baseline methods

Abstract

With consecutive bands in a wide range of wavelengths, hyperspectral images (HSI) have provided a unique tool for object detection task. However, existing HSI object detection methods have not been fully utilized in real applications, which is mainly resulted by the difference of spatial and spectral resolution between the unlabeled target domain and a labeled source domain, i.e. the domain shift of HSI. In this work, we aim to explore the unsupervised cross-domain object detection of HSI. Our key observation is that the local spatial-spectral characteristics remain invariant across different domains. For solving the problem of domain-shift, we propose a HSI cross-domain object detection method based on spectral-spatial feature alignment, which is the first attempt in the object detection community to the best of our knowledge. Firstly, we develop a spectral-spatial alignment module to extract domain-invariant local spatial-spectral features. Secondly, the spectral autocorrelation module has been designed to solve the domain shift in the spectral domain specifically, which can effectively align HSIs with different spectral resolutions. Besides, we have collected and annotated an HSI dataset for the cross-domain object detection. Our experimental results have proved the effectiveness of HSI cross-domain object detection, which has firstly demonstrated a significant and promising step towards HSI cross-domain object detection in the object detection community.