Looking into a Pixel by Nonlinear Unmixing -- A Generative Approach

TL;DR

This paper introduces a generative, model-free approach to hyperspectral nonlinear unmixing using a bi-directional GAN framework with cycle consistency and linear linkage constraints.

Contribution

It proposes the LCGU net, a novel invertible unmixing model that does not rely on explicit mixing models, improving stability and performance.

Findings

LCGU net achieves stable, competitive results across datasets.

The approach outperforms traditional model-based methods.

It effectively handles nonlinear mixtures without explicit models.

Abstract

Due to the large footprint of pixels in remote sensing imagery, hyperspectral unmixing (HU) has become an important and necessary procedure in hyperspectral image analysis. Traditional HU methods rely on a prior spectral mixing model, especially for nonlinear mixtures, which has largely limited the performance and generalization capacity of the unmixing approach. In this paper, we address the challenging problem of hyperspectral nonlinear unmixing (HNU) without explicit knowledge of the mixing model. Inspired by the principle of generative models, where images of the same distribution can be generated as that of the training images without knowing the exact probability distribution function of the image, we develop an invertible mixing-unmixing process via a bi-directional GAN framework, constrained by both the cycle consistency and the linkage between linear and nonlinear mixtures. The combination of cycle consistency and linear linkage provides powerful constraints without requiring an explicit mixing model. We refer to the proposed approach as the linearly-constrained CycleGAN unmixing net, or LCGU net. Experimental results indicate that the proposed LCGU net exhibits stable and competitive performance across different datasets compared with other state-of-the-art model-based HNU methods.