Convolutional Autoencoder for Spectral Spatial Hyperspectral Unmixing

Blind hyperspectral unmixing is the process of expressing the measured spectrum of a pixel as a combination of a set of spectral signatures called endmembers and simultaneously determining their fractional abundances in the pixel. Most unmixing methods are strictly spectral and do not exploit the spatial structure of hyperspectral images (HSIs). In this article, we present a new spectral spatial linear mixture model and an associated estimation method based on a convolutional neural network autoencoder unmixing (CNNAEU). The CNNAEU technique exploits the spatial and the spectral structure of HSIs both for endmember and abundance map estimation. As it works directly with patches of HSIs and does not use any pooling or upsampling layers, the spatial structure is preserved throughout and abundance maps are obtained as feature maps of a hidden convolutional layer. We compared the CNNAEU method to four conventional and three deep learning state-of-the-art unmixing methods using four real HSIs. Experimental results show that the proposed CNNAEU technique performs particularly well and consistently when it comes to endmembers extraction and outperforms all the comparison methods.

Automated summary

In this article, a new spectral spatial linear mixture model and an associated estimation method based on a convolutional neural network autoencoder unmixing (CNNAEU) technique were presented. The CNNAEU method successfully exploits both the spatial and spectral structure of hyperspectral images for endmember and abundance map estimation.