Journal
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Volume 59, Issue 9, Pages 7711-7725Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TGRS.2021.3049875
Keywords
Feature extraction; Correlation; Image reconstruction; Spatial resolution; Superresolution; Hyperspectral imaging; Convolution; Convolutional neural network (CNN); group convolution; hyperspectral image (HSI); spectral attention mechanism; super-resolution (SR)
Categories
Funding
- National Natural Science Foundation of China [41922008, 61971319, 62071341]
- Hubei Science Foundation for Distinguished Young Scholars [2020CFA051]
Ask authors/readers for more resources
A novel CNN-based method, SGARDN, is proposed in this article for hyperspectral image super-resolution, utilizing spectral grouping and attention mechanisms to extract effective spatial-spectral features and improve feature expression and spectral correlation learning. Experimental results demonstrate the superiority of the proposed method over other state-of-the-art methods in synthesized and real-scenario hyperspectral images.
Although unprecedented success has been achieved in convolutional neural network (CNN)-based super-resolution (SR) for natural images, hyperspectral image (HSI) SR without auxiliary high-resolution images remains a challenging task due to the high spectral dimensionality, where learning effective spatial and spectral representations is of great importance. In this article, we introduce a novel CNN-based HSI SR method, termed spectral grouping and attention-driven residual dense network (SGARDN) to facilitate the modeling of all spectral bands and focus on the exploration of spatial-spectral features. Considering the block characteristic of HSI, we employ group convolutions in and between groups composed of highly similar spectral bands at early stages to extract informative spatial features and avoid spectral disorder caused by normal convolution. To exploit spectral prior, a new spectral attention mechanism constructed by covariance statistics of features is designed to adaptively recalibrate features. We adapt the spectral attention for group convolutions to rescale grouping features with holistic spectral information. These two sequential operations called spectral grouping and integration module aim to extract effective shallow spatial-spectral features that are reused in the following layers. On the other hand, the residual dense block can better deal with spatial-spectral features by experimental comparison and hence is combined with the spectral attention to form a new basic building block for powerful feature expression and spectral correlation learning. The experimental results on synthesized and real-scenario HSIs demonstrate the feasibility and superiority of the proposed method over other state-of-the-art methods.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available