期刊
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
卷 60, 期 -, 页码 -出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TGRS.2021.3135028
关键词
Hyperspectral imaging; Spatial resolution; Feature extraction; Image reconstruction; Image color analysis; Tensors; Correlation; Attention mechanism; hyperspectral super-resolution (HSR); structure-color preserving
类别
资金
- National Key Research and Development Program of China [2019YFC1510905]
- National Natural Science Foundation of China [62001251, 62001252]
- China Postdoctoral Science Foundation [2020M670631]
In this article, a new structure-color preserving network (SCPNet) based on the joint attention mechanism is proposed for hyperspectral super-resolution (HSR). The SCPNet consists of three modules: structure-preserving module (SPM), color-preserving module (CPM), and cross-fusion module. Experimental results show that the proposed SCPNet has advantages on three benchmark datasets compared to state-of-the-art HSR methods.
Fusion-based hyperspectral super-resolution (HSR) algorithms usually utilize a low-resolution hyperspectral image (LR-HSI) and a high-resolution multispectral image (MSI) to generate a high-resolution hyperspectral image (HR-HSI), which have attracted increasing attention in recent years. However, how to deal with the abundant spectral information of hyperspectral images and complex structure characteristics of MSIs has always been the focus and difficulty of fusion-based HSR. In this article, we propose a new structure & x2013;color preserving network (SCPNet) for HSR, which is developed under the basis of the joint attention mechanism. The SCPNet mainly includes three modules: structure-preserving module (SPM), color-preserving module (CPM), and cross-fusion module. The SPM is constructed based on the spatial attention, which aims to capture and enhance the significant structure information from the high-resolution MSI. Meanwhile, the CPM is constructed based on the channel attention, where the spectral characteristics in the LR-HSI are preserved during the reconstruction process. Finally, we propose a cross attention-based cross-fusion strategy to integrate the features from the two branches and reconstruct the final HR-HSI. The major contribution of SCPNet is that the structure and color information is described and preserved via the joint attention mechanism. Experimental results indicate that the proposed SCPNet has presented advantages on three benchmark datasets when compared with some state-of-the-art HSR methods.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据