期刊
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
卷 15, 期 -, 页码 7539-7555出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSTARS.2022.3202866
关键词
Convolutional neural network (CNN); deep-shallow architecture; hyperspectral (HS) pansharpening; multi-detail extractor (MDR); spectral attention (SA)
类别
资金
- Natural Science Foundation of Sichuan Province [2022NSFSC0501]
- NSFC [12171072]
- Sichuan Science and Technology Project [2021ZYD0021, 2022NSFSC0507]
- National Key Research and Development Program of China [2020YFA0714001]
- Southwest Minzu University Research Startup Funds [RQD2021066]
This paper proposes a new hyperspectral pansharpening network architecture (Hyper-DSNet) to fully preserve latent spatial details and spectral fidelity through a deep-shallow fusion structure, multi-detail extractor, and spectral attention.
Hyperspectral (HS) pansharpening aims at fusing a low-resolution HS image with a high-resolution panchromatic (PAN) image to obtain a HS image with both higher spectral and spatial resolutions. However, existing HS pansharpening algorithms are mainly based on multispectral pansharpening approaches, which cannot perfectly restore much spectral information in the continuous spectral bands and much broader spectral range, leading to spectral distortion and spatial blur. In this paper, we develop a new hyperspectral pansharpening network architecture (called Hyper-DSNet) to fully preserve latent spatial details and spectral fidelity via a deep-shallow fusion structure with multi-detail extractor and spectral attention. First, to solve the problem of spatial ambiguity, five types of high-pass filter templates are used to fully extract the spatial details of the PAN image, constructing a so-called multi-detail extractor. Then, a multi-scale convolution module and a deep-shallow fusion structure, which reduces parameters by decreasing the number of output channels as the network goes deeper, is utilized sequentially. In final, a spectral attention module is conducted to preserve the spectrum for a wealth of spectral information of HS images. Visual and quantitative experiments on three commonly used simulated datasets and one full-resolution dataset demonstrate the effectiveness and robustness of the proposed Hyper-DSNet against the recent state-of-the-art hyperspectral pansharpening techniques. Ablation studies and discussions further verify our contributions, e.g., better spectral preservation and spatial detail recovery.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据