期刊
REMOTE SENSING
卷 10, 期 5, 页码 -出版社
MDPI
DOI: 10.3390/rs10050800
关键词
convolutional neural network; deep learning; hyperspectral; multispectral; fusion; J0101
类别
资金
- National Natural Science Foundation of China [61771391, 61371152, 61511140292]
- South Korean National Research Foundation Joint Funded Cooperation Program [61511140292]
- Fundamental Research Funds for the Central Universities [3102015ZY045]
- China Scholarship Council [201506290120]
- Innovation Foundation of Doctor Dissertation of Northwestern Polytechnical University [CX201621]
Enhancing the spatial resolution of hyperspectral image (HSI) is of significance for applications. Fusing HSI with a high resolution (HR) multispectral image (MSI) is an important technology for HSI enhancement. Inspired by the success of deep learning in image enhancement, in this paper, we propose a HSI-MSI fusion method by designing a deep convolutional neural network (CNN) with two branches which are devoted to features of HSI and MSI. In order to exploit spectral correlation and fuse the MSI, we extract the features from the spectrum of each pixel in low resolution HSI, and its corresponding spatial neighborhood in MSI, with the two CNN branches. The extracted features are then concatenated and fed to fully connected (FC) layers, where the information of HSI and MSI could be fully fused. The output of the FC layers is the spectrum of the expected HR HSI. In the experiment, we evaluate the proposed method on Airborne Visible Infrared Imaging Spectrometer (AVIRIS), and Environmental Mapping and Analysis Program (EnMAP) data. We also apply it to real Hyperion-Sentinel data fusion. The results on the simulated and the real data demonstrate that the proposed method is competitive with other state-of-the-art fusion methods.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据