期刊
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
卷 60, 期 -, 页码 -出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TGRS.2022.3155794
关键词
Laser radar; Feature extraction; Hyperspectral imaging; Data mining; Synthetic aperture radar; Data models; Estimation; Attention; autoencoder (AE); deep learning (DL); hyperspectral unmixing (HU); light detection and ranging (LiDAR); multimodality
类别
资金
- National Natural Science Foundation of China [62161160336, 42030111]
- MIAI@Grenoble Alpes [ANR-19-P3IA-0003]
- AXA Research Fund
A novel multimodal unmixing network, called MUNet, is proposed for hyperspectral images, which integrates multiple modalities and utilizes LiDAR-derived attention map to aid the unmixing process, resulting in improved performance.
Deep learning (DL) has aroused wide attention in hyperspectral unmixing (HU) owing to its powerful feature representation ability. As a representative of unsupervised DL approaches, autoencoder (AE) has been proven to be effective to better capture nonlinear components of hyperspectral images than the traditional model-driven linearized methods. However, only using hyperspectral images for unmixing fails to distinguish objects in complex scene, especially for different endmembers with similar materials. To overcome this limitation, we propose a novel multimodal unmixing network for hyperspectral images, called MUNet, by considering the height differences of light detection and ranging (LiDAR) data in a squeeze-and-excitation (SE)-driven attention fashion to guide the unmixing process, yielding performance improvement. MUNet is capable of fusing multimodal information and using the attention map derived by LiDAR to aid network that focuses on more discriminative and meaningful spatial information regarding scenes. Moreover, attribute profile (AP) is adopted to extract the geometrical structures of different objects to better model the spatial information of LiDAR. Experimental results on synthetic and real datasets demonstrate the effectiveness and superiority of the proposed method compared with several state-of-the-art unmixing algorithms. The codes will be available at https://github.com/hanzhu97702/IEEE_TGRS_MUNet, contributing to the remote sensing community.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据