Journal
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Volume 60, Issue -, Pages -Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TGRS.2022.3188529
Keywords
Hyperspectral imaging; Feature extraction; Training; Laser radar; Representation learning; Principal component analysis; Data models; Fine-tuning strategy; hyperspectral image classification; multimodal data; unsupervised deep learning
Categories
Funding
- National Key Research and Development Program of China [2021ZD0112200]
- Natural Science Foundation of China [61906096, U21B2049]
Ask authors/readers for more resources
Unsupervised feature learning with multimodal data can address the issue of labeling in hyperspectral image classification, and the dual fine-tuning strategy improves the classification performance.
Deep learning has attracted much attention in the field of hyperspectral image classification recently, due to its powerful representation and generalization abilities. Most of the current deep learning models are trained in a supervised manner, which requires large amounts of labeled samples to achieve the state-of-the-art performance. Unfortunately, pixel-level labeling in hyperspectral imageries is difficult, time-consuming, and human-dependent. To address this issue, we propose an unsupervised feature learning model using multimodal data, hyperspectral, and light detection and ranging (LiDAR) in particular. It takes advantage of the relationship between hyperspectral and LiDAR data to extract features, without using any label information. After that, we design a dual fine-tuning strategy to transfer the extracted features for hyperspectral image classification with small numbers of training samples. Such a strategy is able to explore not only the semantic information but also the intrinsic structure information of training samples. In order to test the performance of our proposed model, we conduct comprehensive experiments on three hyperspectral and LiDAR datasets. Experimental results show that our proposed model can achieve better performance than several state-of-the-art deep learning models.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available