4.6 Article

Triple-branch ternary-attention mechanism network with deformable 3D convolution for hyperspectral image classification

Journal

INTERNATIONAL JOURNAL OF REMOTE SENSING
Volume 43, Issue 12, Pages 4352-4377

Publisher

TAYLOR & FRANCIS LTD
DOI: 10.1080/01431161.2022.2111666

Keywords

Hyperspectral image classification; convolutional neural network; deformable convolution; attention mechanism; deep learning

Funding

  1. National Natural Science Foundation of China [61962048]
  2. Inner Mongolia Highschool Research Project [NJZZ22502, NJZY21492]

Ask authors/readers for more resources

Recently, the classification of hyperspectral images has been extensively studied. This paper proposes a triple-branch ternary-attention mechanism network with deformable 3D convolution to effectively utilize the spectral and spatial information. Experimental results demonstrate that the proposed method outperforms existing algorithms on different datasets.
In recent years, the classification of hyperspectral images (HSI) has received extensive research attention. As compared with traditional HSI classification, which only uses spectral information, it is found that spatial information is also essential in HSI classification. To effectively utilize the spectral and spatial information of HSI, this paper proposes a triple-branch ternary-attention mechanism network with deformable 3D convolution (D3DTBTA). In D3DTBTA, three branches, i.e. the spectral, spatial-X, and spatial-Y branches, are combined with the attention mechanism in three directions, which can better capture the vector features of three dimensions in HSI. Furthermore, considering the adaptation of scale and receptive field size in the convolution operation, our method uses deformable convolution to enable D3DTBTA to enhance feature extraction. Our experimental results show that the framework outperforms existing algorithms on four hyperspectral datasets, especially when the training samples are limited.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available