4.7 Article

Spectral-Spatial-Temporal Transformers for Hyperspectral Image Change Detection

Related references

Note: Only part of the references are listed.
Article Geochemistry & Geophysics

A Spectral-Spatial Change Detection Method Based on Simplified 3-D Convolutional Autoencoder for Multitemporal Hyperspectral Images

Chunhui Zhao et al.

Summary: This study proposes a hyperspectral change detection method based on a simplified 3-D convolutional autoencoder, which can extract deep spectral-spatial features, simplify the structure and improve data processing speed, and only require a few labeled samples to train the classifier.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

CatBoost for RS Image Classification With Pseudo Label Support From Neighbor Patches-Based Clustering

Alim Samat et al.

Summary: In this letter, a new approach for remote sensing image classification using CatBoost algorithm was introduced and investigated. Experimental results demonstrated the effectiveness of this method, which outperformed traditional methods. This is of great importance for the application of remote sensing images.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Engineering, Electrical & Electronic

Multilayer Cascade Screening Strategy for Semi-Supervised Change Detection in Hyperspectral Images

Lian Liu et al.

Summary: Change detection is an important application of remote sensing, and hyperspectral imagery provides more spectral information for accurate identification of change features. In this study, a semi-supervised CD method with multilayer cascade screening strategy ((MCSCD)-C-4) is proposed, which utilizes both spatial information and active learning to select reliable unlabeled samples. Additionally, a subspace CD method based on iterative slow feature analysis is introduced to extract the temporally invariant component from high-dimensional spectra.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Generalized Scene Classification From Small-Scale Datasets With Multitask Learning

Xiangtao Zheng et al.

Summary: This article addresses the dilemma of using deep learning networks to classify remote sensing images by proposing a method using multitask learning network (MTLN) to improve the generalization ability and accuracy of classification.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Dimensionality Reduction and Classification of Hyperspectral Image via Multistructure Unified Discriminative Embedding

Fulin Luo et al.

Summary: The research proposes a multistructure unified discriminative embedding (MUDE) method to extract the low-dimensional features of hyperspectral image (HSI), by considering the neighborhood, tangential, and statistical properties of each sample in HSI for achieving the complementarity of different characteristics. Experimental results demonstrate that the proposed method can improve the classification performance of HSI.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Convolutional Neural Networks for Multimodal Remote Sensing Data Classification

Xin Wu et al.

Summary: This paper proposes a new framework for multimodal remote sensing data classification, using deep learning and a cross-channel reconstruction module to learn compact fusion representations of different data sources. Extensive experiments on two multimodal RS datasets demonstrate the effectiveness and superiority of the proposed method.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Spectral-Spatial-Temporal Transformers for Hyperspectral Image Change Detection

Yanheng Wang et al.

Summary: This article presents a joint spectral, spatial, and temporal transformer for hyperspectral image change detection. The proposed method encodes the positions of pixels to remember spectral and spatial sequences and uses transformer encoders to extract features. Experimental results show that the method outperforms other approaches both visually and qualitatively.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Learning Orientation Information From Frequency-Domain for Oriented Object Detection in Remote Sensing Images

Shangdong Zheng et al.

Summary: This article proposes a new frequency-domain orientation learning module for object detection in remote sensing images, achieving state-of-the-art performance by utilizing frequency-domain feature extraction and an orientation enhanced self-attention layer to learn orientation information efficiently.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

Rotation-Invariant Attention Network for Hyperspectral Image Classification

Xiangtao Zheng et al.

Summary: This paper proposes a rotation-invariant attention network (RIAN) for HSI classification, which extracts rotation-invariant spectral-spatial features using center spectral attention and rectified spatial attention modules. Experimental results show that RIAN performs well on HSIs with spatial rotation.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2022)

Article Geochemistry & Geophysics

Interactformer: Interactive Transformer and CNN for Hyperspectral Image Super-Resolution

Yaoting Liu et al.

Summary: This article proposes a method called Interactformer to enhance the spatial resolution of hyperspectral images (HSIs) by interacting with global and local features extracted by Transformer and 3D convolutional neural network (CNN) branches. A separable self-attention module with linear complexity is designed in the Transformer branch to solve the memory cost problem of traditional self-attention mechanisms. In the 3D CNN branch, the spectral attention module and 3D convolution are applied jointly to protect the spectral correlation and facilitate local feature extraction. Experimental results demonstrate that Interactformer can effectively improve the spatial resolution while preserving the spectral information.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Proceedings Paper Computer Science, Artificial Intelligence

MM-ViT: Multi-Modal Video Transformer for Compressed Video Action Recognition

Jiawei Chen et al.

Summary: This paper presents a pure transformer-based approach, MM-ViT, for video action recognition. It operates exclusively in the compressed video domain and exploits all available modalities. Through scalable model variants and cross-modal attention mechanisms, it handles the large number of tokens from multiple modalities and explores the inter-modal interactions.

2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022) (2022)

Article Geochemistry & Geophysics

A Deep Multiscale Pyramid Network Enhanced With Spatial-Spectral Residual Attention for Hyperspectral Image Change Detection

Yufei Yang et al.

Summary: Change detection is important in Earth surface observation. This article proposes a deep multiscale pyramid network enhanced with spatial-spectral residual attention for hyperspectral image change detection, which achieves competitive performance.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

SCViT: A Spatial-Channel Feature Preserving Vision Transformer for Remote Sensing Image Scene Classification

Pengyuan Lv et al.

Summary: In this article, a new ViT model (SCViT) is proposed, which considers the geometric information of high-spatial-resolution imagery and the contribution of different channels. Tokens are generated by progressively aggregating patches, and the global interactions of tokens are modeled using the self-attention mechanism and a lightweight channel attention module. The experimental results confirm the potential of using ViT models in remote sensing image scene classification.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Dual-Branch Difference Amplification Graph Convolutional Network for Hyperspectral Image Change Detection

Jiahui Qu et al.

Summary: In this article, a novel dual-branch difference amplification graph convolutional network (D(2)AGCN) is proposed for hyperspectral image (HSI) change detection with limited samples. The GCN with a graph structure is applied to flexibly capture the characteristics and structure information of non-Euclidean data. The D(2)AGCN outperforms most of the state-of-the-art methods in HSI change detection, as demonstrated by visual and quantitative experimental results on three real hyperspectral datasets.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification

Danfeng Hong et al.

Summary: This study introduces a general multimodal deep learning (MDL) framework for the classification and identification challenges in geoscience and remote sensing. By investigating a special case of multi-modality learning (MML), the study presents five fusion strategies and demonstrates how to train deep networks and build network architectures effectively. Experimental results on two different multimodal RS data sets confirm the efficiency and advantages of the proposed MDL framework.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Geochemistry & Geophysics

Graph Convolutional Networks for Hyperspectral Image Classification

Danfeng Hong et al.

Summary: This article thoroughly investigates the applications of Convolutional Neural Networks (CNNs) and Graph Convolutional Networks (GCNs) in hyperspectral image classification. By developing a new minibatch GCN (miniGCN) to train and infer large-scale GCNs, as well as exploring fusion strategies for different types of HS features, the study achieves good classification performance.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Engineering, Electrical & Electronic

Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

Zebin Wu et al.

Summary: This article surveys the state-of-the-art methods for processing remotely sensed big data and thoroughly investigates existing parallel implementations. The study shows that cloud computing is the most promising solution for efficient and scalable processing of remotely sensed big data, with scheduling strategies being crucial for fully exploiting parallelism.

PROCEEDINGS OF THE IEEE (2021)

Article Automation & Control Systems

Scheduling-Guided Automatic Processing of Massive Hyperspectral Image Classification on Cloud Computing Architectures

Zebin Wu et al.

Summary: This article presents a method for accelerating the classification of large HSI data on the cloud platform, utilizing scheduling metaheuristics to automatically distribute tasks for improved computational efficiency.

IEEE TRANSACTIONS ON CYBERNETICS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

ViT-YOLO:Transformer-Based YOLO for Object Detection

Zixiao Zhang et al.

Summary: The study introduces an improved backbone network, MHSA-Darknet, for object detection, utilizing multi-head self-attention and a weighted bi-directional feature pyramid network for feature fusion. Additional techniques like TTA and WBF are employed to enhance accuracy and robustness, leading to significant performance improvements over state-of-the-art detectors in the VisDrone-DET 2021 challenge.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Self-attention based Text Knowledge Mining for Text Detection

Qi Wan et al.

Summary: This paper proposes a self-attention based text knowledge mining model that provides general prior knowledge by pre-training an encoder and decoder with synthetic data, significantly improving the performance of various text detectors.

2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 (2021)

Article Engineering, Electrical & Electronic

Unsupervised Hyperspectral Image Change Detection via Deep Learning Self-Generated Credible Labels

Qiuxia Li et al.

Summary: The article introduces a strategy that combines two complementary model-driven methods to generate credible labels, aiming to improve the accuracy and efficiency of HSI-CD tasks.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2021)

Article Geochemistry & Geophysics

Dimensionality Reduction With Enhanced Hybrid-Graph Discriminant Learning for Hyperspectral Image Classification

Fulin Luo et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2020)

Article Environmental Sciences

Hyperspectral Nonlinear Unmixing by Using Plug-and-Play Prior for Abundance Maps

Zhicheng Wang et al.

REMOTE SENSING (2020)

Article Geochemistry & Geophysics

GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection

Qi Wang et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2019)

Article Computer Science, Artificial Intelligence

An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing

Danfeng Hong et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2019)

Article Engineering, Electrical & Electronic

Hyperspectral Anomaly Detection via Global and Local Joint Modeling of Background

Zebin Wu et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Environmental Sciences

Change Detection in Hyperspectral Images Using Recurrent 3D Fully Convolutional Networks

Ahram Song et al.

REMOTE SENSING (2018)

Article Geochemistry & Geophysics

Unsupervised Multitemporal Spectral Unmixing for Detecting Multiple Changes in Hyperspectral Images

Sicong Liu et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2016)

Article Geochemistry & Geophysics

Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images

Sicong Liu et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2015)

Article Computer Science, Artificial Intelligence

Rayleigh-Rice Mixture Parameter Estimation via EM Algorithm for Change Detection in Multispectral Images

Massimo Zanetti et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2015)

Review Geography, Physical

Change detection from remotely sensed images: From pixel-based to object-based approaches

Masroor Hussain et al.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2013)

Article Geochemistry & Geophysics

A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images

Francesca Bovolo et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2012)

Article Geochemistry & Geophysics

A novel approach to unsupervised change detection based on a semisupervised SVM and a similarity measure

Francesca Bovolo et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2008)

Article Remote Sensing

PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data

J. S. Deng et al.

INTERNATIONAL JOURNAL OF REMOTE SENSING (2008)

Article Computer Science, Artificial Intelligence

The regularized iteratively reweighted MAD method for change detection in multi- and hyperspectral data

Allan Aasbjerg Nielsen

IEEE TRANSACTIONS ON IMAGE PROCESSING (2007)

Article Geography, Physical

Multiple support vector machines for land cover change detection: An application for mapping urban extensions

Hassiba Nemmour et al.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2006)

Article Engineering, Industrial

The transformer

JW Coltman

IEEE INDUSTRY APPLICATIONS MAGAZINE (2002)

Article Geochemistry & Geophysics

Automatic analysis of the difference image for unsupervised change detection

L Bruzzone et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2000)