4.7 Article

Multimodal Hyperspectral Unmixing: Insights From Attention Networks

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

Adversarial Autoencoder Network for Hyperspectral Unmixing

Qiwen Jin et al.

Summary: This article proposes an unsupervised unmixing technique based on the adversarial autoencoder network (AAENet) for hyperspectral image analysis. By partitioning the image into homogeneous regions and considering the spatial correlation between local pixels, the proposed method improves the performance and robustness of unmixing, and experiments show that it outperforms other state-of-the-art methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Geochemistry & Geophysics

Dual Branch Autoencoder Network for Spectral-Spatial Hyperspectral Unmixing

Ziqiang Hua et al.

Summary: Spatial information can support spectral unmixing, and a dual branch autoencoder network is proposed to incorporate spatial-contextual information for spectral-spatial unmixing. The network efficiently extracts spatial and spectral information, merges the features to generate abundance and reconstruct pixels, and introduces a new function to improve convergence quality. Experimental results demonstrate the effectiveness of the proposed method on synthetic and real-world data.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

CyCU-Net: Cycle-Consistency Unmixing Network by Learning Cascaded Autoencoders

Lianru Gao et al.

Summary: In recent years, deep learning has gained attention in hyperspectral unmixing applications. However, traditional autoencoder frameworks tend to lose important detailed information. This study proposes a cycle-consistency unmixing network (CyCU-Net) to enhance the unmixing performance by learning two cascaded autoencoders and introducing a self-perception loss to achieve cycle consistency. Experimental results demonstrate that CyCU-Net outperforms other algorithms in terms of effectiveness and competitiveness.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

Endmember-Guided Unmixing Network (EGU-Net): A General Deep Learning Framework for Self-Supervised Hyperspectral Unmixing

Danfeng Hong et al.

Summary: This paper proposes a deep learning approach called endmember-guided unmixing network (EGU-Net) to improve the efficiency and accuracy of hyperspectral unmixing. By utilizing a two-stream Siamese deep network and adding spectrally meaningful constraints, EGU-Net is able to extract endmembers better and achieve more accurate and interpretable unmixing solutions.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Geochemistry & Geophysics

Sequential ISAR Target Classification Based on Hybrid Transformer

Ruihang Xue et al.

Summary: This article proposes a sequential ISAR target classification network based on hybrid transformer (HT), which extracts long-term global features and short-term local features through a temporal-spatial encoder and a local feature encoder, and fuses them to obtain classification labels using a channel encoder-decoder. In target classification experiments, the proposed HT demonstrates high accuracy and robustness to unknown image scaling, rotation, and combined deformations.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Deep Half-Siamese Networks for Hyperspectral Unmixing

Zhu Han et al.

Summary: In recent years, deep learning has attracted attention in solving hyperspectral unmixing problems, but DL-based methods tend to generate trivial results due to the lack of consideration of physically meaningful endmember information. To overcome this, a novel deep half-siamese network called Deep HSNet is proposed, which effectively utilizes endmember information extracted using different algorithms to guide the unmixing process.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2021)

Article Environmental Sciences

Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism

Yuhao Qing et al.

Summary: A new multi-scale residual convolutional neural network model (MRA-NET) for hyperspectral image classification was proposed, which utilizes an efficient channel attention network to improve deep learning classification accuracy. The evaluation on three public datasets demonstrated higher classification accuracy compared to current networks.

REMOTE SENSING (2021)

Review Automation & Control Systems

A comprehensive review of hyperspectral data fusion with lidar and sar data

Sevcan Kahraman et al.

Summary: With the development of remote sensing techniques, the fusion of hyperspectral-LiDAR and hyperspectral-SAR data has become an important research field. Data fusion methods are promising solutions to obtain high spatial resolution remote-sensing images.

ANNUAL REVIEWS IN CONTROL (2021)

Article Geochemistry & Geophysics

More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification

Danfeng Hong et al.

Summary: This study introduces a general multimodal deep learning (MDL) framework for the classification and identification challenges in geoscience and remote sensing. By investigating a special case of multi-modality learning (MML), the study presents five fusion strategies and demonstrates how to train deep networks and build network architectures effectively. Experimental results on two different multimodal RS data sets confirm the efficiency and advantages of the proposed MDL framework.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Geochemistry & Geophysics

Graph Convolutional Networks for Hyperspectral Image Classification

Danfeng Hong et al.

Summary: This article thoroughly investigates the applications of Convolutional Neural Networks (CNNs) and Graph Convolutional Networks (GCNs) in hyperspectral image classification. By developing a new minibatch GCN (miniGCN) to train and infer large-scale GCNs, as well as exploring fusion strategies for different types of HS features, the study achieves good classification performance.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Environmental Sciences

Unknown SAR Target Identification Method Based on Feature Extraction Network and KLD-RPA Joint Discrimination

Zhiqiang Zeng et al.

Summary: This study presents a novel method for identifying unknown SAR targets using deep learning techniques, which significantly improves the identification accuracy of unknown targets through feature extraction network and statistical methods. Experimental results demonstrate that the proposed method outperforms existing approaches in terms of accuracy in identifying unknown targets.

REMOTE SENSING (2021)

Article Geochemistry & Geophysics

Interpretable Hyperspectral Artificial Intelligence: When nonconvex modeling meets hyperspectral remote sensing

Danfeng Hong et al.

Summary: Hyperspectral imaging, a landmark technique in geoscience and remote sensing, has posed challenges in processing and analyzing the data due to the large manpower and material costs involved. Developing more intelligent and automatic approaches is urgently needed to reduce manual labor burden and improve efficiency. Nonconvex modeling has shown promise in bridging the gap between challenging hyperspectral vision tasks and current advanced data processing models.

IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE (2021)

Article Geochemistry & Geophysics

Convolutional Autoencoder for Spectral Spatial Hyperspectral Unmixing

Burkni Palsson et al.

Summary: In this article, a new spectral spatial linear mixture model and an associated estimation method based on a convolutional neural network autoencoder unmixing (CNNAEU) technique were presented. The CNNAEU method successfully exploits both the spatial and spectral structure of hyperspectral images for endmember and abundance map estimation.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Remote Sensing

Hyperspectral unmixing using deep convolutional autoencoder

Menna M. Elkholy et al.

INTERNATIONAL JOURNAL OF REMOTE SENSING (2020)

Article Geochemistry & Geophysics

Multi-Scale Local Context Embedding for LiDAR Point Cloud Classification

Rong Huang et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2020)

Article Geochemistry & Geophysics

Spectral-Spatial Attention Network for Hyperspectral Image Classification

Hao Sun et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2020)

Article Geochemistry & Geophysics

Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification

Danfeng Hong et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2020)

Article Geochemistry & Geophysics

Classification of Hyperspectral and LiDAR Data Using Coupled CNNs

Renlong Hang et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2020)

Article Geography, Physical

Vehicle detection of multi-source remote sensing data using active fine-tuning network

Xin Wu et al.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2020)

Article Geochemistry & Geophysics

Simultaneously Counting and Extracting Endmembers in a Hyperspectral Image Based on Divergent Subsets

Xuanwen Tao et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2020)

Article Computer Science, Artificial Intelligence

Hierarchical U-Shape Attention Network for Salient Object Detection

Sanping Zhou et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Engineering, Electrical & Electronic

Hyperspectral Unmixing Using Deep Convolutional Autoencoders in a Supervised Scenario

Farshid Khajehrayeni et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2020)

Article Geochemistry & Geophysics

EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing

Savas Ozkan et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2019)

Article Geochemistry & Geophysics

uDAS: An Untied Denoising Autoencoder With Sparsity for Spectral Unmixing

Ying Qu et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2019)

Article Geochemistry & Geophysics

A Fast Multiscale Spatial Regularization for Sparse Hyperspectral Unmixing

Ricardo Augusto Borsoi et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2019)

Article Computer Science, Artificial Intelligence

An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing

Danfeng Hong et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2019)

Article Geochemistry & Geophysics

Visual Attention-Driven Hyperspectral Image Classification

Juan Mario Haut et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2019)

Article Geochemistry & Geophysics

MIMA: MAPPER-Induced Manifold Alignment for Semi-Supervised Fusion of Optical Image and Polarimetric SAR Data

Jingliang Hu et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2019)

Proceedings Paper Geosciences, Multidisciplinary

LiDAR DATA-AIDED HYPERGRAPH REGULARIZED MULTI-MODAL UNMIXING

Sevcan Kahraman et al.

2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019) (2019)

Article Geochemistry & Geophysics

Hyperspectral Image Unmixing With LiDAR Data-Aided Spatial Regularization

Tatsumi Uezato et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2018)

Article Geochemistry & Geophysics

Band-Wise Nonlinear Unmixing for Hyperspectral Imagery Using an Extended Multilinear Mixing Model

Bin Yang et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2018)

Article Computer Science, Information Systems

Hyperspectral Unmixing Using a Neural Network Autoencoder

Burkni Palsson et al.

IEEE ACCESS (2018)

Article Geochemistry & Geophysics

Multiharmonic Postnonlinear Mixing Model for Hyperspectral Nonlinear Unmixing

Maofeng Tang et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2018)

Proceedings Paper Computer Science, Artificial Intelligence

PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection

Nian Liu et al.

2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2018)

Article Geochemistry & Geophysics

Spatial Group Sparsity Regularized Nonnegative Matrix Factorization for Hyperspectral Unmixing

Xinyu Wang et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2017)

Article Geochemistry & Geophysics

A Multilinear Mixing Model for Nonlinear Spectral Unmixing

Rob Heylen et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2016)

Article Geochemistry & Geophysics

Learning With Hypergraph for Hyperspectral Image Feature Extraction

Haoliang Yuan et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2015)

Article Engineering, Electrical & Electronic

Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing

Mauro Dalla Mura et al.

PROCEEDINGS OF THE IEEE (2015)

Article Engineering, Electrical & Electronic

A Review of Nonlinear Hyperspectral Unmixing Methods

Rob Heylen et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2014)

Article Engineering, Electrical & Electronic

Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches

Jose M. Bioucas-Dias et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2012)

Article Computer Science, Artificial Intelligence

Supervised Nonlinear Spectral Unmixing Using a Postnonlinear Mixing Model for Hyperspectral Imagery

Yoann Altmann et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2012)

Article Geochemistry & Geophysics

Hyperspectral Unmixing via L1/2 Sparsity-Constrained Nonnegative Matrix Factorization

Yuntao Qian et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2011)

Article Geochemistry & Geophysics

Nonlinear Unmixing of Hyperspectral Images Using a Generalized Bilinear Model

Abderrahim Halimi et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2011)

Article Geochemistry & Geophysics

Hyperspectral subspace identification

Jose M. Bioucas-Dias et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2008)

Article Geochemistry & Geophysics

Endmember extraction from highly mixed data using minimum volume constrained nonnegative matrix factorization

Lidan Miao et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2007)

Article Geochemistry & Geophysics

Vertex component analysis: A fast algorithm to unmix hyperspectral data

JMP Nascimento et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2005)

Article Engineering, Electrical & Electronic

Spectral unmixing

N Keshava et al.

IEEE SIGNAL PROCESSING MAGAZINE (2002)