4.7 Article

Stereo Cross-Attention Network for Unregistered Hyperspectral and Multispectral Image Fusion

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

MCT-Net: Multi-hierarchical cross transformer for hyperspectral and multispectral image fusion

Xianghai Wang et al.

Summary: To improve the reliability and accuracy of optical imaging, this paper proposes a novel multi-hierarchical cross transformer for hyperspectral and multispectral image fusion. The proposed method extracts multi-scale features of HSI and MSI and performs cross-modality information interaction between them using a multi-hierarchical cross transformer. Experimental results show the superior performance of the proposed method on multiple datasets.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Geochemistry & Geophysics

Hyperspectral Pansharpening via Local Intensity Component and Local Injection Gain Estimation

Wenqian Dong et al.

Summary: This letter proposes an improved CS-based HS pansharpening method in which the intensity component and injection gain are estimated locally achieved by the binary partition tree (BPT) image segmentation algorithm. The method is applied to two credible CS-based HS pansharpening algorithms, improving the performance of GSA and Brovey and creating promising perceptual and quantitative results.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

Unsupervised and Unregistered Hyperspectral Image Super-Resolution With Mutual Dirichlet-Net

Ying Qu et al.

Summary: This article introduces an unregistered and unsupervised HSI-SR method that improves the performance of HSI super-resolution tasks by incorporating mutual information and collaborative l(2,1)-norm, without the need for multimodality registration. Experimental results demonstrate the superior performance of this method compared to existing techniques.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Fusion of Hyperspectral and Multispectral Images Accounting for Localized Inter-Image Changes

Xiyou Fu et al.

Summary: This article proposes a novel group sparsity constrained fusion method based on matrix factorization for fusing hyperspectral and multispectral images. By considering localized interimage changes and integrating an advanced denoiser, this method achieves better fusion results.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Proceedings Paper Computer Science, Artificial Intelligence

IMAGE FUSION TRANSFORMER

V. S. Vibashan et al.

Summary: Image fusion is the process of merging images obtained from different sensors to create a single image with enhanced information. State-of-the-art methods use Convolution Neural Networks to encode meaningful features for image fusion, but they often overlook long-range dependencies in the image. Transformer-based models, on the other hand, address this by modeling long-range dependencies through the self-attention mechanism, leading to the proposal of a novel Image Fusion Transformer.

2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Restormer: Efficient Transformer for High-Resolution Image Restoration

Syed Waqas Zamir et al.

Summary: Convolutional neural networks (CNNs) perform well at learning image priors, while Transformers capture long-range pixel interactions. However, the computational complexity of Transformers makes it challenging to apply them to high-resolution image restoration tasks. This work proposes an efficient Transformer model, Restormer, which achieves state-of-the-art results on various image restoration tasks.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Proceedings Paper Imaging Science & Photographic Technology

Dual-Branch Squeeze-Fusion-Excitation Module for Cross-Modality Registration of Cardiac SPECT and CT

Xiongchao Chen et al.

Summary: This study introduces a Dual-Branch Squeeze-Fusion-Excitation (DuSFE) module for the registration of cardiac SPECT and CT-derived mu-maps. By fusing knowledge from multiple modalities, DuSFE can enable feature fusion at different spatial dimensions, resulting in more accurate SPECT images.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI (2022)

Article Geochemistry & Geophysics

Fusformer: A Transformer-Based Fusion Network for Hyperspectral Image Super-Resolution

Jin-Fan Hu et al.

Summary: This paper proposes a Fusformer method based on the Transformer architecture to solve the hyperspectral image super-resolution problem. By utilizing self-attention mechanism, this method can globally explore the intrinsic relationship within features, achieving better performance than current state-of-the-art methods.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

NonRegSRNet: A Nonrigid Registration Hyperspectral Super-Resolution Network

Ke Zheng et al.

Summary: Due to limitations in imaging systems, satellite hyperspectral imagery often suffer from poor spatial resolution. This paper presents a novel unsupervised spectral unmixing and image deformation correction network, NonRegSRNet, that utilizes multimodal and multitask learning to generate high spatial and high spectral resolution imagery by jointly registering HSI and MSI.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

A Locally Optimized Model for Hyperspectral and Multispectral Images Fusion

Kai Ren et al.

Summary: This article presents a locally optimized image segmentation fusion (LOISF) framework for HS super-resolution reconstruction, which preserves spatial details and texture while improving image quality in LR HS and HR MS images through the construction of a joint fusion model and a convex optimization solution.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Hyperspectral Anomaly Detection via Deep Plug-and-Play Denoising CNN Regularization

Xiyou Fu et al.

Summary: The article introduces a novel anomaly detection algorithm that uses a plug-and-play prior for representation coefficients and constructs a new dictionary based on clustering. This approach improves anomaly detection by enhancing the ability to separate background and anomalous pixels compared to traditional methods.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Geochemistry & Geophysics

Spatial Revising Variational Autoencoder-Based Feature Extraction Method for Hyperspectral Images

Wenbo Yu et al.

Summary: The article proposes a novel unsupervised hyperspectral feature extraction architecture based on spatial revising variational autoencoder, which extracts spatial features from multiple aspects and revises the acquired spectral features. Experimental results demonstrate that this method outperforms comparison methods and is expected to play a significant role in hyperspectral image processing.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Environmental Sciences

Multimodal Remote Sensing Image Registration Methods and Advancements: A Survey

Xinyue Zhang et al.

Summary: This paper introduces the research status and development trend of multi-modal remote sensing image registration methods, including three theoretical frameworks: area-based, feature-based, and deep learning-based methods. It explores traditional methods and more advanced methods proposed in recent years, aiming to provide researchers in related fields with a deeper understanding for further breakthroughs and innovations.

REMOTE SENSING (2021)

Article Environmental Sciences

An Efficient and Robust Framework for Hyperspectral Anomaly Detection

Linbo Tang et al.

Summary: This study proposes an efficient and robust method for anomaly detection in hyperspectral images, using principal component analysis, improved guided filter, and diagonal matrix operation to improve detection accuracy and speed.

REMOTE SENSING (2021)

Article Engineering, Electrical & Electronic

Coupled Tensor Decomposition for Hyperspectral and Multispectral Image Fusion With Inter-Image Variability

Ricardo A. Borsoi et al.

Summary: The study explores image fusion while considering spatial and spectrally localized changes, proposing two new algorithms with theoretical guarantees for exact recovery of high-resolution images. Experimental results demonstrate that the proposed method outperforms existing methods in the presence of spectral and spatial variations, with lower computational cost.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2021)

Article Computer Science, Artificial Intelligence

Recent advances and new guidelines on hyperspectral and multispectral image fusion

Renwei Dian et al.

Summary: This paper provides a comprehensive review and categorization of hyperspectral image (HSI) and multispectral image (MSI) fusion methods, including pan-sharpening, matrix factorization, tensor representation, and deep convolution neural network. The characteristics, discussions, and comparisons of various fusion methods are introduced, along with the existing challenges and potential future directions for HSI-MSI fusion.

INFORMATION FUSION (2021)

Article Engineering, Electrical & Electronic

Bayesian sparse hierarchical model for image denoising

Jun Xiao et al.

Summary: Sparse models have been successful in image denoising and have advantages over deep-learning-based methods, such as not requiring a large amount of training data and having better generalization capability.

SIGNAL PROCESSING-IMAGE COMMUNICATION (2021)

Article Geochemistry & Geophysics

SSR-NET: SpatialSpectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion

Xueting Zhang et al.

Summary: The article proposes an interpretable spatial-spectral reconstruction network (SSR-NET) based on CNN for efficient fusion of HSI and MSI. The SSR-NET consists of three components for cross-mode message inserting, spatial reconstruction, and spectral reconstruction, achieving superior or competitive results in comparison with seven state-of-the-art methods on six HSI data sets.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Engineering, Electrical & Electronic

Hyperspectral Satellites, Evolution, and Development History

Shen-En Qian

Summary: This article provides an overview of spaceborne hyperspectral imagers, their technology evolution, development history, as well as the current deployment and upcoming launches of hyperspectral imagers. By summarizing the past and future of hyperspectral technology, it highlights the significant progress in earth observation and space exploration enabled by hyperspectral imaging.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2021)

Article Engineering, Electrical & Electronic

Visual Attention and Background Subtraction With Adaptive Weight for Hyperspectral Anomaly Detection

Pei Xiang et al.

Summary: The paper introduces a strategy for hyperspectral anomaly detection using visual attention model and adaptive weight for background subtraction, which shows promising results in improving detection performance.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2021)

Article Geochemistry & Geophysics

Hyperspectral and Multispectral Image Fusion via Nonlocal Low-Rank Tensor Approximation and Sparse Representation

Xuelong Li et al.

Summary: The article introduces a novel fusion method for HS and MS images based on nonlocal low-rank tensor approximation and sparse representation, which aims to generate high-resolution HRHS images. The proposed method is shown to outperform several state-of-the-art competitors in experiments on synthetic and real data sets.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Computer Science, Artificial Intelligence

Remote sensing image fusion based on two-stream fusion network

Xiangyu Liu et al.

INFORMATION FUSION (2020)

Article Geochemistry & Geophysics

An Integrated Approach to Registration and Fusion of Hyperspectral and Multispectral Images

Yuan Zhou et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2020)

Article Computer Science, Artificial Intelligence

Simultaneous hyperspectral image super-resolution and geometric alignment with a hybrid camera system

Ying Fu et al.

NEUROCOMPUTING (2020)

Article Computer Science, Artificial Intelligence

Squeeze-and-Excitation Networks

Jie Hu et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2020)

Proceedings Paper Computer Science, Software Engineering

UNSUPERVISED DEEP HYPERSPECTRAL SUPER-RESOLUTION WITH UNREGISTERED IMAGES

Jiangtao Nie et al.

2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) (2020)

Article Computer Science, Artificial Intelligence

FusionNet: An Unsupervised Convolutional Variational Network for Hyperspectral and Multispectral Image Fusion

Zhengjue Wang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Engineering, Electrical & Electronic

A Stereo Attention Module for Stereo Image Super-Resolution

Xinyi Ying et al.

IEEE SIGNAL PROCESSING LETTERS (2020)

Article Environmental Sciences

Local hyperspectral anomaly detection method based on low-rank and sparse matrix decomposition

Hongwei Chang et al.

JOURNAL OF APPLIED REMOTE SENSING (2019)

Article Engineering, Electrical & Electronic

HyperPNN: Hyperspectral Pansharpening via Spectrally Predictive Convolutional Neural Networks

Lin He et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Deep Blind Hyperspectral Image Fusion

Wu Wang et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Learning Parallax Attention for Stereo Image Super-Resolution

Longguang Wang et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Proceedings Paper Engineering, Electrical & Electronic

HYPERSPECTRAL AND MULTISPECTRAL IMAGE FUSION BASED ON DEEP ATTENTION NETWORK

Qing Yang et al.

2019 10TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING - EVOLUTION IN REMOTE SENSING (WHISPERS) (2019)

Proceedings Paper Geosciences, Multidisciplinary

IMPROVED MULTIRESOLUTION ANALYSIS METHOD FOR HYPERSPECTRAL PANSHARPENING

Xiuxiu Hu et al.

2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019) (2019)

Article Engineering, Electrical & Electronic

Remote Sensing Image Fusion With Deep Convolutional Neural Network

Zhenfeng Shao et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2018)

Article Engineering, Electrical & Electronic

A bayesian framework for image recognition based on hidden markov eigen-image models

Kei Sawada et al.

IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING (2018)

Article Engineering, Electrical & Electronic

Bayesian dictionary learning for hyperspectral image super resolution in mixed Poisson-Gaussian noise

Changzhong Zou et al.

SIGNAL PROCESSING-IMAGE COMMUNICATION (2018)

Article Geochemistry & Geophysics

Volumetric Directional Pattern for Spatial Feature Extraction in Hyperspectral Imagery

Almabrok Essa et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2017)

Article Geochemistry & Geophysics

Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network

Frosti Palsson et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2017)

Article Engineering, Electrical & Electronic

Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm

Shengwei Zhong et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2017)

Article Computer Science, Artificial Intelligence

Pixel-level image fusion: A survey of the state of the art

Shutao Li et al.

INFORMATION FUSION (2017)

Article Computer Science, Theory & Methods

Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications

Giorgio Licciardi et al.

MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING (2016)

Article Engineering, Electrical & Electronic

Dual-band stereo vision based on heterogeneous sensor networks

Ying Tong et al.

SIGNAL PROCESSING (2016)

Article Environmental Sciences

Pansharpening by Convolutional Neural Networks

Giuseppe Masi et al.

REMOTE SENSING (2016)

Article Geochemistry & Geophysics

Novel Adaptive Component-Substitution-Based Pan-Sharpening Using Particle Swarm Optimization

Wenqing Wang et al.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2015)

Article Computer Science, Artificial Intelligence

Depth map super-resolution using stereo-vision-assisted model

Yuxiang Yang et al.

NEUROCOMPUTING (2015)

Review Geochemistry & Geophysics

Hyperspectral Pansharpening: A Review

Laetitia Loncan et al.

IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE (2015)

Article Engineering, Electrical & Electronic

Denoising of Hyperspectral Images Employing Two-Phase Matrix Decomposition

Qian Li et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2014)

Article Remote Sensing

A multilevel decision fusion approach for urban mapping using very high-resolution multi/hyperspectral imagery

Xin Huang et al.

INTERNATIONAL JOURNAL OF REMOTE SENSING (2012)

Article Geochemistry & Geophysics

A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement

Jaewan Choi et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2011)

Proceedings Paper Engineering, Electrical & Electronic

COUPLED NON-NEGATIVE MATRIX FACTORIZATION (CNMF) FOR HYPERSPECTRAL AND MULTISPECTRAL DATA FUSION: APPLICATION TO PASTURE CLASSIFICATION

Naoto Yokoya et al.

2011 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS) (2011)