☆ 4.8 Article

MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Related references

Note: Only part of the references are listed.

Article Computer Science, Artificial Intelligence

U2Fusion: A Unified Unsupervised Image Fusion Network

Han Xu et al.

Summary: This study proposes a novel unified and unsupervised end-to-end image fusion network, U2Fusion, which can solve different fusion problems. By training the model with adaptive information preservation, the network avoids the requirements of previous image fusion methods and has broad applicability. Moreover, a new dataset RoadScene is released for evaluation and comparison.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Add to Collection

Article Computer Science, Artificial Intelligence

Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network

Linfeng Tang et al.

Summary: This paper proposes a semantic-aware real-time image fusion network (SeAFusion), which effectively boosts the performance of high-level vision tasks on fused images and outperforms existing alternatives in terms of maintaining pixel intensity distribution and preserving texture detail.

INFORMATION FUSION (2022)

Add to Collection

Article Computer Science, Artificial Intelligence

PIAFusion: A progressive infrared and visible image fusion network based on illumination aware

Linfeng Tang et al.

Summary: This paper proposes a progressive image fusion network based on illumination-aware, termed as PIAFusion, which adaptively maintains the intensity distribution of salient targets and preserves texture information in the background. The method achieves superior results in target maintenance and texture preservation compared to existing alternatives.

INFORMATION FUSION (2022)

Add to Collection

Proceedings Paper Computer Science, Artificial Intelligence

RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion

Han Xu et al.

Summary: This paper proposes a novel method for multi-modal image registration and fusion. For the first time, the feedback of image fusion is used to improve the registration accuracy, and the fine-registered results also enhance the fusion performance. The method solves the bottleneck of defining registration metrics for multi-modal images and facilitating network convergence, and focuses on texture preservation for image fusion.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Add to Collection

Article Computer Science, Interdisciplinary Applications

A Novel Method of Multimodal Medical Image Fusion Based on Hybrid Approach of NSCT and DTCWT

Nawar Alseelawi et al.

Summary: The approach of multimodal medical image fusion is a significant and beneficial tool for illness study. This study proposed an effective strategy based on NSCT and DTCWT, using a convolutional network to generate a weight map and performing multiscale fusion with medical image pyramids, resulting in the highest-quality fused images.

INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING (2022)

Add to Collection

Article Computer Science, Artificial Intelligence

Image Matching from Handcrafted to Deep Features: A Survey

Jiayi Ma et al.

Summary: Image matching is a fundamental task in various visual applications, and with the development of deep learning techniques, there has been an increasing number of methods proposed in this field. However, the challenge remains in choosing the suitable method for specific applications and designing image matching methods with superior performance. This comprehensive review and analysis provide insights into classical and latest techniques, and offer prospects for future development in image matching technologies.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2021)

Add to Collection

Article Computer Science, Artificial Intelligence

EMFusion: An unsupervised enhanced medical image fusion network

Han Xu et al.

Summary: This paper proposes an unsupervised enhanced medical image fusion network that preserves information through surface-level and deep-level constraints, while also enhancing the chrominance information of fusion results.

INFORMATION FUSION (2021)

Add to Collection

Article Computer Science, Artificial Intelligence

Image fusion meets deep learning: A survey and perspective

Hao Zhang et al.

Summary: Image fusion aims to extract and combine meaningful information from different source images to generate a single informative image. The development of deep learning, with techniques like generative adversarial networks and autoencoders, has significantly advanced image fusion. However, a comprehensive review of the latest deep-learning methods in different fusion scenarios is lacking, which is addressed in this survey.

INFORMATION FUSION (2021)

Add to Collection

Article Computer Science, Artificial Intelligence

RXDNFuse: A aggregated residual dense network for infrared and visible image fusion

Yongzhi Long et al.

Summary: This study introduces a novel unsupervised network called RXDNFuse for infrared/visible light fusion task, utilizing a combination of ResNeXt and DenseNet structures. The method automatically estimates information preservation levels and incorporates loss function strategies for network parameter training, improving quality of detailed information. The results demonstrate effective preservation of textural details and thermal radiation information, aligning well with human visual perception system.

INFORMATION FUSION (2021)

Add to Collection

Article Computer Science, Artificial Intelligence

An infrared and visible image fusion method based on multi-scale transformation and norm optimization

Guofa Li et al.

Summary: This paper proposes a new infrared and visible image fusion method based on multi-scale transformation and norm optimization, which uses a new loss function and the split Bregman method for image fusion. Experimental results show that the method outperforms others in highlighting targets and retaining effective detail information.

INFORMATION FUSION (2021)

Add to Collection

Review Computer Science, Artificial Intelligence

A review of multimodal image matching: Methods and applications

Xingyu Jiang et al.

Summary: This paper introduces the fundamental problem of multimodal image matching and analyzes existing research methods and applications. It then provides a detailed summary and comparison of multimodal image matching methods in different research fields, and outlines future trends in related areas.

INFORMATION FUSION (2021)

Add to Collection

Article Computer Science, Artificial Intelligence

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

Hui Li et al.

Summary: In the field of image fusion, designing deep learning-based fusion methods is challenging due to the need to choose an appropriate fusion strategy for specific tasks. The study introduces a novel end-to-end fusion network architecture and utilizes a residual architecture to replace traditional fusion methods, with proposed loss functions for training and a two-stage training strategy, achieving superior performance to existing methods.

INFORMATION FUSION (2021)

Add to Collection

Article Environmental Sciences

A Quantitative Validation of Multi-Modal Image Fusion and Segmentation for Object Detection and Tracking

Nicholas LaHaye et al.

Summary: This paper demonstrates the efficacy of using Deep Belief Networks and clustering to identify distinct classes of objects within remotely sensed data, and quantitatively validates the methodology against current datasets in the remote sensing community. The experiments show strong segmentation capabilities across different levels of granularity and global coverage, potentially serving as the basis for dynamic object tracking across datasets from various remote sensing instruments.

REMOTE SENSING (2021)

Add to Collection

Article Engineering, Electrical & Electronic

DRF: Disentangled Representation for Visible and Infrared Image Fusion

Han Xu et al.

Summary: In this article, a novel decomposition method for visible and infrared image fusion (DRF) is proposed, which disentangles images into scene- and sensor modality-related representations and applies different fusion strategies, leading to comparable performance in terms of visual effect and quantitative metrics compared to the state of the art.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2021)

Add to Collection

Article Engineering, Electrical & Electronic

Hyperspectral-Multispectral Image Fusion via Tensor Ring and Subspace Decompositions

Honghui Xu et al.

Summary: In this work, a new model LRTRTNN is proposed for fusion of high-spatial hyperspectral image and multispectral image, efficiently utilizing the global low-rank property and nonlocal similarity. Experimental results show that the proposed method outperforms most state-of-the-art algorithms in terms of fusion performance.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2021)

Add to Collection

Article Engineering, Electrical & Electronic

Multi-Modal Sensor Fusion-Based Deep Neural Network for End-to-End Autonomous Driving With Scene Understanding

Zhiyu Huang et al.

Summary: The deep learning model proposed in the study demonstrates better performance and generalization capability in autonomous driving, achieving higher success rates in various tasks.

IEEE SENSORS JOURNAL (2021)

Add to Collection

Article Engineering, Electrical & Electronic

GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion

Jiayi Ma et al.

Summary: Combining visible and infrared images into a single image requires balancing contrast and texture details, the proposed GANMcC framework achieves more reasonable fusion by introducing multiclassification constraints and specific content loss to constrain the generator for better information extraction from source images. Extensive experiments demonstrate the advantages of GANMcC over state-of-the-art methods in terms of qualitative effect and quantitative metric, even for overexposed visible images.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2021)

Add to Collection

Article Computer Science, Artificial Intelligence

Infrared and visible image fusion via detail preserving adversarial learning

Jiayi Ma et al.

INFORMATION FUSION (2020)

Add to Collection

Article Computer Science, Artificial Intelligence

IFCNN: A general image fusion framework based on convolutional neural network

Yu Zhang et al.

INFORMATION FUSION (2020)

Add to Collection

Review Computer Science, Interdisciplinary Applications

Image fusion using hybrid methods in multimodality medical images

Satya Prakash Yadav et al.

MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING (2020)

Add to Collection

Article Engineering, Electrical & Electronic

NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models

Hui Li et al.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2020)

Add to Collection

Article Computer Science, Artificial Intelligence

MDLatLRR: A Novel Decomposition Method for Infrared and Visible Image Fusion

Hui Li et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Add to Collection

Article Computer Science, Artificial Intelligence

DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion

Jiayi Ma et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Add to Collection

Article Computer Science, Artificial Intelligence

Boosting Structure Consistency for Multispectral and Multimodal Image Registration

Si-Yuan Cao et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Add to Collection

Article Computer Science, Artificial Intelligence

Unsupervised Deep Image Fusion With Structure Tensor Representations

Hyungjoo Jung et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Add to Collection

Article Computer Science, Artificial Intelligence

DenseFuse: A Fusion Approach to Infrared and Visible Images

Hui Li et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2019)

Add to Collection

Article Computer Science, Artificial Intelligence

FusionGAN: A generative adversarial network for infrared and visible image fusion

Jiayi Ma et al.

INFORMATION FUSION (2019)

Add to Collection

Article Computer Science, Artificial Intelligence

Infrared and visible image fusion methods and applications: A survey

Jiayi Ma et al.

INFORMATION FUSION (2019)

Add to Collection

Article Computer Science, Artificial Intelligence

Normalized Total Gradient: A New Measure for Multispectral Image Registration

Shu-Jie Chen et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2018)

Add to Collection

Article Chemistry, Analytical

An Improved Pansharpening Method for Misaligned Panchromatic and Multispectral Data

Hui Li et al.

SENSORS (2018)

Add to Collection

Article Computer Science, Artificial Intelligence

Multi-focus: Focused region finding and multi-scale transform for image fusion

Kangjian He et al.

NEUROCOMPUTING (2018)

Add to Collection

Article Chemistry, Analytical

Fusing Infrared and Visible Images of Different Resolutions via Total Variation Model

Qinglei Du et al.

SENSORS (2018)

Add to Collection

Article Computer Science, Artificial Intelligence

DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation

Seungryong Kim et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2017)

Add to Collection

Article Instruments & Instrumentation

Infrared and visible image fusion based on visual saliency map and weighted least square optimization

Jinlei Ma et al.

INFRARED PHYSICS & TECHNOLOGY (2017)

Add to Collection

Article Computer Science, Information Systems

Multi-focus image fusion using HOSVD and edge intensity

Xiaoqing Luo et al.

JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION (2017)

Add to Collection

Proceedings Paper Computer Science, Artificial Intelligence

Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

Xun Huang et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Add to Collection

Article Computer Science, Artificial Intelligence

Infrared and visible image fusion via gradient transfer and total variation minimization

Jiayi Ma et al.

INFORMATION FUSION (2016)

Add to Collection

Article Computer Science, Artificial Intelligence

Image fusion with saliency map and interest points

Fanjie Meng et al.

NEUROCOMPUTING (2016)

Add to Collection

Article Geochemistry & Geophysics

Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation

Qi Wei et al.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2015)

Add to Collection

Article Computer Science, Artificial Intelligence

A general framework for image fusion based on multi-scale transform and sparse representation

Yu Liu et al.

INFORMATION FUSION (2015)

Add to Collection

Article Engineering, Electrical & Electronic

A Pan-Sharpening Based on the Non-Subsampled Contourlet Transform: Application to Worldview-2 Imagery

Miloud Chikr El-Mezouar et al.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2014)

Add to Collection

Article Computer Science, Artificial Intelligence

A new image fusion performance metric based on visual information fidelity

Yu Han et al.

INFORMATION FUSION (2013)

Add to Collection

Article Computer Science, Artificial Intelligence

Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study

Zheng Liu et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2012)

Add to Collection

Article Computer Science, Artificial Intelligence

WLD: A Robust Local Image Descriptor

Jie Chen et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2010)

Add to Collection

Article Acoustics

A Fast Normalized Cross-Correlation Calculation Method for Motion Estimation

Jianwen Luo et al.

IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL (2010)

Add to Collection

Article Computer Science, Artificial Intelligence

Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain

B. B. Avants et al.

MEDICAL IMAGE ANALYSIS (2008)

Add to Collection

Article Computer Science, Interdisciplinary Applications

Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change

C Studholme et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2006)

Add to Collection

Article Computer Science, Artificial Intelligence

Image quality assessment: From error visibility to structural similarity

Z Wang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2004)

Add to Collection

© Peeref 2019-2024. All rights reserved.