4.7 Article

Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

U2Fusion: A Unified Unsupervised Image Fusion Network

Han Xu et al.

Summary: This study proposes a novel unified and unsupervised end-to-end image fusion network, U2Fusion, which can solve different fusion problems. By training the model with adaptive information preservation, the network avoids the requirements of previous image fusion methods and has broad applicability. Moreover, a new dataset RoadScene is released for evaluation and comparison.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Hardware & Architecture

Semantic Guided Infrared and Visible Image Fusion

Wei Wu et al.

Summary: The letter proposed a semantic-guided image fusion method that uses neural networks to fuse different semantic objects with varying weights based on their characteristics. Experimental results showed that this method outperforms state-of-the-art techniques in terms of visual effects and quantitative metrics.

IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES (2021)

Article Computer Science, Artificial Intelligence

Image fusion meets deep learning: A survey and perspective

Hao Zhang et al.

Summary: Image fusion aims to extract and combine meaningful information from different source images to generate a single informative image. The development of deep learning, with techniques like generative adversarial networks and autoencoders, has significantly advanced image fusion. However, a comprehensive review of the latest deep-learning methods in different fusion scenarios is lacking, which is addressed in this survey.

INFORMATION FUSION (2021)

Article Computer Science, Artificial Intelligence

RXDNFuse: A aggregated residual dense network for infrared and visible image fusion

Yongzhi Long et al.

Summary: This study introduces a novel unsupervised network called RXDNFuse for infrared/visible light fusion task, utilizing a combination of ResNeXt and DenseNet structures. The method automatically estimates information preservation levels and incorporates loss function strategies for network parameter training, improving quality of detailed information. The results demonstrate effective preservation of textural details and thermal radiation information, aligning well with human visual perception system.

INFORMATION FUSION (2021)

Article Computer Science, Artificial Intelligence

Bilateral attention decoder: A lightweight decoder for real-time semantic segmentation

Chengli Peng et al.

Summary: A lightweight bilateral attention decoder is proposed for real-time semantic segmentation in this paper, which improves spatial accuracy and efficiency through information refinement and fusion. The proposed method achieves better performance with higher inference speed compared to other state-of-the-art real-time and non-real-time semantic segmentation methods.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

Hui Li et al.

Summary: In the field of image fusion, designing deep learning-based fusion methods is challenging due to the need to choose an appropriate fusion strategy for specific tasks. The study introduces a novel end-to-end fusion network architecture and utilizes a residual architecture to replace traditional fusion methods, with proposed loss functions for training and a two-stage training strategy, achieving superior performance to existing methods.

INFORMATION FUSION (2021)

Article Computer Science, Artificial Intelligence

SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion

Hao Zhang et al.

Summary: This paper introduces a squeeze-and-decomposition network (SDNet) for real-time multi-modal and digital photography image fusion. By transforming fusion problems into extraction and reconstruction of gradient and intensity information, and introducing the squeeze and decomposition concept into image fusion, the method outperforms state-of-the-art techniques in subjective visual effect and quantitative metrics in various fusion tasks, while also being much faster for real-time fusion tasks.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2021)

Article Engineering, Electrical & Electronic

GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators

Hao Zhang et al.

Summary: This novel Generative Adversarial Network with Full-scale skip connection and dual Markovian discriminators (GAN-FM) is proposed to fully preserve effective information in infrared and visible images during fusion, achieving a balance between contrast and texture. By emphasizing details and local regions to improve the quality of fused results, and using a joint gradient loss to prevent background texture pollution caused by high-contrast targets.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2021)

Article Engineering, Electrical & Electronic

STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection

Jiayi Ma et al.

Summary: The proposed STDFusionNet is a fusion network for infrared and visible images that preserves thermal targets and texture structures. By utilizing salient target detection and a specific loss function, it successfully extracts and reconstructs features to achieve high-quality fusion results. Through qualitative and quantitative experiments, the algorithm has shown superiority in terms of speed and quality improvement over existing methods.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2021)

Article Engineering, Electrical & Electronic

Classification Saliency-Based Rule for Visible and Infrared Image Fusion

Han Xu et al.

Summary: This study achieves interpretable importance evaluation of feature maps in a deep learning manner and proposes a pixel-wise classification saliency-based fusion rule, which reduces distortion without human intervention.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2021)

Article Computer Science, Information Systems

AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks

Jing Li et al.

Summary: In this paper, a method named AttentionFGAN is proposed to fuse infrared and visible images by integrating multi-scale attention mechanism into Generative Adversarial Networks (GAN). The generator and discriminator both apply attention mechanism to emphasize the focus on typical regions of source images during fusion. Ablation experiments demonstrate the effectiveness of the method, and extensive qualitative and quantitative experiments on three public datasets show the advantages of AttentionFGAN compared to other state-of-the-art methods.

IEEE TRANSACTIONS ON MULTIMEDIA (2021)

Article Computer Science, Artificial Intelligence

Infrared and visible image fusion via detail preserving adversarial learning

Jiayi Ma et al.

INFORMATION FUSION (2020)

Article Computer Science, Artificial Intelligence

IFCNN: A general image fusion framework based on convolutional neural network

Yu Zhang et al.

INFORMATION FUSION (2020)

Article Computer Science, Information Systems

Infrared and visible image fusion based on target-enhanced multiscale transform decomposition

Jun Chen et al.

INFORMATION SCIENCES (2020)

Article Optics

Infrared and visible image fusion via joint convolutional sparse representation

Minghui Wu et al.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION (2020)

Article Computer Science, Artificial Intelligence

Fast infrared and visible image fusion with structural decomposition

Hui Li et al.

KNOWLEDGE-BASED SYSTEMS (2020)

Article Engineering, Electrical & Electronic

NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models

Hui Li et al.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2020)

Article Computer Science, Artificial Intelligence

MDLatLRR: A Novel Decomposition Method for Infrared and Visible Image Fusion

Hui Li et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Computer Science, Artificial Intelligence

DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion

Jiayi Ma et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Connecting Image Denoising and High-Level Vision Tasks via Deep Learning

Ding Liu et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Pedestrian detection with unsupervised multispectral feature learning using deep neural networks

Yanpeng Cao et al.

INFORMATION FUSION (2019)

Article Computer Science, Artificial Intelligence

DenseFuse: A Fusion Approach to Infrared and Visible Images

Hui Li et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2019)

Article Computer Science, Artificial Intelligence

FusionGAN: A generative adversarial network for infrared and visible image fusion

Jiayi Ma et al.

INFORMATION FUSION (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Single Image Deraining: A Comprehensive Benchmark Analysis

Siyuan Li et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Article Computer Science, Artificial Intelligence

Pixel-level image fusion: A survey of the state of the art

Shutao Li et al.

INFORMATION FUSION (2017)

Article Instruments & Instrumentation

Infrared and visible image fusion based on visual saliency map and weighted least square optimization

Jinlei Ma et al.

INFRARED PHYSICS & TECHNOLOGY (2017)

Article Computer Science, Artificial Intelligence

Structure tensor and nonsubsampled shearlet transform based algorithm for CT and MRI image fusion

Xingbin Liu et al.

NEUROCOMPUTING (2017)

Proceedings Paper Computer Science, Artificial Intelligence

DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs

K. Ram Prabhakar et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

AOD-Net: All-in-One Dehazing Network

Boyi Li et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Article Engineering, Electrical & Electronic

Image Fusion With Convolutional Sparse Representation

Yu Liu et al.

IEEE SIGNAL PROCESSING LETTERS (2016)

Article Computer Science, Artificial Intelligence

Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters

Zhiqiang Zhou et al.

INFORMATION FUSION (2016)

Article Computer Science, Artificial Intelligence

Infrared and visible image fusion via gradient transfer and total variation minimization

Jiayi Ma et al.

INFORMATION FUSION (2016)

Article Instruments & Instrumentation

Infrared and visible images fusion based on RPCA and NSCT

Zhizhong Fu et al.

INFRARED PHYSICS & TECHNOLOGY (2016)

Article Instruments & Instrumentation

An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing

Qiong Zhang et al.

INFRARED PHYSICS & TECHNOLOGY (2016)

Article Computer Science, Artificial Intelligence

A general framework for image fusion based on multi-scale transform and sparse representation

Yu Liu et al.

INFORMATION FUSION (2015)

Article Engineering, Electrical & Electronic

Region level based multi-focus image fusion using quaternion wavelet and normalized cut

Yipeng Liu et al.

SIGNAL PROCESSING (2014)

Article Computer Science, Artificial Intelligence

A new image fusion performance metric based on visual information fidelity

Yu Han et al.

INFORMATION FUSION (2013)

Article Engineering, Electrical & Electronic

Region-based multimodal image fusion using ICA bases

Nedeljko Cvejic et al.

IEEE SENSORS JOURNAL (2007)

Article Engineering, Electrical & Electronic

Information measure for performance of image fusion

GH Qu et al.

ELECTRONICS LETTERS (2002)