4.7 Article

F-DARTS: Foveated Differentiable Architecture Search Based Multimodal Medical Image Fusion

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

An architecture entropy regularizer for differentiable neural architecture search

Kun Jing et al.

Summary: This study proposes an architecture entropy regularizer to address the dilemma in differentiable architecture search (DARTS), which significantly improves the performance of different differentiable NAS algorithms on various datasets and search spaces.

NEURAL NETWORKS (2023)

Article Computer Science, Hardware & Architecture

A novel small-scale pedestrian detection method base on residual block group of CenterNet

Mingyang Wang et al.

Summary: This paper presents a pedestrian detection method using three ResNet blocks based on the CenterNet detection model. By integrating three different basic blocks and introducing the relu6 activation function, the proposed method exhibits excellent accuracy and detection speed, especially for small-scale pedestrian detection.

COMPUTER STANDARDS & INTERFACES (2023)

Article Biochemical Research Methods

Multimodal medical image fusion using adaptive co-occurrence filter-based decomposition optimization model

Rui Zhu et al.

Summary: In this article, a novel medical image fusion method is proposed, utilizing skewness of pixel intensity and an adaptive co-occurrence filter for image decomposition optimization. Experimental results show that this method outperforms 22 state-of-the-art methods in terms of quality and computational efficiency.

BIOINFORMATICS (2022)

Article Geochemistry & Geophysics

Self-Trained Target Detection of Radar and Sonar Images Using Automatic Deep Learning

Peng Zhang et al.

Summary: A self-trained target detection method was established by utilizing a Derived Classification Dataset and a Differentiable Architecture Search algorithm to automatically design and self-train optimal CNN models. The self-trained AutoDL detectors, implemented with the automatic backbones, outperformed traditional transfer learning detectors on public SAR ship detection dataset and self-made sonar common target detection dataset, achieving state-of-the-art detection precisions and speeds.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

U2Fusion: A Unified Unsupervised Image Fusion Network

Han Xu et al.

Summary: This study proposes a novel unified and unsupervised end-to-end image fusion network, U2Fusion, which can solve different fusion problems. By training the model with adaptive information preservation, the network avoids the requirements of previous image fusion methods and has broad applicability. Moreover, a new dataset RoadScene is released for evaluation and comparison.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Interdisciplinary Applications

Impedance-Optical Dual-Modal Cell Culture Imaging With Learning-Based Information Fusion

Zhe Liu et al.

Summary: This paper presents an impedance-optical dual-modal imaging framework for high-quality 3D cell culture imaging and other tissue engineering applications. The framework includes a dual-modal sensor, a guidance image processing algorithm, and a deep learning model for information fusion. The proposed method significantly improves image quality and has the potential to reveal both structural and functional information of tissue-level targets simultaneously.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2022)

Article Computer Science, Information Systems

Improved differentiable neural architecture search for single image super-resolution

Yu Weng et al.

Summary: Research on the application of DARTS in SISR suggests the need for improvements to enhance performance, involving removing redundant operations and redesigning operations in cells; the improved method shows effectiveness on super-resolution networks.

PEER-TO-PEER NETWORKING AND APPLICATIONS (2021)

Article Engineering, Biomedical

A multiscale residual pyramid attention network for medical image fusion

Jun Fu et al.

Summary: In this study, a multiscale residual pyramid attention network (MSRPAN) for medical image fusion is proposed, which achieves better fusion results through feature extraction, reconstruction, and a feature fusion strategy. Compared to existing algorithms, the proposed MSRPAN network demonstrates superior performance in terms of both visual quality and objective metrics.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2021)

Article Engineering, Electrical & Electronic

Recent Advances in Sparse Representation Based Medical Image Fusion

Yu Liu et al.

Summary: Medical image fusion plays a crucial role in precise diagnosis and treatment by combining multi-source information using sparse representation techniques. Recent advances have covered conventional local and single-component SR methods to the latest global and multi-component SR methods, but there are still challenges remaining in this direction.

IEEE INSTRUMENTATION & MEASUREMENT MAGAZINE (2021)

Article Computer Science, Artificial Intelligence

Partially-Connected Neural Architecture Search for Reduced Computational Redundancy

Yuhui Xu et al.

Summary: The proposed approach, Partially-Connected DARTS (PC-DARTS), reduces channel and spatial redundancies in the super-network to achieve efficient and stable neural architecture search. By sampling a small subset of channels at the channel level and introducing side operations, as well as downsampling input features at the spatial level, PC-DARTS achieves higher search speed and training stability compared to DARTS. The experimental results show significant improvements in terms of search efficiency and performance on CIFAR-10 and ImageNet datasets.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Article Computer Science, Artificial Intelligence

Image fusion based on generative adversarial network consistent with perception

Yu Fu et al.

Summary: This paper proposes a new fusion method based on dense blocks and GAN to improve the performance of deep learning networks, using structural similarity and gradient loss functions for training. Experimental results show that the fused images obtained through this method perform well in terms of evaluation indicators and have better visual effects.

INFORMATION FUSION (2021)

Article Computer Science, Artificial Intelligence

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

Hui Li et al.

Summary: In the field of image fusion, designing deep learning-based fusion methods is challenging due to the need to choose an appropriate fusion strategy for specific tasks. The study introduces a novel end-to-end fusion network architecture and utilizes a residual architecture to replace traditional fusion methods, with proposed loss functions for training and a two-stage training strategy, achieving superior performance to existing methods.

INFORMATION FUSION (2021)

Article Computer Science, Information Systems

Multimodal medical image fusion based on joint bilateral filter and local gradient energy

Xiaosong Li et al.

Summary: Multimodal medical image fusion is an important technique for biomedical diagnosis, and a novel method with two-layer decomposition and local gradient energy operator is proposed in this paper to achieve better fusion performance and computational efficiency. Extensive experiments demonstrate the method's superiority over state-of-the-art methods in both visual quality and quantitative evaluation.

INFORMATION SCIENCES (2021)

Proceedings Paper Engineering, Biomedical

Mutual Information for Unsupervised Deep Learning Image Registration

Bob D. de Vos et al.

Summary: This study investigates the use of mutual information as a loss for unsupervised deep learning image registration, showing comparable performance with conventional image registration in certain cases.

MEDICAL IMAGING 2020: IMAGE PROCESSING (2021)

Article Computer Science, Artificial Intelligence

Visible-NIR Image Fusion Based on Top-Hat Transform

Maria Herrera-Arellano et al.

Summary: This study proposes a method of selective Visible-NIR fusion using top-hat transform, with experimental results showing a high degree of detail preservation in edges while maintaining the color of the image. The method also demonstrates that improvements in image quality were not significantly affected by a change in the color space.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2021)

Article Computer Science, Artificial Intelligence

A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion

Risheng Liu et al.

Summary: This paper proposes a generic image fusion method with a bilevel optimization paradigm to tackle multi-modality image fusion tasks, achieving flexible fusion strategies through adaptive integration weight maps. The method has been successfully applied to various image fusion tasks, demonstrating outstanding performance and versatility in both quantitative and qualitative aspects.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2021)

Article Computer Science, Artificial Intelligence

Remote sensing image fusion based on two-stream fusion network

Xiangyu Liu et al.

INFORMATION FUSION (2020)

Article Computer Science, Artificial Intelligence

Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization

Ramprasaath R. Selvaraju et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2020)

Article Computer Science, Interdisciplinary Applications

Co-Learning Feature Fusion Maps From PET-CT Images of Lung Cancer

Ashnil Kumar et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2020)

Article Computer Science, Artificial Intelligence

IFCNN: A general image fusion framework based on convolutional neural network

Yu Zhang et al.

INFORMATION FUSION (2020)

Article Computer Science, Artificial Intelligence

Squeeze-and-Excitation Networks

Jie Hu et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2020)

Article Radiology, Nuclear Medicine & Medical Imaging

Tips to start an MR-US fusion biopsy program

Alison Sheridan et al.

ABDOMINAL RADIOLOGY (2020)

Article Engineering, Electrical & Electronic

NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models

Hui Li et al.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2020)

Article Computer Science, Interdisciplinary Applications

An adaptive two-scale biomedical image fusion method with statistical comparisons

Jiao Du et al.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2020)

Article Engineering, Electrical & Electronic

Multi-focus image fusion method based on two stage of convolutional neural network

Di Gai et al.

SIGNAL PROCESSING (2020)

Article Engineering, Electrical & Electronic

VIF-Net: An Unsupervised Framework for Infrared and Visible Image Fusion

Ruichao Hou et al.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2020)

Article Computer Science, Artificial Intelligence

DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion

Jinxing Li et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Deep Guided Learning for Fast Multi-Exposure Image Fusion

Kede Ma et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Engineering, Electrical & Electronic

Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Ming Yin et al.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2019)

Article Computer Science, Artificial Intelligence

Multi-scale convolutional neural network for multi-focus image fusion

Hafiz Tayyab Mustafa et al.

IMAGE AND VISION COMPUTING (2019)

Article Computer Science, Artificial Intelligence

DenseFuse: A Fusion Approach to Infrared and Visible Images

Hui Li et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2019)

Article Engineering, Electrical & Electronic

MCFNet: Multi-Layer Concatenation Fusion Network for Medical Images Fusion

Xuecan Liang et al.

IEEE SENSORS JOURNAL (2019)

Article Computer Science, Artificial Intelligence

FusionGAN: A generative adversarial network for infrared and visible image fusion

Jiayi Ma et al.

INFORMATION FUSION (2019)

Article Instruments & Instrumentation

Infrared and visible image fusion with ResNet and zero-phase component analysis

Hui Li et al.

INFRARED PHYSICS & TECHNOLOGY (2019)

Article Computer Science, Information Systems

FusionCNN: a remote sensing image fusion algorithm based on deep convolutional neural networks

Fajie Ye et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2019)

Article Computer Science, Artificial Intelligence

Deep learning for pixel-level image fusion: Recent advances and future prospects

Yu Liu et al.

INFORMATION FUSION (2018)

Article Engineering, Electrical & Electronic

Medical image fusion using PCNN and Poisson-hidden Markov model

Biswajit Biswas et al.

INTERNATIONAL JOURNAL OF SIGNAL AND IMAGING SYSTEMS ENGINEERING (2018)

Article Computer Science, Interdisciplinary Applications

Real-time Triple-modal Photoacoustic, Ultrasound, and Magnetic Resonance Fusion Imaging of Humans

Sara Park et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2017)

Article Computer Science, Artificial Intelligence

Pixel-level image fusion: A survey of the state of the art

Shutao Li et al.

INFORMATION FUSION (2017)

Article Computer Science, Artificial Intelligence

Multi-focus image fusion with a deep convolutional neural network

Yu Liu et al.

INFORMATION FUSION (2017)

Article Engineering, Electrical & Electronic

Image Fusion With Convolutional Sparse Representation

Yu Liu et al.

IEEE SIGNAL PROCESSING LETTERS (2016)

Article Computer Science, Artificial Intelligence

Joint patch clustering-based dictionary learning for multimodal image fusion

Minjae Kim et al.

INFORMATION FUSION (2016)

Article Computer Science, Artificial Intelligence

Foveated Nonlocal Self-Similarity

Alessandro Foi et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2016)

Article Engineering, Electrical & Electronic

A new image quality metric for image fusion: The sum of the correlations of differences

V. Aslantas et al.

AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS (2015)

Article Computer Science, Artificial Intelligence

A general framework for image fusion based on multi-scale transform and sparse representation

Yu Liu et al.

INFORMATION FUSION (2015)

Article Computer Science, Artificial Intelligence

A new image fusion performance metric based on visual information fidelity

Yu Han et al.

INFORMATION FUSION (2013)

Article Computer Science, Artificial Intelligence

MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration

Mattias P. Heinrich et al.

MEDICAL IMAGE ANALYSIS (2012)

Proceedings Paper Computer Science, Artificial Intelligence

Foveated self-similarity in nonlocal image filtering

Alessandro Foi et al.

HUMAN VISION AND ELECTRONIC IMAGING XVII (2012)

Article Computer Science, Artificial Intelligence

Biological image fusion using a NSCT based variable-weight method

Tianjie Li et al.

INFORMATION FUSION (2011)

Article Computer Science, Artificial Intelligence

A new automated quality assessment algorithm for image fusion

Yin Chen et al.

IMAGE AND VISION COMPUTING (2009)

Article Computer Science, Artificial Intelligence

A novel similarity based quality metric for image fusion

Cui Yang et al.

INFORMATION FUSION (2008)

Article Computer Science, Artificial Intelligence

A new metric based on extended spatial frequency and its application to DWT based fusion algorithms

Yufeng Zheng et al.

INFORMATION FUSION (2007)

Article Computer Science, Artificial Intelligence

Image information and visual quality

HR Sheikh et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2006)

Article Computer Science, Artificial Intelligence

Image quality assessment: From error visibility to structural similarity

Z Wang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2004)

Article Computer Science, Artificial Intelligence

A wavelet-based image fusion tutorial

G Pajares et al.

PATTERN RECOGNITION (2004)

Article Engineering, Electrical & Electronic

Objective image fusion performance measure

CS Xydeas et al.

ELECTRONICS LETTERS (2000)