4.7 Article

Dual-level Deep Evidential Fusion: Integrating multimodal information for enhanced reliable decision-making in deep learning

Related references

Note: Only part of the references are listed.
Article Computer Science, Information Systems

Analysis of multimodal data fusion from an information theory perspective

Yinglong Dai et al.

Summary: Inspired by the McGurk effect, this study proposes basic concepts and principles from an information theory perspective to gain insight into the process of multimodal data fusion. It analyzes different multimodal data fusion cases and defines the model accuracy upper bound for multimodal tasks. The study also examines the latent representation space and analyzes the information loss in deep learning. Experimental results validate the proposed definitions and principles.

INFORMATION SCIENCES (2023)

Article Engineering, Aerospace

An Evidential Reasoning Rule Considering Parameter Uncertainty

Jie Wang et al.

Summary: This article proposes an evidential reasoning rule that takes into account parameter uncertainty. By modeling the weight and reliability parameters as interval and random variables respectively, a unified inference model for evidence aggregation is developed. The article also presents a practical example to illustrate the potential applications of the proposed model.

IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS (2022)

Review Computer Science, Artificial Intelligence

Modern views of machine learning for precision psychiatry

Zhe Sage Chen et al.

Summary: This review provides a comprehensive overview of the methodologies and applications of machine learning (ML) in psychiatry, including neuroimaging, neuromodulation, and advanced mobile technologies. It also discusses the potential and future research opportunities of ML in precision psychiatry.

PATTERNS (2022)

Article Computer Science, Artificial Intelligence

Deep evidential fusion network for medical image classification

Shaoxun Xu et al.

Summary: This paper investigates a fusion method based on the belief/uncertainty estimation framework of evidential deep learning and Dempster's rule of combination to combine the information of multi-modality medical images. The proposed method can handle the modality missing problem in medical image classification and utilize incomplete data for learning.

INTERNATIONAL JOURNAL OF APPROXIMATE REASONING (2022)

Article Computer Science, Artificial Intelligence

Lymphoma segmentation from 3D PET-CT images using a deep evidential network

Ling Huang et al.

Summary: An automatic evidential segmentation method based on Dempster-Shafer theory and deep learning is proposed for segmenting lymphomas from PET and CT images. The method combines deep feature extraction and evidential segmentation, and achieves better results than the baseline model and other state-of-the-art models by training the model to minimize the Dice loss function.

INTERNATIONAL JOURNAL OF APPROXIMATE REASONING (2022)

Article Computer Science, Theory & Methods

A Survey on Uncertainty Estimation in Deep Learning Classification Systems from a Bayesian Perspective

Jose Mena et al.

Summary: This study introduces the importance of uncertainty estimation in machine learning systems and analyzes how uncertainty can be measured in classification systems based on deep learning. The study also provides an overview of practical considerations in different applications and highlights the properties that should be considered when developing metrics.

ACM COMPUTING SURVEYS (2022)

Editorial Material Psychiatry

Structural Magnetic Resonance Imaging All Over Again

Daniel R. Weinberger et al.

JAMA PSYCHIATRY (2021)

Article Computer Science, Artificial Intelligence

Early, intermediate and late fusion strategies for robust deep learning-based multimodal action recognition

Said Yacine Boulahia et al.

Summary: Multimodal action recognition techniques combine multiple image modalities, including early fusion, intermediate fusion, and late fusion methods for more robust recognition. By deeply investigating different fusion levels, new schemes are proposed to better combine features from different modalities and achieve better recognition results than traditional methods.

MACHINE VISION AND APPLICATIONS (2021)

Article Computer Science, Artificial Intelligence

Information Aware max-norm Dirichlet networks for predictive uncertainty estimation

Theodoros Tsiligkaridis

Summary: This paper introduces the Information Aware Dirichlet networks method to improve uncertainty estimation in neural network predictions by learning a Dirichlet prior distribution. Experimental results demonstrate that this method significantly outperforms existing neural network techniques in accuracy and detecting adversarial examples.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

An evidential classifier based on Dempster-Shafer theory and deep learning

Zheng Tong et al.

Summary: The study introduces a new classifier based on DS theory and CNN architecture, named the evidential deep-learning classifier. It aims to improve classification accuracy through feature extraction, mass function conversion, and set-valued classification, while also enabling cautious decision-making. The research also proposes an end-to-end learning strategy and a method for selecting partial multi-class acts.

NEUROCOMPUTING (2021)

Article Engineering, Electrical & Electronic

Multimodal Intelligence: Representation Learning, Information Fusion, and Applications

Chao Zhang et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2020)

Article Biochemical Research Methods

A Multimodal Deep Neural Network for Human Breast Cancer Prognosis Prediction by Integrating Multi-Dimensional Data

Dongdong Sun et al.

IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS (2019)

Article Engineering, Electrical & Electronic

End-to-End Multimodal Emotion Recognition Using Deep Neural Networks

Panagiotis Tzirakis et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2017)

Article Mathematical & Computational Biology

Resting State fMRI Functional Connectivity-Based Classification Using a Convolutional Neural Network Architecture

Regina J. Meszlenyi et al.

FRONTIERS IN NEUROINFORMATICS (2017)

Article Computer Science, Artificial Intelligence

Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition

Di Wu et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2016)

Article Automation & Control Systems

Multimodal integration learning of robot behavior using deep neural networks

Kuniaki Noda et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2014)

Review Clinical Neurology

Resting-State fMRI: A Review of Methods and Clinical Applications

M. H. Lee et al.

AMERICAN JOURNAL OF NEURORADIOLOGY (2013)

Article Computer Science, Artificial Intelligence

Evidential reasoning rule for evidence combination

Jian-Bo Yang et al.

ARTIFICIAL INTELLIGENCE (2013)

Article Computer Science, Cybernetics

A neural network classifier based on Dempster-Shafer theory

T Denoeux

IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS (2000)