4.6 Review

Natural Image Reconstruction From fMRI Using Deep Learning: A Survey

Related references

Note: Only part of the references are listed.
Review Engineering, Biomedical

A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers

Xiang Zhang et al.

Summary: Brain signals are biometric information collected from the human brain for decoding the underlying neurological or physical status of individuals. Recent advancements in deep learning have significantly enhanced the study of brain signals. This work presents a taxonomy of non-invasive brain signals, basics of deep learning algorithms, frontiers of applying deep learning for non-invasive brain signals analysis, and potential real-world applications.

JOURNAL OF NEURAL ENGINEERING (2021)

Article Neurosciences

Reconstructing seen image from brain activity by visually-guided cognitive representation and adversarial learning

Ziqi Ren et al.

Summary: This research demonstrates the possibility of reconstructing visual stimuli from fMRI signals by learning latent cognitive representations and inversely decoding them. The proposed Dual-Variational Autoencoder/Generative Adversarial Network (DVAE/GAN) combines adversarial representation learning with knowledge distillation and shows promising results in experimental evaluations. The three-stage learning strategy enables the cognitive encoder to distill useful knowledge from the visual encoder, leading to significantly better performance compared to existing methods.

NEUROIMAGE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Learning Implicit Generative Models by Teaching Density Estimators

Kun Xu et al.

Summary: Implicit generative models are traditionally difficult to train, but the learning by teaching (LBT) approach in this paper tackles the mode collapse issue by optimizing KL-divergence and effectively matching the true data distribution. The LBT method can be integrated with GANs to derive a hybrid model that provides complimentary benefits and demonstrates effectiveness in challenging learning problems through a stochastic gradient ascent algorithm.

MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT II (2021)

Article Chemistry, Analytical

Population Graph-Based Multi-Model Ensemble Method for Diagnosing Autism Spectrum Disorder

Zarina Rakhimberdina et al.

SENSORS (2020)

Review Behavioral Sciences

The Face of Image Reconstruction: Progress, Pitfalls, Prospects

Adrian Nestor et al.

TRENDS IN COGNITIVE SCIENCES (2020)

Article Mathematical & Computational Biology

End-to-End Deep Image Reconstruction From Human Brain Activity

Guohua Shen et al.

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2019)

Article Biochemical Research Methods

Deep image reconstruction from human brain activity

Guohua Shen et al.

PLOS COMPUTATIONAL BIOLOGY (2019)

Article Biology

Reconstructing faces from fMRI patterns using deep generative neural networks

Rufin VanRullen et al.

COMMUNICATIONS BIOLOGY (2019)

Review Behavioral Sciences

Mind Reading and Writing: The Future of Neurotechnology

Pieter R. Roelfsema et al.

TRENDS IN COGNITIVE SCIENCES (2018)

Proceedings Paper Computer Science, Cybernetics

Generative Adversarial Networks Conditioned on Brain Activity Reconstruct Seen Images

Ghislain St-Yves et al.

2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC) (2018)

Article Computer Science, Artificial Intelligence

Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising

Kai Zhang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2017)

Article Computer Science, Artificial Intelligence

Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation

Konstantinos Kamnitsas et al.

MEDICAL IMAGE ANALYSIS (2017)

Article Multidisciplinary Sciences

Generic decoding of seen and imagined objects using hierarchical visual features

Tomoyasu Horikawa et al.

NATURE COMMUNICATIONS (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Image-to-Image Translation with Conditional Adversarial Networks

Phillip Isola et al.

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)

Review Multidisciplinary Sciences

Progress and challenges in probing the human brain

Russell A. Poldrack et al.

NATURE (2015)

Article Neurosciences

Deep Neural Networks: A New Framework for Modeling Biological Vision and Brain Information Processing

Nikolaus Kriegeskorte

ANNUAL REVIEW OF VISION SCIENCE, VOL 1 (2015)

Article Computer Science, Artificial Intelligence

Modular Encoding and Decoding Models Derived from Bayesian Canonical Correlation Analysis

Yusuke Fujiwara et al.

NEURAL COMPUTATION (2013)

Article Neurosciences

Linear reconstruction of perceived images from human brain activity

Sanne Schoenmakers et al.

NEUROIMAGE (2013)

Review Neurosciences

Twenty years of functional MRI: The science and the stories

Peter A. Bandettini

NEUROIMAGE (2012)

Review Mathematical & Computational Biology

Invariant visual object and face recognition: neural and computational bases, and a model, VisNet

Edmund T. Rolls

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2012)

Review Neurosciences

Encoding and decoding in fMRI

Thomas Naselaris et al.

NEUROIMAGE (2011)

Article Computer Science, Artificial Intelligence

Neural Decoding with Hierarchical Generative Models

Marcel A. J. van Gerven et al.

NEURAL COMPUTATION (2010)

Article Neurosciences

Bayesian Reconstruction of Natural Images from Human Brain Activity

Thomas Naselaris et al.

NEURON (2009)

Article Biochemical Research Methods

A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation

Nicolas Pinto et al.

PLOS COMPUTATIONAL BIOLOGY (2009)

Article Multidisciplinary Sciences

Identifying natural images from human brain activity

Kendrick N. Kay et al.

NATURE (2008)

Article Multidisciplinary Sciences

Invariant visual representation by single neurons in the human brain

RQ Quiroga et al.

NATURE (2005)

Article Neurosciences

Decoding the visual and subjective contents of the human brain

Y Kamitani et al.

NATURE NEUROSCIENCE (2005)

Article Computer Science, Artificial Intelligence

Image quality assessment: From error visibility to structural similarity

Z Wang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2004)