4.7 Article

Semantic reconstruction of continuous language from non-invasive brain recordings

Related references

Note: Only part of the references are listed.
Article Biology

Attention modulates neural representation to render reconstructions according to subjective appearance

Tomoyasu Horikawa et al.

Summary: In this study, Horikawa and Kamitani investigate the effects of attention on visual image reconstructions from fMRI activity. They show that top-down attention can modulate neural representations to render reconstructions in accordance with subjective appearance.

COMMUNICATIONS BIOLOGY (2022)

Article Biology

Brains and algorithms partially converge in natural language processing

Charlotte Caucheteux et al.

Summary: This study examines the similarity between deep language models and the human brain responses by comparing different neural network models trained on word prediction tasks. The researchers find that the similarity primarily depends on the models' ability to predict words from context, and it reveals the formation and maintenance of perceptual, lexical, and compositional representations within each cortical region.

COMMUNICATIONS BIOLOGY (2022)

Article Neurosciences

Voxelwise Encoding Models Show That Cerebellar Language Representations Are Highly Conceptual

Amanda LeBel et al.

Summary: Research shows that the cerebellum plays a significant role in language understanding, particularly in processing high-level conceptual language features, with recent findings contradicting theories related to low-level acoustic or phonemic features. Additionally, the cerebellum has been found to exhibit a higher response to social semantic categories, indicating a preference for social information in language representation.

JOURNAL OF NEUROSCIENCE (2021)

Article Neurosciences

Visual and linguistic semantic representations are aligned at the border of human visual cortex

Sara F. Popham et al.

Summary: Semantic information in the human brain is organized into multiple networks, with different networks being activated by movies and stories as stimuli. The study found that the two distinct networks corresponded along the boundary of visual cortex, suggesting a smooth integration for visual perception and semantic memory.

NATURE NEUROSCIENCE (2021)

Article Multidisciplinary Sciences

The neural architecture of language: Integrative modeling converges on predictive processing

Martin Schrimpf et al.

Summary: A recent approach in neuroscience has connected computation, brain function, and behavior to provide new insights into cognitive and neural mechanisms. Powerful transformer models in language processing can predict neural responses and correlate with model accuracy on next-word prediction task.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Article Multidisciplinary Sciences

High-performance brain-to-text communication via handwriting

Francis R. Willett et al.

Summary: BCIs can restore communication for individuals with paralysis by decoding attempted handwriting movements, achieving typing speeds of 90 characters per minute with high accuracy. This approach opens new possibilities for BCIs and demonstrates the feasibility of decoding rapid, dexterous movements even years after paralysis.

NATURE (2021)

Article Ethics

Recommendations for Responsible Development and Application of Neurotechnologies

Sara Goering et al.

Summary: The advancement of novel neurotechnologies has profound implications for society and individual rights, potentially challenging basic human concepts. To mitigate negative consequences, recommendations include establishing global ethical guidelines, enhancing data privacy protection, preventing bias, and ensuring safe and equitable distribution of neurotechnological devices.

NEUROETHICS (2021)

Article Neurosciences

Attentional Modulation of Hierarchical Speech Representations in a Multitalker Environment

Ibrahim Kiremitci et al.

Summary: Attention plays a crucial role in selectively listening to desired speakers in noisy environments, causing broad modulations in speech representations at multiple levels and growing stronger towards later stages of processing. Unattended speech is still represented up to the semantic level in parabelt auditory cortex.

CEREBRAL CORTEX (2021)

Article Medicine, General & Internal

Neuroprosthesis for Decoding Speech in a Paralyzed Person with Anarthria

David A. Moses et al.

Summary: This study successfully decoded words and sentences directly from cortical activity during attempted speech in a patient with anarthria and spastic quadriparesis using deep-learning models and a natural-language model, showing potential for improving communication in paralyzed individuals.

NEW ENGLAND JOURNAL OF MEDICINE (2021)

Article Biochemical Research Methods

SciPy 1.0: fundamental algorithms for scientific computing in Python

Pauli Virtanen et al.

NATURE METHODS (2020)

Article Neurosciences

Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals

Debadatta Dash et al.

FRONTIERS IN NEUROSCIENCE (2020)

Article Neurosciences

Machine translation of cortical activity to text with an encoder-decoder framework

Joseph G. Makin et al.

NATURE NEUROSCIENCE (2020)

Review Multidisciplinary Sciences

Array programming with NumPy

Charles R. Harris et al.

NATURE (2020)

Article Multidisciplinary Sciences

Speech synthesis from neural decoding of spoken sentences

Gopala K. Anumanchipalli et al.

NATURE (2019)

Article Biochemistry & Molecular Biology

Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech

Michael P. Broderick et al.

CURRENT BIOLOGY (2018)

Article Multidisciplinary Sciences

Toward a universal decoder of linguistic meaning from brain activation

Francisco Pereira et al.

NATURE COMMUNICATIONS (2018)

Article Neurosciences

The Hierarchical Cortical Organization of Human Speech Processing

Wendy A. de Heer et al.

JOURNAL OF NEUROSCIENCE (2017)

Article Multidisciplinary Sciences

Natural speech reveals the semantic maps that tile human cerebral cortex

Alexander G. Huth et al.

NATURE (2016)

Article Mathematical & Computational Biology

Pycortex: an interactive surface visualizer for fMRI

James S. Gao et al.

FRONTIERS IN NEUROINFORMATICS (2015)

Review Neurosciences

The Role of High-Level Processes for Oscillatory Phase Entrainment to Speech Sound

Benedikt Zoefel et al.

FRONTIERS IN HUMAN NEUROSCIENCE (2015)

Article Multidisciplinary Sciences

Coupled neural systems underlie the production and comprehension of naturalistic narrative speech

Lauren J. Silbert et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2014)

Review Behavioral Sciences

Reworking the language network

Evelina Fedorenko et al.

TRENDS IN COGNITIVE SCIENCES (2014)

Article Psychology, Mathematical

Concreteness ratings for 40 thousand generally known English word lemmas

Marc Brysbaert et al.

BEHAVIOR RESEARCH METHODS (2014)

Article Neurosciences

Brain Regions That Represent Amodal Conceptual Knowledge

Scott L. Fairhall et al.

JOURNAL OF NEUROSCIENCE (2013)

Article Neurosciences

Attention during natural vision warps semantic representation across the human brain

Tolga Cukur et al.

NATURE NEUROSCIENCE (2013)

Article Psychology, Mathematical

Norms of valence, arousal, and dominance for 13,915 English lemmas

Amy Beth Warriner et al.

BEHAVIOR RESEARCH METHODS (2013)

Article Biochemistry & Molecular Biology

Reconstructing Speech from Human Auditory Cortex

Brian N. Pasley et al.

PLOS BIOLOGY (2012)

Article Multidisciplinary Sciences

Selective cortical representation of attended speaker in multi-talker speech perception

Nima Mesgarani et al.

NATURE (2012)

Article Biochemistry & Molecular Biology

Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies

Shinji Nishimoto et al.

CURRENT BIOLOGY (2011)

Article Neurosciences

Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story

Yulia Lerner et al.

JOURNAL OF NEUROSCIENCE (2011)

Review Behavioral Sciences

The neurobiology of semantic memory

Jeffrey R. Binder et al.

TRENDS IN COGNITIVE SCIENCES (2011)

Article Biochemical Research Methods

Quantitative evaluation of high-density diffuse optical tomography: in vivo resolution and mapping performance

Brian R. White et al.

JOURNAL OF BIOMEDICAL OPTICS (2010)

Article Neurosciences

New Method for fMRI Investigations of Language: Defining ROIs Functionally in Individual Subjects

Evelina Fedorenko et al.

JOURNAL OF NEUROPHYSIOLOGY (2010)

Article Neurosciences

Bayesian Reconstruction of Natural Images from Human Brain Activity

Thomas Naselaris et al.

NEURON (2009)

Review Psychology

Grounded cognition

Lawrence W. Barsalou

ANNUAL REVIEW OF PSYCHOLOGY (2008)

Article Acoustics

Speaker identification on the SCOTUS corpus

Jiahong Yuan et al.

JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA (2008)

Article Multidisciplinary Sciences

Predicting human brain activity associated with the meanings of nouns

Tom M. Mitchell et al.

SCIENCE (2008)

Review Psychology, Experimental

Expectation-based syntactic comprehension

Roger Levy

COGNITION (2008)

Article Psychology, Mathematical

G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences

Franz Faul et al.

BEHAVIOR RESEARCH METHODS (2007)

Article Neurosciences

Scanning silence: Mental imagery of complex sounds

N Bunzeck et al.

NEUROIMAGE (2005)

Article Computer Science, Artificial Intelligence

Word reordering and a dynamic programming beam search algorithm for statistical machine translation

C Tillmann et al.

COMPUTATIONAL LINGUISTICS (2003)

Article Computer Science, Artificial Intelligence

A global optimisation method for robust affine registration of brain images

M Jenkinson et al.

MEDICAL IMAGE ANALYSIS (2001)