4.7 Article

Meta-reinforcement learning via orbitofrontal cortex

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Neurosciences

Context-dependent persistency as a coding mechanism for robust and widely distributed value

Ryoma Hattori et al.

Summary: Task-related information is coded with different persistency across the brain. The coding persistency of action history and value in mice varies across areas, learning phases, and task context, with the highest persistency observed in the retrosplenial cortex of expert mice. Persistent coding enables robust signal coding and distribution in neuronal networks.

NEURON (2022)

Article Neurosciences

Learning binds new inputs into functional synaptic clusters via spinogenesis

Nathan G. Hedrick et al.

Summary: Learning induces the formation of new dendritic spines, which bind new presynaptic inputs into preexisting clusters, generating locally coherent inputs representing learned behaviors. Successful connections are selected based on co-activity with nearby task-related spines, ensuring the functional clustering of new spines. Furthermore, a majority of new spines synapse with previously unrepresented axons, suggesting the binding of new information into functional synaptic clusters.

NATURE NEUROSCIENCE (2022)

Article Biochemical Research Methods

PatchWarp: Corrections of non-uniform image distortions in two-photon calcium imaging data by patchwork affine transformations

Ryoma Hattori et al.

Summary: PatchWarp is a registration algorithm developed to correct slow image distortion in calcium imaging data. It combines rigid and non-rigid registrations to robustly correct non-uniform distortions and provides a fully automated method for registering images from different imaging sessions. PatchWarp improves the quality of neural activity analyses and is useful for correcting image distortions in a wide range of disciplines.

CELL REPORTS METHODS (2022)

Article Biochemical Research Methods

Longitudinal two-photon calcium imaging with ultra-large cranial window for head-fixed mice

Ryoma Hattori et al.

Summary: This article describes a protocol for longitudinal in vivo two-photon calcium imaging using an ultra-large cranial window in head-fixed mice. The protocol allows tracking neural activity from different cortical areas at cellular resolution to understand cortical computations during behavioral tasks.

STAR PROTOCOLS (2022)

Article Multidisciplinary Sciences

Photoactivatable CaMKII induces synaptic plasticity in single synapses

Akihiro C. E. Shibata et al.

Summary: The study introduces a photoactivatable CaMKII tool to control synaptic plasticity at the single synapse level by optogenetic means, shedding light on the sufficiency of CaMKII activation for inducing structural long-term potentiation, and can have important applications in neuroscience research.

NATURE COMMUNICATIONS (2021)

Article Biochemical Research Methods

Choice history effects in mice and humans improve reward harvesting efficiency

Samuel Lopez-Yepez Junior et al.

Summary: Choice history effects describe how past choices influence future decisions, maximizing reward harvesting efficiency in animals. By manipulating environmental statistics and developing a reinforcement learning model, researchers have demonstrated the adaptive nature of choice history effects in promoting optimal decision-making processes across various time scales.

PLOS COMPUTATIONAL BIOLOGY (2021)

Article Biology

Robust and distributed neural representation of action values

Eun Ju Shin et al.

Summary: Studies in rats, monkeys, and humans have found action-value signals encoded in various brain regions, which bias choices towards higher expected rewards. Statistical tests on neural activity in the striatum, frontal cortex, and hippocampus show that previously identified action-value signals cannot be solely explained by serial correlations or activity related to other decision variables. Additionally, it was found that neural activity related to action value is intertwined with signals related to other decision variables.
Article Biochemical Research Methods

SciPy 1.0: fundamental algorithms for scientific computing in Python

Pauli Virtanen et al.

NATURE METHODS (2020)

Article Multidisciplinary Sciences

Value-guided remapping of sensory cortex by lateral orbitofrontal cortex

Abhishek Banerjee et al.

NATURE (2020)

Review Multidisciplinary Sciences

Array programming with NumPy

Charles R. Harris et al.

NATURE (2020)

Article Biochemistry & Molecular Biology

Area-Specificity and Plasticity of History-Dependent Value Coding During Learning

Ryoma Hattori et al.

Review Behavioral Sciences

Reinforcement Learning, Fast and Slow

Matthew Botvinick et al.

TRENDS IN COGNITIVE SCIENCES (2019)

Article Neurosciences

Stable Representations of Decision Variables for Flexible Behavior

Bilal A. Bari et al.

NEURON (2019)

Review Neurosciences

CaM Kinase: Still Inspiring at 40

K. Ulrich Bayer et al.

NEURON (2019)

Article Multidisciplinary Sciences

Frontal cortex neuron types categorically encode single decision variables

Junya Hirokawa et al.

NATURE (2019)

Article Neurosciences

Prefrontal cortex as a meta-reinforcement learning system

Jane X. Wang et al.

NATURE NEUROSCIENCE (2018)

Article Biology

Striatal action-value neurons reconsidered

Lotem Elber-Dorozko et al.

Article Neurosciences

Robustness of Spike Deconvolution for Neuronal Calcium Imaging

Marius Pachitariu et al.

JOURNAL OF NEUROSCIENCE (2018)

Article Multidisciplinary Sciences

Stochastic synaptic plasticity underlying compulsion in a model of addiction

Vincent Pascoli et al.

NATURE (2018)

Article Biochemistry & Molecular Biology

Dopamine D1 or D2 receptor-expressing neurons in the central nervous system

Xiaoyan Wei et al.

ADDICTION BIOLOGY (2018)

Article Biochemical Research Methods

Fast online deconvolution of calcium imaging data

Johannes Friedrich et al.

PLOS COMPUTATIONAL BIOLOGY (2017)

Article Neurosciences

Large-scale imaging of cortical dynamics during sensory perception and behavior

Joseph B. Wekselblatt et al.

JOURNAL OF NEUROPHYSIOLOGY (2016)

Article Neurosciences

Spike sorting for large, dense electrode arrays

Cyrille Rossant et al.

NATURE NEUROSCIENCE (2016)

Article Biochemistry & Molecular Biology

Circuit Architecture of VTA Dopamine Neurons Revealed by Systematic Input-Output Mapping

Kevin T. Beier et al.

Article Mathematics, Interdisciplinary Applications

The relation between reinforcement learning parameters and the influence of reinforcement history on choice behavior

Kentaro Katahira

JOURNAL OF MATHEMATICAL PSYCHOLOGY (2015)

Article Computer Science, Interdisciplinary Applications

Fitting Linear Mixed-Effects Models Using lme4

Douglas Bates et al.

JOURNAL OF STATISTICAL SOFTWARE (2015)

Article Multidisciplinary Sciences

Human-level control through deep reinforcement learning

Volodymyr Mnih et al.

NATURE (2015)

Article Neurosciences

Long-term in vivo time-lapse imaging of synapse development and plasticity in the cerebellum

Naoko Nishiyama et al.

JOURNAL OF NEUROPHYSIOLOGY (2014)

Article Multidisciplinary Sciences

Emergence of reproducible spatiotemporal activity during motor learning

Andrew J. Peters et al.

NATURE (2014)

Article Biochemical Research Methods

Independent optical excitation of distinct neural populations

Nathan C. Klapoetke et al.

NATURE METHODS (2014)

Article Neurosciences

Flow of Cortical Activity Underlying a Tactile Decision in Mice

Zengcai V. Guo et al.

NEURON (2014)

Article Multidisciplinary Sciences

Ultrasensitive fluorescent proteins for imaging neuronal activity

Tsai-Wen Chen et al.

NATURE (2013)

Article Neurosciences

Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons

Mitsuko Watabe-Uchida et al.

NEURON (2012)

Article Neurosciences

Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex

Yuji K. Takahashi et al.

NATURE NEUROSCIENCE (2011)

Article Neurosciences

Role of Striatum in Updating Values of Chosen Actions

Hoseok Kim et al.

JOURNAL OF NEUROSCIENCE (2009)

Review Neurosciences

OPINION A new perspective on the role of the orbitofrontal cortex in adaptive behaviour

Geoffrey Schoenbaum et al.

NATURE REVIEWS NEUROSCIENCE (2009)

Article Multidisciplinary Sciences

Neurons in the orbitofrontal cortex encode economic value

C Padoa-Schioppa et al.

NATURE (2006)

Article Multidisciplinary Sciences

Representation of action-specific reward values in the striatum

K Samejima et al.

SCIENCE (2005)

Article Psychology, Biological

Dynamic response-by-response models of matching behavior in rhesus monkeys

B Lau et al.

JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR (2005)

Article Multidisciplinary Sciences

Matching behavior and the representation of value in the parietal cortex

LP Sugrue et al.

SCIENCE (2004)

Article Multidisciplinary Sciences

Structural basis of long-term potentiation in single dendritic spines

M Matsuzaki et al.

NATURE (2004)

Article Computer Science, Artificial Intelligence

Meta-learning in Reinforcement Learning

N Schweighofer et al.

NEURAL NETWORKS (2003)