4.6 Article

Opponent learning with different representations in the cortico-basal ganglia pathways can develop obsession-compulsion cycle

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Biochemistry & Molecular Biology

Individuals with problem gambling and obsessive-compulsive disorder learn through distinct reinforcement mechanisms

Shinsuke Suzuki et al.

Summary: Obsessive-compulsive disorder (OCD) and pathological gambling (PG) are associated with deficits in behavioural flexibility. Model-based functional magnetic resonance imaging (fMRI) reveals altered reward-learning in OCD and PG, with OCD patients showing lower learning rates for worse-than-expected outcomes and attenuated encoding of negative reward prediction errors, and PG patients showing higher and lower learning rates for better- and worse-than-expected outcomes, respectively, accompanied with higher encoding of positive reward prediction errors. Perseveration did not significantly differ between the patient groups and healthy controls.

PLOS BIOLOGY (2023)

Article Multidisciplinary Sciences

Dopamine error signal to actively cope with lack of expected reward

Seiya Ishino et al.

Summary: Animals must learn to actively overcome reward omission and adjust behavior to obtain more uncertain rewards. The neural mechanisms underlying this coping with reward omission are still unclear. In this study, a task was developed in rats to monitor active behavioral switch after no reward. It was found that some dopamine neurons in the ventral tegmental area exhibited increased responses to unexpected reward omission and decreased responses to unexpected reward, opposite to the well-known reward prediction error signaling dopamine neurons. The dopamine increase in the nucleus accumbens correlated with behavioral adjustment to actively overcome no reward. These findings suggest that these responses signal error to actively cope with the lack of expected reward, enabling adaptive pursuit of uncertain reward to obtain more reward.

SCIENCE ADVANCES (2023)

Article Neurosciences

Striatal dopamine explains novelty-induced behavioral dynamics and individual variability in threat prediction

Korleki Akiti et al.

Summary: In this study, the behavior of mice freely interacting with a novel object was characterized using multi-point tracking and behavioral segmentation techniques. The results revealed that novelty elicits a characteristic sequence of behavior, and dopamine in the tail of the striatum suppresses object engagement. A reinforcement-learning model explained the behavioral dynamics and individual variability, uncovering an algorithmic similarity between reward- and threat-related dopamine sub-systems.

NEURON (2022)

Article Cell Biology

Memory trace imbalance in reinforcement and punishment systems can reinforce implicit choices leading to obsessive-compulsive behavior

Yuki Sakai et al.

Summary: This study models obsessive-compulsive disorder (OCD) symptoms as implicitly learned maladaptive behaviors using reinforcement learning framework, extends understanding of therapeutic effects of behavioral therapy in OCD, and discovers imbalanced traces in OCD patients and healthy participants.

CELL REPORTS (2022)

Article Multidisciplinary Sciences

Cell-type-specific asynchronous modulation of PKA by dopamine in learning

Suk Joon Lee et al.

Summary: Dopamine modulates the PKA activity in spiny projection neurons during learning, with positive and negative effects occurring at different phases and being associated with different types of dopamine receptors.

NATURE (2021)

Article Biochemistry & Molecular Biology

Disruption of model-based decision making by silencing of serotonin neurons in the dorsal raphe nucleus

Yu Ohmura et al.

Summary: The article explores the strategy changes in decision making under different environmental conditions and the role of the central serotonergic system in model-based decision making. Through manipulation of serotonin neurons, it is demonstrated that their impact on model-based decision making has been confirmed.

CURRENT BIOLOGY (2021)

Article Neurosciences

Rigid reduced successor representation as a potential mechanism for addiction

Kanji Shimomura et al.

Summary: The formation of rigid reduced successor representations (SR) in habitual reward-obtaining behavior makes resistance particularly difficult, serving as a potential mechanism for addiction.

EUROPEAN JOURNAL OF NEUROSCIENCE (2021)

Article Medicine, General & Internal

Association of Environmental Uncertainty With Altered Decision-making and Learning Mechanisms in Youths With Obsessive-Compulsive Disorder

Aleya A. Marzuki et al.

Summary: This cross-sectional study found that youths with OCD displayed atypical probabilistic reversal learning but were generally unimpaired on the deterministic Wisconsin Card Sorting Task, particularly for patients receiving serotonergic medication.

JAMA NETWORK OPEN (2021)

Article Multidisciplinary Sciences

Dopamine D2 receptors in discrimination learning and spine enlargement

Yusuke Iino et al.

NATURE (2020)

Review Neurosciences

Obsessive-Compulsive Disorder: Puzzles and Prospects

Trevor W. Robbins et al.

NEURON (2019)

Article Neurosciences

Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes

Stephanie M. Groman et al.

NEURON (2019)

Article Computer Science, Artificial Intelligence

Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

Dimitri Ognibene et al.

NEURAL NETWORKS (2019)

Article Psychology, Clinical

Impaired generalization of reward but not loss in obsessive-compulsive disorder

Nina Rouhani et al.

DEPRESSION AND ANXIETY (2019)

Article Neurosciences

The hippocampus as a predictive map

Kimberly L. Stachenfeld et al.

NATURE NEUROSCIENCE (2017)

Article Biochemical Research Methods

Predictive representations can link model-based reinforcement learning to model-free mechanisms

Evan M. Russek et al.

PLOS COMPUTATIONAL BIOLOGY (2017)

Article Psychology, Biological

The successor representation in human reinforcement learning

I. Momennejad et al.

NATURE HUMAN BEHAVIOUR (2017)

Article Biochemistry & Molecular Biology

Valence-dependent influence of serotonin depletion on model-based choice strategy

Y. Worbe et al.

MOLECULAR PSYCHIATRY (2016)

Review Clinical Neurology

Arbitration between Action Strategies in Obsessive-Compulsive Disorder

Patricia Gruner et al.

NEUROSCIENTIST (2016)

Article Biochemical Research Methods

Learning Reward Uncertainty in the Basal Ganglia

John G. Mikhael et al.

PLOS COMPUTATIONAL BIOLOGY (2016)

Article Biochemical Research Methods

Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation

Ayaka Kato et al.

PLOS COMPUTATIONAL BIOLOGY (2016)

Article Biochemistry & Molecular Biology

Disorders of compulsivity: a common bias towards learning habits

V. Voon et al.

MOLECULAR PSYCHIATRY (2015)

Editorial Material Neurosciences

Which Is the Driver, the Obsessions or the Compulsions, in OCD?

Claire M. Gillan et al.

NEUROPSYCHOPHARMACOLOGY (2015)

Review Neurosciences

Goals and Habits in the Brain

Ray J. Dolan et al.

NEURON (2013)

Article Neurosciences

Distinct roles for direct and indirect pathway striatal neurons in reinforcement

Alexxai V. Kravitz et al.

NATURE NEUROSCIENCE (2012)

Article Multidisciplinary Sciences

Two types of dopamine neuron distinctly convey positive and negative motivational signals

Masayuki Matsumoto et al.

NATURE (2009)

Article Psychology, Biological

Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits

BW Balleine

PHYSIOLOGY & BEHAVIOR (2005)

Article Multidisciplinary Sciences

By carrot or by stick: Cognitive reinforcement learning in Parkinsonism

MJ Frank et al.

SCIENCE (2004)

Review Computer Science, Artificial Intelligence

How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades

JW Brown et al.

NEURAL NETWORKS (2004)