4.6 Article

Impairment of arbitration between model-based and model-free reinforcement learning in obsessive-compulsive disorder

Related references

Note: Only part of the references are listed.
Article Neurosciences

Imbalance in Functional and Structural Connectivity Underlying Goal-Directed and Habitual Learning Systems in Obsessive-Compulsive Disorder

Chuanyong Xu et al.

Summary: An imbalance between goal-directed and habitual learning systems may underlie compulsivity in OCD, with stress hormone ACTH potentially moderating this relationship. This study provides new insights into the neural correlates of this imbalance and its relationship with symptom dimensions in patients with OCD.

CEREBRAL CORTEX (2022)

Review Biochemistry & Molecular Biology

Toward a neurocircuit-based taxonomy to guide treatment of obsessive-compulsive disorder

Elizabeth Shephard et al.

Summary: This review proposes a heuristic neurocircuit-based taxonomy to guide the treatment of obsessive-compulsive disorder, integrating information about patient symptoms, clinical profiles, neurocircuit dysfunctions, and potential treatments. The approach provides valuable insights for future research in understanding and treating OCD.

MOLECULAR PSYCHIATRY (2021)

Article Neurosciences

White Matter Alterations of the Goal-Directed System in Patients With Obsessive-Compulsive Disorder and Their Unaffected First-Degree Relatives

Ziwen Peng et al.

Summary: The study found that patients with OCD and their UFDRs exhibit reduced white matter connectivity in the goal-directed network, which may explain symptom onset and impaired cognitive flexibility. These alterations could be an endophenotype of OCD.

BIOLOGICAL PSYCHIATRY-COGNITIVE NEUROSCIENCE AND NEUROIMAGING (2021)

Article Cell Biology

Prefrontal solution to the bias-variance tradeoff during reinforcement learning

Dongjae Kim et al.

Summary: The brain has been found to adaptively resolve the tradeoff between bias and variance during reinforcement learning, requiring baseline correction for prediction error to offset the adverse effects of irreducible error on value learning. Behavioral evidence of adaptive control has been shown in a Markov decision task with context changes, suggesting that the prediction error baseline signals context changes to improve adaptability. Multiplexed representations of prediction error baseline within specific brain regions have been identified, indicating their role in guiding model based and model-free reinforcement learning.

CELL REPORTS (2021)

Review Behavioral Sciences

Why and how the brain weights contributions from a mixture of experts

John P. O'Doherty et al.

Summary: The brain is proposed to act as a Mixture of Experts, with different expert systems proposing action strategies based on reliability. The anterior prefrontal cortex is suggested to play a specific role in this process, favoring simpler expert systems. Research indicates that this reliability-based control mechanism may be domain general.

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS (2021)

Article Biochemical Research Methods

Effects of subclinical depression on prefrontal-striatal model-based and model-free learning

Suyeon Heo et al.

Summary: The study revealed that subclinical depression affects model-based and model-free learning in the prefrontal-striatal circuitry, as well as disrupts the arbitration control between the two. Additionally, depression undermines the ability to exploit viable options, known as exploitation sensitivity. The findings suggest the potential for clinical applications, such as early diagnosis and behavioral therapy design, to address the impact of depression on decision-making processes.

PLOS COMPUTATIONAL BIOLOGY (2021)

Review Neurosciences

The two-step task, avoidance, and OCD

Matthew A. Geramita et al.

JOURNAL OF NEUROSCIENCE RESEARCH (2020)

Article Psychology, Biological

Humans primarily use model-based inference in the two-stage task

Carolina Feher da Silva et al.

NATURE HUMAN BEHAVIOUR (2020)

Review Neurosciences

Obsessive-Compulsive Disorder: Puzzles and Prospects

Trevor W. Robbins et al.

NEURON (2019)

Editorial Material Neurosciences

Are we of two minds?

Nathaniel D. Daw

NATURE NEUROSCIENCE (2018)

Review Neurosciences

Model-Based Control in Dimensional Psychiatry

Valerie Voon et al.

BIOLOGICAL PSYCHIATRY (2017)

Review Clinical Neurology

Arbitration between Action Strategies in Obsessive-Compulsive Disorder

Patricia Gruner et al.

NEUROSCIENTIST (2016)

Article Psychiatry

Functional Neuroimaging of Avoidance Habits in Obsessive-Compulsive Disorder

Claire M. Gillan et al.

AMERICAN JOURNAL OF PSYCHIATRY (2015)

Article Biochemistry & Molecular Biology

Disorders of compulsivity: a common bias towards learning habits

V. Voon et al.

MOLECULAR PSYCHIATRY (2015)

Article Neurosciences

Enhanced Avoidance Habits in Obsessive-Compulsive Disorder

Claire M. Gillan et al.

BIOLOGICAL PSYCHIATRY (2014)

Review Biology

Goal-directed learning and obsessive - compulsive disorder

Claire M. Gillan et al.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES (2014)

Review Neurosciences

Goals and Habits in the Brain

Ray J. Dolan et al.

NEURON (2013)

Article Psychology, Clinical

Mild Uncertainty Promotes Checking Behavior in Subclinical Obsessive-Compulsive Disorder

Marieke B. J. Toffolo et al.

CLINICAL PSYCHOLOGICAL SCIENCE (2013)

Review Behavioral Sciences

Computational psychiatry

P. Read Montague et al.

TRENDS IN COGNITIVE SCIENCES (2012)

Article Neurosciences

Model-Based Influences on Humans' Choices and Striatal Prediction Errors

Nathaniel D. Daw et al.

NEURON (2011)

Review Neurosciences

Functional Neuroimaging in Obsessive-Compulsive Disorder

A. Del Casale et al.

NEUROPSYCHOBIOLOGY (2011)