4.6 Review

Reinforcement learning detuned in addiction: integrative and translational approaches

Related references

Note: Only part of the references are listed.
Article Neurosciences

Longitudinal imaging of metabotropic glutamate 5 receptors during early and extended alcohol abstinence

Ansel T. Hillmer et al.

Summary: The study aimed to measure mGlu5 receptor availability levels during early and extended alcohol abstinence using PET imaging, finding significantly higher mGlu5 receptor levels in cortical brain regions in patients with alcohol use disorder during early abstinence compared to controls.

NEUROPSYCHOPHARMACOLOGY (2021)

Article Biochemistry & Molecular Biology

Are methamphetamine users compulsive? Faulty reinforcement learning, not inflexibility, underlies decision making in people with methamphetamine use disorder

Alex H. Robinson et al.

Summary: The study found that individuals with methamphetamine use disorder exhibit weaker learning abilities in reversal tasks, suggesting deficits in reinforcement learning rather than inflexibility.

ADDICTION BIOLOGY (2021)

Article Neurosciences

Orbitofrontal State Representations Are Related to Choice Adaptations and Reward Predictions

Thomas A. Stalnaker et al.

Summary: By studying neural activity in the orbitofrontal cortex, it was found that rats can accurately predict outcomes and adapt quickly to new states. The activity of neurons in the orbitofrontal cortex is closely related to state representations and has a strong representation ability for action-outcome contingencies.

JOURNAL OF NEUROSCIENCE (2021)

Article Neurosciences

Model-Based and Model-Free Control Predicts Alcohol Consumption Developmental Trajectory in Young Adults: A 3-Year Prospective Study

Hao Chen et al.

Summary: The study found that goal-directed and habitual control at age 18 were associated with alcohol use trajectories over the course of 3 years. Results showed that goal-directed behavioral control was negatively associated with the development of binge drinking score, while reward prediction error signals were closely linked to the Alcohol Use Disorders Identification Test consumption score development.

BIOLOGICAL PSYCHIATRY (2021)

Article Neurosciences

Organization of Afferents along the Anterior-posterior and Medial-lateral Axes of the Rat Orbitofrontal Cortex

Ines Barreiros et al.

Summary: This study utilized a retrograde tracer to investigate the projections into different subdivisions of the rat orbitofrontal cortex (OFC) and found distinct connectivity patterns and strengths from various brain regions. While some regions showed a gradient in connectivity strength, others exhibited almost exclusive projections to specific OFC subdivisions. The differences in input patterns between anterior lateral (ALO) and posterior lateral (PLO) were as pronounced as those between PLO and posterior ventral (PVO).

NEUROSCIENCE (2021)

Article Neurosciences

Single Exposure to Cocaine Impairs Reinforcement Learning by Potentiating the Activity of Neurons in the Direct Striatal Pathway in Mice

Zhijun Diao et al.

Summary: Plasticity in glutamatergic synapses on striatal medium spiny neurons is crucial for behavioral adaptation and is highly susceptible to drugs of abuse. A single exposure to cocaine can disrupt reinforcement learning by impairing the potentiation required for this type of learning, possibly by potentiating the activity of direct pathway neurons in the dorsomedial striatum.

NEUROSCIENCE BULLETIN (2021)

Article Psychiatry

The role of the orbitofrontal cortex and the nucleus accumbens for craving in alcohol use disorder

Tobias Bracht et al.

Summary: This study investigated structural and functional alterations in the reward system and neurobiology of craving in alcohol use disorder. The findings indicate reduced NAcc volume, decreased structural connectivity in the OFC-NAcc pathway, and reduced resting-state OFC-NAcc functional connectivity. Additionally, craving was found to be associated with increased OFC-NAcc FC.

TRANSLATIONAL PSYCHIATRY (2021)

Article Behavioral Sciences

Computational theory-driven studies of reinforcement learning and decision-making in addiction: what have we learned?

Maelle C. M. Gueguen et al.

Summary: Computational psychiatry offers a new approach to linking addictive behaviors to cognitive and neurobiological factors, but current research is limited in capturing addiction cycles/states dynamically and focusing on only a few behavioral variables at a time. A longitudinal and multidimensional examination of value-based processes could provide a more comprehensive understanding of addiction and help in developing tailored and timely interventions.

CURRENT OPINION IN BEHAVIORAL SCIENCES (2021)

Article Clinical Neurology

Impaired Learning From Negative Feedback in Stimulant Use Disorder: Dopaminergic Modulation

Tsen Vei Lim et al.

Summary: The study revealed that SUD patients have significantly reduced learning rates from punishment compared to healthy controls, while reward learning rates were not measurably impaired. Furthermore, the dopaminergic receptor agents modulated RL parameters differently in SUD patients and healthy participants.

INTERNATIONAL JOURNAL OF NEUROPSYCHOPHARMACOLOGY (2021)

Review Pharmacology & Pharmacy

Targeting mGlu5 for Methamphetamine Use Disorder

Johannes Petzold et al.

Summary: Research suggests that modulation of the mGlu(5) receptor with allosteric modulators may offer a promising approach for ameliorating the devastating consequences of methamphetamine abuse. Further clinical research is needed to understand the mechanisms underlying these effects and develop tailored medications for Methamphetamine Use Disorder.

PHARMACOLOGY & THERAPEUTICS (2021)

Article Neurosciences

Multivariate analysis of 1.5 million people identifies genetic associations with traits related to self-regulation and addiction

Richard Karlsson Linner et al.

Summary: Research shows that persistent difficulties in self-regulation may be conceptualized as a neurodevelopmental trait with complex and far-reaching social and health correlates. By leveraging genetic correlations, over 500 genetic loci related to externalizing traits were identified, enriched for genes expressed in the brain and related to nervous system development.

NATURE NEUROSCIENCE (2021)

Article Behavioral Sciences

Unlocking the Reinforcement-Learning Circuits of the Orbitofrontal Cortex

Stephanie M. Groman et al.

Summary: Neuroimaging studies consistently suggest the involvement of the orbitofrontal cortex (OFC) in neuropsychiatric disorders, with distinct reinforcement-learning mechanisms affecting decision-making in different clinical populations. By combining analogous behavioral paradigms, reinforcement-learning algorithms, and advanced neuroscience techniques in animals, critical insights into OFC pathology in biobehavioral disorders can be gained.

BEHAVIORAL NEUROSCIENCE (2021)

Article Neurosciences

Midbrain D3 Receptor Availability Predicts Escalation in Cocaine Self-administration

Stephanie M. Groman et al.

BIOLOGICAL PSYCHIATRY (2020)

Article Biology

Paranoia as a deficit in non-social belief updating

Erin J. Reed et al.

ELIFE (2020)

Editorial Material Psychiatry

Translation of Computational Psychiatry in the Context of Addiction

Shuyan Liu et al.

JAMA PSYCHIATRY (2020)

Article Neurosciences

Reinforcement Learning during Adolescence in Rats

Neema Moin Afshar et al.

JOURNAL OF NEUROSCIENCE (2020)

Article Neurosciences

Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes

Stephanie M. Groman et al.

NEURON (2019)

Article Neurosciences

Model-Free and Model-Based Influences in Addiction-Related Behaviors

Stephanie M. Groman et al.

BIOLOGICAL PSYCHIATRY (2019)

Article Multidisciplinary Sciences

Frontal cortex neuron types categorically encode single decision variables

Junya Hirokawa et al.

NATURE (2019)

Article Psychology, Clinical

Assessing cognitive functioning in individuals with cocaine use disorder

Kirsten M. Frazer et al.

JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY (2018)

Article Neurosciences

Organization of afferents to the orbitofrontal cortex in the rat

Monika J. M. Murphy et al.

JOURNAL OF COMPARATIVE NEUROLOGY (2018)

Article Radiology, Nuclear Medicine & Medical Imaging

Glutamatergic Biomarkers for Cocaine Addiction: A Longitudinal Study Using MR Spectroscopy and mGluR5 PET in Self-Administering Rats

Bait de Laat et al.

JOURNAL OF NUCLEAR MEDICINE (2018)

Article Neurosciences

Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties

Benjamin T. Saunders et al.

NATURE NEUROSCIENCE (2018)

Article Behavioral Sciences

Orbitofrontal neurons signal reward predictions, not reward prediction errors

Thomas A. Stalnaker et al.

NEUROBIOLOGY OF LEARNING AND MEMORY (2018)

Article Neurosciences

Volatility Facilitates Value Updating in the Prefrontal Cortex

Bart Massi et al.

NEURON (2018)

Review Behavioral Sciences

Individual decision-making in the causal pathway to addiction: contributions and limitations of rodent models

Serge H. Ahmed

PHARMACOLOGY BIOCHEMISTRY AND BEHAVIOR (2018)

Review Behavioral Sciences

Stages of dysfunctional decision-making in addiction

Antonio Verdejo-Garcia et al.

PHARMACOLOGY BIOCHEMISTRY AND BEHAVIOR (2018)

Article Multidisciplinary Sciences

A neuronal mechanism underlying decision-making deficits during hyperdopaminergic states

Jeroen P. H. Verharen et al.

NATURE COMMUNICATIONS (2018)

Editorial Material Psychiatry

Explaining Delusions: Reducing Uncertainty Through Basic and Computational Neuroscience

Erin J. Feeney et al.

SCHIZOPHRENIA BULLETIN (2017)

Article Radiology, Nuclear Medicine & Medical Imaging

Microstructures in striato-thalamo-orbitofrontal circuit in methamphetamine users

Yadi Li et al.

ACTA RADIOLOGICA (2017)

Review Neurosciences

Model-Based Control in Dimensional Psychiatry

Valerie Voon et al.

BIOLOGICAL PSYCHIATRY (2017)

Article Neurosciences

Dopamine D3 Receptor Availability Is Associated with Inflexible Decision Making

Stephanie M. Groman et al.

JOURNAL OF NEUROSCIENCE (2016)

Article Neurosciences

The Medial Orbitofrontal Cortex Regulates Sensitivity to Outcome Value

Shannon L. Gourley et al.

JOURNAL OF NEUROSCIENCE (2016)

Article Multidisciplinary Sciences

Carrots and sticks fail to change behavior in cocaine addiction

Karen D. Ersche et al.

SCIENCE (2016)

Article Neurosciences

Impaired Neural Response to Negative Prediction Errors in Cocaine Addiction

Muhammad A. Parvaz et al.

JOURNAL OF NEUROSCIENCE (2015)

Article Biochemistry & Molecular Biology

Disorders of compulsivity: a common bias towards learning habits

V. Voon et al.

MOLECULAR PSYCHIATRY (2015)

Article Neurosciences

Model-Based and Model-Free Decisions in Alcohol Dependence

Miriam Sebold et al.

NEUROPSYCHOBIOLOGY (2014)

Article Psychiatry

Reduced Neural Tracking of Prediction Error in Substance-Dependent Individuals

Jody Tanabe et al.

AMERICAN JOURNAL OF PSYCHIATRY (2013)

Article Neurosciences

Basolateral Amygdala Lesions Facilitate Reward Choices after Negative Feedback in Rats

Alicia Izquierdo et al.

JOURNAL OF NEUROSCIENCE (2013)

Review Neurosciences

Decision Making: From Neuroscience to Psychiatry

Daeyeol Lee

NEURON (2013)

Article Neurosciences

Memory for Fear Extinction Requires mGluR5-Mediated Activation of Infralimbic Neurons

Darah E. Fontanez-Nuin et al.

CEREBRAL CORTEX (2011)

Article Neurosciences

Projections of the medial orbital and ventral orbital cortex in the rat

Walter B. Hoover et al.

JOURNAL OF COMPARATIVE NEUROLOGY (2011)

Article Neurosciences

Addiction related alteration in resting-state brain connectivity

Ning Ma et al.

NEUROIMAGE (2010)

Article Mathematics, Interdisciplinary Applications

Reinforcement learning in the brain

Yael Niv

JOURNAL OF MATHEMATICAL PSYCHOLOGY (2009)

Article Neurosciences

mGluR5 Has a Critical Role in Inhibitory Learning

Jian Xu et al.

JOURNAL OF NEUROSCIENCE (2009)

Review Psychology, Biological

A unified framework for addiction: Vulnerabilities in the decision process

A. David Redish et al.

BEHAVIORAL AND BRAIN SCIENCES (2008)

Review Neurosciences

Orbitofrontal cortex, decision-making and drug addiction

G Schoenbaum et al.

TRENDS IN NEUROSCIENCES (2006)

Article Multidisciplinary Sciences

Discrete coding of reward probability and uncertainty by dopamine neurons

CD Fiorillo et al.

SCIENCE (2003)