Journal
NATURE
Volume 525, Issue 7568, Pages 243-+Publisher
NATURE PUBLISHING GROUP
DOI: 10.1038/nature14855
Keywords
-
Categories
Funding
- Sackler Fellowship in Psychobiology
- National Institutes of Health [T32GM007753, F30MH100729, R01MH095953, R01MH101207]
Ask authors/readers for more resources
Dopamine neurons are thought to facilitate learning by comparing actual and expected reward(1,2). Despite two decades of investigation, little is known about how this comparison is made. To determine how dopamine neurons calculate prediction error, we combined optogenetic manipulations with extracellular recordings in the ventral tegmental area while mice engaged in classical conditioning. Here we demonstrate, by manipulating the temporal expectation of reward, that dopamine neurons perform subtraction, a computation that is ideal for reinforcement learning but rarely observed in the brain. Furthermore, selectively exciting and inhibiting neighbouring GABA (c-aminobutyric acid) neurons in the ventral tegmental area reveals that these neurons are a source of subtraction: they inhibit dopamine neurons when reward is expected, causally contributing to prediction-error calculations. Finally, bilaterally stimulating ventral tegmental area GABA neurons dramatically reduces anticipatory licking to conditioned odours, consistent with an important role for these neurons in reinforcement learning. Together, our results uncover the arithmetic and local circuitry underlying dopamine prediction errors.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available