Journal
NEURON
Volume 103, Issue 3, Pages 533-+Publisher
CELL PRESS
DOI: 10.1016/j.neuron.2019.05.017
Keywords
-
Categories
Funding
- Intramural Research Program of the National Institute of Mental Health [ZIA MH002928]
- NATIONAL INSTITUTE OF MENTAL HEALTH [ZIAMH002928] Funding Source: NIH RePORTER
Ask authors/readers for more resources
The explore-exploit dilemma refers to the challenge of deciding when to forego immediate rewards and explore new opportunities that could lead to greater rewards in the future. While motivational neural circuits facilitate learning based on past choices and outcomes, it is unclear whether they also support computations relevant for deciding when to explore. We recorded neural activity in the amygdala and ventral striatum of rhesus macaques as they solved a task that required them to balance novelty-driven exploration with exploitation of what they had already learned. Using a partially observable Markov decision process (POMDP) model to quantify explore-exploit trade-offs, we identified that the ventral striatum and amygdala differ in how they represent the immediate value of exploitative choices and the future value of exploratory choices. These findings show that subcortical motivational circuits are important in guiding explore-exploit decisions.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available