Journal
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
Volume 104, Issue 22, Pages 9493-9498Publisher
NATL ACAD SCIENCES
DOI: 10.1073/pnas.0608842104
Keywords
counterfactual signals; decision-making; neuroeconomics; reinforcement learning
Categories
Funding
- NIDA NIH HHS [DA 11723, R01 DA011723] Funding Source: Medline
- NINDS NIH HHS [NS 045790, R01 NS045790] Funding Source: Medline
Ask authors/readers for more resources
Reinforcement learning models now provide principled guides for a wide range of reward learning experiments in animals and humans. One key learning (error) signal in these models is experiential and reports ongoing temporal differences between expected and experienced reward. However, these same abstract learning models also accommodate the existence of another class of learning signal that takes the form of a fictive error encoding ongoing differences between experienced returns and returns that could-have-been-experienced if decisions had been different. These observations suggest the hypothesis that, for all real-world learning tasks, one should expect the presence of both experiential and fictive learning signals. Motivated by this possibility, we used a sequential investment game and fMRI to probe ongoing brain responses to both experiential and fictive learning signals generated throughout the game. Using a large cohort of subjects (n = 54), we report that fictive learning signals strongly predict changes in subjects' investment behavior and correlate with fMRI signals measured in dopaminoceptive structures known to be involved in valuation and choice.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available