Journal
ENEURO
Volume 9, Issue 2, Pages -Publisher
SOC NEUROSCIENCE
DOI: 10.1523/ENEURO.0457-21.2022
Keywords
action selection; arousal; decision-making; decisions; mouse; value
Categories
Funding
- National Institutes of Health (NIH)/National Institute of Mental Health [R01MH112750, R01MH121848, R21MH118596]
- China Scholarship Council-Yale World Scholars Fellowship
- Gruber Science Fellowship
- NIH [T32NS007224]
- Kavli Institute for Neuroscience Postdoctoral Fellowship
Ask authors/readers for more resources
In this study, we trained head-fixed male mice to play a competitive game against a virtual computer opponent. The mice's performance was well described by a hybrid computational model that includes Q-learning and choice kernels. Comparing the competitive game with a non-competitive task, we found that they encourage different regimes of reinforcement learning. Additionally, we measured pupil size fluctuations and found that pupil responses were modulated by observable and latent variables.
In a competitive game involving an animal and an opponent, the outcome is contingent on the choices of both players. To succeed, the animal must continually adapt to competitive pressure, or else risk being exploited and lose out on rewards. In this study, we demonstrate that head-fixed male mice can be trained to play the iterative competitive game matching pennies against a virtual computer opponent. We find that the animals' performance is well described by a hybrid computational model that includes Q-learning and choice kernels. Comparing between matching pennies and a non-competitive two-armed bandit task, we show that the tasks encourage animals to operate at different regimes of reinforcement learning. To understand the involvement of neuromodulatory mechanisms, we measure fluctuations in pupil size and use multiple linear regression to relate the trial-by-trial transient pupil responses to decision-related variables. The analysis reveals that pupil responses are modulated by observable variables, including choice and outcome, as well as latent variables for value updating, but not action selection. Collectively, these results establish a paradigm for studying competitive decision-making in head-fixed mice and provide insights into the role of arousal-linked neuromodulation in the decision process.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available