Journal
COGNITIVE BRAIN RESEARCH
Volume 22, Issue 1, Pages 45-58Publisher
ELSEVIER SCIENCE BV
DOI: 10.1016/j.cogbrainres.2004.07.007
Keywords
game theory; mixed strategy; motivation; prefrontal cortex; reward; zero-sum game
Funding
- NEI NIH HHS [P30-EY001319] Funding Source: Medline
- NINDS NIH HHS [R01-NS044270] Funding Source: Medline
Ask authors/readers for more resources
Animals living in a dynamic environment must adjust their decision-making strategies through experience. To gain insights into the neural basis of such adaptive decision-making processes, we trained monkeys to play a competitive game against a computer in an oculomotor free-choice task. The animal selected one of two visual targets in each trial and was rewarded only when it selected the same target as the computer opponent. To determine how the animal's decision-making strategy can be affected by the opponent's strategy, the computer opponent was programmed with three different algorithms that exploited different aspects of the animal's choice and reward history. When the computer selected its targets randomly with equal probabilities, animals selected one of the targets more often, violating the prediction of probability matching, and their choices were systematically influenced by the choice history of the two players. When the computer exploited only the animal's choice history but not its reward history, animal's choice became more independent of its own choice history but was still related to the choice history of the opponent. This bias was substantially reduced, but not completely eliminated, when the computer used the choice history of both players in making its predictions. These biases were consistent with the predictions of reinforcement learning, suggesting that the animals sought optimal decision-making strategies using reinforcement learning algorithms. (C) 2004 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available