4.7 Article

Quantum reinforcement learning during human decision-making

Journal

NATURE HUMAN BEHAVIOUR
Volume 4, Issue 3, Pages 294-307

Publisher

NATURE PORTFOLIO
DOI: 10.1038/s41562-019-0804-2

Keywords

-

Funding

  1. National Key Basic Research Programme [2016YFA0400900, 2018YFC0831101]
  2. National Natural Science Foundation of China [31471071, 31771221, 61773360, 71671115, 71874170, 71942003]
  3. Fundamental Research Funds for the Central Universities of China
  4. MURI Center for Dynamic Magneto-Optics via the Air Force Office of Scientific Research (AFOSR) [FA9550-14-1-0040]
  5. Army Research Office (ARO) [W911NF-18-1-0358]
  6. Asian Office of Aerospace Research and Development (AOARD) [FA2386-18-1-4045]
  7. Japan Science and Technology Agency (JST
  8. via CREST grant) [JPMJCR1676]
  9. Japan Society for the Promotion of Science (JSPS
  10. JSPS-RFBR) [17-52-50023]
  11. Japan Society for the Promotion of Science (JSPS
  12. JSPS-FWO) [VS.059.18N]
  13. RIKEN-AIST Challenge Research Fund
  14. Templeton Foundation
  15. Foundational Questions Institute (FQXi)
  16. NTT PHI Laboratory
  17. Australian Research Council's Discovery Projects funding scheme [DP190101566]
  18. Alexander von Humboldt Foundation
  19. US Office of Naval Research
  20. Japan Science and Technology Agency (JST
  21. via the Q-LEAP programme)

Ask authors/readers for more resources

Li et al. show that human value-based decision-making can be modelled using the quantum reinforcement learning framework. These new models reveal the importance of the medial frontal cortex in this quantum-like decision-making process. Classical reinforcement learning (CRL) has been widely applied in neuroscience and psychology; however, quantum reinforcement learning (QRL), which shows superior performance in computer simulations, has never been empirically tested on human decision-making. Moreover, all current successful quantum models for human cognition lack connections to neuroscience. Here we studied whether QRL can properly explain value-based decision-making. We compared 2 QRL and 12 CRL models by using behavioural and functional magnetic resonance imaging data from healthy and cigarette-smoking subjects performing the Iowa Gambling Task. In all groups, the QRL models performed well when compared with the best CRL models and further revealed the representation of quantum-like internal-state-related variables in the medial frontal gyrus in both healthy subjects and smokers, suggesting that value-based decision-making can be illustrated by QRL at both the behavioural and neural levels.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available