Journal
ELIFE
Volume 4, Issue -, Pages -Publisher
ELIFE SCIENCES PUBLICATIONS LTD
DOI: 10.7554/eLife.12029
Keywords
-
Categories
Funding
- National Science Foundation [1460604]
- National Institutes of Health [R01 MH080066-01]
- Division Of Behavioral and Cognitive Sci
- Direct For Social, Behav & Economic Scie [1460604] Funding Source: National Science Foundation
Ask authors/readers for more resources
Convergent evidence suggests that the basal ganglia support reinforcement learning by adjusting action values according to reward prediction errors. However, adaptive behavior in stochastic environments requires the consideration of uncertainty to dynamically adjust the learning rate. We consider how cholinergic tonically active interneurons (TANs) may endow the striatum with such a mechanism in computational models spanning three Marr's levels of analysis. In the neural model, TANs modulate the excitability of spiny neurons, their population response to reinforcement, and hence the effective learning rate. Long TAN pauses facilitated robustness to spurious outcomes by increasing divergence in synaptic weights between neurons coding for alternative action values, whereas short TAN pauses facilitated stochastic behavior but increased responsiveness to change-points in outcome contingencies. A feedback control system allowed TAN pauses to be dynamically modulated by uncertainty across the spiny neuron population, allowing the system to self-tune and optimize performance across stochastic environments.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available