4.7 Article

Efficient coding of cognitive variables underlies dopamine response and choice behavior

Journal

NATURE NEUROSCIENCE
Volume 25, Issue 6, Pages 738-+

Publisher

NATURE PORTFOLIO
DOI: 10.1038/s41593-022-01085-7

Keywords

-

Categories

Funding

  1. research infrastructure Congento
  2. Lisboa Regional Operational Programme (Lisboa2020)
  3. European Regional Development Fund
  4. Fundacao para a Ciencia e Tecnologia (Portugal) [LISBOA-01-0145-FEDER-022170]
  5. Howard Hughes Medical Institute International Research Scholar Award [55008745]
  6. European Research Council Consolidator grant [DYCOCIRC - REP-772339-1]
  7. BIAL bursary for scientific research [193/2016]
  8. Champalimaud Foundation
  9. National Institutes of Health U01 grant [NS094288]
  10. Fundacao para Ciencia e Tecnologia [SFRH/BD/52214/2013]
  11. Fundação para a Ciência e a Tecnologia [SFRH/BD/52214/2013] Funding Source: FCT

Ask authors/readers for more resources

Reward expectations based on internal knowledge are important for adaptive behavior, but internal knowledge may be inaccurate. This study found that specific highly compressed internal representations can reproduce both choice behavior and dopaminergic activity during time-based decision-making in mice. These findings demonstrate how representational efficiency constraints are expressed in reward-based computations.
Reward expectations based on internal knowledge of the external environment are a core component of adaptive behavior. However, internal knowledge may be inaccurate or incomplete due to errors in sensory measurements. Some features of the environment may also be encoded inaccurately to minimize representational costs associated with their processing. In this study, we investigated how reward expectations are affected by features of internal representations by studying behavior and dopaminergic activity while mice make time-based decisions. We show that several possible representations allow a reinforcement learning agent to model animals' overall performance during the task. However, only a small subset of highly compressed representations simultaneously reproduced the co-variability in animals' choice behavior and dopaminergic activity. Strikingly, these representations predict an unusual distribution of response times that closely match animals' behavior. These results inform how constraints of representational efficiency may be expressed in encoding representations of dynamic cognitive variables used for reward-based computations. Sensory systems compress representations while preserving information. Modeling of dopamine neuron responses and behavior during decision-making indicates that cognitive systems also compress representations as long as overall rewards are preserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available