4.8 Article

Efficiency and prioritization of inference-based credit assignment

期刊

CURRENT BIOLOGY
卷 31, 期 13, 页码 2747-+

出版社

CELL PRESS
DOI: 10.1016/j.cub.2021.03.091

关键词

-

资金

  1. Max Planck Society, Munich, Germany [647070403019]
  2. Wellcome Trust [098362/Z/12/Z]
  3. Max Planck Society
  4. Alexander von Humboldt Foundation

向作者/读者索取更多资源

The study explores how inference affects state-value updates in a task, finding that the need for inference reduces state-value updates. Interestingly, this reduction in credit assignment is selective for the observed outcome alone, contrary to normative theories.
Organisms adapt to their environments by learning to approach states that predict rewards and avoid states associated with punishments. Knowledge about the affective value of states often relies on credit assignment (CA), whereby state values are updated on the basis of reward feedback. Remarkably, humans assign credit to states that are not observed but are instead inferred based on a cognitive map that represents structural knowledge of an environment. A pertinent example is authors attempting to infer the identity of anonymous reviewers to assign them credit or blame and, on this basis, inform future referee recommendations. Although inference is cognitively costly, it is unknown how it influences CA or how it is apportioned between hidden and observable states (for example, both anonymous and revealed reviewers). We addressed these questions in a task that provided choices between lotteries where each led to a unique pair of occasionally rewarding outcome states. On some trials, both states were observable (rendering inference nugatory), whereas on others, the identity of one of the states was concealed. Importantly, by exploiting knowledge of choice-state associations, subjects could infer the identity of this hidden state. We show that having to perform inference reduces state-value updates. Strikingly, and in violation of normative theories, this reduction in CA was selective for the observed outcome alone. These findings have implications for the operation of putative cognitive maps.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.8
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据