4.5 Review

Instrumental vigour in punishment and reward

Journal

EUROPEAN JOURNAL OF NEUROSCIENCE
Volume 35, Issue 7, Pages 1152-1168

Publisher

WILEY
DOI: 10.1111/j.1460-9568.2012.08026.x

Keywords

dopamine; reinforcement learning; safety; serotonin; two-factor theory

Categories

Funding

  1. Gatsby Charitable Foundation

Ask authors/readers for more resources

Recent notions about the vigour of responding in operant conditioning suggest that the long-run average rate of reward should control the alacrity of action in cases in which the actual cost of speed is balanced against the opportunity cost of sloth. The average reward rate is suggested as being reported by tonic activity in the dopamine system and thereby influencing all actions, including ones that do not themselves lead directly to the rewards. This idea is syntactically problematical for the case of punishment. Here, we broaden the scope of the original suggestion, providing a two-factor analysis of obviated punishment in a variety of operant circumstances. We also consider the effects of stochastically successful actions, which turn out to differ rather markedly between appetitive and aversive cases. Finally, we study how to fit these ideas into nascent treatments that extend concepts of opponency between dopamine and serotonin from valence to invigoration.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available