English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  How fast to work: response vigor, motivation and tonic dopamine

Niv, Y., Daw, N., & Dayan, P. (2006). How fast to work: response vigor, motivation and tonic dopamine. In Y. Weiss, B. Schölkopf, & J. Platt (Eds.), Advances in Neural Information Processing Systems 18: Proceedings of the 2005 Conference (pp. 1019-1026). Cambridge, MA, USA: MIT Press.

Item is

Basic

show hide
Genre: Conference Paper

Files

show Files

Creators

show
hide
 Creators:
Niv, Y, Author
Daw, ND, Author
Dayan, P1, Author              
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: Reinforcement learning models have long promised to unify computational, psychological and neural accounts of appetitively conditioned behavior. However, the bulk of data on animal conditioning comes from free-operant experiments measuring how fast animals will work for reinforcement. Existing reinforcement learning (RL) models are silent about these tasks, because they lack any notion of vigor. They thus fail to address the simple observation that hungrier animals will work harder for food, as well as stranger facts such as their sometimes greater productivity even when working for irrelevant outcomes such as water. Here, we develop an RL framework for free-operant behavior, suggesting that subjects choose how vigorously to perform selected actions by optimally balancing the costs and benefits of quick responding. Motivational states such as hunger shift these factors, skewing the tradeoff. This accounts normatively for the effects of motivation on response rates, as well as many other classic findings. Finally, we suggest that tonic levels of dopamine may be involved in the computation linking motivational state to optimal responding, thereby explaining the complex vigor-related effects of pharmacological manipulation of dopamine.

Details

show
hide
Language(s):
 Dates: 2006-05
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: -
 Degree: -

Event

show
hide
Title: Nineteenth Annual Conference on Neural Information Processing Systems (NIPS 2005)
Place of Event: Vancouver, BC, Canada
Start-/End Date: 2005-12-05 - 2005-12-08

Legal Case

show

Project information

show

Source 1

show
hide
Title: Advances in Neural Information Processing Systems 18: Proceedings of the 2005 Conference
Source Genre: Proceedings
 Creator(s):
Weiss, Y, Editor
Schölkopf, B1, Editor            
Platt, J, Editor
Affiliations:
1 Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497794            
Publ. Info: Cambridge, MA, USA : MIT Press
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 1019 - 1026 Identifier: ISBN: 0-262-23253-7