English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
 
 
DownloadE-Mail
  Alterations in choice behavior by manipulations of world model

Green, C., Benson, C., Kersten, D., & Schrater, P. (2010). Alterations in choice behavior by manipulations of world model. Proceedings of the National Academy of Sciences of the United States of America, 107(37), 16401-16406. doi:10.1073/pnas.1001709107.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/11858/00-001M-0000-0013-BE44-B Version Permalink: http://hdl.handle.net/21.11116/0000-0002-6AA8-A
Genre: Journal Article

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Green, CS, Author
Benson, C, Author
Kersten, D1, 2, Author              
Schrater, P, Author
Affiliations:
1Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497797              
2Max Planck Institute for Biological Cybernetics, Max Planck Society, Spemannstrasse 38, 72076 Tübingen, DE, ou_1497794              

Content

show
hide
Free keywords: -
 Abstract: How to compute initially unknown reward values makes up one of the key problems in reinforcement learning theory, with two basic approaches being used. Model-free algorithms rely on the accumulation of substantial amounts of experience to compute the value of actions, whereas in model-based learning, the agent seeks to learn the generative process for outcomes fromwhich the value of actions can be predicted. Here we show that (i) “probability matching”— a consistent example of suboptimal choice behavior seen in humans —occurs in an optimal Bayesian model-based learner using a max decision rule that is initialized with ecologically plausible, but incorrect beliefs about the generative process for outcomes and (ii) human behavior can be strongly and predictably altered by the presence of cues suggestive of various generative processes, despite statistically identical outcome generation. These results suggest human decision making is rational and model based and not consistent with model-free learning.

Details

show
hide
Language(s):
 Dates: 2010-09
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Method: -
 Identifiers: DOI: 10.1073/pnas.1001709107
BibTex Citekey: 6752
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Proceedings of the National Academy of Sciences of the United States of America
  Other : Proc. Acad. Sci. USA
  Other : Proc. Acad. Sci. U.S.A.
  Other : Proceedings of the National Academy of Sciences of the USA
  Abbreviation : PNAS
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Washington, D.C. : National Academy of Sciences
Pages: - Volume / Issue: 107 (37) Sequence Number: - Start / End Page: 16401 - 16406 Identifier: ISSN: 0027-8424
CoNE: https://pure.mpg.de/cone/journals/resource/954925427230