English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Talk

Polar Exploration

MPS-Authors
There are no MPG-Authors available
Fulltext (public)
There are no public fulltexts available
Supplementary Material (public)
There is no public supplementary material available
Citation

Dayan, P. (2011). Polar Exploration. Talk presented at Exploration and Curiosity in Robot Learning and Inference (Dagstuhl Seminar 11131). Dagstuhl, Germany. 2011-03-27 - 2011-04-01. doi:10.4230/DagRep.1.3.67.


Cite as: http://hdl.handle.net/21.11116/0000-0004-7EA4-6
Abstract
I will discuss the exploratory and exploitative behavior of human subjects in a four-armed restless bandit task. Despite our best analytical efforts, we could find no evidence that subjects awarded exploration bonuses to options they hadn’t tried for a while. Instead, their exploratory behaviour was well-captured by a form of softmax choice in a conventional reinforcement learning model. Fronto-polar cortex, a large and poorly understood area of the human brain, was specifically activated on trials that this model classified as exploratory, to a degree that depended on the requirement for cognitive control associated with those trials.