States versus Rewards: Dissociable neural prediction error signals underlying 
model-based and model-free reinforcement learning

Gläscher, J; Daw, N; Dayan, P; O'Doherty, JP

doi:10.1016/j.neuron.2010.04.016

アイテム詳細

登録内容を編集ファイル形式で保存

一時保存へ追加

タグ情報を表示リリース履歴を表示詳細要約

公開

学術論文

States versus Rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning

MPS-Authors

There are no MPG-Authors in the publication available

External Resource

https://www.sciencedirect.com/science/article/pii/S0896627310002874
(出版社版)

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

フルテキスト (公開)

公開されているフルテキストはありません

付随資料 (公開)

There is no public supplementary material available

引用

Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. (2010). States versus Rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66(4), 585-596. doi:10.1016/j.neuron.2010.04.016.

引用: https://hdl.handle.net/21.11116/0000-0002-C7F0-E

要旨

Reinforcement learning (RL) uses sequential experience with situations (“states”) and outcomes to assess actions. Whereas model-free RL uses this experience directly, in the form of a reward prediction error (RPE), model-based RL uses it indirectly, building a model of the state transition and outcome structure of the environment, and evaluating actions by searching this model. A state prediction error (SPE) plays a central role, reporting discrepancies between the current model and the observed state transitions. Using functional magnetic resonance imaging in humans solving a probabilistic Markov decision task, we found the neural signature of an SPE in the intraparietal sulcus and lateral prefrontal cortex, in addition to the previously well-characterized RPE in the ventral striatum. This finding supports the existence of two unique forms of learning signal in humans, which may form the basis of distinct computational strategies for guiding behavior.