English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Context-dependent decision-making: a simple Bayesian model

Lloyd, K., & Leslie, D. (2013). Context-dependent decision-making: a simple Bayesian model. Interface: Journal of the Royal Society, 10(82), 1-12. doi:10.1098/rsif.2013.0069.

Item is

Basic

show hide
Genre: Journal Article

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Lloyd, K1, Author              
Leslie, DS, Author
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: Many phenomena in animal learning can be explained by a context-learning process whereby an animal learns about different patterns of relationship between environmental variables. Differentiating between such environmental regimes or ‘contexts’ allows an animal to rapidly adapt its behaviour when context changes occur. The current work views animals as making sequential inferences about current context identity in a world assumed to be relatively stable but also capable of rapid switches to previously observed or entirely new contexts. We describe a novel decision-making model in which contexts are assumed to follow a Chinese restaurant process with inertia and full Bayesian inference is approximated by a sequential-sampling scheme in which only a single hypothesis about current context is maintained. Actions are selected via Thompson sampling, allowing uncertainty in parameters to drive exploration in a straightforward manner. The model is tested on simple two-alternative choice problems with switching reinforcement schedules and the results compared with rat behavioural data from a number of T-maze studies. The model successfully replicates a number of important behavioural effects: spontaneous recovery, the effect of partial reinforcement on extinction and reversal, the overtraining reversal effect, and serial reversal-learning effects.

Details

show
hide
Language(s):
 Dates: 2013-05
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: DOI: 10.1098/rsif.2013.0069
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Interface : Journal of the Royal Society
  Other : J. R. Soc. Interface
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: London : Royal Society
Pages: - Volume / Issue: 10 (82) Sequence Number: - Start / End Page: 1 - 12 Identifier: ISSN: 1742-5689
CoNE: https://pure.mpg.de/cone/journals/resource/1000000000018840_1