English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Learning to use working memory: a reinforcement learning gating model of rule acquisition in rats

Lloyd, K., Becker, N., Jones, M., & Bogacz, R. (2012). Learning to use working memory: a reinforcement learning gating model of rule acquisition in rats. Frontiers in Computational Neuroscience, 6: 87, pp. 1-10. doi:10.3389/fncom.2012.00087.

Item is

Basic

show hide
Genre: Journal Article

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Lloyd, K1, Author              
Becker, N, Author
Jones, MW, Author
Bogacz, R, Author
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: Learning to form appropriate, task-relevant working memory representations is a complex process central to cognition. Gating models frame working memory as a collection of past observations and use reinforcement learning (RL) to solve the problem of when to update these observations. Investigation of how gating models relate to brain and behavior remains, however, at an early stage. The current study sought to explore the ability of simple RL gating models to replicate rule learning behavior in rats. Rats were trained in a maze-based spatial learning task that required animals to make trial-by-trial choices contingent upon their previous experience. Using an abstract version of this task, we tested the ability of two gating algorithms, one based on the Actor-Critic and the other on the State-Action-Reward-State-Action (SARSA) algorithm, to generate behavior consistent with the rats'. Both models produced rule-acquisition behavior consistent with the experimental data, though only the SARSA gating model mirrored faster learning following rule reversal. We also found that both gating models learned multiple strategies in solving the initial task, a property which highlights the multi-agent nature of such models and which is of importance in considering the neural basis of individual differences in behavior.

Details

show
hide
Language(s):
 Dates: 2012-10
 Publication Status: Published online
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: DOI: 10.3389/fncom.2012.00087
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Frontiers in Computational Neuroscience
  Abbreviation : Front Comput Neurosci
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Lausanne : Frontiers Research Foundation
Pages: - Volume / Issue: 6 Sequence Number: 87 Start / End Page: 1 - 10 Identifier: Other: 1662-5188
CoNE: https://pure.mpg.de/cone/journals/resource/1662-5188