English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  A Reward-Maximizing Spiking Neuron as a Bounded Rational Decision Maker

Leibfried, F., & Braun, D. (2015). A Reward-Maximizing Spiking Neuron as a Bounded Rational Decision Maker. Neural Computation, 27(8), 1686-1720. doi:10.1162/NECO_a_00758.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/11858/00-001M-0000-002A-4545-A Version Permalink: http://hdl.handle.net/21.11116/0000-0000-B663-3
Genre: Journal Article

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Leibfried, F1, Author              
Braun, DA1, 2, Author              
Affiliations:
1Research Group Sensorimotor Learning and Decision-Making, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497809              
2Research Group Sensorimotor Learning and Decision-making, Max Planck Institute for Intelligent Systems, Max Planck Society, ou_1688138              

Content

show
hide
Free keywords: -
 Abstract: Rate distortion theory describes how to communicate relevant information most efficiently over a channel with limited capacity. One of the many applications of rate distortion theory is bounded rational decision making, where decision makers are modeled as information channels that transform sensory input into motor output under the constraint that their channel capacity is limited. Such a bounded rational decision maker can be thought to optimize an objective function that trades off the decision maker's utility or cumulative reward against the information processing cost measured by the mutual information between sensory input and motor output. In this study, we interpret a spiking neuron as a bounded rational decision maker that aims to maximize its expected reward under the computational constraint that the mutual information between the neuron's input and output is upper bounded. This abstract computational constraint translates into a penalization of the deviation between the neuron's instantaneous and average firing behavior. We derive a synaptic weight update rule for such a rate distortion optimizing neuron and show in simulations that the neuron efficiently extracts reward-relevant information from the input by trading off its synaptic strengths against the collected reward.

Details

show
hide
Language(s):
 Dates: 2015-07
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Method: -
 Identifiers: DOI: 10.1162/NECO_a_00758
BibTex Citekey: LeibfriedB2015
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Neural Computation
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: -
Pages: - Volume / Issue: 27 (8) Sequence Number: - Start / End Page: 1686 - 1720 Identifier: -