Deutsch
 
Hilfe Datenschutzhinweis Impressum
  DetailsucheBrowse

Datensatz

DATENSATZ AKTIONENEXPORT
  Bounded Rational Decision-Making in Feedforward Neural Networks

Leibfried, F., & Braun, D. (2016). Bounded Rational Decision-Making in Feedforward Neural Networks. In A. Ihler, & D. Janzing (Eds.), Uncertainty in Artificial Intelligence (pp. 407-416). Corvallis, OR, USA: AUAI Press.

Item is

Basisdaten

einblenden: ausblenden:
Genre: Konferenzbeitrag

Externe Referenzen

einblenden:
ausblenden:
externe Referenz:
Link (beliebiger Volltext)
Beschreibung:
-
OA-Status:

Urheber

einblenden:
ausblenden:
 Urheber:
Leibfried, F1, 2, Autor           
Braun, D1, 2, 3, Autor           
Affiliations:
1Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497794              
2Research Group Sensorimotor Learning and Decision-Making, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497809              
3Research Group Sensorimotor Learning and Decision-making, Max Planck Institute for Intelligent Systems, Max Planck Society, ou_1688138              

Inhalt

einblenden:
ausblenden:
Schlagwörter: -
 Zusammenfassung: Bounded rational decision-makers transform sensory input into motor output under limited computational resources. Mathematically, such decision-makers can be modeled as information-theoretic channels with limited transmission rate. Here, we apply this formalism for the first time to multilayer feedforward neural networks. We derive synaptic weight update rules for two scenarios, where either each neuron is considered as a bounded rational decision-maker or the network as a whole. In the update rules, bounded rationality translates into information-theoretically motivated types of regularization in weight space. In experiments on the MNIST benchmark classification task for handwritten digits, we show that such information-theoretic regularization successfully prevents overfitting across different architectures and attains results that are competitive with other recent techniques like dropout, dropconnect and Bayes by backprop, for both ordinary and convolutional neural networks.

Details

einblenden:
ausblenden:
Sprache(n):
 Datum: 2016-06
 Publikationsstatus: Erschienen
 Seiten: -
 Ort, Verlag, Ausgabe: -
 Inhaltsverzeichnis: -
 Art der Begutachtung: -
 Identifikatoren: BibTex Citekey: LeibfriedB2016
 Art des Abschluß: -

Veranstaltung

einblenden:
ausblenden:
Titel: 32nd Conference on Uncertainty in Artificial Intelligence (UAI 2016)
Veranstaltungsort: New York, NY, USA
Start-/Enddatum: -

Entscheidung

einblenden:

Projektinformation

einblenden:

Quelle 1

einblenden:
ausblenden:
Titel: Uncertainty in Artificial Intelligence
Genre der Quelle: Konferenzband
 Urheber:
Ihler , A., Herausgeber
Janzing, D., Herausgeber
Affiliations:
-
Ort, Verlag, Ausgabe: Corvallis, OR, USA : AUAI Press
Seiten: - Band / Heft: - Artikelnummer: - Start- / Endseite: 407 - 416 Identifikator: ISBN: 978-0-9966431-1-5