English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
 
 
DownloadE-Mail
 Local TagsRelease HistoryDetailsSummary
  A simple algorithm that discovers efficient perceptual codes

Frey, B., Dayan, P., & Hinton, G. (1997). A simple algorithm that discovers efficient perceptual codes. Computational and Psychophysical Mechanisms of Visual Coding, 296-315.

Item is

 

show all hide all

Basic

show hide
Item Permalink: https://hdl.handle.net/21.11116/0000-0007-55A3-1 Version Permalink: https://hdl.handle.net/21.11116/0000-0007-55A4-0
Genre: Journal Article

Files

show Files

Locators

show
hide
Locator:
https://www.cs.toronto.edu/~hinton/absps/percepts.pdf (Any fulltext)
Description:
-
OA-Status:

Creators

show
hide
 Creators:
Frey, BJ, Author
Dayan, P1, Author           
Hinton, GE, Author
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: We describe the 'wake-sleep' algorithm that allows a multilayer, unsupervised, neural network to build a hierarchy of representations of sensory input. The network has bottom-up 'recognition' connections that are used to convert sensory input into underlying representations. Unlike most artificial neural networks, it also has top-down 'generative' connections that can be used to reconstruct the sensory input from the representations. In the 'wake' phase of the learning algorithm, the network is driven by the bottom-up recognition connections and the top-down generative connections are trained to be better at reconstructing the sensory input from the representation chosen by the recognition process. In the 'sleep' phase, the network is driven top-down by the generative connections to produce a fantasized representation and a fantasized sensory input. The recognition connections are then trained to be better at recovering the fantasized representation from the fantasized sensory input. In both phases, the synaptic learning rule is simple and local. The combined effect of the two phases is to create representations of the sensory input that are efficient in the following sense: On average, it takes more bits to describe each sensory input vector directly than to first describe the representation of the sensory input chosen by the recognition process and then describe the difference between the sensory input and its reconstruction from the chosen representation.

Details

show
hide
Language(s):
 Dates: 1997-09
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: -
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Computational and Psychophysical Mechanisms of Visual Coding
Source Genre: Book
 Creator(s):
Jenkin, M, Editor
Harris, L, Editor
Affiliations:
-
Publ. Info: Cambridge, UK : Cambridge University Press
Pages: 361 Volume / Issue: - Sequence Number: - Start / End Page: 296 - 315 Identifier: ISBN: 0-521-57104-9