English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  On the choice of a sparse prior

Kording, K., Kayser, C., & König, P. (2003). On the choice of a sparse prior. Reviews in the Neurosciences, 14(1-2), 53-62. doi:10.1515/REVNEURO.2003.14.1-2.53.

Item is

Files

show Files

Creators

show
hide
 Creators:
Kording, KP, Author
Kayser, C1, Author              
König, P, Author
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: An emerging paradigm analyses in what respect the properties of the nervous system reflect properties of natural scenes. It is hypothesized that neurons form sparse representations of natural stimuli: each neuron should respond strongly to some stimuli while being inactive upon presentation of most others. For a given network, sparse representations need fewest spikes, and thus the nervous system can consume the least energy. To obtain optimally sparse responses the receptive fields of simulated neurons are optimized. Algorithmically this is identical to searching for basis functions that allow coding for the stimuli with sparse coefficients. The problem is identical to maximizing the log likelihood of a generative model with prior knowledge of natural images. It is found that the resulting simulated neurons share most properties of simple cells found in primary visual cortex. Thus, forming optimally sparse representations is a very compact approach to describing simple cell properties. Many ways of defining sparse responses exist and it is widely believed that the particular choice of the sparse prior of the generative model does not significantly influence the estimated basis functions. Here we examine this assumption more closely. We include the constraint of unit variance of neuronal activity, used in most studies, into the objective functions. We then analyze learning on a database of natural (cat-cam) visual stimuli. We show that the effective objective functions are largely dominated by the constraint, and are therefore very similar. The resulting receptive fields show some similarities but also qualitative differences. Even for coefficient values for which the objective functions are dissimilar, the distributions of coefficients are similar and do not match the priors of the assumed generative model. In conclusion, the specific choice of the sparse prior is relevant, as is the choice of additional constraints, such as normalization of variance.

Details

show
hide
Language(s):
 Dates: 2003-01
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: DOI: 10.1515/REVNEURO.2003.14.1-2.53
BibTex Citekey: 2971
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Reviews in the Neurosciences
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: London, England : Freund Pub. House
Pages: - Volume / Issue: 14 (1-2) Sequence Number: - Start / End Page: 53 - 62 Identifier: ISSN: 0334-1763
CoNE: https://pure.mpg.de/cone/journals/resource/954927654884