English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Seeking summary statistics that match peripheral visual appearance using naturalistic textures generated by Deep Neural Networks

Wallis, T., Ecker, A., Gatys, L., Funke, C., Wichmann, F., & Bethge, M. (2016). Seeking summary statistics that match peripheral visual appearance using naturalistic textures generated by Deep Neural Networks. Poster presented at 16th Annual Meeting of the Vision Sciences Society (VSS 2016), St. Pete Beach, FL, USA.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/21.11116/0000-0000-7B30-0 Version Permalink: http://hdl.handle.net/21.11116/0000-0005-9B0C-0
Genre: Poster

Files

show Files

Locators

show
hide
Locator:
Link (Any fulltext)
Description:
-

Creators

show
hide
 Creators:
Wallis, TSA1, Author
Ecker, AS1, Author              
Gatys, LA1, Author
Funke, CM1, Author
Wichmann, FA1, Author              
Bethge, M1, Author              
Affiliations:
1Werner Reichardt Center for Integrative Neuroscience, Eberhard Karls Universität Tübingen, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: An important hypothesis that emerged from crowding research is that the perception of image structure in the periphery is texture-like. We investigate this hypothesis by measuring perceptual properties of a family of naturalistic textures generated using Deep Neural Networks (DNNs), a class of algorithms that can identify objects in images with near-human performance. DNNs function by stacking repeated convolutional operations in a layered feedforward hierarchy. Our group has recently shown how to generate shift-invariant textures that reproduce the statistical structure of natural images increasingly well, by matching the DNN representation at an increasing number of layers. Here, observers discriminated original photographic images from DNN-synthesised images in a spatial oddity paradigm. In this paradigm, low psychophysical performance means that the model is good at matching the appearance of the original scenes. For photographs of natural textures (a subset of the MIT VisTex dataset), discrimination performance decreased as the DNN representations were matched to higher convolutional layers. For photographs of natural scenes (containing inhomogeneous structure), discrimination performance was nearly perfect until the highest layers were matched, whereby performance declined (but never to chance). Performance was only weakly related to retinal eccentricity (from 1.5 to 10 degrees) and strongly depended on individual source images (some images were always hard, others always easy). Surprisingly, performance showed little relationship to size: within a layer-matching condition, images further from the fovea were somewhat harder to discriminate but this result was invariant to a three-fold change in image size (changed via up/down sampling). The DNN stimuli we examine here can match texture appearance but are not yet sufficient to match the peripheral appearance of inhomogeneous scenes. In the future, we can leverage the flexibility of DNN texture synthesis for testing different sets of summary statistics to further refine what information can be discarded without affecting appearance.

Details

show
hide
Language(s):
 Dates: 2016-08
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: DOI: 10.1167/16.12.230
BibTex Citekey: WallisEGFWB2016
 Degree: -

Event

show
hide
Title: 16th Annual Meeting of the Vision Sciences Society (VSS 2016)
Place of Event: St. Pete Beach, FL, USA
Start-/End Date: 2016-05-13 - 2016-05-18

Legal Case

show

Project information

show

Source 1

show
hide
Title: Journal of Vision
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Charlottesville, VA : Scholar One, Inc.
Pages: - Volume / Issue: 16 (12) Sequence Number: - Start / End Page: 230 Identifier: ISSN: 1534-7362
CoNE: https://pure.mpg.de/cone/journals/resource/111061245811050