English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  How image statistics drive shape-from-texture and shape-from-specularity

Fleming, R., Torralba, A., Dror, R., & Adelson, E. (2003). How image statistics drive shape-from-texture and shape-from-specularity. Poster presented at Third Annual Meeting of the Vision Sciences Society (VSS 2003), Sarasota, FL, USA.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/11858/00-001M-0000-0013-DB69-F Version Permalink: http://hdl.handle.net/21.11116/0000-0005-770B-A
Genre: Poster

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Fleming, RW1, Author              
Torralba , A, Author
Dror, RO, Author
Adelson, EH, Author
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: We present a new visual cue that allows the visual system to solve two key perceptual problems under a large range of circumstances. The first problem is our ability to distinguish specular reflections from texture markings. The second problem is the estimation of 3D object shape from monocular images. Textures and specular reflections both lead to stochastic patterns in images. How can we tell them apart? Recently we have argued that textures and reflections have different statistical properties (e.g. specular reflections of the real world have heavily skewed pixel histograms). However, there is an additional cue, which results from the way that patterns are distorted by 3D shape. As a textured plane is oriented away from frontoparallel, the image of the texture becomes compressed. This provides a cue for 3D shape: if the visual system can measure the compression of the texture at each image location, it can recover local orientation and thus shape. We argue that specular reflections can be treated a bit like textures, because they also lead to stochastic image patterns with well-conserved statistics. When the world is reflected in a specular surface, the reflection is distorted by the shape of the object. The pattern of distortion is a function of the 3D shape, just as it is with textures. Crucially, however, for specularities the compression is a function of surface curvature as well as orientation. Hence, the mapping from image compression to 3D shape follows different rules for specular vs. textured surfaces. We call the pattern of compressions across an image the ‘texture trajectory’. Texture trajectories can allow the visual system to distinguish specular reflections from textures, and to estimate 3D shape for both textured and specular objects. The texture trajectory cue is weakest for spheres and planes, and strongest for objects with very different surface curvatures in orthogonal directions (e.g. cylinders). We exploit this to generate some powerful demos.

Details

show
hide
Language(s):
 Dates: 2003-10
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: DOI: 10.1167/3.9.73
BibTex Citekey: 2560
 Degree: -

Event

show
hide
Title: Third Annual Meeting of the Vision Sciences Society (VSS 2003)
Place of Event: Sarasota, FL, USA
Start-/End Date: 2003-05-09 - 2003-05-14

Legal Case

show

Project information

show

Source 1

show
hide
Title: Journal of Vision
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Charlottesville, VA : Scholar One, Inc.
Pages: - Volume / Issue: 3 (9) Sequence Number: - Start / End Page: 73 Identifier: ISSN: 1534-7362
CoNE: https://pure.mpg.de/cone/journals/resource/111061245811050