English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  LIME: Live Intrinsic Material Estimation

Meka, A., Maximov, M., Zollhöfer, M., Chatterjee, A., Seidel, H.-P., Richardt, C., et al. (2018). LIME: Live Intrinsic Material Estimation. Retrieved from http://arxiv.org/abs/1801.01075.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/21.11116/0000-0001-40D9-2 Version Permalink: http://hdl.handle.net/21.11116/0000-0001-40E7-2
Genre: Paper
Latex : LIME: {L}ive Intrinsic Material Estimation

Files

show Files
hide Files
:
arXiv:1801.01075.pdf (Preprint), 8MB
Name:
arXiv:1801.01075.pdf
Description:
File downloaded from arXiv at 2018-05-07 11:27 Spotlight paper in CVPR 2018
Visibility:
Public
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
-
Copyright Info:
-

Locators

show

Creators

show
hide
 Creators:
Meka, Abhimitra1, Author              
Maximov, Maxim2, Author              
Zollhöfer, Michael1, Author              
Chatterjee, Avishek1, Author              
Seidel, Hans-Peter1, Author              
Richardt, Christian3, Author              
Theobalt, Christian1, Author              
Affiliations:
1Computer Graphics, MPI for Informatics, Max Planck Society, ou_40047              
2D2 External, ou_persistent22              
3External Organizations, ou_persistent22              

Content

show
hide
Free keywords: Computer Science, Computer Vision and Pattern Recognition, cs.CV
 Abstract: We present the first end to end approach for real time material estimation for general object shapes with uniform material that only requires a single color image as input. In addition to Lambertian surface properties, our approach fully automatically computes the specular albedo, material shininess, and a foreground segmentation. We tackle this challenging and ill posed inverse rendering problem using recent advances in image to image translation techniques based on deep convolutional encoder decoder architectures. The underlying core representations of our approach are specular shading, diffuse shading and mirror images, which allow to learn the effective and accurate separation of diffuse and specular albedo. In addition, we propose a novel highly efficient perceptual rendering loss that mimics real world image formation and obtains intermediate results even during run time. The estimation of material parameters at real time frame rates enables exciting mixed reality applications, such as seamless illumination consistent integration of virtual objects into real world scenes, and virtual material cloning. We demonstrate our approach in a live setup, compare it to the state of the art, and demonstrate its effectiveness through quantitative and qualitative evaluation.

Details

show
hide
Language(s):
 Dates: 2018-01-032018-05-042018
 Publication Status: Published online
 Pages: 17 p.
 Publishing info: -
 Table of Contents: -
 Rev. Method: -
 Identifiers: arXiv: 1801.01075
URI: http://arxiv.org/abs/1801.01075
BibTex Citekey: Meka_arXiv1801.01075
 Degree: -

Event

show

Legal Case

show

Project information

show

Source

show