Article

Image-based reconstruction of spatially varying materials

Authors:

Hendrik P. A. Lensch,

Michael Goesele,

Wolfgang Heidrich,

Hans-Peter SeidelAuthors Info & Claims

EGWR'01: Proceedings of the 12th Eurographics conference on Rendering

Pages 103 - 114

Published: 01 June 2001 Publication History

Abstract

The measurement of accurate material properties is an important step towards photorealistic rendering. Many real-world objects are composed of a number of materials that often show subtle changes even within a single material. Thus, for photorealistic rendering both the general surface properties as well as the spatially varying effects of the object are needed.

We present an image-based measuring method that robustly detects the different materials of real objects and fits an average bidirectional reflectance distribution function (BRDF) to each of them. In order to model the local changes as well, we project the measured data for each surface point into a basis formed by the recovered BRDFs leading to a truly spatially varying BRDF representation.

A high quality model of a real object can be generated with relatively few input data. The generated model allows for rendering under arbitrary viewing and lighting conditions and realistically reproduces the appearance of the original object.

References

[1]

K. Dana, B. van Ginneken, S. Nayar, and J. Koenderink. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics, 18(1):1-34, January 1999.

[2]

P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar. Acquiring the Reflectance Field of a Human Face. In Proc. SIGGRAPH, pages 145-156, July 2000. ISBN 1-58113-208-5.

[3]

P. Debevec and J. Malik. Recovering High Dynamic Range Radiance Maps from Photographs. In Proc. SIGGRAPH, pages 369-378, August 1997.

[4]

P. Debevec, C. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proc. SIGGRAPH, pages 11-20, August 1996.

[5]

M. Garland and P. Heckbert. Surface Simplification Using Quadric Error Metrics. In Proc. SIGGRAPH, pages 209-216, August 1997.

[6]

A. Gersho and R. Gray. Vector Quantization and Signal Compression. Kluwer Acad. Publishers, 1992.

[7]

S. Gortler, R. Grzeszczuk, R. Szelinski, and M. Cohen. The Lumigraph. In Proc. SIGGRAPH, pages 43-54, August 1996.

[8]

J. Kautz and H.-P. Seidel. Towards Interactive Bump Mapping with Anisotropic Shift-Variant BRDFs. In Eurographics/SIGGRAPH Hardware Workshop, pages 51-58, August 2000.

[9]

L. Kobbelt. Discrete fairing. In Proc. of the 7th IMA Conf. on the Mathematics of Surfaces, pages 101-131, 1996.

[10]

J. Koenderink, A. van Doorn, and M. Stavridi. Bidirectional Reflection Distribution Function expressed in terms of surface scattering modes. In Proc. 4th Europ. Conf. on Computer Vision, pages 28-39, 1996.

[11]

E. Lafortune, S. Foo, K. Torrance, and D. Greenberg. Non-Linear Approximation of Reflectance Functions. In Proc. SIGGRAPH, pages 117-126, August 1997.

[12]

H. Lensch, W. Heidrich, and H.-P. Seidel. Automated Texture Registration and Stitching for Real World Models. In Pacific Graphics '00, pages 317-326, October 2000.

[13]

M. Levoy and P. Hanrahan. Light Field Rendering. In Proc. SIGGRAPH, pages 31-42, August 1996.

[14]

S. Lloyd. Least squares quantization in PCM. IEEE Trans. on Information Theory, IT-28:129-137, 1982.

[15]

R. Lu, J. Koenderink, and A. Kappers. Optical Properties (bidirectional reflectance distribution functions) of velvet. Applied Optics, 37(25):5974-5984, September 1998.

[16]

J. MacQueen. Some methods for classification and analysis of multivariate observations. In Proc. of the 5th Berkeley Symp. on Mathematical Statistics and Probability, volume 1, 1967.

[17]

S. Marschner, S. Westin, E. Lafortune, K. Torrance, and D. Greenberg. Image-based BRDF Measurement Including Human Skin. In 10th Eurographics Workshop on Rendering, pages 131-144, June 1999.

[18]

G. Miller, S. Rubin, and D. Ponceleon. Lazy decompression of surface light fields for precomputed global illumination. In 9th Eurographics Workshop on Rendering, pages 281-292, June 1998.

[19]

S. Nayar, K. Ikeuchi, and T. Kanade. Recovering Shape in the Presence of Interreflections. In IEEE Int. Conf. on Robotics and Automation, pages 1814-1819, 1991.

[20]

W. Press, S. Teukolsky, W. Vetterling, and B. Flannery. Numerical Recipes in C: The Art of Scientific Computing (2nd ed.). Cambridge University Press, 1992. ISBN 0-521-43108-5.

[21]

H. Rushmeier, G. Taubin, and A. Guéziec. Applying Shape from Lighting Variation to Bump Map Capture. In 8th Eurographics Workshop on Rendering Workshop, pages 35-44, June 1997.

[22]

Y. Sato, M. Wheeler, and K. Ikeuchi. Object Shape and Reflectance Modeling from Observation. In Proc. SIGGRAPH, pages 379-388, August 1997.

[23]

H. Schirmacher, W. Heidrich, M. Rubick, D. Schiron, and H.-P. Seidel. Image-Based BRDF Reconstruction. In Proc. of the 4th VMV Conference, pages 285-292, November 1999.

[24]

K. Torrance and E. Sparrow. Theory for off-specular reflection from roughened surfaces. Journal of Optical Society of America, 57(9), 1967.

[25]

G. Ward Larson. Measuring and Modeling Anisotropic Reflection. In Proc. SIGGRAPH, pages 265-272, July 1992.

[26]

S. Westin, J. Arvo, and K. Torrance. Predicting Reflectance Functions From Complex Surfaces. In Proc. SIGGRAPH, pages 255-264, July 1992.

[27]

D. Wood, D. Azuma, K. Aldinger, B. Curless, T. Duchamp, D. Salesin, and W. Stuetzle. Surface Light Fields for 3D Photography. In Proc. SIGGRAPH, pages 287-296, July 2000.

[28]

Y. Yu, P. Debevec, J. Malik, and T. Hawkins. Inverse Global Illumination: Recovering Reflectance Models of Real Scenes From Photographs. In Proc. SIGGRAPH, pages 215-224, August 1999.

[29]

Z. Zhang. Flexible Camera Calibration By Viewing a Plane From Unknown Orientations. In Int. Conf. on Computer Vision, pages 666-673, September 1999.

Cited By

Boss MEngelhardt AKar ALi YSun DBarron JLensch HJampani VKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)SAMURAIProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602184(26389-26403)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602184
Boss MJampani VBraun RLiu CBarron JLensch HRanzato MBeygelzimer ADauphin YLiang PVaughan J(2021)Neural-PILProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541079(10691-10704)Online publication date: 6-Dec-2021
https://dl.acm.org/doi/10.5555/3540261.3541079
Mylo MGiesel MZaidi QHullin MKlein RHullin MKlein RSchultz TYao A(2017)Appearance bendingProceedings of the conference on Vision, Modeling and Visualization10.2312/vmv.20171254(9-16)Online publication date: 25-Sep-2017
https://dl.acm.org/doi/10.2312/vmv.20171254
Show More Cited By

Index Terms

Image-based reconstruction of spatially varying materials
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
    2. Shape modeling

Index terms have been assigned to the content through auto-classification.

Recommendations

Image-based reconstruction of spatial appearance and geometric detail

Real-world objects are usually composed of a number of different materials that often show subtle changes even within a single material. Photorealistic rendering of such objects requires accurate measurements of the reflection properties of each ...
Spatially varying image based lighting by light probe sequences: Capture, processing and rendering
Abstract
We present a novel technique for capturing spatially or temporally resolved light probe sequences, and using them for image based lighting. For this purpose we have designed and built a real-time light probe, a catadioptric imaging system that can ...
All-frequency rendering of dynamic, spatially-varying reflectance
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

We describe a technique for real-time rendering of dynamic, spatially-varying BRDFs in static scenes with all-frequency shadows from environmental and point lights. The 6D SVBRDF is represented with a general microfacet model and spherical lobes fit to ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

EGWR'01: Proceedings of the 12th Eurographics conference on Rendering

June 2001

321 pages

ISBN:3211837094

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 01 June 2001

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Boss MEngelhardt AKar ALi YSun DBarron JLensch HJampani VKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)SAMURAIProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602184(26389-26403)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602184
Boss MJampani VBraun RLiu CBarron JLensch HRanzato MBeygelzimer ADauphin YLiang PVaughan J(2021)Neural-PILProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541079(10691-10704)Online publication date: 6-Dec-2021
https://dl.acm.org/doi/10.5555/3540261.3541079
Mylo MGiesel MZaidi QHullin MKlein RHullin MKlein RSchultz TYao A(2017)Appearance bendingProceedings of the conference on Vision, Modeling and Visualization10.2312/vmv.20171254(9-16)Online publication date: 25-Sep-2017
https://dl.acm.org/doi/10.2312/vmv.20171254
Coutinho DMarroquim RDellepiane MScopigno R(2017)Assisted color acquisition for 3D modelsComputers and Graphics10.1016/j.cag.2017.08.01168:C(119-128)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1016/j.cag.2017.08.011
Aittala MWeyrich TLehtinen J(2015)Two-shot SVBRDF capture for stationary materialsACM Transactions on Graphics10.1145/276696734:4(1-13)Online publication date: 27-Jul-2015
https://dl.acm.org/doi/10.1145/2766967
Feng JXiao WZhou BChen BSharf A(2013)Image-pair-based anisotropic material modelingSIGGRAPH Asia 2013 Technical Briefs10.1145/2542355.2542376(1-4)Online publication date: 19-Nov-2013
https://dl.acm.org/doi/10.1145/2542355.2542376
Zickler TRamamoorthi REnrique SBelhumeur P(2006)Reflectance SharingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2006.17028:8(1287-1302)Online publication date: 1-Aug-2006
https://dl.acm.org/doi/10.1109/TPAMI.2006.170

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents