Article

Wavelet environment matting

Authors:

Philip DutréAuthors Info & Claims

EGRW '03: Proceedings of the 14th Eurographics workshop on Rendering

Pages 157 - 166

Published: 25 June 2003 Publication History

Abstract

In this paper we present a novel approach for capturing the environment matte of a scene. We impose no restrictions on material properties of the objects in the captured scene and exploit scene characteristics (e.g. material properties and self-shadowing) to minimize recording time and to bound the error. Using a CRT monitor, wavelet patterns are emitted onto the scene in order of importance to efficiently construct the environment matte. This order of importance is obtained by means of a feedback loop that takes advantage of the knowledge learned from previously recorded photographs. Once the recording process is finished, new backdrops can be efficiently placed behind the scene.

References

[1]

Yung-Yu Chuang, Douglas E. Zongker, Joel Hindorff, Brian Curless, David H. Salesin, and Richard Szeliski. Environment matting extensions: Towards higher accuracy and real-time capture. In Kurt Akeley, editor, SIG-GRAPH 2000, Computer Graphics Proceedings, Annual Conference Series. Addison Wesley, 2000.

Digital Library

[2]

Brian Curless and Marc Levoy. Better optical triangulation through spacetime analysis. In IEEE International Conference on Computer Vision, pages 987--994, 1995.

Digital Library

[3]

Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, and Mark Sagar. Acquiring the reflectance field of a human face. In Kurt Akeley, editor, SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, pages 145--156. ACM SIGGRAPH, Addison Wesley, July 2000.

Digital Library

[4]

Paul Debevec and Jitendra Malik. Recovering high dynamic range radiance maps from photographs. In Turner Whitted, editor, SIGGRAPH 97, Conference Graphics Proceedings, Annual Conference Series, pages 369--378. ACM SIGGRAPH, Addison Wesley, August 1997.

Digital Library

[5]

Ronald A. DeVore, Bjorn Jawerth, and Bradley J. Lucier. Image compression through wavelet transform coding. IEEE Transactions on Information Theory, 38(2):719--746, 1992.

Digital Library

[6]

Tim Hawkins, Jonathan Cohen, and Paul Debevec. A photometric approach to digitizing cultural artifacts. In In 2nd International Symposium on Virtual Reality, Archaeology, and Cultural Heritage, Glyfada, Greece, November 2001., 2001.

Digital Library

[7]

Takeo Kanade, Andrew Gruss, and L. Carley. A very fast vlsi range finder. In IEEE International Conference on Robotics and Automation, pages 1322--1329, 1991.

[8]

Vincent Masselus, Philip Dutré, and Frederik Anrys. The free-form light stage. In Rendering Techniques EG 2002, Annual Conference Series. EG, 2002.

Digital Library

[9]

Wojciech Matusik, Hanspeter P ster, Addy Ngan, Paul Beardsley, Remo Ziegler, and Leonard McMillan. Image-based 3D photography using opacity hulls. In SIGGRAPH 2002 Conference Proceedings, Annual Conference Series, pages 427--437. ACM SIGGRAPH, 2002.

Digital Library

[10]

Wojciech Matusik, Hanspeter P ster, Remo Ziegler, Addy Ngan, and Leonard McMillan. Acquisition and rendering of transparant and refractive objects. In Rendering Techniques EG 2002, Annual Conference Series. EG, 2002.

Digital Library

[11]

Jeffry Nimeroff, Eero Simoncelli, and Julie Dorsey. Efficient re-rendering of naturally illuminated environments. In Eurographics Rendering Workshop 1994, Darmstadt, Germany, June 1994. EG, Springer-Verlag.

[12]

Thomas Porter and Tom Duff. Compositing digital images. In Hank Christiansen, editor, Computer Graphics (SIGGRAPH '84 Proceedings), volume 18, pages 253--259, July 1984.

Digital Library

[13]

Ravi Ramamoorthi and Pat Hanrahan. An efficient representation for irradiance environment maps. In Eugene Fiume, editor, SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, pages 497--500, 2001.

Digital Library

[14]

Alvy Ray Smith and James F. Blinn. Blue screen matting. Computer Graphics, 30(Annual Conference Series):259--268, 1996.

Digital Library

[15]

Eric J. Stollnitz, Tony D. DeRose, and David H. Salesin. Wavelets for computer graphics: theory and applications. Morgan Kaufmann Publishers, Inc., 1996.

Digital Library

[16]

Yonatna Wexler, Andrew W. Fitzgibbon, and Andrew Zisserman. Image-based environment matting. In Rendering Techniques EG 2002, Annual Conference Series. EG, 2002.

Digital Library

[17]

Douglas E. Zongker, Dawn M. Werner, Brian Curless, and David H. Salesin. Environment matting and compositing. In Alyn Rockwood, editor, SIGGRAPH 1999, Computer Graphics Proceedings, Annual Conference Series, pages 205--214, Los Angeles, 1999. ACM SIGGRAPH, Addison Wesley.

Digital Library

Cited By

Nayar SKrishnan GUniversity CRaskar R(2023)Fast Separation of Direct and Global Components of a Scene Using High Frequency IlluminationSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596765(505-514)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596765
Lyu JWu BLischinski DCohen-Or DHuang H(2020)Differentiable refraction-tracing for mesh reconstruction of transparent objectsACM Transactions on Graphics10.1145/3414685.341781539:6(1-13)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417815
Wu BZhou YQian YCong MHuang H(2018)Full 3D reconstruction of transparent objectsACM Transactions on Graphics10.1145/3197517.320128637:4(1-11)Online publication date: 30-Jul-2018
https://dl.acm.org/doi/10.1145/3197517.3201286
Show More Cited By

Index Terms

Wavelet environment matting

Recommendations

Environment matting extensions: towards higher accuracy and real-time capture
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

Environment matting is a generalization of traditional bluescreen matting. By photographing an object in front of a sequence of structured light backdrops, a set of approximate light-transport paths through the object can be computed. The original ...
Environment Matting and Compositing
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

This paper introduces a new process, environment matting, which captures not just a foreground object and its traditional opacity matte from a real-world scene, but also a description of how that object refracts and reflects light, which we call an ...
Shadow matting and compositing
SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

In this paper, we describe a method for extracting shadows from one natural scene and inserting them into another. We develop physically-based shadow matting and compositing equations and use these to pull a shadow matte from a source scene in which the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EGRW '03: Proceedings of the 14th Eurographics workshop on Rendering

June 2003

320 pages

ISBN:3905673037

Conference Chairs:
Philip Dutré
Katholieke Universiteit Leuven
,
Frank Suykens
Katholieke Universiteit Leuven
,
Program Chairs:
Per H. Christensen
Pixar Animation Studios
,
Daniel Cohen-Or
Tel Aviv University

Sponsors

EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 25 June 2003

Check for updates

Qualifiers

Article

Conference

EGSR03

Sponsor:

EUROGRAPHICS

EGSR03: Eurographics Symposium on Rendering 2003

June 25 - 27, 2003

Leuven, Belgium

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
541
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nayar SKrishnan GUniversity CRaskar R(2023)Fast Separation of Direct and Global Components of a Scene Using High Frequency IlluminationSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596765(505-514)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596765
Lyu JWu BLischinski DCohen-Or DHuang H(2020)Differentiable refraction-tracing for mesh reconstruction of transparent objectsACM Transactions on Graphics10.1145/3414685.341781539:6(1-13)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417815
Wu BZhou YQian YCong MHuang H(2018)Full 3D reconstruction of transparent objectsACM Transactions on Graphics10.1145/3197517.320128637:4(1-11)Online publication date: 30-Jul-2018
https://dl.acm.org/doi/10.1145/3197517.3201286
Ren PDong YLin STong XGuo B(2015)Image based relighting using neural networksACM Transactions on Graphics10.1145/276689934:4(1-12)Online publication date: 27-Jul-2015
https://dl.acm.org/doi/10.1145/2766899
Endo YKanamori YFukui YMitani J(2012)Matting and Compositing for Fresnel Reflection on Wavy SurfacesComputer Graphics Forum10.1111/j.1467-8659.2012.03139.x31:4(1435-1443)Online publication date: 1-Jun-2012
https://dl.acm.org/doi/10.1111/j.1467-8659.2012.03139.x
Yeung STang CBrown MKang S(2011)Matting and compositing of transparent and refractive objectsACM Transactions on Graphics10.1145/1899404.189940630:1(1-13)Online publication date: 2-Feb-2011
https://dl.acm.org/doi/10.1145/1899404.1899406
Shan QCurless BKohno T(2010)Seeing through obscure glassProceedings of the 11th European conference on Computer vision: Part VI10.5555/1888212.1888241(364-378)Online publication date: 5-Sep-2010
https://dl.acm.org/doi/10.5555/1888212.1888241
O'Toole MKutulakos K(2010)Optical computing for fast light transport analysisACM Transactions on Graphics10.1145/1882261.186616529:6(1-12)Online publication date: 15-Dec-2010
https://dl.acm.org/doi/10.1145/1882261.1866165
O'Toole MKutulakos KDrettakis G(2010)Optical computing for fast light transport analysisACM SIGGRAPH Asia 2010 papers10.1145/1866158.1866165(1-12)Online publication date: 15-Dec-2010
https://dl.acm.org/doi/10.1145/1866158.1866165
Duan QCai JZheng J(2009)Vector field fitting for real-time environment matting of transparent objectsProceedings of the 16th IEEE international conference on Image processing10.5555/1819298.1819622(3193-3196)Online publication date: 7-Nov-2009
https://dl.acm.org/doi/10.5555/1819298.1819622
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

Media

Figures

Other

Tables

View Table of Contents