Article

Image-based 3D photography using opacity hulls

Authors:

Wojciech Matusik,

Hanspeter Pfister,

Paul Beardsley,

Leonard McMillanAuthors Info & Claims

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

Pages 427 - 437

https://doi.org/10.1145/566570.566599

Published: 01 July 2002 Publication History

Abstract

We have built a system for acquiring and displaying high quality graphical models of objects that are impossible to scan with traditional scanners. Our system can acquire highly specular and fuzzy materials, such as fur and feathers. The hardware set-up consists of a turntable, two plasma displays, an array of cameras, and a rotating array of directional lights. We use multi-background matting techniques to acquire alpha mattes of the object from multiple viewpoints. The alpha mattes are used to construct an opacity hull. The opacity hull is a new shape representation, defined as the visual hull of the object with view-dependent opacity. It enables visualization of complex object silhouettes and seamless blending of objects into new environments. Our system also supports relighting of objects with arbitrary appearance using surface reflectance fields, a purely image-based appearance representation. Our system is the first to acquire and render surface reflectance fields under varying illumination from arbitrary viewpoints. We have built three generations of digitizers with increasing sophistication. In this paper, we present our results from digitizing hundreds of models.

References

[1]

BEARDSLEY, P. 2002. Calibration of stereo cameras for a turntable 3d scanner. Tech. rep., MERL. TR 2002/20.

[2]

BERNARDINI, F., MARTIN, I., AND RUSHMEIER, H. 2001. High-quality texture reconstruction from multiple scans. IEEE Trans. on Vis. and Comp. Graph. 7, 4 (Oct.-Dec.), 318-332.

Digital Library

[3]

BUEHLER, C., BOSSE, M., MCMILLAN, L., GORTLER, S., AND COHEN, M. 2001. Unstructured lumigraph rendering. In Computer Graphics, SIGGRAPH 2001 Proceedings, 425-432.

Digital Library

[4]

CHEN, S. E., AND WILLIAMS, L. 1993. View interpolation for image synthesis. In Computer Graphics, SIGGRAPH 93 Proceedings, 279-288.

Digital Library

[5]

CHEN, W.-C., GRZESZCZUK, R., AND BOUGUET, J.-Y. 2002. Light field mapping: Efficient representation and hardware rendering of surface light fields. In Computer Graphics, To appear in the SIGGRAPH 2002 Proceedings.

Digital Library

[6]

CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Computer Graphics, SIGGRAPH 96 Proceedings, 303-312.

Digital Library

[7]

DEBEVEC, P., AND MALIK, J. 1997. Recovering high dynamic range radiance maps from photographs. In Computer Graphics, SIGGRAPH 97 Proceedings, 369-378.

Digital Library

[8]

DEBEVEC, P., TAYLOR, C., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Computer Graphics, SIGGRAPH 96 Proceedings, 11-20.

Digital Library

[9]

DEBEVEC, P., YU, Y., AND BORSHUKOV, G. 1998. Efficient view-dependent image-based rendering with projective texture-mapping. In Proceedings of the 9th Eurographics Workshop on Rendering, 105-116.

Digital Library

[10]

DEBEVEC, P., HAWKINS, T., TCHOU, C., DUIKER, H.-P., SAROKIN, W., AND SAGAR, M. 2000. Acquiring the reflectance field of a human face. In Computer Graphics, SIGGRAPH 2000 Proceedings, 145-156.

Digital Library

[11]

GEORGHIADES, A., BELHUMEUR, P., AND KRIEGMAN, D. 1999. Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting. In IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes, 47-54.

Digital Library

[12]

GORTLER, S., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. 1996. The lumigraph. In Computer Graphics, SIGGRAPH 96 Proceedings, 43-54.

Digital Library

[13]

HAWKINS, T., COHEN, J., AND DEBEVEC, P. 2001. A photometric approach to digitizing cultural artifacts. In 2nd International Symposium on Virtual Reality, Archaeology, and Cultural Heritage.

Digital Library

[14]

KOUDELKA, M., BELHUMEUR, P., MAGDA, S., AND KRIEGMAN, D. 2001. Image-based modeling and rendering of surfaces with arbitrary brdfs. In Proc. of Computer Vision and Pattern Recognition, in press.

[15]

LAURENTINI, A. 1994. The visual hull concept for silhouette-based image understanding. PAMI 16, 2 (February), 150-162.

Digital Library

[16]

LENGYEL, J., PRAUN, E., FINKELSTEIN, A., AND HOPPE, H. 2001. Real-time fur over arbitrary surfaces. In Symposium on Interactive 3D Graphics, 227-232.

Digital Library

[17]

LENSCH, H., KAUTZ, J., GOESELE, M., HEIDRICH, W., AND SEIDEL, H.-P. 2001. Image-based reconstruction of spatially varying materials. In Proceedings of the 12th Eurographics Workshop on Rendering.

Digital Library

[18]

LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. In Computer Graphics, SIGGRAPH 96 Proceedings, 31-42.

Digital Library

[19]

LEVOY, M., AND WHITTED, T. 1985. The use of points as display primitives. Tech. Rep. TR 85-022, The University of North Carolina at Chapel Hill, Department of Computer Science.

[20]

LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., SHADE, J., AND FULK, D. 2000. The digital michelangelo project: 3d scanning of large statues. In Computer Graphics, SIGGRAPH 2000 Proceedings, 131-144.

Digital Library

[21]

MALZBENDER, T., GELB, D., AND WOLTERS, H. 2001. Polynomial texture maps. In Computer Graphics, SIGGRAPH 2001 Proceedings, 519-528.

Digital Library

[22]

MARSCHNER, S., WESTIN, S., LAFORTUNE, E., TORRANCE, K., AND GREENBERG, D. 1999. Image-based brdf measurement including human skin. In Proceedings of the 10th Eurographics Workshop on Rendering, 139-152.

Digital Library

[23]

MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S., AND MCMILLAN, L. 2000. Image-based visual hulls. In Computer Graphics, SIGGRAPH 2000 Proceedings, 369-374.

Digital Library

[24]

MCMILLAN, L., AND BISHOP, G. 1995. Plenoptic modeling: An image-based rendering system. In Computer Graphics, SIGGRAPH 95 Proceedings, 39-46.

Digital Library

[25]

MILLER, G., RUBIN, S., AND PONCELEON, D. 1998. Lazy decompression of surface light fields for precomputed global illumination. In Proceedings of the 9th Eurographics Workshop on Rendering, 281-292.

[26]

NISHINO, K., SATO, Y., AND IKEUCHI, K. 1999. Appearance compression and synthesis based on 3d model for mixed reality. In Proceedings of IEEE ICCV '99, 38-45.

[27]

NISHINO, K., SATO, Y., AND IKEUCHI, K. 1999. Eigen-texture method: Appearance compression based on 3d model. In Proc. of Computer Vision and Pattern Recognition, 618-624.

[28]

PFISTER, H., ZWICKER, M., VAN BAAR, J., AND GROSS, M. 2000. Surfels: Surface elements as rendering primitives. In Computer Graphics, SIGGRAPH 2000 Proceedings, 335-342.

Digital Library

[29]

PULLI, K., COHEN, M., DUCHAMP, T., HOPPE, H., SHAPIRO, L., AND STUETZLE, W. 1997. View-based rendering: Visualizing real objects from scanned range and color data. In Eurographics Rendering Workshop 1997, 23-34.

Digital Library

[30]

RAMAMOORTHI, R., AND HANRAHAN, P. 2001. A signal-processing framework for inverse rendering. In Computer Graphics, SIGGRAPH 2001 Proceedings, 117-128.

Digital Library

[31]

RUSHMEIER, H., BERNARDINI, F., MITTLEMAN, J., AND TAUBIN, G. 1998. Acquiring input for rendering at appropriate levels of detail: Digitizing a pietà. In Proceedings of the 9th Eurographics Workshop on Rendering, 81-92.

[32]

RUSINKIEWICZ, S., AND LEVOY, M. 2000. Qsplat: A multiresolution point rendering system for large meshes. In Computer Graphics, SIGGRAPH 2000 Proceedings, 343-352.

Digital Library

[33]

SANDER, P., GU, X., GORTLER, S., HOPPE, H., AND SNYDER, J. 2000. Silhouette clipping. In Computer Graphics, SIGGRAPH 2000 Proceedings, 327-334.

Digital Library

[34]

SATO, Y., WHEELER, M. D., AND IKEUCHI, K. 1997. Object shape and reflectance modeling from observation. In Computer Graphics, SIGGRAPH 97 Proceedings, 379-387.

Digital Library

[35]

SMITH, A. R., AND BLINN, J. F. 1996. Blue screen matting. In Computer Graphics, vol. 30 of SIGGRAPH 96 Proceedings, 259-268.

Digital Library

[36]

TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In Computer Graphics, SIGGRAPH 94 Proceedings, 311-318.

Digital Library

[37]

UDUPA, J., AND ODHNER, D. 1993. Shell rendering. IEEE Computer Graphics & Applications 13, 6 (Nov.), 58-67.

Digital Library

[38]

WOOD, D., AZUMA, D., ALDINGER, K., CURLESS, B., DUCHAMP, T., SALESIN, D., AND STUETZLE, W. 2000. Surface light fields for 3d photography. In Computer Graphics, SIGGRAPH 2000 Proceedings, 287-296.

Digital Library

[39]

YU, Y., DEBEVEC, P., MALIK, J., AND HAWKINS, T. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In Computer Graphics, SIGGRAPH 99 Proceedings, 215-224.

Digital Library

[40]

ZONGKER, D., WERNER, D., CURLESS, B., AND SALESIN, D. 1999. Environment matting and compositing. In Computer Graphics, SIGGRAPH 99 Proceedings, 205-214.

Digital Library

[41]

ZWICKER, M., PFISTER., H., BAAR, J. V., AND GROSS, M. 2001. Surface splatting. In Computer Graphics, SIGGRAPH 2001 Proceedings, 371-378.

Digital Library

Cited By

Ihrke I(2021)OpacityComputer Vision10.1007/978-3-030-63416-2_564(915-920)Online publication date: 13-Oct-2021
https://doi.org/10.1007/978-3-030-63416-2_564
Dana K(2021)Bidirectional Texture Function and 3D TextureComputer Vision10.1007/978-3-030-63416-2_263(79-83)Online publication date: 13-Oct-2021
https://doi.org/10.1007/978-3-030-63416-2_263
Ihrke I(2020)OpacityComputer Vision10.1007/978-3-030-03243-2_564-1(1-6)Online publication date: 2-Dec-2020
https://doi.org/10.1007/978-3-030-03243-2_564-1
Show More Cited By

Index Terms

Image-based 3D photography using opacity hulls
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document scanning
      2. Graphics recognition and interpretation
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics

Recommendations

Image-based 3D photography using opacity hulls

We have built a system for acquiring and displaying high quality graphical models of objects that are impossible to scan with traditional scanners. Our system can acquire highly specular and fuzzy materials, such as fur and feathers. The hardware set-up ...
Opacity light fields: interactive rendering of surface light fields with view-dependent opacity
I3D '03: Proceedings of the 2003 symposium on Interactive 3D graphics

We present new hardware-accelerated techniques for rendering surface light fields with opacity hulls that allow for interactive visualization of objects that have complex reflectance properties and elaborate geometrical details. The opacity hull is a ...
Surface light fields for 3D photography
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

A surface light field is a function that assigns a color to each ray originating on a surface. Surface light fields are well suited to constructing virtual images of shiny objects under complex lighting conditions. This paper presents a framework for ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

July 2002

574 pages

ISBN:1581135211

DOI:10.1145/566570

Conference Chair:
Tom Appolloni
Harris Corporation

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH02

Sponsor:

SIGGRAPH

SIGGRAPH02: The 29th International Conference on Computer Graphics and Interactive Techniques

July 23 - 26, 2002

Texas, San Antonio

Acceptance Rates

SIGGRAPH '02 Paper Acceptance Rate 67 of 358 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

81
Total Citations
View Citations
2,145
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ihrke I(2021)OpacityComputer Vision10.1007/978-3-030-63416-2_564(915-920)Online publication date: 13-Oct-2021
https://doi.org/10.1007/978-3-030-63416-2_564
Dana K(2021)Bidirectional Texture Function and 3D TextureComputer Vision10.1007/978-3-030-63416-2_263(79-83)Online publication date: 13-Oct-2021
https://doi.org/10.1007/978-3-030-63416-2_263
Ihrke I(2020)OpacityComputer Vision10.1007/978-3-030-03243-2_564-1(1-6)Online publication date: 2-Dec-2020
https://doi.org/10.1007/978-3-030-03243-2_564-1
Ihrke I(2016)OpacityComputer Vision10.1007/978-0-387-31439-6_564(562-564)Online publication date: 5-Feb-2016
https://doi.org/10.1007/978-0-387-31439-6_564
Dana K(2016)Bidirectional Texture Function and 3D TextureComputer Vision10.1007/978-0-387-31439-6_263(46-50)Online publication date: 5-Feb-2016
https://doi.org/10.1007/978-0-387-31439-6_263
Weinmann MKlein R(2015)Advances in geometry and reflectance acquisition (course notes)SIGGRAPH Asia 2015 Courses10.1145/2818143.2818165(1-71)Online publication date: 2-Nov-2015
https://dl.acm.org/doi/10.1145/2818143.2818165
Imber JGuillemaut JHilton A(2014)Intrinsic Textures for Relightable Free-Viewpoint VideoComputer Vision – ECCV 201410.1007/978-3-319-10605-2_26(392-407)Online publication date: 2014
https://doi.org/10.1007/978-3-319-10605-2_26
Ferguson R(2013)Image-Based RenderingA Hitchhiker's Guide to Virtual Reality10.1201/b10677-11(219-233)Online publication date: 12-Jun-2013
https://doi.org/10.1201/b10677-11
Imber JVolino MGuillemaut JFenney SHilton AEisert PGagalowicz A(2013)Free-viewpoint video rendering for mobile devicesProceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications10.1145/2466715.2466726(1-8)Online publication date: 6-Jun-2013
https://dl.acm.org/doi/10.1145/2466715.2466726
Ouyang BDalgleish FVuorenkoski ABritton WRamos BMetzger B(2013)Visualization and Image Enhancement for Multistatic Underwater Laser Line Scan System Using Image-Based RenderingIEEE Journal of Oceanic Engineering10.1109/JOE.2012.222906638:3(566-580)Online publication date: Jul-2013
https://doi.org/10.1109/JOE.2012.2229066
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents