Article

Light field mapping: efficient representation and hardware rendering of surface light fields

Authors:

Jean-Yves Bouguet,

Michael H. Chu,

Radek GrzeszczukAuthors Info & Claims

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

Pages 447 - 456

https://doi.org/10.1145/566570.566601

Published: 01 July 2002 Publication History

Abstract

A light field parameterized on the surface offers a natural and intuitive description of the view-dependent appearance of scenes with complex reflectance properties. To enable the use of surface light fields in real-time rendering we develop a compact representation suitable for an accelerated graphics pipeline. We propose to approximate the light field data by partitioning it over elementary surface primitives and factorizing each part into a small set of lower-dimensional functions. We show that our representation can be further compressed using standard image compression techniques leading to extremely compact data sets that are up to four orders of magnitude smaller than the input data. Finally, we develop an image-based rendering method, light field mapping, that can visualize surface light fields directly from this compact representation at interactive frame rates on a personal computer. We also implement a new method of approximating the light field data that produces positive only factors allowing for faster rendering using simpler graphics hardware than earlier methods. We demonstrate the results for a variety of non-trivial synthetic scenes and physical objects scanned through 3D photography.

References

[1]

C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon Press, 1995.

Digital Library

[2]

S. Boivin and A. Gagalowicz. Image-Based Rendering of Diffuse, Specular and Glossy Surfaces From a Single Image. Proceedings of SIGGRAPH 2001, pages 107-116, August 2001.

Digital Library

[3]

J-Y. Bouguet and P. Perona. 3D Photography Using Shadows in Dual-Space Geometry. International Journal of Computer Vision, 35(2):129-149, December 1999.

Digital Library

[4]

C. Buehler, M. Bosse, L. McMillan, S. J. Gortler, and M. F. Cohen. Unstructured Lumigraph Rendering. Proceedings of SIGGRAPH 2001, pages 425-432, August 2001.

Digital Library

[5]

J-X. Chai, X. Tong, S-C. Chan, and H-Y. Shum. Plenoptic Sampling. Proceedings of SIGGRAPH 2000, pages 307-318, July 2000.

Digital Library

[6]

W-C. Chen, R. Grzeszczuk, and J-Y. Bouguet. Light Field Mapping: Hardware-accelerated Visualization of Surface Light Fields. Published as part of "Acquisition and Visualization of Surface Light Fields," SIGGRAPH 2001 Course Notes for Course 46, pages 410-416, August 2001.

[7]

R. L. Cook and K. E. Torrance. A Reflectance Model for Computer Graphics. ACM Transactions on Graphics, 1(1):7-24, January 1982.

Digital Library

[8]

B. Curless and M. Levoy. Better Optical Triangulation through Spacetime Analysis. Proc. 5th Int. Conf. Computer Vision, Boston, USA, pages 987-993, 1995.

Digital Library

[9]

P. Debevec, T. Hawkins, C. Tchou, H-P. Duiker, W. Sarokin, and M. Sagar. Acquiring the Reflectance Field of a Human Face. Proceedings of SIGGRAPH 2000, pages 145-156, July 2000.

Digital Library

[10]

P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. Proceedings of SIGGRAPH 96, pages 11-20, August 1996.

Digital Library

[11]

P. E. Debevec, Y. Yu, and G. D. Borshukov. Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping. Eurographics Rendering Workshop 1998, pages 105-116, June 1998.

Digital Library

[12]

A. Fournier. Separating Reflection Functions for Linear Radiosity. Eurographics Rendering Workshop 1995, pages 296-305, June 1995.

Digital Library

[13]

A. Gersho and R. M. Gray. Vector Quantization and Signal Compression. Kluwer Academic Publishers, 1992.

Digital Library

[14]

S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The Lumigraph. Proceedings of SIGGRAPH 96, pages 43-54, August 1996.

Digital Library

[15]

W. Heidrich and H-P. Seidel. Realistic, Hardware-Accelerated Shading and Lighting. Proceedings of SIGGRAPH 99, pages 171-178, August 1999.

Digital Library

[16]

J. Kautz and M. D. McCool. Interactive Rendering with Arbitrary BRDFs using Separable Approximations. Eurographics Rendering Workshop 1999, June 1999.

Digital Library

[17]

J. Kautz and H-P. Seidel. Towards Interactive Bump Mapping with Anisotropic Shift-Variant BRDFs. 2000 SIGGRAPH / Eurographics Workshop on Graphics Hardware, pages 51-58, August 2000.

Digital Library

[18]

J. J. Koenderink and A. J. van Doorn. Bidirectional Reflection Distribution Function Expressed in Terms of Surface Scattering Modes. In European Conference on Computer Vision, pages II:28-39, 1996.

Digital Library

[19]

E. P. F. Lafortune, S-C. Foo, K. E. Torrance, and D. P. Greenberg. Non-Linear Approximation of Reflectance Functions. Proceedings of SIGGRAPH 97, pages 117-126, August 1997.

Digital Library

[20]

D. D. Lee and H. S. Seung. Learning the Parts of Objects by Non-Negative Matrix Factorization. Nature, 401:788-791, 1999.

[21]

Hendrik P. A. Lensch, Jan Kautz, Michael Goesele, Wolfgang Heidrich, and Hans-Peter Seidel. Image-Based Reconstruction of Spatially Varying Materials. In Twelveth Eurographics Rendering Workshop 2001, pages 104-115. Eurographics, June 2001.

Digital Library

[22]

M. Levoy and P. Hanrahan. Light Field Rendering. Proceedings of SIGGRAPH 96, pages 31-42, August 1996.

Digital Library

[23]

M. Magnor and B. Girod. Data Compression for Light Field Rendering. IEEE Trans. Circuits and Systems for Video Technology, 10(3):338-343, April 2000.

Digital Library

[24]

T. Malzbender, D. Gelb, and H. Wolters. Polynomial Texture Maps. Proceedings of SIGGRAPH 2001, pages 519-528, August 2001.

Digital Library

[25]

Michael D. McCool, Jason Ang, and Anis Ahmad. Homomorphic Factorization of BRDFs for High-Performance Rendering. Proceedings of SIGGRAPH 2001, pages 171-178, August 2001.

Digital Library

[26]

L. McMillan and G. Bishop. Plenoptic Modeling: An Image-Based Rendering System. Proceedings of SIGGRAPH 95, pages 39-46, August 1995.

Digital Library

[27]

G. S. P. Miller, S. Rubin, and D. Ponceleon. Lazy Decompression of Surface Light Fields for Precomputed Global Illumination. Eurographics Rendering Workshop 1998, pages 281-292, June 1998.

[28]

K. Nishino, Y. Sato, and K. Ikeuchi. Eigen-Texture Method: Appearance Compression Based on 3D Model. In Proceedings of the IEEE Computer Science Conference on Computer Vision and Pattern Recognition (CVPR-99), pages 618-624, 1999.

[29]

P. Poulin and A. Fournier. A Model for Anisotropic Reflection. Proceedings of SIGGRAPH 90, 24(4):273-282, August 1990.

Digital Library

[30]

K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle. View-based Rendering: Visualizing Real Objects from Scanned Range and Color Data. Eurographics Rendering Workshop 1997, pages 23-34, June 1997.

Digital Library

[31]

R. Ramamoorthi and P. Hanrahan. A Signal-Processing Framework for Inverse Rendering. Proceedings of SIGGRAPH 2001, pages 117-128, August 2001.

Digital Library

[32]

Sam Roweis. EM algorithms for PCA and SPCA. In Advances in Neural Information Processing Systems, volume 10. The MIT Press, 1998.

Digital Library

[33]

Y. Sato, M. D. Wheeler, and K. Ikeuchi. Object Shape and Reflectance Modeling from Observation. Proceedings of SIGGRAPH 97, pages 379-388, August 1997.

Digital Library

[34]

P. Schröder and W. Sweldens. Spherical Wavelets: Efficiently Representing Functions on the Sphere. Proceedings of SIGGRAPH 95, pages 161-172, August 1995.

Digital Library

[35]

J. Spitzer. Texture Compositing With Register Combiners. Game Developers Conference, April 2000.

[36]

G. Taubin and J. Rossignac. Geometric Compression Through Topological Surgery. ACM Transactions on Graphics, 17(2):84-115, April 1998.

Digital Library

[37]

K. E. Torrance and E. M. Sparrow. Polarization, Directional Distribution, and Off-Specular Peak Phenomena in Light Reflected from Roughened Surfaces. Journal of Optical Society of America, 56(7), 1966.

[38]

G. J. Ward. Measuring and Modeling Anisotropic Reflection. Proceedings of SIGGRAPH 92, 26(2):265-272, July 1992.

Digital Library

[39]

D. N. Wood, D. I. Azuma, K. Aldinger, B. Curless, T. Duchamp, D. H. Salesin, and W. Stuetzle. Surface Light Fields for 3D Photography. Proceedings of SIGGRAPH 2000, pages 287-296, July 2000.

Digital Library

[40]

Y. Yu, P. E. Debevec, J. Malik, and T. Hawkins. Inverse Global Illumination: Recovering Reflectance Models of Real Scenes From Photographs. Proceedings of SIGGRAPH 99, pages 215-224, August 1999.

Digital Library

Cited By

Park JHolynski ASeitz S(2020)Seeing the World in a Bag of Chips2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.00149(1414-1424)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.00149
Volino MMustafa AGuillemaut JHilton A(2020)Light Field Video for Immersive Content ProductionReal VR – Immersive Digital Reality10.1007/978-3-030-41816-8_2(33-64)Online publication date: 3-Mar-2020
https://doi.org/10.1007/978-3-030-41816-8_2
Thies JZollhöfer MNießner M(2019)Deferred neural renderingACM Transactions on Graphics10.1145/3306346.332303538:4(1-12)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3323035
Show More Cited By

Index Terms

Light field mapping: efficient representation and hardware rendering of surface light fields
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Light field mapping: efficient representation and hardware rendering of surface light fields

A light field parameterized on the surface offers a natural and intuitive description of the view-dependent appearance of scenes with complex reflectance properties. To enable the use of surface light fields in real-time rendering we develop a compact ...
A fast relighting engine for interactive cinematic lighting design
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

We present new techniques for interactive cinematic lighting design of complex scenes that use procedural shaders. Deep-framebuffers are used to store the geometric and optical information of the visible surfaces of an image. The geometric information ...
Efficient rendering of spatial bi-directional reflectance distribution functions
HWWS '02: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware

We propose texture maps that contain at each texel all the parameters of a Lafortune representation BRDF as a compact, but quite general surface appearance representation. We describe a method for rendering such surfaces rapidly on current graphics ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

July 2002

574 pages

ISBN:1581135211

DOI:10.1145/566570

Conference Chair:
Tom Appolloni
Harris Corporation

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH02

Sponsor:

SIGGRAPH

SIGGRAPH02: The 29th International Conference on Computer Graphics and Interactive Techniques

July 23 - 26, 2002

Texas, San Antonio

Acceptance Rates

SIGGRAPH '02 Paper Acceptance Rate 67 of 358 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

48
Total Citations
View Citations
1,093
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Park JHolynski ASeitz S(2020)Seeing the World in a Bag of Chips2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.00149(1414-1424)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.00149
Volino MMustafa AGuillemaut JHilton A(2020)Light Field Video for Immersive Content ProductionReal VR – Immersive Digital Reality10.1007/978-3-030-41816-8_2(33-64)Online publication date: 3-Mar-2020
https://doi.org/10.1007/978-3-030-41816-8_2
Thies JZollhöfer MNießner M(2019)Deferred neural renderingACM Transactions on Graphics10.1145/3306346.332303538:4(1-12)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3323035
Pratapa SManocha DAndrews STatarchuk N(2019)RLFCProceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/3306131.3317018(1-10)Online publication date: 21-May-2019
https://dl.acm.org/doi/10.1145/3306131.3317018
Erat OHoell MHaubenwallner KPirchheim CSchmalstieg D(2019)Real-Time View Planning for Unstructured Lumigraph ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.293223725:11(3063-3072)Online publication date: Nov-2019
https://doi.org/10.1109/TVCG.2019.2932237
Volino MMustafa AGuillemaut JHilton A(2019)Light Field Compression using Eigen Textures2019 International Conference on 3D Vision (3DV)10.1109/3DV.2019.00060(482-490)Online publication date: Sep-2019
https://doi.org/10.1109/3DV.2019.00060
Vanhoey KSauvage BKraemer PLarue FDischler J(2015)Simplification of meshes with digitized radianceThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1124-931:6-8(1011-1021)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1007/s00371-015-1124-9
Kim CZimmer HPritch YSorkine-Hornung AGross M(2013)Scene reconstruction from high spatio-angular resolution light fieldsACM Transactions on Graphics10.1145/2461912.246192632:4(1-12)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1145/2461912.2461926
Lam PLeung CWong TFu C(2010)Uniformly sampling multi-resolution analysis for image-based relightingJournal of Visual Communication and Image Representation10.1016/j.jvcir.2010.05.00421:7(693-706)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1016/j.jvcir.2010.05.004
Hile HGrzeszczuk RLiu AVedantham RKošecka JBorriello G(2009)Landmark-Based Pedestrian Navigation with Enhanced Spatial ReasoningProceedings of the 7th International Conference on Pervasive Computing10.1007/978-3-642-01516-8_6(59-76)Online publication date: 11-May-2009
https://dl.acm.org/doi/10.1007/978-3-642-01516-8_6
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents