research-article

All-frequency rendering of dynamic, spatially-varying reflectance

Authors:

Baining GuoAuthors Info & Claims

SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

Article No.: 133, Pages 1 - 10

https://doi.org/10.1145/1661412.1618479

Published: 01 December 2009 Publication History

Abstract

We describe a technique for real-time rendering of dynamic, spatially-varying BRDFs in static scenes with all-frequency shadows from environmental and point lights. The 6D SVBRDF is represented with a general microfacet model and spherical lobes fit to its 4D spatially-varying normal distribution function (SVNDF). A sum of spherical Gaussians (SGs) provides an accurate approximation with a small number of lobes. Parametric BRDFs are fit on-the-fly using simple analytic expressions; measured BRDFs are fit as a preprocess using nonlinear optimization. Our BRDF representation is compact, allows detailed textures, is closed under products and rotations, and supports reflectance of arbitrarily high specularity. At run-time, SGs representing the NDF are warped to align the half-angle vector to the lighting direction and multiplied by the microfacet shadowing and Fresnel factors. This yields the relevant 2D view slice on-the-fly at each pixel, still represented in the SG basis. We account for macro-scale shadowing using a new, nonlinear visibility representation based on spherical signed distance functions (SSDFs). SSDFs allow per-pixel interpolation of high-frequency visibility without ghosting and can be multiplied by the BRDF and lighting efficiently on the GPU.

Supplementary Material

Supplemental material. (133-wang.zip)

Download
1.53 MB

References

[1]

Arvo, J., Torrance, K., and Smits, B. 1994. A framework for the analysis of error in global illumination algorithms. In Proceedings of SIGGRAPH 1994, ACM, 75--84.

Digital Library

[2]

Ashikhmin, M., and Shirley, P. 2000. An anisotropic Phong BRDF model. Journal of Graphics Tools 5, 2, 25--32.

Digital Library

[3]

Ashikmin, M., Premože, S., and Shirley, P. 2000. A microfacet-based BRDF generator. In Proceedings of SIGGRAPH 2000, ACM, 65--74.

Digital Library

[4]

Ben-Artzi, A., Overbeck, R., and Ramamoorthi, R. 2006. Real-time BRDF editing in complex lighting. ACM Transactions on Graphics 25, 3, 945--954.

Digital Library

[5]

Ben-Artzi, A., Egan, K., Ramamoorthi, R., and Durand, F. 2008. A precomputed polynomial representation for interactive BRDF editing with global illumination. ACM Transactions on Graphics 27, 2, 13:1--13:13.

Digital Library

[6]

Blinn, J. F. 1977. Models of light reflection for computer synthesized pictures. In Computer Graphics (Proceedings of SIGGRAPH 77), ACM, vol. 11, 192--198.

Digital Library

[7]

Cheslack-Postava, E., Wang, R., Akerlund, O., and Pellacini, F. 2008. Fast, realistic lighting and material design using nonlinear cut approximation. ACM Transactions on Graphics 27, 5, 128:1--128:10.

Digital Library

[8]

Cook, R. L., and Torrance, K. E. 1981. A reflectance model for computer graphics. In Computer Graphics (Proceedings of SIGGRAPH 81), ACM, vol. 1, 307--316.

Digital Library

[9]

Green, P., Kautz, J., Matusik, W., and Durand, F. 2006. View-dependent precomputed light transport using nonlinear gaussian function approximations. In I3D '06: Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, ACM, 7--14.

Digital Library

[10]

Green, P., Kautz, J., and Durand, F. 2007. Efficient reflectance and visibility approximations for environment map rendering. Computer Graphics Forum (Proc. EUROGRAPHICS) 26, 3, 495--502.

[11]

Han, C., Sun, B., Ramamoorthi, R., and Grinspun, E. 2007. Frequency domain normal map filtering. ACM Transactions on Graphics 26, 3, 28:1--28:11.

Digital Library

[12]

Kautz, J., Vázquez, P.-P., Heidrich, W., and Seidel, H.-P. 2000. Unified approach to prefiltered environment maps. In Proceedings of the Eurographics Workshop on Rendering Techniques 2000, Springer-Verlag, London, UK, 185--196.

Digital Library

[13]

Křivánek, J., and Colbert, M. 2008. Real-time shading with filtered importance sampling. Computer Graphics Forum (Proc. of Eurographics Symposium on Rendering) 27, 4.

Digital Library

[14]

Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Transactions on Graphics 25, 3, 735--745.

Digital Library

[15]

Liu, X., Sloan, P. P., Shum, H. Y., and Snyder, J. 2004. All-frequency precomputed radiance transfer for glossy objects. In Proceedings of the Eurographics Symposium on Rendering, Eurographics Association, 337--344.

Digital Library

[16]

Mahajan, D., Tseng, Y.-T., and Ramamoorthi, R. 2008. An analysis of the in-out BRDF factorization for view-dependent relighting. In Eurographics Symposium on Rendering, vol. 27.

Digital Library

[17]

Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics 22, 3, 759--769.

Digital Library

[18]

McAllister, D. K., Lastra, A., and Heidrich, W. 2002. Efficient rendering of spatial bi-directional reflectance distribution functions. In HWWS '02: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Conference on Graphics Hardware, Eurographics Association, Aire-la-Ville, Switzerland, 79--88.

Digital Library

[19]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. ACM Transactions on Graphics 22, 3, 376--381.

Digital Library

[20]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. ACM Transactions on Graphics 23, 3, 477--487.

Digital Library

[21]

Ngan, A., Durand, F., and Matusik, W. 2005. Experimental analysis of BRDF models. In Rendering Techniques 2005: 16th Eurographics Workshop on Rendering, 117--126.

Digital Library

[22]

Nocedal, J., and Wright, S. J. 1999. Numerical optimization. Springer Series in Operations Research, Springer-Verlag.

[23]

Ren, Z., Wang, R., Snyder, J., Zhou, K., Liu, X., Sun, B., Sloan, P.-P., Bao, H., Peng, Q., and Guo, B. 2006. Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation. ACM Transactions on Graphics 25, 3, 977--986.

Digital Library

[24]

Shirley, P., and Chiu, K. 1997. A low distortion map between disk and square. J. Graph. Tools 2, 3, 45--52.

Digital Library

[25]

Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of SIGGRAPH 2002, ACM, 527--536.

Digital Library

[26]

Sloan, P.-P., Liu, X., Shum, H.-Y., and Snyder, J. 2003. Bi-scale radiance transfer. ACM Transactions on Graphics 22, 3 (July), 370--375.

Digital Library

[27]

Sloan, P.-P., Luna, B., and Snyder, J. 2005. Local, deformable precomputed radiance transfer. ACM Transactions on Graphics 24, 3, 1216--1224.

Digital Library

[28]

Sun, X., Zhou, K., Chen, Y., Lin, S., Shi, J., and Guo, B. 2007. Interactive relighting with dynamic BRDFs. ACM Transactions on Graphics 26, 3, 27:1--27:10.

Digital Library

[29]

Torrance, K. E., and Sparrow, E. M. 1967. Theory for off-specular reflection from roughened surfaces. In Journal of the Oprical Society of America, vol. 57.

[30]

Tsai, Y.-T., and Shih, Z.-C. 2006. All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. ACM Transactions on Graphics 25, 3, 967--976.

Digital Library

[31]

Tsai, Y.-T., Chang, C.-C., Jiang, Q.-Z., and Weng, S.-C. 2008. Importance sampling of products from illumination and BRDF using spherical radial basis functions. Vis. Comput. 24, 7, 817--826.

Digital Library

[32]

Walter, B., Fernandez, S., Arbree, A., Bala, K., Donikian, M., and Greenberg, D. P. 2005. Lightcuts: a scalable approach to illumination. ACM Transactions on Graphics 24, 3, 1098--1107.

Digital Library

[33]

Walter, B., Arbree, A., Bala, K., and Greenberg, D. P. 2006. Multidimensional lightcuts. ACM Transactions on Graphics 25, 3, 1081--1088.

Digital Library

[34]

Wang, R., Tran, J., and Luebke, D. 2004. All-frequency relighting of non-diffuse objects using separable BRDF approximation. In Rendering Techniques, Eurographics Association, 345--354.

Digital Library

[35]

Wang, R., Tran, J., and Luebke, D. 2006. All-frequency relighting of glossy objects. ACM Transactions on Graphics 25, 2, 293--318.

Digital Library

[36]

Wang, J., Zhao, S., Tong, X., Snyder, J., and Guo, B. 2008. Modeling anisotropic surface reflectance with example-based microfacet synthesis. ACM Transactions on Graphics 27, 3, 41:1--41:9.

Digital Library

[37]

Ward, G. J. 1992. Measuring and modeling anisotropic reflection. In Computer Graphics (Proceedings of ACM SIGGRAPH 92), ACM, vol. 26, 265--272.

Digital Library

[38]

Xu, K., Jia, Y.-T., Fu, H., Hu, S., and Tai, C.-L. 2008. Spherical piecewise constant basis functions for all-frequency precomputed radiance transfer. IEEE Transactions on Visualization and Computer Graphics 14, 2, 454--467.

Digital Library

[39]

Zhou, K., Hu, Y., Lin, S., Guo, B., and Shum, H.-Y. 2005. Precomputed shadow fields for dynamic scenes. ACM Transactions on Graphics 24, 3, 1196--1201.

Digital Library

[40]

Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. 1997. Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Transactions on Mathematical Software 23, 4, 550--560.

Digital Library

Cited By

Li JCao CSchwartz GKhirodkar RRichardt CSimon TSheikh YSaito S(2024)URAvatar: Universal Relightable Gaussian Codec AvatarsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687653(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687653
Ren HHuo YPeng YSheng HXue WHuang HLan JWang RBao H(2024)LightFormer: Light-Oriented Global Neural Rendering in Dynamic SceneACM Transactions on Graphics10.1145/365822943:4(1-14)Online publication date: 19-Jul-2024
https://doi.org/10.1145/3658229
Huang JIizuka ATanaka HKomura TKitamura Y(2024)Online Neural Path Guiding with Normalized Anisotropic Spherical GaussiansACM Transactions on Graphics10.1145/364931043:3(1-18)Online publication date: 9-Apr-2024
https://dl.acm.org/doi/10.1145/3649310
Show More Cited By

Index Terms

All-frequency rendering of dynamic, spatially-varying reflectance
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

All-frequency rendering of dynamic, spatially-varying reflectance

We describe a technique for real-time rendering of dynamic, spatially-varying BRDFs in static scenes with all-frequency shadows from environmental and point lights. The 6D SVBRDF is represented with a general microfacet model and spherical lobes fit to ...
Real-time rendering of animated hair under dynamic, low-frequency environmental lighting
VRCAI '12: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

We present a fast algorithm for rendering animated hair under a dynamic lighting environment at interactive frame rates. We use spherical harmonics (SH) to represent the environmental lighting. Since SH functions are orthogonal, the environmental light ...
Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments

We present a new, real-time method for rendering diffuse and glossy objects in low-frequency lighting environments that captures soft shadows, interreflections, and caustics. As a preprocess, a novel global transport simulator creates functions over the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

December 2009

669 pages

ISBN:9781605588582

DOI:10.1145/1661412

Conference Chair:
Masa Inakage
Keio University

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SA09

Sponsor:

SIGGRAPH

SA09: SIGGRAPH ASIA 2009

December 16 - 19, 2009

Yokohama, Japan

Acceptance Rates

SIGGRAPH Asia '09 Paper Acceptance Rate 70 of 275 submissions, 25%;

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
1,276
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)10

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li JCao CSchwartz GKhirodkar RRichardt CSimon TSheikh YSaito S(2024)URAvatar: Universal Relightable Gaussian Codec AvatarsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687653(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687653
Ren HHuo YPeng YSheng HXue WHuang HLan JWang RBao H(2024)LightFormer: Light-Oriented Global Neural Rendering in Dynamic SceneACM Transactions on Graphics10.1145/365822943:4(1-14)Online publication date: 19-Jul-2024
https://doi.org/10.1145/3658229
Huang JIizuka ATanaka HKomura TKitamura Y(2024)Online Neural Path Guiding with Normalized Anisotropic Spherical GaussiansACM Transactions on Graphics10.1145/364931043:3(1-18)Online publication date: 9-Apr-2024
https://dl.acm.org/doi/10.1145/3649310
Zhao JXue BZhang M(2024)SALENet: Structure-Aware Lighting Estimations From a Single Image for Indoor EnvironmentsIEEE Transactions on Image Processing10.1109/TIP.2024.351238133(6806-6820)Online publication date: 2024
https://doi.org/10.1109/TIP.2024.3512381
Li ZLu ZYan HShi BPan GZheng QJiang X(2024)Spin-UP: Spin Light for Natural Light Uncalibrated Photometric Stereo2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01131(11905-11914)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.01131
Liu IChen LFu ZWu LJin HLi ZWong CXu YRamamoorthi RXu ZSu HOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)OpenIlluminationProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667729(36951-36962)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3667729
Lyu LTewari AHabermann MSaito SZollhöfer MLeimkühler TTheobalt C(2023)Diffusion Posterior Illumination for Ambiguity-Aware Inverse RenderingACM Transactions on Graphics10.1145/361835742:6(1-14)Online publication date: 5-Dec-2023
https://doi.org/10.1145/3618357
Rodriguez‐Pardo CFabre JGarces ELopez‐Moreno J(2023)NEnv: Neural Environment Maps for Global IlluminationComputer Graphics Forum10.1111/cgf.1488342:4Online publication date: 26-Jul-2023
https://doi.org/10.1111/cgf.14883
Caselles PRamon EGarcia JGiro-i-Nieto XMoreno-Noguer FTriginer G(2023)SIRA: Relightable Avatars from a Single Image2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00084(775-784)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00084
Salihu DSteinbach E(2023)SGPCR: Spherical Gaussian Point Cloud Representation and its Application to Object Registration and Retrieval2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00064(572-581)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00064
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents