Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Inverse volume rendering with material dictionaries

Published: 01 November 2013 Publication History
  • Get Citation Alerts
  • Abstract

    Translucent materials are ubiquitous, and simulating their appearance requires accurate physical parameters. However, physically-accurate parameters for scattering materials are difficult to acquire. We introduce an optimization framework for measuring bulk scattering properties of homogeneous materials (phase function, scattering coefficient, and absorption coefficient) that is more accurate, and more applicable to a broad range of materials. The optimization combines stochastic gradient descent with Monte Carlo rendering and a material dictionary to invert the radiative transfer equation. It offers several advantages: (1) it does not require isolating single-scattering events; (2) it allows measuring solids and liquids that are hard to dilute; (3) it returns parameters in physically-meaningful units; and (4) it does not restrict the shape of the phase function using Henyey-Greenstein or any other low-parameter model. We evaluate our approach by creating an acquisition setup that collects images of a material slab under narrow-beam RGB illumination. We validate results by measuring prescribed nano-dispersions and showing that recovered parameters match those predicted by Lorenz-Mie theory. We also provide a table of RGB scattering parameters for some common liquids and solids, which are validated by simulating color images in novel geometric configurations that match the corresponding photographs with less than 5% error.

    Supplementary Material

    ZIP File (a162-gkioulekas.zip)
    Supplemental material.

    References

    [1]
    Antyufeev, V. 2000. Monte Carlo method for solving inverse problems of radiation transfer, vol. 20. Inverse and Ill-Posed Problems Series, V.S.P. International Science.
    [2]
    Bal, G. 2009. Inverse transport theory and applications. Inverse Problems 25, 5.
    [3]
    Ben-Artzi, A., Egan, K., Durand, F., and Ramamoorthi, R. 2008. A precomputed polynomial representation for interactive BRDF editing with global illumination. ACM Trans. Graph. 27, 2.
    [4]
    Bhate, N., and Tokuta, A. 1992. Photorealistic volume rendering of media with directional scattering. In Third Eurographics Workshop on Rendering.
    [5]
    Bohren, C., and Huffman, D. 1983. Absorption and scattering of light by small particles. Wiley-Vch.
    [6]
    Bottou, L., and Bousquet, O. 2008. The Tradeoffs of Large Scale Learning. NIPS.
    [7]
    Chandrasekhar, S. 1960. Radiative transfer. Dover.
    [8]
    Chen, C., Lu, J., Ding, H., Jacobs, K., Du, Y., Hu, X., et al. 2006. A primary method for determination of optical parameters of turbid samples and application to intralipid between 550 and 1630 nm. Optics Express 14, 16.
    [9]
    Debevec, P., Hawkins, T., Tchou, C., Duiker, H., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of SIGGRAPH 2000, Annual Conference Series.
    [10]
    Donner, C., and Jensen, H. 2005. Light diffusion in multilayered translucent materials. ACM Trans. Graph. 24, 3.
    [11]
    Donner, C., Weyrich, T., d'Eon, E., Ramamoorthi, R., and Rusinkiewicz, S. 2008. A layered, heterogeneous reflectance model for acquiring and rendering human skin. ACM Trans. Graph. 27, 5.
    [12]
    Duchi, J., Shalev-Shwartz, S., Singer, Y., and Chandra, T. 2008. Efficient projections onto the l1-ball for learning in high dimensions. ICML.
    [13]
    Dutré, P., Bala, K., and Bekaert, P. 2006. Advanced global illumination. AK Peters, Ltd.
    [14]
    Fleming, R., and Bülthoff, H. 2005. Low-level image cues in the perception of translucent materials. ACM Transactions on Applied Perception (TAP) 2, 3.
    [15]
    Frisvad, J., Christensen, N., and Jensen, H. 2007. Computing the scattering properties of participating media using lorenz-mie theory. ACM Trans. Graph. 26, 3.
    [16]
    Fuchs, C., Chen, T., Goesele, M., Theisel, H., and Seidel, H. 2007. Density estimation for dynamic volumes. Computers & Graphics 31, 2.
    [17]
    Ghosh, A., Achutha, S., Heidrich, W., and O'Toole, M. 2007. BRDF acquisition with basis illumination. IEEE CVPR.
    [18]
    Gkioulekas, I., Xiao, B., Zhao, S., Adelson, E., Zickler, T., and Bala, K. 2013. Understanding the role of phase function in translucent appearance. To appear in ACM Trans. Graph. 32, 5.
    [19]
    Goesele, M., Lensch, H., Lang, J., Fuchs, C., and Seidel, H. 2004. Disco: acquisition of translucent objects. ACM Trans. Graph. 23, 3.
    [20]
    Gu, J., Nayar, S., Grinspun, E., Belhumeur, P., and Ramamoorthi, R. 2008. Compressive structured light for recovering inhomogeneous participating media. ECCV.
    [21]
    Gupta, M., Agrawal, A., Veeraraghavan, A., and Narasimhan, S. 2011. Structured light 3D scanning in the presence of global illumination. IEEE CVPR.
    [22]
    Hasinoff, S., Durand, F., and Freeman, W. 2010. Noise-optimal capture for high dynamic range photography. IEEE CVPR.
    [23]
    Hawkins, T., Einarsson, P., and Debevec, P. 2005. Acquisition of time-varying participating media. ACM Trans. Graph. 24, 3.
    [24]
    Henyey, L., and Greenstein, J. 1941. Diffuse radiation in the galaxy. The Astrophysical Journal 93.
    [25]
    Holroyd, M., and Lawrence, J. 2011. An analysis of using high-frequency sinusoidal illumination to measure the 3d shape of translucent objects. IEEE CVPR.
    [26]
    Hullin, B., Fuchs, M., Ajdin, B., Ihrke, I., Seidel, H., and Lensch, H. 2008. Direct visualization of real-world light transport. Vision, Modeling, and Visualization 2008.
    [27]
    Ishimaru, A. 1978. Wave propagation and scattering in random media. Wiley-IEEE.
    [28]
    Jensen, H., Marschner, S., Levoy, M., and Hanrahan, P. 2001. A practical model for subsurface light transport. In Proceedings of SIGGRAPH 2001, Annual Conference Series.
    [29]
    Jensen, H. 2001. Realistic image synthesis using photon mapping. AK Peters, Ltd.
    [30]
    Johnson, C., and Gabriel, D. 1994. Laser light scattering. Dover.
    [31]
    Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Trans. Graph. 25, 3.
    [32]
    LeVeque, R. 2007. Finite Difference Methods for Ordinary and Partial Differential Equations, Steady-State and Time-Dependent Problems. SIAM.
    [33]
    McCormick, N., and Sanchez, R. 1981. Inverse problem transport calculations for anisotropic scattering coefficients. Journal of Mathematical Physics 22, 199.
    [34]
    Mishchenko, M., Travis, L., and Lacis, A. 2006. Multiple scattering of light by particles: radiative transfer and coherent backscattering. Cambridge University.
    [35]
    Mukaigawa, Y., Yagi, Y., and Raskar, R. 2010. Analysis of light transport in scattering media. IEEE CVPR.
    [36]
    Narasimhan, S., Gupta, M., Donner, C., Ramamoorthi, R., Nayar, S., and Jensen, H. 2006. Acquiring scattering properties of participating media by dilution. ACM Trans. Graph. 25, 3.
    [37]
    Nayar, S., Krishnan, G., Grossberg, M., and Raskar, R. 2006. Fast separation of direct and global components of a scene using high frequency illumination. ACM Trans. Graph. 25, 3.
    [38]
    O'Toole, M., and Kutulakos, K. N. 2010. Optical computing for fast light transport analysis. ACM Trans. Graph. 29, 6.
    [39]
    Peers, P., vom Berge, K., Matusik, W., Ramamoorthi, R., Lawrence, J., Rusinkiewicz, S., and Dutré, P. 2006. A compact factored representation of heterogeneous subsurface scattering. ACM Trans. Graph. 25, 3.
    [40]
    Pine, D., Weitz, D., Zhu, J., and Herbolzheimer, E. 1990. Diffusing-wave spectroscopy: dynamic light scattering in the multiple scattering limit. Journal de Physique 51, 18.
    [41]
    Prahl, S., van Gemert, M., and Welch, A. 1993. Determining the optical properties of turbid media by using the adding--doubling method. Applied optics 32, 4.
    [42]
    Pusey, P. 1999. Suppression of multiple scattering by photon cross-correlation techniques. Current opinion in colloid & interface science 4, 3.
    [43]
    Ramamoorthi, R., and Hanrahan, P. 2001. A signal-processing framework for inverse rendering. In Proceedings of SIGGRAPH 2001, Annual Conference Series.
    [44]
    Reynolds, L., and McCormick, N. 1980. Approximate two-parameter phase function for light scattering. JOSA 70, 10.
    [45]
    Rushmeier, H., and Torrance, K. 1987. The zonal method for calculating light intensities in the presence of a participating medium. In Computer Graphics, vol. 21.
    [46]
    Singer, J., Grünbaum, F., Kohn, P., Zubelli, J., et al. 1990. Image reconstruction of the interior of bodies that diffuse radiation. Science 248, 4958.
    [47]
    Tong, X., Wang, J., Lin, S., Guo, B., and Shum, H. 2005. Modeling and rendering of quasi-homogeneous materials. ACM Trans. Graph. 24, 3.
    [48]
    Wang, J., Zhao, S., Tong, X., Lin, S., Lin, Z., Dong, Y., Guo, B., and Shum, H. 2008. Modeling and rendering of heterogeneous translucent materials using the diffusion equation. ACM Trans. Graph. 27, 1.
    [49]
    Wu, D., O'Toole, M., Velten, A., Agrawal, A., and Raskar, R. 2012. Decomposing global light transport using time of flight imaging. IEEE CVPR.
    [50]
    Wyman, D., Patterson, M., and Wilson, B. 1989. Similarity relations for the interaction parameters in radiation transport. Applied optics 28, 24.

    Cited By

    View all
    • (2024)Digitizing translucent object appearance by validating computed optical propertiesApplied Optics10.1364/AO.52197463:16(4317)Online publication date: 22-May-2024
    • (2024)View-Independent Adjoint Light Tracing for Lighting Design OptimizationACM Transactions on Graphics10.1145/366218043:3(1-16)Online publication date: 3-May-2024
    • (2024)Navigating the Manifold of Translucent AppearanceComputer Graphics Forum10.1111/cgf.1503543:2Online publication date: 27-Apr-2024
    • Show More Cited By

    Index Terms

    1. Inverse volume rendering with material dictionaries

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Graphics
      ACM Transactions on Graphics  Volume 32, Issue 6
      November 2013
      671 pages
      ISSN:0730-0301
      EISSN:1557-7368
      DOI:10.1145/2508363
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 01 November 2013
      Published in TOG Volume 32, Issue 6

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. inverse rendering
      2. material dictionaries
      3. scattering

      Qualifiers

      • Research-article

      Funding Sources

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)80
      • Downloads (Last 6 weeks)17

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Digitizing translucent object appearance by validating computed optical propertiesApplied Optics10.1364/AO.52197463:16(4317)Online publication date: 22-May-2024
      • (2024)View-Independent Adjoint Light Tracing for Lighting Design OptimizationACM Transactions on Graphics10.1145/366218043:3(1-16)Online publication date: 3-May-2024
      • (2024)Navigating the Manifold of Translucent AppearanceComputer Graphics Forum10.1111/cgf.1503543:2Online publication date: 27-Apr-2024
      • (2024)Image-based reconstruction of heterogeneous media in the presence of multiple light-scatteringComputers & Graphics10.1016/j.cag.2024.01.004119(103877)Online publication date: Apr-2024
      • (2023)PARS - Path recycling and sorting for efficient cloud tomographyIntelligent Computing10.34133/icomputing.00072Online publication date: 8-Mar-2023
      • (2023)Differentiable Rendering of Parametric GeometryACM Transactions on Graphics10.1145/361838742:6(1-18)Online publication date: 5-Dec-2023
      • (2023)Extended Path Space Manifolds for Physically Based Differentiable RenderingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618195(1-11)Online publication date: 10-Dec-2023
      • (2023)PSDR-Room: Single Photo to Scene using Differentiable RenderingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618165(1-11)Online publication date: 10-Dec-2023
      • (2023)Recursive Control Variates for Inverse RenderingACM Transactions on Graphics10.1145/359213942:4(1-13)Online publication date: 26-Jul-2023
      • (2023)Stealth Shaper: Reflectivity Optimization as Surface StylizationACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591542(1-10)Online publication date: 23-Jul-2023
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media