Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

ReSTIR Subsurface Scattering for Real-Time Path Tracing

Published: 09 August 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Subsurface scattering is an important visual cue and in real-time rendering it is often approximated using screen-space algorithms. Path tracing with the diffusion approximation can easily overcome the limitations of these algorithms, but increases image noise. We improve its efficiency by applying reservoir-based spatiotemporal importance resampling (ReSTIR) to subsurface light transport paths. For this, we adopt BSSRDF importance sampling for generating candidates. Further, spatiotemporal reuse requires shifting paths between domains. We observe that different image regions benefit most from either reconnecting through the translucent object (reconnection shift), or one vertex later (delayed reconnection shift). We first introduce a local subsurface scattering specific criterion for a hybrid shift that deterministically selects one of the two shifts for a path. Due to the locality, it cannot always choose the most efficient shift, e.g. near shadow boundaries. Therefore, we additionally propose a novel sequential shift to combine multiple shift mappings: We execute subsequent resampling passes, each one using a different shift, which does not require to deterministically choose a shift for a path. Instead, resampling can pick the most successful shift implicitly. Our method achieves realtime performance and significantly reduces noise and denoising artifacts in regions with visible subsurface scattering compared to standard path tracing with equal render time.

    Supplemental Material

    PDF File - supplemental PDF
    supplemental PDF

    References

    [1]
    Benedikt Bitterli. 2021. Correlations and reuse for fast and accurate physically based light transport. Ph. D. Dissertation. Dartmouth College.
    [2]
    Benedikt Bitterli, Wenzel Jakob, Jan Novák, and Wojciech Jarosz. 2017. Reversible Jump Metropolis Light Transport Using Inverse Mappings. ACM Trans. Graph. 37, 1, Article 1 (Oct. 2017). https://doi.org/10.1145/3132704
    [3]
    Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Trans. Graph. 39, 4, Article 148 (Aug. 2020). https://doi.org/10.1145/3386569.3392481
    [4]
    Jesper Børlum, Brian Bunch Christensen, Thomas Kim Kjeldsen, Peter Trier Mikkelsen, Karsten Østergaard Noe, Jens Rimestad, and Jesper Mosegaard. 2011. SSLPV: Subsurface Light Propagation Volumes. In Proceedings of the ACM SIGGRAPH Symposium on High Performance Graphics (Vancouver, British Columbia, Canada) (HPG '11). Association for Computing Machinery, New York, NY, USA, 7--14. https://doi.org/10.1145/2018323.2018325
    [5]
    Brent Burley. 2015. Extending the Disney BRDF to a BSDF with Integrated Subsurface Scattering. In SIGGRAPH Courses: Physically Based Shading in Theory and Practice. https://doi.org/10.1145/2776880.2787670
    [6]
    Christopher A. Burns and Warren A. Hunt. 2013. The Visibility Buffer: A Cache-Friendly Approach to Deferred Shading. JCGT 2, 2 (12 Aug. 2013), 55--69. http://jcgt.org/published/0002/02/04/
    [7]
    Min-Te Chao. 1982. A general purpose unequal probability sampling plan. Biometrika 69, 3 (Dec. 1982), 653--656. https://doi.org/10.1093/biomet/69.3.653
    [8]
    Per H. Christensen. 2015. An approximate reflectance profile for efficient subsurface scattering. In SIGGRAPH Talks. ACM, Article 25. https://doi.org/10.1145/2775280.2792555
    [9]
    Per H. Christensen, George Harker, Jonathan Shade, Brenden Schubert, and Dana Batali. 2012. Multiresolution radiosity caching for global illumination in movies. In SIGGRAPH Talks. ACM, Article 47. https://doi.org/10.1145/2343045.2343108
    [10]
    Carsten Dachsbacher, Jaroslav Křivánek, Miloš Hašan, Adam Arbree, Bruce Walter, and Jan Novák. 2014. Scalable Realistic Rendering with Many-Light Methods. Computer Graphics Forum 33, 1 (2014), 88--104. https://doi.org/10.1111/cgf.12256
    [11]
    Eugene D'Eon and Geoffrey Irving. 2011. A quantized-diffusion model for rendering translucent materials. ACM Trans. Graph. 30, 4, Article 56 (July 2011). https://doi.org/10.1145/2010324.1964951
    [12]
    Eugene d'Eon, David Luebke, and Eric Enderton. 2007. Efficient rendering of human skin. In Rendering Techniques (Proc. EGSR). Eurographics Association, 147--157. https://doi.org/10.2312/EGWR/EGSR07/147-157
    [13]
    Craig Donner and Henrik Wann Jensen. 2005. Light diffusion in multi-layered translucent materials. ACM Trans. Graph. 24, 3 (July 2005), 1032--1039. https://doi.org/10.1145/1073204.1073308
    [14]
    Evgenii Golubev. 2018. Efficient screen-space subsurface scattering using Burley's normalized diffusion in real-time. SIGGRAPH Courses: Advances in Real-Time Rendering in Games Course (2018). https://doi.org/10.1145/3214834.3264541
    [15]
    Evgenii Golubev. 2019. Sampling Burley's Normalized Diffusion Profiles. zero-radiance.github.io [Online; posted 2019-12-16].
    [16]
    Simon Green. 2004. Real-Time Approximations to Subsurface Scattering. In GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics. Pearson Higher Education, Chapter 16.
    [17]
    Adrien Gruson, Binh-Son Hua, Nicolas Vibert, Derek Nowrouzezahrai, and Toshiya Hachisuka. 2018. Gradient-domain volumetric photon density estimation. ACM Trans. Graph. 37, 4, Article 82 (July 2018). https://doi.org/10.1145/3197517.3201363
    [18]
    Ralf Habel, Per H. Christensen, and Wojciech Jarosz. 2013. Photon Beam Diffusion: A Hybrid Monte Carlo Method for Subsurface Scattering. Computer Graphics Forum (Proc. EGSR) 32, 4 (2013), 27--37. https://doi.org/10.1111/cgf.12148
    [19]
    Binh-Son Hua, Adrien Gruson, Derek Nowrouzezahrai, and Toshiya Hachisuka. 2017. Gradient-Domain Photon Density Estimation. Computer Graphics Forum (2017). https://doi.org/10.1111/cgf.13104
    [20]
    Binh-Son Hua, Adrien Gruson, Victor Petitjean, Matthias Zwicker, Derek Nowrouzezahrai, Elmar Eisemann, and Toshiya Hachisuka. 2019. A Survey on Gradient-Domain Rendering. Computer Graphics Forum 38, 2 (2019), 455--472. https://doi.org/10.1111/cgf.13652
    [21]
    Henrik Wann Jensen and Juan Buhler. 2002. A rapid hierarchical rendering technique for translucent materials. ACM Trans. Graph. 21, 3 (July 2002), 576--581. https://doi.org/10.1145/566654.566619
    [22]
    Henrik Wann Jensen, Stephen R. Marschner, Marc Levoy, and Pat Hanrahan. 2001. A practical model for subsurface light transport. In Annual Conference Series (Proc. SIGGRAPH). ACM, 511--518. https://doi.org/10.1145/383259.383319
    [23]
    Jorge Jimenez, Veronica Sundstedt, and Diego Gutierrez. 2009. Screen-space perceptual rendering of human skin. ACM Trans. Appl. Percept. 6, 4, Article 23 (Oct. 2009). https://doi.org/10.1145/1609967.1609970
    [24]
    Jorge Jimenez, Károly Zsolnai, Adrian Jarabo, Christian Freude, Thomas Auzinger, Xian-Chun Wu, Javier von der Pahlen, Michael Wimmer, and Diego Gutierrez. 2015. Separable Subsurface Scattering. Computer Graphics Forum 34, 6 (2015), 188--197. https://doi.org/10.1111/cgf.12529
    [25]
    James T. Kajiya. 1986. The Rendering Equation. Computer Graphics (Proceedings of SIGGRAPH) 20, 4 (Aug. 1986), 143--150. https://doi.org/10/cvf53j
    [26]
    Markus Kettunen, Daqi Lin, Ravi Ramamoorthi, Thomas Bashford-Rogers, and Chris Wyman. 2023. Conditional Resampled Importance Sampling and ReSTIR. In SIGGRAPH Asia Conference Papers. ACM, Article 91. https://doi.org/10.1145/3610548.3618245
    [27]
    Markus Kettunen, Marco Manzi, Miika Aittala, Jaakko Lehtinen, Frédo Durand, and Matthias Zwicker. 2015. Gradient-domain path tracing. ACM Trans. Graph. 34, 4, Article 123 (July 2015). https://doi.org/10.1145/2766997
    [28]
    Alan King, Christopher Kulla, Alejandro Conty, and Marcos Fajardo. 2013. BSSRDF importance sampling. In SIGGRAPH Talks. ACM, Article 48. https://doi.org/10.1145/2504459.2504520
    [29]
    Jaroslav Křivánek and Eugene d'Eon. 2014. A zero-variance-based sampling scheme for Monte Carlo subsurface scattering. In SIGGRAPH Talks. ACM, Article 66. https://doi.org/10.1145/2614106.2614138
    [30]
    Jaakko Lehtinen, Tero Karras, Samuli Laine, Miika Aittala, Frédo Durand, and Timo Aila. 2013. Gradient-domain metropolis light transport. ACM Trans. Graph. 32, 4, Article 95 (July 2013). https://doi.org/10.1145/2461912.2461943
    [31]
    Shiyu Liang, Yang Gao, Chonghao Hu, Peng Zhou, Aimin Hao, Lili Wang, and Hong Qin. 2024. State of the Art in Efficient Translucent Material Rendering with BSSRDF. Computer Graphics Forum 43, 1 (2024). https://doi.org/10.1111/cgf.14998
    [32]
    Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuksel, and Chris Wyman. 2022. Generalized resampled importance sampling: foundations of ReSTIR. ACM Trans. Graph. 41, 4, Article 75 (July 2022). https://doi.org/10.1145/3528223.3530158
    [33]
    Daqi Lin, Chris Wyman, and Cem Yuksel. 2021. Fast volume rendering with spatiotemporal reservoir resampling. ACM Trans. Graph. 40, 6, Article 279 (Dec. 2021). https://doi.org/10.1145/3478513.3480499
    [34]
    Zander Majercik, Thomas Müller, Alexander Keller, Derek Nowrouzezahrai, and Morgan McGuire. 2022. Dynamic Diffuse
    [35]
    Global Illumination Resampling. Computer Graphics Forum 41, 1 (2022), 158--171. https://doi.org/10.1111/cgf.14427
    [36]
    Marco Manzi, Markus Kettunen, Frédo Durand, Matthias Zwicker, and Jaakko Lehtinen. 2016. Temporal gradient-domain path tracing. ACM Trans. Graph. 35, 6, Article 246 (Dec. 2016). https://doi.org/10.1145/2980179.2980256
    [37]
    Johannes Meng, Johannes Hanika, and Carsten Dachsbacher. 2016. Improving the Dwivedi Sampling Scheme. Computer Graphics Forum 35, 4 (2016), 37--44. https://doi.org/10.1111/cgf.12947
    [38]
    Thomas Müller, Fabrice Rousselle, Jan Novák, and Alexander Keller. 2021. Real-time neural radiance caching for path tracing. ACM Trans. Graph. 40, 4, Article 36 (July 2021). https://doi.org/10.1145/3450626.3459812
    [39]
    Jan Novák, Iliyan Georgiev, Johannes Hanika, and Wojciech Jarosz. 2018. Monte Carlo Methods for Volumetric Light Transport Simulation. Computer Graphics Forum 37, 2 (2018), 551--576. https://doi.org/10.1111/cgf.13383
    [40]
    NVIDIA Research. 2017. NVIDIA OptiX™ AI-Accelerated Denoiser. https://developer.nvidia.com/optix-denoiser
    [41]
    Hisanari Otsu, Anton S. Kaplanyan, Johannes Hanika, Carsten Dachsbacher, and Toshiya Hachisuka. 2017. Fusing state spaces for markov chain Monte Carlo rendering. ACM Trans. Graph. 36, 4, Article 74 (July 2017). https://doi.org/10.1145/3072959.3073691
    [42]
    Y. Ouyang, S. Liu, M. Kettunen, M. Pharr, and J. Pantaleoni. 2021. ReSTIR GI: Path Resampling for Real-Time Path Tracing. Computer Graphics Forum 40, 8 (2021), 17--29. https://doi.org/10.1111/cgf.14378
    [43]
    Jacopo Pantaleoni. 2017. Charted metropolis light transport. ACM Trans. Graph. 36, 4, Article 75 (July 2017). https://doi.org/10.1145/3072959.3073677
    [44]
    Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically Based Rendering: From Theory to Implementation (3rd ed.). Morgan Kaufmann Publishers Inc.
    [45]
    Rohan Sawhney, Daqi Lin, Markus Kettunen, Benedikt Bitterli, Ravi Ramamoorthi, Chris Wyman, and Matt Pharr. 2024. Decorrelating ReSTIR Samplers via MCMC Mutations. ACM Trans. Graph. 43, 1, Article 10 (Jan. 2024). https://doi.org/10.1145/3629166
    [46]
    Christoph Schied and Carsten Dachsbacher. 2015. Deferred attribute interpolation for memory-efficient deferred shading. In Proc. High-Performance Graphics. ACM, 43--49. https://doi.org/10.1145/2790060.2790066
    [47]
    Justin Talbot, David Cline, and Parris Egbert. 2005. Importance Resampling for Global Illumination. In Proc. EGSR. Eurographics Association. https://doi.org/10.2312/EGWR/EGSR05/139-146
    [48]
    Bruce Walter, Pramook Khungurn, and Kavita Bala. 2012. Bidirectional lightcuts. ACM Trans. Graph. 31, 4, Article 59 (July 2012). https://doi.org/10.1145/2185520.2185555
    [49]
    Chris Wyman and Alexey Panteleev. 2022. Rearchitecting spatiotemporal resampling for production. In Proc. High-Performance Graphics. Eurographics Association, 23--41. https://doi.org/10.2312/hpg.20211281
    [50]
    Tiantian Xie, Marc Olano, Brian Karis, and Krzysztof Narkowicz. 2020. Real-time subsurface scattering with single pass variance-guided adaptive importance sampling. Proc. ACM Comput. Graph. Interact. Tech. 3, 1, Article 3 (May 2020). https://doi.org/10.1145/3384536
    [51]
    Matthias Zwicker, Wojciech Jarosz, Jaakko Lehtinen, Bochang Moon, Ravi Ramamoorthi, Fabrice Rousselle, Pradeep Sen, Cyril Soler, and Sung-Eui Yoon. 2015. Recent Advances in Adaptive Sampling and Reconstruction for Monte Carlo Rendering. Computer Graphics Forum (Proc. Eurographics) 34, 2 (May 2015), 667--681. https://doi.org/10/f7k6kj

    Index Terms

    1. ReSTIR Subsurface Scattering for Real-Time Path Tracing

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
      Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 7, Issue 3
      August 2024
      363 pages
      EISSN:2577-6193
      DOI:10.1145/3688389
      Issue’s Table of Contents
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 09 August 2024
      Published in PACMCGIT Volume 7, Issue 3

      Check for updates

      Author Tags

      1. BSSRDF importance sampling
      2. ReSTIR
      3. diffusion profile
      4. real-time rendering
      5. subsurface scattering

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 4
        Total Downloads
      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 10 Aug 2024

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Get Access

      Login options

      Full Access

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media