Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Converging Algorithm-Agnostic Denoising for Monte Carlo Rendering

Published: 09 August 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Denoising Monte Carlo rendered images is a critical challenge in computer graphics, traditionally addressed in post-processing phases. Recent advances have shifted focus towards integrating denoising directly into progressive rendering. This approach not only blends denoised outputs with noisy inputs to enhance visual quality but also guides adaptive sampling through variance estimation of denoised outputs. In this paper, we introduce a novel method that predicts the blending weight of denoised images directly during progressive rendering. Our technique adjusts the blending weight for each pixel based on error estimates, effectively 'skipping' certain iterations of Monte Carlo Path Tracing (MCPT) and mimicking adaptive sampling a posteriori. A key innovation of our approach is an analytical method that ensures the blended output converges accurately to the reference image. Our method does not rely on deep-learning techniques, making it immediately applicable to any denoising algorithm. We demonstrate that our method enhances visual quality and allows for blending between noisy and denoised images, even those obtained at different MCPT iterations. This not only streamlines the rendering process but also improves efficiency and output fidelity.

    Supplemental Material

    ZIP File - supplemental PDF
    supplemental PDF + source

    References

    [1]
    Attila T. Áfra. 2023. Intel® Open Image Denoise. https://www.openimagedenoise.org.
    [2]
    Pontus Andersson, Jim Nilsson, Peter Shirley, and Tomas Akenine-Möller. 2021. Visualizing Errors in Rendered High Dynamic Range Images. In Eurographics Short Papers. https://doi.org/10.2312/egs.20211015
    [3]
    Steve Bako, Thijs Vogels, Brian McWilliams, Mark Meyer, Jan Novák, Alex Harvill, Pradeep Sen, Tony Derose, and Fabrice Rousselle. 2017. Kernel-predicting convolutional networks for denoising Monte Carlo renderings. ACM Trans. Graph. 36, 4 (2017), 97--1.
    [4]
    Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Transactions on Graphics (TOG) 39, 4 (2020), 148--1.
    [5]
    Mike Reis Bueno, Carlos Estrela, José Mauro Granjeiro, Matheus Rodrigues de Araújo Estrela, Bruno Correa Azevedo, and Anibal Diogenes. 2021. Cone-beam computed tomography cinematic rendering: clinical, teaching and research applications. Brazilian oral research 35 (2021).
    [6]
    Per Christensen, Julian Fong, Jonathan Shade, Wayne Wooten, Brenden Schubert, Andrew Kensler, Stephen Friedman, Charlie Kilpatrick, Cliff Ramshaw, Marc Bannister, et al. 2018. Renderman: An advanced path-tracing architecture for movie rendering. ACM Transactions on Graphics (TOG) 37, 3 (2018), 1--21.
    [7]
    Robert L Cook. 1986. Stochastic sampling in computer graphics. ACM Transactions on Graphics (TOG) 5, 1 (1986), 51--72.
    [8]
    Elena Denisova, Leonardo Manetti, Leonardo Bocchi, and Ernesto Iadanza. 2023. AR2T: Advanced Realistic Rendering Technique for Biomedical Volumes. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 347--357.
    [9]
    William Donnelly, Alan Wolfe, Judith Bütepage, and Jon Valdés. 2024. FAST: Filter-Adapted Spatio-Temporal Sampling for Real-Time Rendering. Proceedings of the ACM on Computer Graphics and Interactive Techniques 7, 1 (2024), 1--16.
    [10]
    Lars C Ebert, Wolf Schweitzer, Dominic Gascho, Thomas D Ruder, Patricia M Flach, Michael J Thali, and Garyfalia Ampanozi. 2017. Forensic 3D visualization of CT data using cinematic volume rendering: a preliminary study. American Journal of Roentgenology 208, 2 (2017), 233--240.
    [11]
    Arthur Firmino, Jeppe Revall Frisvad, and Henrik Wann Jensen. 2022. Progressive denoising of Monte Carlo rendered images. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 1--11.
    [12]
    Arthur Firmino, Jeppe Revall Frisvad, and Henrik Wann Jensen. 2023. Denoising-Aware Adaptive Sampling for Monte Carlo Ray Tracing. In ACM SIGGRAPH 2023 Conference Proceedings. 1--11.
    [13]
    Estevão S Gedraite and Murielle Hadad. 2011. Investigation on the effect of a Gaussian Blur in image filtering and segmentation. In Proceedings ELMAR-2011. IEEE, 393--396.
    [14]
    Jeongmin Gu, Jose A Iglesias-Guitian, and Bochang Moon. 2022. Neural James-Stein combiner for unbiased and biased renderings. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1--14.
    [15]
    Nikolai Hofmann, Jana Martschinke, Klaus Engel, and Marc Stamminger. 2020. Neural denoising for path tracing of medical volumetric data. Proceedings of the ACM on Computer Graphics and Interactive Techniques 3, 2 (2020), 1--18.
    [16]
    Cheolkon Jung, Tian Sun, and Aiguo Gu. 2015. Content adaptive video denoising based on human visual perception. Journal of Visual Communication and Image Representation 31 (2015), 14--25.
    [17]
    James T. Kajiya. 1986. The Rendering Equation. In Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '86). Association for Computing Machinery, New York, NY, USA, 143--150. https://doi.org/10.1145/15922.15902
    [18]
    Dirk P Kroese and Reuven Y Rubinstein. 2012. Monte carlo methods. Wiley Interdisciplinary Reviews: Computational Statistics 4, 1 (2012), 48--58.
    [19]
    Tzu-Mao Li, Yu-Ting Wu, and Yung-Yu Chuang. 2012. SURE-based optimization for adaptive sampling and reconstruction. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1--9.
    [20]
    Merlin Nimier-David, Delio Vicini, Tizian Zeltner, and Wenzel Jakob. 2019. Mitsuba 2: A retargetable forward and inverse renderer. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1--17.
    [21]
    Steven G Parker, James Bigler, Andreas Dietrich, Heiko Friedrich, Jared Hoberock, David Luebke, David McAllister, Morgan McGuire, Keith Morley, Austin Robison, et al. 2010. Optix: a general purpose ray tracing engine. Acm transactions on graphics (tog) 29, 4 (2010), 1--13.
    [22]
    Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2023. Physically based rendering: From theory to implementation. MIT Press.
    [23]
    Sathish Ramani, Thierry Blu, and Michael Unser. 2008. Monte-Carlo SURE: A black-box optimization of regularization parameters for general denoising algorithms. IEEE Transactions on image processing 17, 9 (2008), 1540--1554.
    [24]
    Fabrice Rousselle, Claude Knaus, and Matthias Zwicker. 2012. Adaptive rendering with non-local means filtering. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1--11.
    [25]
    Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, and Marco Salvi. 2017. Spatiotemporal variance-guided filtering: real-time reconstruction for path-traced global illumination. In Proceedings of High Performance Graphics. 1--12.
    [26]
    Peter Shirley and R Keith Morley. 2008. Realistic ray tracing. AK Peters, Ltd.
    [27]
    Stephen M. Stigler. 1981. Gauss and the Invention of Least Squares. The Annals of Statistics 9, 3 (1981), 465 - 474. https://doi.org/10.1214/aos/1176345451
    [28]
    Yuqi Yang. 2024. A denoising model for MC rendered images based on fusion kernel prediction and generation of adversarial networks. In Fourth International Conference on Computer Vision and Data Mining (ICCVDM 2023), Vol. 13063. SPIE, 391--399.
    [29]
    Dmitry Zhdan. 2021. ReBLUR: A Hierarchical Recurrent Denoiser. Ray Tracing Gems II: Next Generation Real-Time Rendering with DXR, Vulkan, and OptiX (2021), 823--844.

    Index Terms

    1. Converging Algorithm-Agnostic Denoising for Monte Carlo Rendering

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
      Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 7, Issue 3
      August 2024
      363 pages
      EISSN:2577-6193
      DOI:10.1145/3688389
      Issue’s Table of Contents
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 09 August 2024
      Published in PACMCGIT Volume 7, Issue 3

      Check for updates

      Author Tags

      1. Analytical Blending
      2. Converging Denoising
      3. Monte Carlo Path Tracing

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 2
        Total Downloads
      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 10 Aug 2024

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Get Access

      Login options

      Full Access

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media