Cited By
View all- Wu Y(2024)Efficient Environment Map Rendering Based on DecompositionComputer Graphics Forum10.1111/cgf.15264Online publication date: 22-Oct-2024
Area ReSTIR: Resampling for Real-Time Defocus and Antialiasing
Article No.: 98, Pages 1 - 13
Abstract
Recent advancements in spatiotemporal reservoir resampling (ReSTIR) leverage sample reuse from neighbors to efficiently evaluate the path integral. Like rasterization, ReSTIR methods implicitly assume a pinhole camera and evaluate the light arriving at a pixel through a single predetermined subpixel location at a time (e.g., the pixel center). This prevents efficient path reuse in and near pixels with high-frequency details.
We introduce Area ReSTIR, extending ReSTIR reservoirs to also integrate each pixel's 4D ray space, including 2D areas on the film and lens. We design novel subpixel-tracking temporal reuse and shift mappings that maximize resampling quality in such regions. This robustifies ReSTIR against high-frequency content, letting us importance sample subpixel and lens coordinates and efficiently render antialiasing and depth of field.
Supplementary Material
supplemental
- Download
- 859.31 MB
References
[1]
Guillaume Abadie. 2018. Life of a bokeh. In SIGGRAPH Course Notes: Advances in Real-Time Rendering. https://advances.realtimerendering.com/s2018/index.htm
[2]
Kurt Akeley. 1993. Reality Engine graphics. In Proceedings of SIGGRAPH.
[3]
Steve Bako, Thijs Vogels, Brian Mcwilliams, Mark Meyer, Jan NováK, Alex Harvill, Pradeep Sen, Tony Derose, and Fabrice Rousselle. 2017. Kernel-predicting convolutional networks for denoising Monte Carlo renderings. ACM Trans. Graph. 36, 4, Article 97 (Jul 2017), 14 pages.
[4]
Pablo Bauszat, Victor Petitjean, and Elmar Eisemann. 2017. Gradient-domain path reusing. ACM Trans. Graph. 36, 6, Article 229 (Nov 2017), 9 pages.
[5]
Philippe Bekaert, Mateu Sbert, and John H Halton. 2002. Accelerating path tracing by re-using paths. In Rendering Techniques. 125--134.
[6]
Laurent Belcour, Cyril Soler, Kartic Subr, Nicolas Holzschuch, and Fredo Durand. 2013. 5D covariance tracing for efficient defocus and motion blur. ACM Trans. Graph. 32, 3, Article 31 (Jul 2013), 18 pages.
[7]
Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron E. Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Trans. Graph. 39, 4, Article 148 (Jul 2020), 17 pages.
[8]
Guillaume Boissé. 2021. World-space spatiotemporal reservoir reuse for ray-traced global illumination. In SIGGRAPH Asia Technical Communications. 22:1--4.
[9]
Jakub Boksansky, Paula Jukarainen, and Chris Wyman. 2021. Rendering many lights with grid-based reservoirs. In Ray Tracing Gems II, Adam Marrs, Peter Shirley, and Ingo Wald (Eds.). APress, 351--365.
[10]
Wesley Chang, Venkataram Sivaram, Derek Nowrouzezahrai, Toshiya Hachisuka, Ravi Ramamoorthi, and Tzu-Mao Li. 2023. Parameter-space ReSTIR for differentiable and inverse rendering. In SIGGRAPH (Conference Track). 1--10.
[11]
Min-Te Chao. 1982. A general purpose unequal probability sampling plan. Biometrika 69, 3 (1982), 653--656.
[12]
Robert L. Cook, Thomas K. Porter, and Loren C. Carpenter. 1984. Distributed ray tracing. Proceedings of SIGGRAPH.
[13]
Joe Demers. 2004. Depth of field: A survey of techniques. In GPU Gems. Addison-Wesley, Chapter 23, 375--390.
[14]
Cass Everitt. 2001. Interactive order-independent transparency. White Paper, NVIDIA.
[15]
Paul Haeberli and Kurt Akeley. 1990. The accumulation buffer: Hardware support for high-quality rendering. In Proceedings of SIGGRAPH.
[16]
Jon Hasselgren, Jacob Munkberg, Marco Salvi, Anjul Patney, and Aaron Lefohn. 2020. Neural temporal adaptive sampling and denoising. Computer Graphics Forum 39, 2 (May 2020), 147--155.
[17]
Binh-Son Hua, Adrien Gruson, Victor Petitjean, Matthias Zwicker, Derek Nowrouzezahrai, Elmar Eisemann, and Toshiya Hachisuka. 2019. A survey on gradient-domain rendering. Computer Graphics Forum 38, 2 (2019), 455--472.
[18]
Jie Jiang, Xiang Xu, and Beibei Wang. 2023. A ReSTIR GI Method Using the Sample-Space Filtering. In Computer Graphics International. 79--92.
[19]
Jorge Jimenez. 2014. Next generation post processing in "Call of Duty: Advanced Warfare". In SIGGRAPH Course Notes: Advances in Real-Time Rendering. https://advances.realtimerendering.com/s2014/index.html
[20]
Jorge Jimenez, Diego Gutierrez, Jason Yang, Alexander Reshetov, Pete Demoreuille, Tobias Berghoff, Cedric Perthuis, Henry Yu, Morgan McGuire, Timothy Lottes, Hugh Malan, Emil Persson, Dmitry Andreev, and Tiago Sousa. 2011. Filtering approaches for real-time anti-aliasing. In SIGGRAPH Course Notes. https://www.iryoku.com/aacourse/
[21]
James T Kajiya. 1986. The rendering equation. In Proceedings of SIGGRAPH. 143--150.
[22]
Simon Kallweit, Petrik Clarberg, Craig Kolb, Tomáš Davidovič, Kai-Hwa Yao, Theresa Foley, Yong He, Lifan Wu, Lucy Chen, Tomas Akenine-Möller, Chris Wyman, Cyril Crassin, and Nir Benty. 2022. The Falcor rendering framework. https://github.com/NVIDIAGameWorks/Falcor
[23]
Brian Karis. 2014. High-quality temporal supersampling. In SIGGRAPH Course Notes: Advances in Real-Time Rendering. https://advances.realtimerendering.com/s2014/index.html
[24]
Michael Kass, Aaron Lefohn, and John Owens. 2006. Interactive depth of field using simulated diffusion on a GPU. Pixar Technical Memo, #06-01.
[25]
Markus Kettunen, Daqi Lin, Ravi Ramamoorthi, Thomas Bashford-Rogers, and Chris Wyman. 2023. Conditional resampled importance sampling and ReSTIR. In SIGGRAPH Asia (Conference Track).
[26]
Markus Kettunen, Marco Manzi, Miika Aittala, Jaakko Lehtinen, Frédo Durand, and Matthias Zwicker. 2015. Gradient-domain path tracing. ACM Trans. Graph. 34, 4, Article 123 (Jul 2015), 13 pages.
[27]
Jonathan D. Korein and Norman I. Badler. 1983. Temporal anti-aliasing in computer generated animation. Proceedings of SIGGRAPH, 377--388.
[28]
M. Kraus and M. Strengert. 2007. Depth-of-field rendering by pyramidal image processing. Computer Graphics Forum 26, 3 (2007), 645--654.
[29]
Sungkil Lee, Elmar Eisemann, and Hans-Peter Seidel. 2009. Depth-of-field rendering with multiview synthesis. ACM Trans. Graph. 28, 5 (Dec 2009), 1--6.
[30]
Jaakko Lehtinen, Tero Karras, Samuli Laine, Miika Aittala, Frédo Durand, and Timo Aila. 2013. Gradient-domain Metropolis light transport. ACM Trans. Graph. 32, 4, Article 95 (Jul 2013), 12 pages.
[31]
Tzu-Mao Li, Yu-Ting Wu, and Yung-Yu Chuang. 2012. SURE-based optimization for adaptive sampling and reconstruction. ACM Trans. Graph. 31, 6, Article 194 (Nov 2012), 9 pages.
[32]
Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuksel, and Chris Wyman. 2022. Generalized resampled importance sampling: Foundations of ReSTIR. ACM Trans. Graph. 41, 2, Article 75 (Aug 2022), 23 pages.
[33]
Daqi Lin, Chris Wyman, and Cem Yuksel. 2021. Fast volume rendering with spatiotem-poral reservoir resampling. ACM Trans. Graph. 40, 6, Article 279 (Dec 2021), 18 pages.
[34]
Timothy Lottes. 2009. FXAA. White Paper, NVIDIA.
[35]
Don P. Mitchell and Arun N. Netravali. 1988. Reconstruction filters in computer-graphics. SIGGRAPH Comput. Graph. 22, 4 (Jun 1988), 221--228.
[36]
NVIDIA. 2019. Deep learning super sampling. https://developer.nvidia.com/rtx/dlss [Online; accessed 15-January-2024].
[37]
Yaobin Ouyang, Shiqiu Liu, Markus Kettunen, Matt Pharr, and Jacopo Pantaleoni. 2021. ReSTIR GI: Path resampling for real-time path tracing. In Computer Graphics Forum, Vol. 40. 17--29.
[38]
Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically Based Rendering: From Theory to Implementation (3rd ed.). Morgan Kaufmann, Cambridge, MA. https://pbrt.org/
[39]
Michael Potmesil and Indranil Chakravarty. 1982. Synthetic image generation with a lens and aperture camera model. ACM Trans. Graph. 1, 2 (Apr 1982), 85--108.
[40]
Alexander Reshetov. 2009. Morphological antialiasing. In High Performance Graphics. 109--116.
[41]
Rohan Sawhney, Daqi Lin, Markus Kettunen, Benedikt Bitterli, Ravi Ramamoorthi, Chris Wyman, and Matt Pharr. 2024. Decorrelating restir samplers via mcmc mutations. ACM Trans. Graph. 43, 1 (2024), 1--15.
[42]
Justin Talbot, David Cline, and Parris Egbert. 2005. Importance resampling for global illumination. In Eurographics Symposium on Rendering. 139--146.
[43]
Eric Veach. 1998. Robust Monte Carlo Methods for Light Transport Simulation. Ph. D. Dissertation. Stanford, CA, USA.
[44]
Eric Veach and Leonidas Guibas. 1995. Optimally combining sampling techniques for Monte Carlo rendering. In Proceedings of SIGGRAPH. 419--428.
[45]
Eric Veach and Leonidas J. Guibas. 1997. Metropolis light transport. In Proceedings of SIGGRAPH. 65--76.
[46]
Yu-Chen Wang, Chris Wyman, Lifan Wu, and Shuang Zhao. 2023. Amortizing Samples in Physics-Based Inverse Rendering using ReSTIR. ACM Trans. Graph. 42, 6 (December 2023), 1--17.
[47]
Alexander Weinrauch, Wolfgang Tatzgern, Pascal Stadlbauer, Alexis Crickx, Jozef Hladky, Arno Coomans, Martin Winter, Joerg H. Mueller, and Markus Steinberger. 2023. Effect-based multi-viewer caching for cloud-native rendering. ACM Trans. Graph. 42, 4, Article 87 (Jul 2023), 16 pages.
[48]
Chris Wyman, Markus Kettunen, Daqi Lin, Benedikt Bitterli, Cem Yuksel, Wojciech Jarosz, Pawel Kozlowski, and Giovanni De Francesco. 2023. A gentle introduction to ReSTIR: Path reuse in real-time. In ACM SIGGRAPH Courses.
[49]
Chris Wyman and Alexey Panteleev. 2021. Rearchitecting spatiotemporal resampling for production. In High-Performance Graphics. 23--41.
[50]
Lei Xiao, Salah Nouri, Matt Chapman, Alexander Fix, Douglas Lanman, and Anton Kaplanyan. 2020. Neural supersampling for real-time rendering. ACM Trans. Graph. 39, 4, Article 142 (Aug 2020), 12 pages.
[51]
Lei Yang, Shiqiu Liu, and Marco Salvi. 2020. A Survey of temporal antialiasing techniques. Computer Graphics Forum 39, 2 (2020), 607--621.
Index Terms
- Area ReSTIR: Resampling for Real-Time Defocus and Antialiasing
Recommendations
Generalized resampled importance sampling: foundations of ReSTIR
As scenes become ever more complex and real-time applications embrace ray tracing, path sampling algorithms that maximize quality at low sample counts become vital. Recent resampling algorithms building on Talbot et al.'s [2005] resampled importance ...
Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting
Efficiently rendering direct lighting from millions of dynamic light sources using Monte Carlo integration remains a challenging problem, even for off-line rendering systems. We introduce a new algorithm---ReSTIR---that renders such lighting ...
Fast volume rendering with spatiotemporal reservoir resampling
Volume rendering under complex, dynamic lighting is challenging, especially if targeting real-time. To address this challenge, we extend a recent direct illumination sampling technique, spatiotemporal reservoir resampling, to multi-dimensional path ...
Comments
Information & Contributors
Information
Published In
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 July 2024
Published in TOG Volume 43, Issue 4
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 464Total Downloads
- Downloads (Last 12 months)464
- Downloads (Last 6 weeks)101
Reflects downloads up to 28 Dec 2024
Other Metrics
Citations
Cited By
View all- Wu Y(2024)Efficient Environment Map Rendering Based on DecompositionComputer Graphics Forum10.1111/cgf.15264Online publication date: 22-Oct-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in