Spatiotemporal Variance-Guided Filtering for Motion Blur
Article No.: 22, Pages 1 - 13
Abstract
Adding motion blur to a scene can help to convey the feeling of speed even at low frame rates. Monte Carlo ray tracing can compute accurate motion blur, but requires a large number of samples per pixel to converge. In comparison, rasterization, in combination with a post-processing filter, can generate fast, but not accurate motion blur from a single sample per pixel.
We build upon a recent path tracing denoiser and propose its variant to simulate ray-traced motion blur, enabling fast and high-quality motion blur from a single sample per pixel. Our approach creates temporally coherent renderings by estimating the motion direction and variance locally, and using these estimates to guide wavelet filters at different scales.
We compare image quality against brute force Monte Carlo methods and current post-processing motion blur. Our approach achieves real-time frame rates, requiring less than 4ms for full-screen motion blur at a resolution of 1920 x 1080 on recent graphics cards.
Supplementary Material
Supplemental movie, appendix, image and software files for, Spatiotemporal Variance-Guided Filtering for Motion Blur
- Download
- 145.06 MB
References
[1]
Tomas Akenine-Möller, Jacob Munkberg, and Jon Hasselgren. 2007. Stochastic Rasterization Using Time-Continuous Triangles. In Proceedings of the 22nd ACM SIGGRAPH/EUROGRAPHICS Symposium on Graphics Hardware (GH '07). Eurographics Association, Goslar, DEU, 7--16.
[2]
Pontus Andersson, Jim Nilsson, Tomas Akenine-Möller, Magnus Oskarsson, Kalle Aström, and Mark D. Fairchild. 2020. FLIP: A Difference Evaluator for Alternating Images. Proc. ACM Comput. Graph. Interact. Tech. 3, 2 (2020). https://doi.org/10.1145/3406183
[3]
David Blackman and Sebastiano Vigna. 2021. Scrambled Linear Pseudorandom Number Generators. ACM Trans. Math. Softw. 47, 4 (2021). https://doi.org/10.1145/3460772
[4]
Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive Reconstruction of Monte Carlo Image Sequences Using a Recurrent Denoising Autoencoder. ACM Trans. Graph. 36, 4, Article 98 (jul 2017), 12 pages. https://doi.org/10.1145/3072959.3073601
[5]
Robert L. Cook, Thomas Porter, and Loren Carpenter. 1984. Distributed Ray Tracing. In Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '84). Association for Computing Machinery, New York, NY, USA, 137--145. https://doi.org/10.1145/800031.808590
[6]
Holger Dammertz, Daniel Sewtz, Johannes Hanika, and Hendrik P. A. Lensch. 2010. Edge-Avoiding À-Trous Wavelet Transform for Fast Global Illumination Filtering. In Proceedings of the Conference on High Performance Graphics (HPG '10). Eurographics Association, Goslar, DEU, 67--75.
[7]
Kevin Egan, Yu-Ting Tseng, Nicolas Holzschuch, Fredo Durand, and Ravi Ramamoorthi. 2009. Frequency Analysis and Sheared Reconstruction for Rendering Motion Blur. ACM Transactions on Graphics (SIGGRAPH 09) 28, 3 (2009). http://graphics.cs.berkeley.edu/papers/Egan-FAS-2009-07/
[8]
Eric Enderton and Morgan McGuire. 2012. Stochastic Rasterization.
[9]
Epic Games. 2019. Radial Motion Blur. https://docs.unrealengine.com/4.27/en-US/RenderingAndGraphics/Materials/HowTo/RadialMotionBlur/
[10]
Epic Games. 2022. Motion Blur. https://docs.unrealengine.com/4.27/en-US/Resources/ContentExamples/PostProcessing/1_12/
[11]
Jon Hasselgren, Jacob Munkberg, Marco Salvi, Anjul Patney, and Aaron Lefohn. 2020. Neural Temporal Adaptive Sampling and Denoising. Computer Graphics Forum (2020). https://doi.org/10.1111/cgf.13919
[12]
Jon Hasselgren, Jacob Munkberg, and Karthik Vaidyanathan. 2015. Practical Layered Reconstruction for Defocus and Motion Blur. Journal of Computer Graphics Techniques (JCGT) 4, 2 (2015), 45--58. http://jcgt.org/published/0004/02/04/
[13]
Brian Karis. 2014. High-Quality Temporal Supersampling. In SIGGRAPH Courses: Advances in Real-Time Rendering in Games.
[14]
Jaakko Lehtinen, Timo Aila, Jiawen Chen, Samuli Laine, and Frédo Durand. 2011. Temporal Light Field Reconstruction for Rendering Distribution Effects. ACM Trans. Graph. 30, 4 (2011).
[15]
Morgan McGuire. 2017. Computer Graphics Archive. https://casual-effects.com/data
[16]
Morgan McGuire, Padraic Hennessy, Michael Bukowski, and Brian Osman. 2012. A Reconstruction Filter for Plausible Motion Blur. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D '12). Association for Computing Machinery, New York, NY, USA, 135--142. https://doi.org/10.1145/2159616.2159639
[17]
Microsoft. 2019. D3D12 Raytracing Real-Time Denoised Ambient Occlusion sample. https://github.com/microsoft/DirectX-Graphics-Samples/tree/master/Samples/Desktop/D3D12Raytracing/src/D3D12RaytracingRealTimeDenoisedAmbientOcclusion
[18]
Microsoft. 2021. DirectX Raytracing (DXR) Functional Spec. https://microsoft.github.io/DirectX-Specs/d3d/Raytracing.html
[19]
Jacob Munkberg, Karthik Vaidyanathan, Jon Hasselgren, Petrik Clarberg, and Tomas Akenine-Möller. 2014. Layered Reconstruction for Defocus and Motion Blur. Computer Graphics Forum 33, 4 (2014), 81--92. https://doi.org/10.1111/cgf.12415
[20]
Y. Ouyang, S. Liu, M. Kettunen, M. Pharr, and J. Pantaleoni. 2021. ReSTIR GI: Path Resampling for Real-Time Path Tracing. Computer Graphics Forum 40, 8 (2021), 17--29. https://doi.org/10.1111/cgf.14378
[21]
Matt Ritchie, Greg Modern, and Kenny Mitchell. 2010. Split Second Motion Blur. In ACM SIGGRAPH 2010 Talks (SIGGRAPH '10). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1837026.1837048
[22]
Gilberto Rosado. 2007. Motion Blur as a Post-Processing Effect. In Gpu Gems 3, Hubert Nguyen (Ed.). Addison-Wesley Professional, 575--582. https://developer.nvidia.com/gpugems/gpugems3/part-iv-image-effects/chapter-27-motion-blur-post-processing-effect
[23]
Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, and Marco Salvi. 2017. Spatiotemporal Variance-Guided Filtering: Real-Time Reconstruction for Path-Traced Global Illumination. In Proceedings of High Performance Graphics (HPG '17). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3105762.3105770
[24]
Clement Shimizu, Amit Shesh, and Baoquan Chen. 2003. Hardware accelerated motion blur generation. In EUROGRAPHICS, Vol. 22. 2003.
[25]
Unity Technologies. 2021. Post Processing Effects: Motion Blur. https://learn.unity.com/tutorial/post-processing-effects-motion-blur-2019-3
[26]
Chris Wyman, Shawn Hargreaves, Peter Shirley, and Colin Barré-Brisebois. 2018. Introduction to DirectX Raytracing. In ACM SIGGRAPH 2018 Courses (SIGGRAPH '18). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3214834.3231814
Index Terms
- Spatiotemporal Variance-Guided Filtering for Motion Blur
Recommendations
Spatiotemporal variance-guided filtering: real-time reconstruction for path-traced global illumination
HPG '17: Proceedings of High Performance GraphicsWe introduce a reconstruction algorithm that generates a temporally stable sequence of images from one path-per-pixel global illumination. To handle such noisy input, we use temporal accumulation to increase the effective sample count and spatiotemporal ...
Frequency analysis and sheared reconstruction for rendering motion blur
SIGGRAPH '09: ACM SIGGRAPH 2009 papersMotion blur is crucial for high-quality rendering, but is also very expensive. Our first contribution is a frequency analysis of motion-blurred scenes, including moving objects, specular reflections, and shadows. We show that motion induces a shear in ...
Frequency analysis and sheared reconstruction for rendering motion blur
Motion blur is crucial for high-quality rendering, but is also very expensive. Our first contribution is a frequency analysis of motion-blurred scenes, including moving objects, specular reflections, and shadows. We show that motion induces a shear in ...
Comments
Information & Contributors
Information
Published In
Copyright © 2022 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 July 2022
Published in PACMCGIT Volume 5, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 424Total Downloads
- Downloads (Last 12 months)177
- Downloads (Last 6 weeks)22
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in