Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Virtual Blue Noise Lighting

Published: 27 July 2022 Publication History

Abstract

We introduce virtual blue noise lighting, a rendering pipeline for estimating indirect illumination with a blue noise distribution of virtual lights. Our pipeline is designed for virtual lights with non-uniform emission profiles that are more expensive to store, but required for properly and efficiently handling specular transport.
Unlike the typical virtual light placement approaches that traverse light paths from the original light sources, we generate them starting from the camera. This avoids two important problems: wasted memory and computation with fully-occluded virtual lights, and excessive virtual light density around high-probability light paths. In addition, we introduce a parallel and adaptive sample elimination strategy to achieve a blue noise distribution of virtual lights with varying density. This addresses the third problem of virtual light placement by ensuring that they are not placed too close to each other, providing better coverage of the (indirectly) visible surfaces and further improving the quality of the final lighting estimation.
For computing the virtual light emission profiles, we present a photon splitting technique that allows efficiently using a large number of photons, as it does not require storing them. During lighting estimation, our method allows using both global power-based and local BSDF important sampling techniques, combined via multiple importance sampling. In addition, we present an adaptive path extension method that avoids sampling nearby virtual lights for reducing the estimation error.
We show that our method significantly outperforms path tracing and prior work in virtual lights in terms of both performance and image quality, producing a fast but biased estimate of global illumination.

Supplementary Material

li (li.zip)
Supplemental movie, appendix, image and software files for, Virtual Blue Noise Lighting

References

[1]
Philippe Bekaert, Philipp Slusallek, Ronald Cools, Vlastimil Havran, and Hans-Peter Seidel. 2003. A custom designed density estimation method for light transport. (2003).
[2]
Nir Benty, Kai-Hwa Yao, Petrik Clarberg, Lucy Chen, Simon Kallweit, Tim Foley, Matthew Oakes, Conor Lavelle, and Chris Wyman. 2020. The Falcor Rendering Framework. https://github.com/NVIDIAGameWorks/Falcor
[3]
Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 39, 4 (July 2020).
[4]
Per H Christensen. 2010. Point-based global illumination for movie production. In ACM SIGGRAPH. 40.
[5]
Carsten Dachsbacher, Jaroslav Křivánek, Miloš Hašan, Adam Arbree, Bruce Walter, and Jan Novák. 2014. Scalable realistic rendering with many-light methods. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 88--104.
[6]
Tomáš Davidovič, Iliyan Georgiev, and Philipp Slusallek. 2012. Progressive lightcuts for GPU. In ACM SIGGRAPH 2012 Talks. ACM, 1.
[7]
T Davidovic, J Krivnek, M Hasan, P Slusallek, and K Bala. 2010. Combining global and local lights for high-rank illumination effects. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 29, 5 (2010).
[8]
Thomas Engelhardt and Carsten Dachsbacher. 2008. Octahedron Environment Maps. In VMV. 383--388.
[9]
Alejandro Conty Estevez and Christopher Kulla. 2018. Importance sampling of many lights with adaptive tree splitting. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 2 (2018), 25.
[10]
I. Evangelou, G. Papaioannou, K. Vardis, and A. A. Vasilakis. 2021. Fast Radius Search Exploiting Ray Tracing Frameworks. Journal of Computer Graphics Techniques (JCGT) 10, 1 (5 February 2021), 25--48.
[11]
Iliyan Georgiev, Jaroslav Krivánek, Tomas Davidovic, and Philipp Slusallek. 2012. Light transport simulation with vertex connection and merging. ACM Trans. Graph. 31, 6 (2012), 192--1.
[12]
Iliyan Georgiev and Philipp Slusallek. 2010. Simple and Robust Iterative Importance Sampling of Virtual Point Lights. In Eurographics (Short Papers). 57--60.
[13]
Toshiya Hachisuka, Jacopo Pantaleoni, and Henrik Wann Jensen. 2012. A path space extension for robust light transport simulation. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1--10.
[14]
Miloš Hašan, Jaroslav Křivánek, Bruce Walter, and Kavita Bala. 2009. Virtual spherical lights for many-light rendering of glossy scenes. In ACM SIGGRAPH Asia 2009 papers. 1--6.
[15]
Miloš Hašan, Fabio Pellacini, and Kavita Bala. 2007. Matrix row-column sampling for the many-light problem. ACM Transactions on Graphics (TOG) 26, 3 (2007), 26.
[16]
Peter Hedman, Tero Karras, and Jaakko Lehtinen. 2017. Sequential monte carlo instant radiosity. IEEE transactions on visualization and computer graphics 23, 5 (2017), 1442--1453.
[17]
Yuchi Huo, Rui Wang, Shihao Jin, Xinguo Liu, and Hujun Bao. 2015. A matrix sampling-and-recovery approach for many-lights rendering. ACM Transactions on Graphics (TOG) 34, 6 (2015), 210.
[18]
Henrik Wann Jensen. 1996. Global illumination using photon maps. In Eurographics workshop on Rendering techniques. Springer, 21--30.
[19]
Henrik Wann Jensen. 2001. Realistic image synthesis using photon mapping. Vol. 364. Ak Peters Natick.
[20]
Alexander Keller. 1997. Instant radiosity. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques. 49--56.
[21]
Alexander Keller, Ken Dahm, and Nikolaus Binder. 2014. Path space filtering. (07 2014).
[22]
Thomas Kollig and Alexander Keller. 2006. Illumination in the presence of weak singularities. In Monte Carlo and Quasi-Monte Carlo Methods 2004. Springer, 245--257.
[23]
Jaroslav Krivánek, Pascal Gautron, Sumanta Pattanaik, and Kadi Bouatouch. 2005. Radiance caching for efficient global illumination computation. IEEE Transactions on Visualization and Computer Graphics 11, 5 (2005), 550--561.
[24]
Daqi Lin and Cem Yuksel. 2019. Real-Time Rendering with Lighting Grid Hierarchy. Proc. ACM Comput. Graph. Interact. Tech. 2, 1 (2019), 8--1.
[25]
Daqi Lin and Cem Yuksel. 2020. Real-Time Stochastic Lightcuts. Proceedings of the ACM on Computer Graphics and Interactive Techniques 3, 1 (2020), 1--18.
[26]
Yifan Liu, Kun Xu, and Ling-Qi Yan. 2019. Adaptive BRDF-oriented multiple importance sampling of many lights. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 123--133.
[27]
Mohi Montazer. 2017. Blue noise virtual point lights for global illumination. Master's thesis. University of Utah. Pierre Moreau, Matt Pharr, and Petrik Clarberg. 2019. Dynamic Many-Light Sampling for Real-Time Ray Tracing. In High Performance Graphics (Short Papers). 21--26.
[28]
Thomas Müller, Fabrice Rousselle, Jan Novák, and Alexander Keller. 2021. Real-time neural radiance caching for path tracing. arXiv preprint arXiv:2106.12372 (2021).
[29]
Jan Novák, Derek Nowrouzezahrai, Carsten Dachsbacher, and Wojciech Jarosz. 2012a. Progressive virtual beam lights. In Computer Graphics Forum, Vol. 31. Wiley Online Library, 1407--1413.
[30]
Jan Novák, Derek Nowrouzezahrai, Carsten Dachsbacher, and Wojciech Jarosz. 2012b. Virtual ray lights for rendering scenes with participating media. ACM Transactions on Graphics (TOG) 31, 4 (2012), 1--11.
[31]
Jiawei Ou and Fabio Pellacini. 2011. LightSlice: matrix slice sampling for the many-lights problem. ACM Trans. Graph. 30, 6 (2011), 179--1.
[32]
Eric Paquette, Pierre Poulin, and George Drettakis. 1998. A Light Hierarchy for Fast Rendering of Scenes with Many Lights. Computer Graphics Forum 17, 3 (1998), 63--74.
[33]
Ingmar Peter and Georg Pietrek. 1998. Importance driven construction of photon maps. In Eurographics Workshop on Rendering Techniques. Springer, 269--280.
[34]
Benjamin Segovia, Jean Claude Iehl, Richard Mitanchey, and Bernard Péroche. 2006. Bidirectional Instant Radiosity. In Rendering Techniques. 389--397.
[35]
Benjamin Segovia, Jean Claude Iehl, and Bernard Péroche. 2007. Metropolis instant radiosity. In Computer Graphics Forum, Vol. 26. Wiley Online Library, 425--434.
[36]
Peter Shirley, Changyaw Wang, and Kurt Zimmerman. 1996. Monte Carlo techniques for direct lighting calculations. ACM Transactions on Graphics (TOG) 15, 1 (1996), 1--36.
[37]
Florian Simon, Johannes Hanika, and Carsten Dachsbacher. 2015. Rich-VPLs for improving the versatility of many-light methods. In Computer Graphics Forum, Vol. 34. Wiley Online Library, 575--584.
[38]
Ben Spencer and Mark W Jones. 2009. Into the blue: Better caustics through photon relaxation. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 319--328.
[39]
Jamorn Sriwasansak, Adrien Gruson, and Toshiya Hachisuka. 2018. Efficient Energy-Compensated VPLs using Photon Splatting. Proc. ACM Comput. Graph. Interact. Tech. 1, 1 (2018), 16--1.
[40]
Wolfgang Tatzgern, Benedikt Mayr, Bernhard Kerbl, and Markus Steinberger. 2020. Stochastic Substitute Trees for Real-Time Global Illumination. In Symposium on Interactive 3D Graphics and Games. 1--9.
[41]
Greg Turk. 1991. Generating textures on arbitrary surfaces using reaction-diffusion. Acm Siggraph Computer Graphics 25, 4 (1991), 289--298.
[42]
Eric Veach and Leonidas J. Guibas. 1995. Optimally Combining Sampling Techniques for Monte Carlo Rendering.
[43]
Petr Vévoda, Ivo Kondapaneni, and Jaroslav Křivánek. 2018. Bayesian online regression for adaptive direct illumination sampling. ACM Transactions on Graphics (TOG) 37, 4 (2018), 125.
[44]
Petr Vévoda and Jaroslav Křivánek. 2016. Adaptive direct illumination sampling. In SIGGRAPH ASIA 2016 Posters. ACM, 43.
[45]
Bruce Walter, Adam Arbree, Kavita Bala, and Donald P. Greenberg. 2006. Multidimensional Lightcuts. ACM Transactions on Graphics (Proceedings of SIGGRAPH '06) 25, 3 (2006), 1081--1088.
[46]
Bruce Walter, Sebastian Fernandez, Adam Arbree, Kavita Bala, Michael Donikian, and Donald P Greenberg. 2005. Lightcuts: a scalable approach to illumination. In ACM SIGGRAPH 2005 Papers. 1098--1107.
[47]
Bruce Walter, Pramook Khungurn, and Kavita Bala. 2012. Bidirectional Lightcuts. ACM Transactions on Graphics 31, 4, Article 59 (2012), 11 pages.
[48]
Gregory J Ward, Francis M Rubinstein, and Robert D Clear. 1988. A ray tracing solution for diffuse interreflection. In Proceedings of the 15th annual conference on Computer graphics and interactive techniques. 85--92.
[49]
Cem Yuksel. 2015. Sample Elimination for Generating Poisson Disk Sample Sets. Computer Graphics Forum (Proceedings of EUROGRAPHICS 2015) 34, 2 (2015), 25--32.
[50]
Cem Yuksel. 2019. Stochastic Lightcuts. In High-Performance Graphics (HPG 2019) (Strasbourg, France). The Eurographics Association, 27--32.
[51]
Can Yuksel and Cem Yuksel. 2017. Lighting grid hierarchy for self-illuminating explosions. ACM Trans. Graph. 36, 4 (2017), 110--1.

Cited By

View all
  • (2024)UltraCLR: Contrastive Representation Learning Framework for Ultrasound-based SensingACM Transactions on Sensor Networks10.1145/359749820:4(1-23)Online publication date: 11-May-2024

Index Terms

  1. Virtual Blue Noise Lighting

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
    Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 5, Issue 3
    July 2022
    198 pages
    EISSN:2577-6193
    DOI:10.1145/3552302
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 July 2022
    Published in PACMCGIT Volume 5, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Virtual lights
    2. blue noise sampling
    3. global illumination
    4. instant radiosity
    5. light sampling
    6. many lights
    7. sample elimination
    8. virtual point lights
    9. virtual spherical lights

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)159
    • Downloads (Last 6 weeks)19
    Reflects downloads up to 15 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)UltraCLR: Contrastive Representation Learning Framework for Ultrasound-based SensingACM Transactions on Sensor Networks10.1145/359749820:4(1-23)Online publication date: 11-May-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media