Perceptions of Hybrid Lighting for Virtual Reality
Article No.: 5, Pages 1 - 20
Abstract
Virtual reality (VR) applications are computationally demanding due to high frame rate requirements, which precludes large numbers of realtime lights from being used. In this paper, we explore a hybrid lighting approach that combines the benefits of realtime and baked lights based on the importance of each source. First, we demonstrate that the hybrid approach affords better frames per second than realtime and mixed lighting. We then present the results of an online paired-comparison study, in which participants (n = 60) compared videos of the four lighting conditions (baked, mixed, realtime, and hybrid) in terms of preference. Our results indicate that the hybrid lighting approach is better than realtime lighting in terms of graphical performance and also yields better perceptions of quality for scenes with a small to moderately large number of lights.
Supplemental Material
MP4 File
Supplemental video
- Download
- 69.52 MB
References
[1]
Fedaa Abd-Alhamid, Michael Kent, Christopher Bennett, John Calautit, and Yupeng Wu. 2019. Developing an Innovative Method for Visual Perception Evaluation in a Physical-Based Virtual Environment. Building and Environment 162 (2019), 106278. https://doi.org/10.1016/j.buildenv.2019.106278
[2]
Haley Adams, Jeanine Stefanucci, Sarah Creem-Regehr, Grant Pointon, William Thompson, and Bobby Bodenheimer. 2022. Shedding Light on Cast Shadows: An Investigation of Perceived Ground Contact in AR and VR. IEEE Transactions on Visualization and Computer Graphics 28, 12 (2022), 4624--4639. https://doi.org/10.1109/TVCG.2021.3097978
[3]
Kurt Akeley, David Kirk, Larry Seiler, Philipp Slusallek, and Brad Grantham. 2002. When Will Ray-Tracing Replace Rasterization?. In ACM SIGGRAPH 2002 Conference Abstracts and Applications (San Antonio, Texas) (SIGGRAPH '02). Association for Computing Machinery, New York, NY, USA, 86--87. https://doi.org/10.1145/1242073.1242120
[4]
Rui Bastos, Michael Goslin, and Hansong Zhang. 1997. Efficient Radiosity Rendering Using Textures and Bicubic Reconstruction. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (Providence, Rhode Island, USA) (I3D '97). Association for Computing Machinery, New York, NY, USA, 71-ff. https://doi.org/10.1145/253284.253309
[5]
Inge Brons, Rolph Houben, and Wouter A. Dreschler. 2014. Effects of Noise Reduction on Speech Intelligibility, Perceived Listening Effort, and Personal Preference in Hearing-Impaired Listeners. Trends in Hearing 18 (2014), 2331216514553924. https://doi.org/10.1177/2331216514553924 arXiv:https://doi.org/10.1177/2331216514553924 25315377.
[6]
K. Chamilothori, G. Chinazzo, J. Rodrigues, E.S. Dan-Glauser, J. Wienold, and M. Andersen. 2019a. Subjective and physiological responses to façade and sunlight pattern geometry in virtual reality. Building and Environment 150 (2019), 144--155. https://doi.org/10.1016/j.buildenv.2019.01.009
[7]
Kynthia Chamilothori, Jan Wienold, and Marilyne Andersen. 2019b. Adequacy of Immersive Virtual Reality for the Perception of Daylit Spaces: Comparison of Real and Virtual Environments. LEUKOS 15, 2-3 (2019), 203--226. https://doi.org/10.1080/15502724.2017.1404918
[8]
Hao Chen and Xinguo Liu. 2008. Lighting and Material of Halo 3. In ACM SIGGRAPH 2008 Games. 1--22.
[9]
Y Chen, Z Cui, and L Hao. 2019. Virtual reality in lighting research: Comparing physical and virtual lighting environments. Lighting Research & Technology 51, 6 (2019), 820--837. https://doi.org/10.1177/1477153518825387 arXiv:https://doi.org/10.1177/1477153518825387
[10]
Carsten Dachsbacher and Marc Stamminger. 2005. Reflective Shadow Maps. In Proceedings of the 2005 Symposium on Interactive 3D Graphics and Games (Washington, District of Columbia) (I3D '05). Association for Computing Machinery, New York, NY, USA, 203--231. https://doi.org/10.1145/1053427.1053460
[11]
K. Debattista, K. Bugeja, S. Spina, T. Bashford-Rogers, and V. Hulusic. 2018. Frame Rate vs Resolution: A Subjective Evaluation of Spatiotemporal Perceived Quality Under Varying Computational Budgets. Computer Graphics Forum 37, 1 (2018), 363--374. https://doi.org/10.1111/cgf.13302 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13302
[12]
Ravi Dhar and Itamar Simonson. 2003. The Effect of Forced Choice on Choice. Journal of Marketing Research 40, 2 (2003), 146--160. http://www.jstor.org/stable/30038845
[13]
Tiffany D. Do, Joseph J. LaViola, and Ryan P. McMahan. 2020. The Effects of Object Shape, Fidelity, Color, and Luminance on Depth Perception in Handheld Mobile Augmented Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 64--72. https://doi.org/10.1109/ISMAR50242.2020.00026
[14]
Austin Erickson, Kangsoo Kim, Gerd Bruder, and Gregory F. Welch. 2020. Effects of Dark Mode Graphics on Visual Acuity and Fatigue with Virtual Reality Head-Mounted Displays. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 434--442. https://doi.org/10.1109/VR46266.2020.00064
[15]
Anna Felnhofer, Oswald D. Kothgassner, Mareike Schmidt, Anna-Katharina Heinzle, Leon Beutl, Helmut Hlavacs, and Ilse Kryspin-Exner. 2015. Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios. International Journal of Human-Computer Studies 82 (2015), 48--56. https://doi.org/10.1016/j.ijhcs.2015.05.004
[16]
Jan-F. Flor, Marina Aburas, Fedaa Abd-AlHamid, and Yupeng Wu. 2021. Virtual reality as a tool for evaluating user acceptance of view clarity through ETFE double-skin façades. Energy and Buildings 231 (2021), 110554. https://doi.org/10.1016/j.enbuild.2020.110554
[17]
J. A. Hartigan and M. A. Wong. 1979. Algorithm AS 136: A K-Means Clustering Algorithm. Journal of the Royal Statistical Society. Series C (Applied Statistics) 28, 1 (1979), 100--108. http://www.jstor.org/stable/2346830
[18]
Muhammad Hegazy, Ken Ichiriyama, Kensuke Yasufuku, and Hirokazu Abe. 2021. Comparing daylight brightness perception in real and immersive virtual environments using perceptual light maps. Automation in Construction 131 (2021), 103898. https://doi.org/10.1016/j.autcon.2021.103898
[19]
Alexis Heloir, Kerstin H. Kipp, and Michael Kipp. 2011. Using Individual Light Rigs to Control the Perception of a Virtual Character's Personality. In Affective Computing and Intelligent Interaction, Sidney D'Mello, Arthur Graesser, Björn Schuller, and Jean-Claude Martin (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 117--124.
[20]
Arsalan Heydarian, Joao P. Carneiro, David Gerber, Burcin Becerik-Gerber, Timothy Hayes, and Wendy Wood. 2015. Immersive virtual environments versus physical built environments: A benchmarking study for building design and user-built environment explorations. Automation in Construction 54 (2015), 116--126. https://doi.org/10.1016/j.autcon.2015.03.020
[21]
Juan Luis Higuera-Trujillo, Juan López-Tarruella Maldonado, and Carmen Llinares Millán. 2017. Psychological and physiological human responses to simulated and real environments: A comparison between Photographs, 360° Panoramas, and Virtual Reality. Applied Ergonomics 65 (2017), 398--409. https://doi.org/10.1016/j.apergo.2017.05.006
[22]
Taehoon Hong, Minhyun Lee, Seungkeun Yeom, and Kwangbok Jeong. 2019. Occupant responses on satisfaction with window size in physical and virtual built environments. Building and Environment 166 (2019), 106409. https://doi.org/10.1016/j.buildenv.2019.106409
[23]
Henrik Wann Jensen. 1996. Global Illumination using Photon Maps. In Rendering Techniques '96, Xavier Pueyo and Peter Schröder (Eds.). Springer Vienna, Vienna, 21--30.
[24]
J. Adam Jones, J. Edward Swan II, and Mark Bolas. 2013. Peripheral Stimulation and its Effect on Perceived Spatial Scale in Virtual Environments. IEEE Transactions on Visualization and Computer Graphics 19, 4 (2013), 701--710. https://doi.org/10.1109/TVCG.2013.37
[25]
James T. Kajiya. 1986. The Rendering Equation. SIGGRAPH Comput. Graph. 20, 4 (aug 1986), 143--150. https://doi.org/10.1145/15886.15902
[26]
Tobias Karlsson, Jenny Brusk, and Henrik Engström. 2023. Level Design Processes and Challenges: A Cross Section of Game Development. Games and Culture 18, 6 (2023), 821--849. https://doi.org/10.1177/15554120221139229 arXiv:https://doi.org/10.1177/15554120221139229
[27]
Rhonda G. Kost and Joel Correa da Rosa. 2018. Impact of survey length and compensation on validity, reliability, and sample characteristics for Ultrashort-, Short-, and Long-Research Participant Perception Surveys. Journal of Clinical and Translational Science 2, 1 (2018), 31--37. https://doi.org/10.1017/cts.2018.18
[28]
Küller, Rikard. 1991. Environmental assessment from a neuropsychological perspective. Oxford University Press, 111--147.
[29]
Chengyuan Lai and Ryan P. McMahan. 2020. The Cognitive Load and Usability of Three Walking Metaphors for Consumer Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 627--638. https://doi.org/10.1109/ISMAR50242.2020.00091
[30]
Cristian Lambru, Anca Morar, Florica Moldoveanu, Victor Asavei, and Alin Moldoveanu. 2021. Comparative Analysis of Real-Time Global Illumination Techniques in Current Game Engines. IEEE Access 9 (2021), 125158--125183. https://doi.org/10.1109/ACCESS.2021.3109663
[31]
Joseph J. LaViola, Ernst Kruijff, Ryan P. McMahan, Doug A. Bowman, and Ivan Poupyrev. 2017. 3D User Interfaces: Theory and Practice (2 ed.). Addison-Wesley Professional, Boston.
[32]
Thibault Louis, Jocelyne Troccaz, Amélie Rochet-Capellan, and François Bérard. 2019. Is It Real? Measuring the Effect of Resolution, Latency, Frame Rate and Jitter on the Presence of Virtual Entities. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS '19). Association for Computing Machinery, New York, NY, USA, 5--16. https://doi.org/10.1145/3343055.3359710
[33]
Christan Luksch, Michael Wimmer, and Michael Schwärzler. 2019. Incrementally Baked Global Illumination. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (Montreal, Quebec, Canada) (I3D '19). Association for Computing Machinery, New York, NY, USA, Article 4, 10 pages. https://doi.org/10.1145/3306131.3317015
[34]
Katerina Mania and Andrew Robinson. 2004. The Effect of Quality of Rendering on User Lighting Impressions and Presence in Virtual Environments. In Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (Singapore) (VRCAI '04). Association for Computing Machinery, New York, NY, USA, 200--205. https://doi.org/10.1145/1044588.1044629
[35]
Mohamed Marzouk, Maryam ElSharkawy, and Ayman Mahmoud. 2022. Analysing user daylight preferences in heritage buildings using virtual reality. Building Simulation 15, 9 (2022), 1561--1576. https://doi.org/10.1007/s12273-021-0873-9
[36]
Massimiliano Masullo, Federico Cioffi, Jian Li, Luigi Maffei, Giovanni Ciampi, Sergio Sibilio, and Michelangelo Scorpio. 2023. Urban Park Lighting Quality Perception: An Immersive Virtual Reality Experiment. Sustainability 15, 3 (2023). https://doi.org/10.3390/su15032069
[37]
Massimiliano Masullo, Federico Cioffi, Jian Li, Luigi Maffei, Michelangelo Scorpio, Tina Iachini, Gennaro Ruggiero, Antonio Malferà, and Francesco Ruotolo. 2022. An Investigation of the Influence of the Night Lighting in a Urban Park on Individuals's Emotions. Sustainability 14, 14 (2022). https://doi.org/10.3390/su14148556
[38]
Florian Mathis, John H. Williamson, Kami Vaniea, and Mohamed Khamis. 2021. Fast and Secure Authentication in Virtual Reality Using Coordinated 3D Manipulation and Pointing. ACM Trans. Comput.-Hum. Interact. 28, 1, Article 6 (jan 2021), 44 pages. https://doi.org/10.1145/3428121
[39]
Alec G. Moore, Ryan P. McMahan, Hailiang Dong, and Nicholas Ruozzi. 2021. Personal Identifiability and Obfuscation of User Tracking Data From VR Training Sessions. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 221--228. https://doi.org/10.1109/ISMAR52148.2021.00037
[40]
Claudia Moscoso, Kynthia Chamilothori, Jan Wienold, Marilyne Andersen, and Barbara Matusiak. 2022. Regional Differences in the Perception of Daylit Scenes across Europe Using Virtual Reality. Part I: Effects of Window Size. LEUKOS 18, 3 (2022), 294--315. https://doi.org/10.1080/15502724.2020.1854779 arXiv:https://doi.org/10.1080/15502724.2020.1854779
[41]
Claudia Moscoso, Barbara Matusiak, U. Peter Svensson, and Krzysztof Orleanski. 2015. Analysis of Stereoscopic Images as a New Method for Daylighting Studies. ACM Trans. Appl. Percept. 11, 4, Article 21 (jan 2015), 13 pages. https://doi.org/10.1145/2665078
[42]
Asma Naz, Regis Kopper, Ryan P. McMahan, and Mihai Nadin. 2017. Emotional qualities of VR space. In 2017 IEEE Virtual Reality (VR). 3--11. https://doi.org/10.1109/VR.2017.7892225
[43]
Malte Oehlmann, Jürgen Meyerhoff, Petr Mariel, and Priska Weller. 2017. Uncovering context-induced status quo effects in choice experiments. Journal of Environmental Economics and Management 81 (2017), 59--73. https://doi.org/10.1016/j.jeem.2016.09.002
[44]
Stefan Palan and Christian Schitter. 2018. Prolific.ac---A subject pool for online experiments. Journal of Behavioral and Experimental Finance 17 (2018), 22--27. https://doi.org/10.1016/j.jbef.2017.12.004
[45]
Tabitha C. Peck, Laura E. Sockol, and Sarah M. Hancock. 2020. Mind the Gap: The Underrepresentation of Female Participants and Authors in Virtual Reality Research. IEEE Transactions on Visualization and Computer Graphics 26, 5(2020), 1945--1954. https://doi.org/10.1109/TVCG.2020.2973498
[46]
Eyal Peer, Laura Brandimarte, Sonam Samat, and Alessandro Acquisti. 2017. Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology 70 (2017), 153--163. https://doi.org/10.1016/j.jesp.2017.01.006
[47]
Bui Tuong Phong. 1975. Illumination for Computer Generated Pictures. Commun. ACM 18, 6 (Jun 1975), 311--317. https://doi.org/10.1145/360825.360839
[48]
Brian J. Pohl, Andrew Harris, Michael Balog, Michael Clausen, Gavin Moran, and Ryan Brucks. 2017. Fortnite: Supercharging CG Animation Pipelines with Game Engine Technology. In Proceedings of the ACM SIGGRAPH Digital Production Symposium (Los Angeles, California) (DigiPro '17). Association for Computing Machinery, New York, NY, USA, Article 7, 4 pages. https://doi.org/10.1145/3105692.3114816
[49]
Erik Reinhard, Wolfgang Heidrich, Paul Debevec, Sumanta Pattanaik, Greg Ward, and Karol Myszkowski. 2010. High dynamic range imaging: acquisition, display, and image-based lighting. Morgan Kaufmann.
[50]
S Rockcastle, M Danell, E Calabrese, G Sollom-Brotherton, A Mahic, K Van Den Wymelenberg, and R Davis. 2021. Comparing perceptions of a dimmable LED lighting system between a real space and a virtual reality display. Lighting Research & Technology 53, 8 (2021), 701--725. https://doi.org/10.1177/1477153521990039 arXiv:https://doi.org/10.1177/1477153521990039
[51]
John Rolfe and Jeff Bennett. 2009. The impact of offering two versus three alternatives in choice modelling experiments. Ecological Economics 68, 4(2009), 1140--1148. https://doi.org/10.1016/j.ecolecon.2008.08.007 Participation and Evaluation for Sustainable River Basin Governance.
[52]
Sylvia Rothe, Tobias Höllerer, and Heinrich Hußmann. 2018. CVR-Analyzer: A Tool for Analyzing Cinematic Virtual Reality Viewing Patterns. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM '18). Association for Computing Machinery, New York, NY, USA, 127--137. https://doi.org/10.1145/3282894.3282896
[53]
Dhia Elhaq Rzig, Nafees Iqbal, Isabella Attisano, Xue Qin, and Foyzul Hassan. 2023. Virtual Reality (VR) Automated Testing in the Wild: A Case Study on Unity-Based VR Applications. In Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (Seattle, WA, USA) (ISSTA 2023). Association for Computing Machinery, New York, NY, USA, 1269--1281. https://doi.org/10.1145/3597926.3598134
[54]
Thereza Schmelter, Lucie Kruse, Sukran Karaosmanoglu, Sebastian Rings, Frank Steinicke, and Kristian Hildebrand. 2023. Towards More Inclusive and Accessible Virtual Reality: Conducting Large-Scale Studies in the Wild. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA '23). Association for Computing Machinery, New York, NY, USA, Article 476, 5 pages. https://doi.org/10.1145/3544549.3583888
[55]
Michelangelo Scorpio, Davide Carleo, Martina Gargiulo, Pilar Chías Navarro, Yorgos Spanodimitriou, Parinaz Sabet, Massimiliano Masullo, and Giovanni Ciampi. 2023. A Review of Subjective Assessments in Virtual Reality for Lighting Research. Sustainability 15, 9 (2023). https://doi.org/10.3390/su15097491
[56]
Mel Slater, Pankaj Khanna, Jesper Mortensen, and Insu Yu. 2009. Visual Realism Enhances Realistic Response in an Immersive Virtual Environment. IEEE Computer Graphics and Applications 29, 3 (2009), 76--84. https://doi.org/10.1109/MCG.2009.55
[57]
Jan-Philipp Stauffert, Florian Niebling, and Marc Erich Latoschik. 2020. Latency and Cybersickness: Impact, Causes, and Measures. A Review. Frontiers in Virtual Reality 1 (2020). https://doi.org/10.3389/frvir.2020.582204
[58]
Kishan Takoordyal. 2020. GameObjects, Prefabs, Materials, and Components. Apress, Berkeley, CA, 59--103. https://doi.org/10.1007/978-1-4842-6002-9_3
[59]
David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology 54, 6 (1988), 1063.
[60]
Martin Weier, Thorsten Roth, Ernst Kruijff, André Hinkenjann, Arsène Pérard-Gayot, Philipp Slusallek, and Yongmin Li. 2016. Foveated Real-Time Ray Tracing for Head-Mounted Displays. Computer Graphics Forum 35, 7 (2016), 289--298. https://doi.org/10.1111/cgf.13026 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13026
[61]
Lance Williams. 1978. Casting Curved Shadows on Curved Surfaces. SIGGRAPH Comput. Graph. 12, 3 (aug 1978), 270--274. https://doi.org/10.1145/965139.807402
[62]
Krzysztof Wolski, Fangcheng Zhong, Karol Myszkowski, and Rafał K. Mantiuk. 2022. Dark Stereo: Improving Depth Perception under Low Luminance. ACM Trans. Graph. 41, 4, Article 146 (jul 2022), 12 pages. https://doi.org/10.1145/3528223.3530136
[63]
Yufei Yang, Chenhao Xie, Liansheng Liu, Philip H. W. Leong, and Shuaiwen Leon Song. 2023. Efficient Radius Search for Adaptive Foveal Sizing Mechanism in Collaborative Foveated Rendering Framework. IEEE Transactions on Mobile Computing (2023), 1--13. https://doi.org/10.1109/TMC.2023.3277577
[64]
Daniel Zielasko and Bernhard E. Riecke. 2020. Can We Give Seated Users in Virtual Reality the Sensation of Standing or Even Walking? Do We Want To?. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 281--282. https://doi.org/10.1109/VRW50115.2020.00059
Index Terms
- Perceptions of Hybrid Lighting for Virtual Reality
Recommendations
Fast, Realistic Lighting for Video Games
Global lighting effects produced by diffuse interreflections are typically simulated using global illumination methods such as radiosity or ray tracing. Although diffuse interreflections are crucial to produce realistic images, radiosity like methods ...
Real-time image based lighting in software using HDR panoramas
GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East AsiaWe present a system allowing real-time image based lighting based on HDR panoramic images [Debevec 1998]. The system performs time-consuming diffuse light calculations in a pre-processing step, which is key to attaining interactivity. The real-time ...
Hierarchical Visibility for Virtual Reality
We introduce a novel primary visibility algorithm based on ray casting that provides real time performance and a feature set well suited for rendering virtual reality. The flexibility provided by our approach allows for a variety of features such as lens ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 May 2024
Published in PACMCGIT Volume 7, Issue 1
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Data Availability
Supplemental video https://dl.acm.org/doi/10.1145/3651292#I3D2024_22.mp4
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 30Total Downloads
- Downloads (Last 12 months)30
- Downloads (Last 6 weeks)5
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in