Cited By
View all- Ring PTietenberg JMasuch M(2024)Validation of a German Version of the Collision Anxiety QuestionnaireProceedings of Mensch und Computer 202410.1145/3670653.3677516(370-374)Online publication date: 1-Sep-2024
Development and Validation of the Collision Anxiety Questionnaire for VR Applications
Article No.: 605, Pages 1 - 13
Abstract
The high degree of sensory immersion is a distinctive feature of head-mounted virtual reality (VR) systems. While the visual detachment from the real world enables unique immersive experiences, users risk collisions due to their inability to perceive physical obstacles in their environment. Even the mere anticipation of a collision can adversely affect the overall experience and erode user confidence in the VR system. However, there are currently no valid tools for assessing collision anxiety. We present the iterative development and validation of the Collision Anxiety Questionnaire (CAQ), involving an exploratory and a confirmatory factor analysis with a total of 159 participants. The results provide evidence for both discriminant and convergent validity and a good model fit for the final CAQ with three subscales: general collision anxiety, orientation, and interpersonal collision anxiety. By utilizing the CAQ, researchers can examine potential confounding effects of collision anxiety and evaluate methods for its mitigation.
Supplemental Material
- Download
- 112.61 MB
- Transcript
XLSX File - Participant feedback from study 1
Participant feedback from study 1
- Download
- 16.09 KB
PDF File - Print Version of the CAQ
Print Version of the CAQ
- Download
- 192.95 KB
PDF File - Scoring Guide for the CAQ
Scoring Guide for the CAQ
- Download
- 208.37 KB
XLSX File - Excel version of the items of the CAQ
Excel version of the items of the CAQ
- Download
- 10.39 KB
References
[1]
Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135 (2020), 102370. https://doi.org/10.1016/j.ijhcs.2019.102370
[2]
Jeremy N Bailenson, Jim Blascovich, Andrew C Beall, and Jack M Loomis. 2003. Interpersonal distance in immersive virtual environments. Personality and social psychology bulletin 29, 7 (2003), 819–833. https://doi.org/10.1177/0146167203029007002
[3]
Costas Boletsis and Jarl Erik Cedergren. 2019. VR Locomotion in the New Era of Virtual Reality: An Empirical Comparison of Prevalent Techniques. Advances in Human-Computer Interaction 2019 (2019). https://doi.org/10.1155/2019/7420781
[4]
Raymond B Cattell and Raymond B Cattell. 1978. Fixing the number of factors: The most practicable psychometric procedures. The scientific use of factor analysis in behavioral and life sciences (1978), 72–91.
[5]
Andrew Laurence Comrey and Howard Bing Lee. 1992. A first course in factor analysis, Second Edition. Lawrence Erlbaum Associates, Inc.
[6]
JCF de Winter, Dimitra Dodou, and Peter A Wieringa. 2009. Exploratory factor analysis with small sample sizes. Multivariate behavioral research 44, 2 (2009), 147–181. https://doi.org/10.1080/00273170902794206
[7]
Tobias Drey, Michael Rietzler, and Enrico Rukzio. 2021. Questionnaires and Qualitative Feedback Methods to Measure User Experience in Mixed Reality. arXiv preprint arXiv:2104.06221 (2021). https://doi.org/10.48550/arXiv.2104.06221
[8]
James Coleman Eubanks, Alec G. Moore, Paul A. Fishwick, and Ryan P. McMahan. 2021. A Preliminary Embodiment Short Questionnaire. Frontiers in Virtual Reality 2 (2021). https://doi.org/10.3389/frvir.2021.647896
[9]
Phill Gagné and Gregory R Hancock. 2006. Measurement model quality, sample size, and solution propriety in confirmatory factor models. Multivariate behavioral research 41, 1 (2006), 65–83. https://doi.org/10.1207/s15327906mbr4101_5
[10]
Beat Games. 2019. Beat Saber. Game [Meta Quest].
[11]
Joseph F Hair, Jeffrey J Risher, Marko Sarstedt, and Christian M Ringle. 2019. When to use and how to report the results of PLS-SEM. European business review 31, 1 (2019), 2–24. https://doi.org/10.1108/EBR-11-2018-0203
[12]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
[13]
Jörg Henseler, Christian M Ringle, and Marko Sarstedt. 2015. A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the academy of marketing science 43 (2015), 115–135. https://doi.org/10.1007/s11747-014-0403-8
[14]
Adrian H Hoppe, Roland Reeb, Florian van de Camp, and Rainer Stiefelhagen. 2018. Capability for collision avoidance of different user avatars in virtual reality. In HCI International 2018–Posters’ Extended Abstracts: 20th International Conference, HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part II 20. Springer, 273–279. https://doi.org/10.1007/978-3-319-92279-9_37
[15]
Aulia Inan Nur, Harry B. Santoso, and Panca O. Hadi Putra. 2021. The Method and Metric of User Experience Evaluation: A Systematic Literature Review. In Proceedings of the 2021 10th International Conference on Software and Computer Applications (Kuala Lumpur, Malaysia) (ICSCA ’21). ACM, New York, NY, USA, 307–317. https://doi.org/10.1145/3457784.3457832
[16]
Kohei Kanamori, Nobuchika Sakata, Tomu Tominaga, Yoshinori Hijikata, Kensuke Harada, and Kiyoshi Kiyokawa. 2018. Obstacle Avoidance Method in Real Space for Virtual Reality Immersion. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 80–89. https://doi.org/10.1109/ISMAR.2018.00033
[17]
Panagiotis Kourtesis, Simona Collina, Leonidas A. A. Doumas, and Sarah E. MacPherson. 2019. Validation of the Virtual Reality Neuroscience Questionnaire: Maximum Duration of Immersive Virtual Reality Sessions Without the Presence of Pertinent Adverse Symptomatology. Frontiers in Human Neuroscience 13 (2019). https://doi.org/10.3389/fnhum.2019.00417
[18]
Candice Lanius, Ryan Weber, and Joy Robinson. 2021. User Experience Methods in Research and Practice. Journal of Technical Writing and Communication 51, 4 (2021), 350–379. https://doi.org/10.1177/00472816211044499
[19]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. In HCI and Usability for Education and Work, Andreas Holzinger (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 63–76. https://doi.org/10.1007/978-3-540-89350-9_6
[20]
Robert W Lissitz and Samuel B Green. 1975. Effect of the number of scale points on reliability: A Monte Carlo approach.Journal of applied psychology 60, 1 (1975), 10. https://doi.org/10.1037/h0076268
[21]
Huimin Liu, Zhiquan Wang, Angshuman Mazumdar, and Christos Mousas. 2021. Virtual reality game level layout design for real environment constraints. Graphics and Visual Computing 4 (2021), 200020. https://doi.org/10.1016/j.gvc.2021.200020
[22]
Robert C MacCallum, Michael W Browne, and Hazuki M Sugawara. 1996. Power analysis and determination of sample size for covariance structure modeling.Psychological methods 1, 2 (1996), 130. https://doi.org/10.1037/1082-989X.1.2.130
[23]
Christos Mousas, Dominic Kao, Alexandros Koilias, and Banafsheh Rekabdar. 2020. Real and virtual environment mismatching induces arousal and alters movement behavior. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 626–635. https://doi.org/10.1109/VR46266.2020.00085
[24]
Panos Rriska and Superhot Team. 2019. SuperhotVR. Game [Meta Quest].
[25]
Reinhard Pekrun, Thomas Goetz, Anne C. Frenzel, Petra Barchfeld, and Raymond P. Perry. 2011. Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology 36, 1 (2011), 36–48. https://doi.org/10.1016/j.cedpsych.2010.10.002
[26]
Iana Podkosova and Hannes Kaufmann. 2018. Mutual Collision Avoidance during Walking in Real and Collaborative Virtual Environments. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (Montreal, Quebec, Canada) (I3D ’18). Association for Computing Machinery, New York, NY, USA, Article 9, 9 pages. https://doi.org/10.1145/3190834.3190845
[27]
Patrizia Ring and Maic Masuch. 2023. Measuring Collision Anxiety in XR Exergames. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 627–628. https://doi.org/10.1109/VRW58643.2023.00156
[28]
Daniel Roth and Marc Erich Latoschik. 2020. Construction of the Virtual Embodiment Questionnaire (VEQ). IEEE Transactions on Visualization and Computer Graphics 26, 12 (2020), 3546–3556. https://doi.org/10.1109/TVCG.2020.3023603
[29]
Anthony Scavarelli and Robert J. Teather. 2017. VR Collide! Comparing Collision-Avoidance Methods Between Co-Located Virtual Reality Users. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 2915–2921. https://doi.org/10.1145/3027063.3053180
[30]
Nick Sohre, Charlie Mackin, Victoria Interrante, and Stephen J Guy. 2017. Evaluating collision avoidance effects on discomfort in virtual environments. In 2017 IEEE Virtual Humans and Crowds for Immersive Environments (VHCIE). IEEE, 1–5. https://doi.org/10.1109/VHCIE.2017.7935624
[31]
Andrej Somrak, Matevž Pogačnik, and Jože Guna. 2021. Suitability and Comparison of Questionnaires Assessing Virtual Reality-Induced Symptoms and Effects and User Experience in Virtual Environments. Sensors 21, 4 (2021). https://doi.org/10.3390/s21041185
[32]
J. P. Stevens. 1992. Applied Multivariate Statistics for the Social Sciences, Second Edition. Lawrence Erlbaum Associates, Inc.
[33]
Katy Tcha-Tokey, Olivier Christmann, Emilie Loup-Escande, and Simon Richir. 2016. Proposition and validation of a questionnaire to measure the user experience in immersive virtual environments. International Journal of Virtual Reality 16, 1 (2016), 33–48. https://doi.org/10.20870/IJVR.2016.16.1.2880
[34]
D. Watson, L. A. Clark, and A. Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology 54, 6 (1988). https://doi.org/10.1037/0022-3514.54.6.1063
[35]
Carolin Wienrich, Nina Döllinger, Simon Kock, Kristina Schindler, and Ole Traupe. 2018. Assessing User Experience in Virtual Reality – A Comparison of Different Measurements. In Design, User Experience, and Usability: Theory and Practice, Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, Cham, 573–589. https://doi.org/10.1007/978-3-319-91797-9_41
[36]
Hui Yang, Junyan Li, Jingnan Liu, Yulong Bian, and Juan Liu. 2022. Development of an Indoor Exergame Based on Moving-Target Hitting Task for COVID-19 Epidemic: A Comparison Between AR and VR Mode. IEEE Transactions on Games 14, 3 (2022), 511–521. https://doi.org/10.1109/TG.2021.3118035
Index Terms
- Development and Validation of the Collision Anxiety Questionnaire for VR Applications
Recommendations
Validation of a German Version of the Collision Anxiety Questionnaire
MuC '24: Proceedings of Mensch und Computer 2024The main quality of virtual reality (VR) is its high immersive potential. However, the resulting inability to perceive the real world surroundings can distract users from the application due to the fear of colliding with obstacles or other people. The ...
Exploring the Influence of Collision Anxiety on Player Experience in XR Games
Entertainment Computing – ICEC 2023AbstractExtended Reality (XR) applications are becoming increasingly widespread due to technical advances, but also have their own challenges regarding the user’s real-world orientation. Especially during virtual reality use at home, users are at risk of ...
Estimating VR Sickness and user experience using different HMD technologies: An evaluation study
AbstractThis paper presents results of a user study of the effects of virtual reality technology on VR Sickness and User Experience. In our study the participants watched two different panoramic (360) videos, one with relaxing content (beach ...
Highlights- Assessing VR Sickness discomfort levels using the SSQ and Questionnaire.
- User ...
Comments
Information & Contributors
Information
Published In
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Badges
Artifacts Available / v1.1
Honorable Mention
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 470Total Downloads
- Downloads (Last 12 months)470
- Downloads (Last 6 weeks)82
Reflects downloads up to 14 Oct 2024
Other Metrics
Citations
Cited By
View all- Ring PTietenberg JMasuch M(2024)Validation of a German Version of the Collision Anxiety QuestionnaireProceedings of Mensch und Computer 202410.1145/3670653.3677516(370-374)Online publication date: 1-Sep-2024
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format