research-article

Remote VR Studies: A Framework for Running Virtual Reality Studies Remotely Via Participant-Owned HMDs

Authors:

Ville Mäkelä,

Sarah Delgado Rodriguez,

Yomna Abdelrahman,

Matthias Hoppe,

Albrecht Schmidt,

Florian AltAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 28, Issue 6

Article No.: 46, Pages 1 - 36

https://doi.org/10.1145/3472617

Published: 15 November 2021 Publication History

Abstract

We investigate opportunities and challenges of running virtual reality (VR) studies remotely. Today, many consumers own head-mounted displays (HMDs), allowing them to participate in scientific studies from their homes using their own equipment. Researchers can benefit from this approach by being able to recruit study populations normally out of their reach, and to conduct research at times when it is difficult to get people into the lab (cf. the COVID pandemic). In an initial online survey (N = 227), we assessed HMD owners’ demographics, their VR setups and their attitudes toward remote participation. We then identified different approaches to running remote studies and conducted two case studies for an in-depth understanding. We synthesize our findings into a framework for remote VR studies, discuss strengths and weaknesses of the different approaches, and derive best practices. Our work is valuable for Human-Computer Interaction (HCI) researchers conducting VR studies outside labs.

References

[1]

Frederick Aardema, Kieron O’Connor, Sophie Côté, and Annie Taillon. 2010. Virtual reality induces dissociation and lowers sense of presence in objective reality. Cyberpsychology, Behavior, and Social Networking 13, 4 (2010), 429–435. DOI:https://doi.org/10.1089/cyber.2009.0164

[2]

Jan Philipp Albrecht. 2016. How the GDPR will change the world. European Data Protection Law Review 2, 3 (2016), 287–289.

[3]

Dmitry Alexandrovsky, Susanne Putze, Michael Bonfert, Sebastian Höffner, Pitt Michelmann, Dirk Wenig, Rainer Malaka, and Jan David Smeddinck. 2020. Examining design choices of questionnaires in VR user studies. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–21. DOI:https://doi.org/10.1145/3313831.3376260

Digital Library

[4]

Florian Alt, Stefan Schneegaß, Albrecht Schmidt, Jörg Müller, and Nemanja Memarovic. 2012. How to evaluate public displays. In Proceedings of the 2012 International Symposium on Pervasive Displays. ACM, New York, NY, Article 17, 6 pages. DOI:https://doi.org/10.1145/2307798.2307815

Digital Library

[5]

Florian Alt, Stefan Schneegass, Alireza Sahami Shirazi, Mariam Hassib, and Andreas Bulling. 2015. Graphical passwords in the wild: Understanding how users choose pictures and passwords in image-based authentication schemes. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 316–322. DOI:https://doi.org/10.1145/2785830.2785882

Digital Library

[6]

Morten Sieker Andreasen, Henrik Villemann Nielsen, Simon Ormholt Schrøder, and Jan Stage. 2007. What happened to remote usability testing? An empirical study of three methods. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1405–1414. DOI:https://doi.org/10.1145/1240624.1240838

Digital Library

[7]

Roya Bagheri. 2016. Virtual reality: The real life consequences. UC Davis Business Law Journal 17, 1 (2016), 101. Retrieved from https://heinonline.org/HOL/LandingPage?handle=hein.journals/ucdbulj17&div=7.

[8]

Louise Barkhuus and Jennifer A. Rode. 2007. From mice to men - 24 years of evaluation in CHI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1. DOI:https://doi.org/10.1145/1240624.2180963

Digital Library

[9]

Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016. Point and Teleport locomotion technique for virtual reality. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play. ACM, New York, NY, 205–216. DOI:https://doi.org/10.1145/2967934.2968105

Digital Library

[10]

Ian Bramley, Alastair Goode, Laura Anderson, and Elisabeth Mary. 2018. Researching in-store, at home: Using virtual reality within quantitative surveys. International Journal of Market Research 60, 4 (2018), 344–351.

[11]

Daniel Buschek, Benjamin Bisinger, and Florian Alt. 2018. ResearchIME: A mobile keyboard application for studying free typing behaviour in the wild. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[12]

Daniel Buschek, Fabian Hartmann, Emanuel Von Zezschwitz, Alexander De Luca, and Florian Alt. 2016. Snapapp: Reducing authentication overhead with a time-constrained fast unlock option. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3736–3747.

Digital Library

[13]

Kelly Caine. 2016. Local Standards for Sample Size at CHI. ACM, New York, NY, 981–992. DOI:https://doi.org/10.1145/2858036.2858498

Digital Library

[14]

Sue V. G. Cobb, Sarah Nichols, Amanda Ramsey, and John R. Wilson. 1999. Virtual reality-induced symptoms and effects (VRISE). Presence: Teleoperators and Virtual Environments. 8, 2 (April 1999), 169–186. DOI:https://doi.org/10.1162/105474699566152

Digital Library

[15]

Karen Collins, Kamen Kanev, and Bill Kapralos. 2010. Using games as a method of evaluation of usability and user experience in human-computer interaction design. In Proceedings of the 13th International Conference on Humans and Computers. Citeseer, 5–10.

Digital Library

[16]

Annabelle Cumyn, Kathleen Ouellet, Anne-Marie Côté, Caroline Francoeur, and Christina St-Onge. 2019. Role of researchers in the ethical conduct of research: A discourse analysis from different stakeholder perspectives. Ethics and Behavior 29, 8 (2019), 621–636.

[17]

M. Danesi. 2006. Proxemics. In Proceedings of the Encyclopedia of Language & Linguistics (Second Edition) (second edition ed.), Keith Brown (Ed.). Elsevier, Oxford, 241–243. DOI:https://doi.org/10.1016/B0-08-044854-2/01441-3

[18]

Nigel Davies, Sarah Clinch, and Florian Alt. 2014. Pervasive displays: Understanding the future of digital signage. Synthesis Lectures on Mobile and Pervasive Computing 8, 1 (2014), 1–128.

Digital Library

[19]

Simon Davis, Keith Nesbitt, and Eugene Nalivaiko. 2014. A systematic review of cybersickness. In Proceedings of the 2014 Conference on Interactive Entertainment. ACM, New York, NY, 1–9. DOI:https://doi.org/10.1145/2677758.2677780

Digital Library

[20]

Jaybie A. De Guzman, Kanchana Thilakarathna, and Aruna Seneviratne. 2019. Security and privacy approaches in mixed reality: A literature survey. ACM Computing Surveys 52, 6, Article 110 (October 2019), 37 pages. DOI:https://doi.org/10.1145/3359626

Digital Library

[21]

Jing Du, Yangming Shi, Zhengbo Zou, and Dong Zhao. 2018. CoVR: Cloud-based multiuser virtual reality headset system for project communication of remote users. Journal of Construction Engineering and Management 144, 2 (2018), 04017109.

[22]

Markus Funk, Florian Müller, Marco Fendrich, Megan Shene, Moritz Kolvenbach, Niclas Dobbertin, Sebastian Günther, and Max Mühlhäuser. 2019. Assessing the accuracy of point and teleport locomotion with orientation indication for virtual reality using curved trajectories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–12. DOI:https://doi.org/10.1145/3290605.3300377

Digital Library

[23]

Laura Germine, Ken Nakayama, Bradley C Duchaine, Christopher F Chabris, Garga Chatterjee, and Jeremy B Wilmer. 2012. Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin and Review 19, 5 (2012), 847–857.

[24]

Michelle Goddard. 2017. The EU general data protection regulation (GDPR): European regulation that has a global impact. International Journal of Market Research 59, 6 (2017), 703–705.

[25]

Mattia Gustarini, Selim Ickin, and Katarzyna Wac. 2013. Evaluation of challenges in human subject studies “in-the-Wild” using subjects’ personal smartphones. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication. ACM, New York, NY, 1447–1456. DOI:https://doi.org/10.1145/2494091.2496041

Digital Library

[26]

Niels Henze and Susanne Boll. 2010. Push the study to the app store: Evaluating off-screen visualizations for maps in the android market. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 373–374. DOI:https://doi.org/10.1145/1851600.1851671

Digital Library

[27]

Niels Henze, Martin Pielot, Benjamin Poppinga, Torben Schinke, and Susanne Boll. 2011. My app is an experiment: Experience from user studies in mobile app stores. International Journal of Mobile Human Computer Interaction 3, 4 (2011), 71–91.

Digital Library

[28]

Niels Henze, Enrico Rukzio, and Susanne Boll. 2011. 100,000,000 Taps: Analysis and improvement of touch performance in the large. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 133–142. DOI:https://doi.org/10.1145/2037373.2037395

Digital Library

[29]

Marc Herz and Philipp A. Rauschnabel. 2019. Understanding the diffusion of virtual reality glasses: The role of media, fashion and technology. Technological Forecasting and Social Change 138 (2019), 228–242. DOI:https://doi.org/10.1016/j.techfore.2018.09.008

[30]

Juan Luis Higuera-Trujillo, Juan López-Tarruella Maldonado, and Carmen Llinares Millán. 2017. Psychological and physiological human responses to simulated and real environments: A comparison between Photographs, 360 Panoramas, and Virtual Reality. Applied Ergonomics 65 (2017), 398–409. DOI:https://doi.org/10.1016/j.apergo.2017.05.006

[31]

E. Hodgson, E. Bachmann, D. Waller, A. Bair, and A. Oberlin. 2012. Virtual reality in the wild: A self-contained and wearable simulation system. In Proceedings of the 2012 IEEE Virtual Reality Workshops. 157–158.

Digital Library

[32]

Bernd Huber and Krzysztof Z. Gajos. 2020. Conducting online virtual environment experiments with uncompensated, unsupervised samples. PLOS ONE 15, 1 (01 2020), 1–17. DOI:https://doi.org/10.1371/journal.pone.0227629

[33]

Wijnand A IJsselsteijn, Yvonne AW de Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013), 3–9.

[34]

Konrad Jamrozik. 2004. Research ethics paperwork: What is the plot we seem to have lost?British Medical Journal 329, 7460 (2004), 286–287.

[35]

Patricia Keith-Spiegel, Gerald P Koocher, and Barbara Tabachnick. 2006. What scientists want from their research ethics committee. Journal of Empirical Research on Human Research Ethics 1, 1 (2006), 67–81.

[36]

Kay Köhle, Matthias Hoppe, Albrecht Schmidt, and Ville Mäkelä. 2021. Diegetic and non-diegetic health interfaces in VR shooter games. In Proceedings of the IFIP Conference on Human-Computer Interaction. Springer.

[37]

Edith L. M. Law, Luis Von Ahn, Roger B. Dannenberg, and Mike Crawford. 2007. TagATune: A Game for Music and Sound Annotation. InISMIR, Vol. 3. 2.

[38]

Xing Liu, Tianyu Chen, Feng Qian, Zhixiu Guo, Felix Xiaozhu Lin, Xiaofeng Wang, and Kai Chen. 2017. Characterizing smartwatch usage in the wild. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. ACM, New York, NY, 385–398. DOI:https://doi.org/10.1145/3081333.3081351

Digital Library

[39]

Xiao Ma, Megan Cackett, Leslie Park, Eric Chien, and Mor Naaman. 2018. Web-Based VR experiments powered by the crowd. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 33–43. DOI:https://doi.org/10.1145/3178876.3186034

Digital Library

[40]

Christian Mai, Tim Wiltzius, Florian Alt, and Heinrich Hußmann. 2018. Feeling alone in public: Investigating the influence of spatial layout on users’ VR experience. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. ACM, New York, NY, 286–298. DOI:https://doi.org/10.1145/3240167.3240200mai2018nordichi.

Digital Library

[41]

Ville Mäkelä, Rivu Radiah, Saleh Alsherif, Mohamed Khamis, Chong Xiao, Lisa Borchert, Albrecht Schmidt, and Florian Alt. 2020. Virtual field studies: Conducting studies on public displays in virtual reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY. DOI:https://doi.org/10.1145/3313831.3376796

Digital Library

[42]

Ville Mäkelä, Sumita Sharma, Jaakko Hakulinen, Tomi Heimonen, and Markku Turunen. 2017. Challenges in public display deployments: A taxonomy of external factors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3426–3475. DOI:https://doi.org/10.1145/3025453.3025798

Digital Library

[43]

Guido Makransky, Richard E Mayer, Nicola Veitch, Michelle Hood, Karl Bang Christensen, and Helen Gadegaard. 2019. Equivalence of using a desktop virtual reality science simulation at home and in class. Plos one 14, 4 (2019), e0214944.

[44]

Nemanja Memarovic, Marc Langheinrich, Keith Cheverst, Nick Taylor, and Florian Alt. 2013. P-LAYERS – A layered framework addressing the multifaceted issues facing community-supporting public display deployments. ACM Transactions on Computer-Human Interaction 20, 3, Article 17 (July 2013), 34 pages. DOI:https://doi.org/10.1145/2491500.2491505

Digital Library

[45]

R. J. Menzies, S. J. Rogers, A. M. Phillips, Elodie Chiarovano, C. De Waele, Frans A. J. Verstraten, and H. MacDougall. 2016. An objective measure for the visual fidelity of virtual reality and the risks of falls in a virtual environment. Virtual Reality 20, 3 (2016), 173–181. DOI:https://doi.org/10.1007/s10055-016-0288-6

Digital Library

[46]

Aske Mottelson and Kasper Hornbæk. 2017. Virtual reality studies outside the laboratory. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. ACM, New York, NY, Article 9, 10 pages. DOI:https://doi.org/10.1145/3139131.3139141

Digital Library

[47]

Fares Moustafa and Anthony Steed. 2018. A longitudinal study of small group interaction in social virtual reality. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. ACM, New York, NY, Article 22, 10 pages. DOI:https://doi.org/10.1145/3281505.3281527

Digital Library

[48]

T. C. Peck, L. E. Sockol, and S. M. Hancock. 2020. Mind the Gap: The underrepresentation of female participants and authors in virtual reality research. IEEE Transactions on Visualization and Computer Graphics 26, 5 (2020), 1945–1954. DOI:https://doi.org/10.1109/TVCG.2020.2973498

[49]

Radiah Rivu, Yumeng Zhou, Robin Welsch, Ville Mäkelä, and Florian Alt. 2021. When friends become strangers: Understanding the influence of avatar gender on interpersonal distance in virtual reality. In Proceedings of the IFIP Conference on Human-Computer Interaction. Springer.

[50]

David Saffo, Sara Di Bartolomeo, Caglar Yildirim, and Cody Dunne. 2021. Remote and collaborative virtual reality experiments via social VR platforms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY. DOI:https://doi.org/10.1145/3411764.3445426

Digital Library

[51]

David Saffo, Caglar Yildirim, Sara Di Bartolomeo, and Cody Dunne. 2020. Crowdsourcing virtual reality experiments using VRChat. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–8. DOI:https://doi.org/10.1145/3334480.3382829

Digital Library

[52]

Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Martin Pielot, Dominik Weber, and Albrecht Schmidt. 2014. Large-scale assessment of mobile notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3055–3064. DOI:https://doi.org/10.1145/2556288.2557189

Digital Library

[53]

Stefan Schneegass, Frank Steimle, Andreas Bulling, Florian Alt, and Albrecht Schmidt. 2014. SmudgeSafe: Geometric image transformations for smudge-resistant user authentication. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, New York, NY, 775–786. DOI:https://doi.org/10.1145/2632048.2636090

Digital Library

[54]

Valentin Schwind, Pascal Knierim, Nico Haas, and Niels Henze. 2019. Using presence questionnaires in virtual reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[55]

Mel Slater, John McCarthy, and Francesco Maringelli. 1998. The influence of body movement on subjective presence in virtual environments. Human Factors 40, 3 (1998), 469–477. DOI:https://doi.org/10.1518/001872098779591368

[56]

Mel Slater and Anthony Steed. 2000. A Virtual presence counter. Presence: Teleoperators and Virtual Environments 9, 5 (October 2000), 413–434. DOI:https://doi.org/10.1162/105474600566925

Digital Library

[57]

James S Spiegel. 2018. The ethics of virtual reality technology: Social hazards and public policy recommendations. Science and Engineering Ethics 24, 5 (2018), 1537–1550. DOI:https://doi.org/10.1007/s11948-017-9979-y

[58]

A. Steed, S. Frlston, M. M. Lopez, J. Drummond, Y. Pan, and D. Swapp. 2016. An ‘In the Wild’ experiment on presence and embodiment using consumer virtual reality equipment. IEEE Transactions on Visualization and Computer Graphics 22, 4 (2016), 1406–1414.

Digital Library

[59]

Anthony Steed, Francisco R Ortega, Adam S Williams, Ernst Kruijff, Wolfgang Stuerzlinger, Anil Ufuk Batmaz, Andrea Stevenson Won, Evan Suma Rosenberg, Adalberto L Simeone, and Aleshia Hayes. 2020. Evaluating immersive experiences during COVID-19 and beyond. Retrieved on 15 July, 2021 from https://interactions.acm.org/blog/view/evaluating-immersive-experiences-during-COVID-19-and-beyond.

Digital Library

[60]

The Against Gravity Team. 2019. Rec Room in 2018. Retrieved on 15 July, 2021 from https://recroom.com/2018inreview/.

[61]

Douglas Turnbull, Ruoran Liu, Luke Barrington, and Gert Lanckriet. 2007. A game-based approach for collecting semantic annotations of music. In Proceedings of the 8th International Conference on Music Information Retrieval.

[62]

Martin Usoh, Kevin Arthur, Mary C Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P Brooks. 1999. Walking > Walking-in-Place > Flying, in Virtual Environments. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing Co., 359–364. DOI:https://doi.org/10.1145/311535.311589

Digital Library

[63]

Luis von Ahn and Laura Dabbish. 2004. Labeling images with a computer game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 319–326. DOI:https://doi.org/10.1145/985692.985733

Digital Library

[64]

FengJun Zhang, GuoZhong Dai, and Xiaolan PENG. 2016. A survey on human-computer interaction in virtual reality. Scientia Sinica Informationis 46, 12 (2016), 1711–1736.

Cited By

Schuetz IBaltaretu BFiehler K(2024)Where was this thing again? Evaluating methods to indicate remembered object positions in virtual realityJournal of Vision10.1167/jov.24.7.1024:7(10)Online publication date: 12-Jul-2024
https://doi.org/10.1167/jov.24.7.10
Li YHogue A(2024)StudyVR: A Framework for Streamlining VR User Study Design2024 IEEE Gaming, Entertainment, and Media Conference (GEM)10.1109/GEM61861.2024.10585501(1-5)Online publication date: 5-Jun-2024
https://doi.org/10.1109/GEM61861.2024.10585501
Martínez-Cevallos DAlguacil MCalabuig FDuclos-Bastías D(2024)Brand perception and its relationships to satisfaction with a virtual sporting eventInternational Journal of Sports Marketing and Sponsorship10.1108/IJSMS-09-2023-0186Online publication date: 11-Jul-2024
https://doi.org/10.1108/IJSMS-09-2023-0186
Show More Cited By

Index Terms

Remote VR Studies: A Framework for Running Virtual Reality Studies Remotely Via Participant-Owned HMDs
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Negative Effects Associated with HMDs in Augmented and Virtual Reality
Virtual, Augmented and Mixed Reality. Design and Interaction
Abstract
Head mounted displays (HMD) are becoming ubiquitous. Simulator sickness has been an issue since the first simulators and HMDs were created. As computational power and display capabilities increase, so does their utilization in technologies such ...
Design of a Mixed Reality-Based Immersive Virtual Environment System for Social Interaction and Behavioral Studies
Intelligent Human Computer Interaction
Abstract
The advancements in immersive technologies allow us to create more sophisticated environments designed to help engage users by merging the physical world with a digital or simulated reality. These can range from completely immersive virtual ...
Examining Design Choices of Questionnaires in VR User Studies
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Questionnaires are among the most common research tools in virtual reality (VR) user studies. Transitioning from virtuality to reality for giving self-reports on VR experiences can lead to systematic biases. VR allows to embed questionnaires into the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 28, Issue 6

December 2021

354 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/3492441

Editor:
Kristina Höök
KTH Royal Institute of Technology, Sweden

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2021

Accepted: 01 June 2021

Revised: 01 May 2021

Received: 01 February 2021

Published in TOCHI Volume 28, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
2,066
Total Downloads

Downloads (Last 12 months)402
Downloads (Last 6 weeks)34

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schuetz IBaltaretu BFiehler K(2024)Where was this thing again? Evaluating methods to indicate remembered object positions in virtual realityJournal of Vision10.1167/jov.24.7.1024:7(10)Online publication date: 12-Jul-2024
https://doi.org/10.1167/jov.24.7.10
Li YHogue A(2024)StudyVR: A Framework for Streamlining VR User Study Design2024 IEEE Gaming, Entertainment, and Media Conference (GEM)10.1109/GEM61861.2024.10585501(1-5)Online publication date: 5-Jun-2024
https://doi.org/10.1109/GEM61861.2024.10585501
Martínez-Cevallos DAlguacil MCalabuig FDuclos-Bastías D(2024)Brand perception and its relationships to satisfaction with a virtual sporting eventInternational Journal of Sports Marketing and Sponsorship10.1108/IJSMS-09-2023-0186Online publication date: 11-Jul-2024
https://doi.org/10.1108/IJSMS-09-2023-0186
Loetscher TJurkovic NMichalski SBillinghurst MLee G(2023)Online Platforms for Remote Immersive Virtual Reality Testing: An Emerging Tool for Experimental Behavioral ResearchMultimodal Technologies and Interaction10.3390/mti70300327:3(32)Online publication date: 21-Mar-2023
https://doi.org/10.3390/mti7030032
Banakou DSlater M(2023)A comparison of two methods for moving through a virtual environment: walking in place and interactive redirected walkingFrontiers in Virtual Reality10.3389/frvir.2023.12945394Online publication date: 20-Nov-2023
https://doi.org/10.3389/frvir.2023.1294539
Steed AArcher DBrandstätter KCongdon BFriston SGanapathi PGiunchi DIzzouzi LPark GSwapp DThiel F(2023)Lessons learnt running distributed and remote mixed reality experimentsFrontiers in Computer Science10.3389/fcomp.2022.9663194Online publication date: 5-Jan-2023
https://doi.org/10.3389/fcomp.2022.966319
Zhou SGromala DWang L(2023)Ethical Challenges of Virtual Reality Technology Interventions for the Vulnerabilities of Patients With Chronic Pain: Exploration of Technician ResponsibilityJournal of Medical Internet Research10.2196/4923725(e49237)Online publication date: 4-Dec-2023
https://doi.org/10.2196/49237
Delgado Rodriguez SRivu RMäkelä VAlt FWard JMcGill MMarky K(2023)Challenges in Virtual Reality Studies: Ethics and Internal and External ValidityProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582716(105-111)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582716
Harley DMacArthur C(2023)Sharing Play Spaces: Design Lessons from Reddit Posts Showing Virtual Reality in the HomeProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596005(509-522)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596005
Osborne AFielder SMcveigh-Schultz JLang TKreminski MButler GLi JSanchez DIsbister K(2023)Being Social in VR Meetings: A Landscape Analysis of Current ToolsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595959(1789-1809)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595959
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents