research-article

PAWS: Personalized Arm and Wrist Movements With Sensitivity Mappings for Controller-Free Locomotion in Virtual Reality

Authors:

Sohan Chowdhury,

William Delamare,

Khalad HasanAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue MHCI

Article No.: 217, Pages 1 - 21

https://doi.org/10.1145/3604264

Published: 13 September 2023 Publication History

Abstract

Virtual Reality (VR) headsets equipped with multiple cameras enable hands-only teleportation techniques without requiring any physical controller. Hands-only teleportation is an effective alternative to controllers for navigation tasks in virtual reality - allowing users to move from one point to another instantaneously. However, the current implementation of hands-only techniques does not consider users' physical attributes (e.g., arm's reach). Thus, a hands-only teleportation technique can lead to different user experiences based on physical attributes. We propose PAWS, a personalized arm and wrist-based teleportation technique that incorporates users' physical attributes for improved teleportation experiences. We first evaluate different degrees of teleportation personalization with no-, partial, and full personalization. We find that full personalization offers faster locomotion - but at the cost of degraded performances with distant targets due to increased sensitivity. We hence further explore different combinations of mapping functions (e.g., sigmoid, quadratic) to personalize motor movements and find that asymmetric functions result in improved performance. Overall, our results show that PAWS helps users to navigate quickly in virtual environments.

Supplementary Material

MP4 File (v7mhci217.mp4)

Supplemental video

Download
46.90 MB

References

[1]

Ofer Arazy, Oded Nov, and Nanda Kumar. 2015. Personalityzation: UI personalization, theoretical grounding in HCI and design research. AIS Transactions on Human-Computer Interaction 7, 2 (2015), 43--69.

[2]

Tomislav Bezmalinovic. 2022. Cambria: Meta's high-end headset launches without Controller - Report. (2022). Retrieved September 15, 2022 from https://mixed-news.com/en/cambria-metas-high-end-headset-launches-without-controllerreport/.

[3]

Costas Boletsis and Jarl Erik Cedergren. 2019. VR locomotion in the new era of virtual reality: an empirical comparison of prevalent techniques. Advances in Human-Computer Interaction 2019 (2019).

[4]

Benjamin Bolte, Frank Steinicke, and Gerd Bruder. 2011. The jumper metaphor: an effective navigation technique for immersive display setups. In Proceedings of Virtual Reality International Conference, Vol. 1.

[5]

Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016a. Locomotion in virtual reality for individuals with autism spectrum disorder. In Proceedings of the 2016 Symposium on Spatial User Interaction. 33--42.

Digital Library

[6]

Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016b. Point & Teleport Locomotion Technique for Virtual Reality. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). Association for Computing Machinery, New York, NY, USA, 205--216.

Digital Library

[7]

W. Broll, I. Lindt, J. Ohlenburg, I. Herbst, M. Wittkamper, and T. Novotny. 2005. An infrastructure for realizing custom-tailored augmented reality user interfaces. IEEE Transactions on Visualization and Computer Graphics 11, 6 (2005), 722--733.

Digital Library

[8]

Kelly Caine. 2016. Local Standards for Sample Size at CHI (CHI '16). Association for Computing Machinery, New York, NY, USA.

Digital Library

[9]

Jeff Chastine, Nicole Kosoris, and Joshua Skelton. 2013. A study of gesture-based first person control. In Proceedings of CGAMES'2013 USA. IEEE, 79--86.

[10]

Heni Cherni, Natacha Métayer, and Nicolas Souliman. 2020. Literature review of locomotion techniques in virtual reality. International Journal of Virtual Reality (2020).

[11]

Sohan Chowdhury, A K M Amanat Ullah, Nathan Bruce Pelmore, Pourang Irani, and Khalad Hasan. 2022. WriArm: Leveraging Wrist Movement to Design WristArm Based Teleportation in VR. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 317--325.

[12]

Chris G Christou and Poppy Aristidou. 2017. Steering versus teleport locomotion for head mounted displays. In International conference on augmented reality, virtual reality and computer graphics. Springer, 431--446.

[13]

Jacob Cohen and others. 1965. Some statistical issues in psychological research. Handbook of clinical psychology (1965), 95--121.

[14]

NCD Risk Factor Collaboration and others. 2016. A century of trends in adult human height. Elife 5 (2016), e13410.

[15]

Noah Coomer, Sadler Bullard, William Clinton, and Betsy Williams-Sanders. 2018. Evaluating the Effects of Four VR Locomotion Methods: Joystick, Arm-Cycling, Point-Tugging, and Teleporting. In Proceedings of the 15th ACM Symposium on Applied Perception (SAP '18). Association for Computing Machinery, New York, NY, USA, Article 7, 8 pages.

Digital Library

[16]

Andrea Ferracani, Daniele Pezzatini, Jacopo Bianchini, Gianmarco Biscini, and Alberto Del Bimbo. 2016. Locomotion by Natural Gestures for Immersive Virtual Environments. In Proceedings of the 1st International Workshop on Multimedia Alternate Realities (AltMM '16). Association for Computing Machinery, New York, NY, USA, 21--24. org/10.1145/2983298.2983307

Digital Library

[17]

Eelke Folmer, Isayas Berhe Adhanom, and Aniruddha Prithul. 2021. Teleportation in Virtual Reality; A Mini-Review. Frontiers in Virtual Reality (2021), 138.

[18]

Julian Frommel, Sven Sonntag, and MichaelWeber. 2017. Effects of Controller-Based Locomotion on Player Experience in a Virtual Reality Exploration Game. In Proceedings of the 12th International Conference on the Foundations of Digital Games (FDG '17). Association for Computing Machinery, New York, NY, USA, Article 30, 6 pages.

Digital Library

[19]

Markus Funk, Florian Müller, Marco Fendrich, Megan Shene, Moritz Kolvenbach, Niclas Dobbertin, Sebastian Günther, and Max Mühlhäuser. 2019. Assessing the Accuracy of Point & Teleport Locomotion with Orientation Indication for Virtual Reality Using Curved Trajectories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. 3290605.3300377

Digital Library

[20]

Martin Gonzalez-Rodriguez, Jorge Manrubia, Agueda Vidau, and Marcos Gonzalez-Gallego. 2009. Improving accessibility with user-tailored interfaces. Applied Intelligence 30, 1 (2009), 65--71. 0098--3

[21]

Martín González Rodríguez, J Ramón Pérez Pérez, and M Paule Ruíz. 2004. Designing user interfaces tailored to the current user's requirements in real time. In International Conference on Computers for Handicapped Persons. Springer, 69--75.

[22]

Khalad Hasan, David Ahlström, and Pourang Irani. 2013. Ad-binning: leveraging around device space for storing, browsing and retrieving mobile device content. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 899--908.

Digital Library

[23]

Khalad Hasan, David Ahlström, Junhyeok Kim, and Pourang Irani. 2017. Airpanes: Two-handed around-device interaction for pane switching on smartphones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 679--691.

Digital Library

[24]

Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions (CHI '14). Association for Computing Machinery, New York, NY, USA, 1063--1072.

Digital Library

[25]

Errol R Hoffmann, Colin G Drury, and Carol J Romanowski. 2011. Performance in one-, two-and three-dimensional terminal aiming tasks. Ergonomics 54, 12 (2011), 1175--1185.

[26]

Juan Pablo Hourcade, Christopher M Nguyen, Keith B Perry, and Natalie L Denburg. 2010. Pointassist for older adults: analyzing sub-movement characteristics to aid in pointing tasks. In Proceedings of the sigchi conference on human factors in computing systems. 1115--1124.

Digital Library

[27]

Rachel Huang, Carisa Harris-Adamson, Dan Odell, and David Rempel. 2019. Design of finger gestures for locomotion in virtual reality. Virtual Reality & Intelligent Hardware 1, 1 (2019), 1--9.

[28]

Maryam Khademi, Hossein Mousavi Hondori, Alison McKenzie, Lucy Dodakian, Cristina Videira Lopes, and Steven C Cramer. 2014. Free-hand interaction with leap motion controller for stroke rehabilitation. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. 1663--1668.

[29]

Mohamed Khamis, Daniel Buschek, Tobias Thieron, Florian Alt, and Andreas Bulling. 2018. EyePACT: Eye-Based Parallax Correction on Touch-Enabled Interactive Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 146 (jan 2018), 18 pages.

Digital Library

[30]

Chaowanan Khundam. 2015. First person movement control with palm normal and hand gesture interaction in virtual reality. In 2015 12th International Joint Conference on Computer Science and Software Engineering (JCSSE). IEEE, 325--330.

[31]

Alexander Kulik, André Kunert, and Bernd Froehlich. 2020. On motor performance in virtual 3d object manipulation. IEEE transactions on visualization and computer graphics 26, 5 (2020), 2041--2050.

[32]

Aqueasha Martin-Hammond, Abdullah Ali, Catherine Hornback, and Amy K. Hurst. 2015. Understanding Design Considerations for Adaptive User Interfaces for Accessible Pointing with Older and Younger Adults. In Proceedings of the 12th International Web for All Conference (W4A '15). Association for Computing Machinery, New York, NY, USA, Article 19, 10 pages.

Digital Library

[33]

Aqueasha Martin-Hammond, Foad Hamidi, Tejas Bhalerao, Christian Ortega, Abdullah Ali, Catherine Hornback, Casey Means, and Amy Hurst. 2018. Designing an adaptive web navigation interface for users with variable pointing performance. In Proceedings of the 15th International Web for All Conference (W4A '18). Association for Computing Machinery, New York, NY, USA, Article 31, 10 pages.

Digital Library

[34]

Andrii Matviienko, Florian Müller, Martin Schmitz, Marco Fendrich, and Max Mühlhäuser. 2022. SkyPort: Investigating 3D Teleportation Methods in Virtual Environments. In CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 516, 11 pages. 3491102.3501983

Digital Library

[35]

Mark R Mine. 1995. Virtual environment interaction techniques. UNC Chapel Hill CS Dept (1995).

Digital Library

[36]

MRTK2. 2022. MRTK2-Unity Developer Documentation - MRTK 2. (2022). Retrieved September 15, 2022 from https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05.

[37]

Oculus. 2022. Oculus Developer Center. (2022). Retrieved September 15, 2022 from https://developer.oculus.com/.

[38]

Yun Suen Pai and Kai Kunze. 2017. Armswing: Using arm swings for accessible and immersive navigation in ar/vr spaces. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia. 189--198.

Digital Library

[39]

Laxmi Pandey, Khalad Hasan, and Ahmed Sabbir Arif. 2021. Acceptability of Speech and Silent Speech Input Methods in Private and Public. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--13.

Digital Library

[40]

Octavian Postolache, Luís Teixeira, João Cordeiro, Luísa Lima, Patrícia Arriaga, Mariana Rodrigues, and Pedro Girão. 2019. Tailored Virtual Reality for Smart Physiotherapy. In 2019 11th International Symposium on Advanced Topics in Electrical Engineering (ATEE). 1--6.

[41]

Mahfuz Rahman, Sean Gustafson, Pourang Irani, and Sriram Subramanian. 2009. Tilt Techniques: Investigating the Dexterity ofWrist-Based Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 1943--1952.

Digital Library

[42]

SL Reeves, C Varakamin, and CJ Henry. 1996. The relationship between arm-span measurement and height with special reference to gender and ethnicity. European journal of clinical nutrition 50, 6 (June 1996), 398-400. http: //europepmc.org/abstract/MED/8793422

[43]

RogPodge. 2022. Teleport system - MRTK 2. (2022). Retrieved September 15, 2022 from https://docs.microsoft.com/enus/ windows/mixed-reality/mrtk-unity/mrtk2/features/teleport-system/teleport-system?view=mrtkunity-2022-05.

[44]

Alexander Schäfer, Gerd Reis, and Didier Stricker. 2021. Controlling teleportation-based locomotion in virtual reality with hand gestures: a comparative evaluation of two-handed and one-handed techniques. Electronics 10, 6 (2021), 715.

[45]

Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks. 1999. Walking > Walking-in-Place > Flying, in Virtual Environments. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99). ACM Press/Addison-Wesley Publishing Co., USA, 359--364.

Digital Library

[46]

Valve. 2022a. Half-Life: Alyx on Steam. (2022). Retrieved September 15, 2022 from https://store.steampowered.com/app/546560/HalfLife_Alyx/.

[47]

Valve. 2022b. SDK Installation - Valve Developer Community. (2022). Retrieved September 15, 2022 from https://developer.valvesoftware.com/wiki/SDK_Installation.

[48]

VIVE. 2022. VIVE Focus 3 - VR Headset for Metaverse Solutions. (2022). Retrieved September 15, 2022 from https://www.vive.com/us/product/vive-focus3/overview/.

[49]

Julius von Willich, Martin Schmitz, Florian Müller, Daniel Schmitt, and Max Mühlhäuser. 2020. Podoportation: Foot-Based Locomotion in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14.

Digital Library

[50]

Dennis Wolf, Jan Gugenheimer, Marco Combosch, and Enrico Rukzio. 2020. Understanding the Heisenberg Effect of Spatial Interaction: A Selection Induced Error for Spatially Tracked Input Devices. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--10.

Digital Library

[51]

Fan Zhang, Shaowei Chu, Ruifang Pan, Naye Ji, and Lian Xi. 2017. Double hand-gesture interaction for walk-through in VR environment. In 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS). IEEE, 539--544.

Cited By

Sindhupathiraja SUllah ADelamare WHasan K(2024)Exploring Bi-Manual Teleportation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00095(754-764)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00095

Index Terms

PAWS: Personalized Arm and Wrist Movements With Sensitivity Mappings for Controller-Free Locomotion in Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Point & Teleport Locomotion Technique for Virtual Reality
CHI PLAY '16: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play

With the increasing popularity of virtual reality (VR) and new devices getting available with relatively lower costs, more and more video games have been developed recently. Most of these games use first person interaction techniques since it is more ...
Evaluation of Locomotion Techniques for Room-Scale VR: Joystick, Teleportation, and Redirected Walking
VRIC '18: Proceedings of the Virtual Reality International Conference - Laval Virtual

Due to its multimodal nature virtual reality technology imposes new challenges, for example, when it comes to navigating through a virtual environment. Joystick-based controls and teleportation techniques support only limited self-motion experiences, ...
Assessing the Accuracy of Point & Teleport Locomotion with Orientation Indication for Virtual Reality using Curved Trajectories
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Room-scale Virtual Reality (VR) systems have arrived in users' homes where tracked environments are set up in limited physical spaces. As most Virtual Environments (VEs) are larger than the tracked physical space, locomotion techniques are used to ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue MHCI

MHCI

September 2023

1017 pages

EISSN:2573-0142

DOI:10.1145/3624512

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2023

Published in PACMHCI Volume 7, Issue MHCI

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Natural Sciences and Engineering Research Council of Canada (NSERC)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
165
Total Downloads

Downloads (Last 12 months)165
Downloads (Last 6 weeks)8

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sindhupathiraja SUllah ADelamare WHasan K(2024)Exploring Bi-Manual Teleportation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00095(754-764)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00095

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents