Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3613904.3642147acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

The RayHand Navigation: A Virtual Navigation Method with Relative Position between Hand and Gaze-Ray

Published: 11 May 2024 Publication History

Editorial Notes

The authors have requested minor, non-substantive changes to the VoR and, in accordance with ACM policies, a Corrected VoR was published on July 23, 2024. For reference purposes the VoR may still be accessed via the Supplemental Material section on this page.

Abstract

In this paper, we introduce a novel Virtual Reality (VR) navigation method using gaze ray and hand, named RayHand navigation. It supports controlling navigation speed and direction by quickly indicating the initial direction using gaze and then using dexterous hand movement for controlling the speed and direction based on the relative position between the gaze ray and user's hand. We conducted a user study comparing our approach to the head-hand and torso-leaning-based navigation methods, and also evaluated their learning effect. The results showed that the RayHand and head-hand navigations were less physically demanding than the torso-leaning navigation, and the RayHand supported rich navigation experience with high hedonic quality and solved the issue of the user unintentionally stepping out from the designated interaction area. In addition, our approach showed a significant improvement over time with a learning effect.

Supplemental Material

MP4 File - Video Preview
Video Preview
Transcript for: Video Preview
MP4 File - Video Presentation
Video Presentation
Transcript for: Video Presentation
MP4 File - Video Figure
Video Figure
Transcript for: Video Figure
PDF File - 3642147-VoR
Version of Record for "The RayHand Navigation: A Virtual Navigation Method with Relative Position between Hand and Gaze-Ray" by Kang et al., Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24).

References

[1]
Guilherme Amaro, Daniel Mendes, and Rui Rodrigues. 2022. Design and Evaluation of Travel and Orientation Techniques for Desk VR. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 222–231. https://doi.org/10.1109/VR51125.2022.00041 .
[2]
Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. J. Usability Studies 4, 3 (may 2009), 114–123. .
[3]
Yiwei Bao, Jiaxi Wang, Zhimin Wang, and Feng Lu. 2023. Exploring 3D Interaction with Gaze Guidance in Augmented Reality. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 22–32. https://doi.org/10.1109/VR55154.2023.00018 .
[4]
Jiwan Bhandari, Paul MacNeilage, and Eelke Folmer. 2018. Teleportation without Spatial Disorientation Using Optical Flow Cues. In Proceedings of the 44th Graphics Interface Conference (Toronto, Canada) (GI ’18). Canadian Human-Computer Communications Society, Waterloo, CAN, 162–167. https://doi.org/10.20380/GI2018.22 .
[5]
D.A. Bowman, D. Koller, and L.F. Hodges. 1997. Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques. In Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality. 45–52. https://doi.org/10.1109/VRAIS.1997. 583043 .
[6]
Doug A. Bowman, Donald B. Johnson, and Larry F. Hodges. 1999. Testbed Evaluation of Virtual Environment Interaction Techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (London, United Kingdom) (VRST ’99). Association for Computing Machinery, New York, NY, USA, 26–33. https://doi.org/10.1145/323663.323667 .
[7]
D. A. Bowman, D. Koller, and L. F. Hodges. 1998. A methodology for the evaluation of travel techniques for immersive virtual environments. Virtual Reality 3, 2 (jun 1998), 120–131. https://doi.org/10.1007/bf01417673 .
[8]
Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016. Point & Teleport Locomotion Technique for Virtual Reality. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (Austin, Texas, USA) (CHI PLAY ’16). Association for Computing Machinery, New York, NY, USA, 205–216. https://doi.org/10.1145/2967934.2968105 .
[9]
Hugo Brument, Iana Podkosova, Hannes Kaufmann, Anne Hélène Olivier, and Ferran Argelaguet. 2019. Virtual vs. Physical Navigation in VR: Study of Gaze and Body Segments Temporal Reorientation Behaviour. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 680–689. https://doi.org/10.1109/VR.2019.8797721 .
[10]
Fabio Buttussi and Luca Chittaro. 2021. Locomotion in Place in Virtual Reality: A Comparative Evaluation of Joystick, Teleport, and Leaning. IEEE Transactions on Visualization and Computer Graphics 27, 1 (2021), 125–136. https://doi.org/10.1109/TVCG.2019.2928304 .
[11]
Davide Calandra, Fabrizio Lamberti, and Massimo Migliorini. 2019. On the Usability of Consumer Locomotion Techniques in Serious Games: Comparing Arm Swinging, Treadmills and Walk-in-Place. In 2019 IEEE 9th International Conference on Consumer Electronics (ICCE-Berlin). 348–352. https://doi.org/10.1109/ICCE-Berlin47944.2019.8966165 .
[12]
CGTrader. 2021. Low Poly Horse - Free 3D Model. https://www.cgtrader.com/free-3d-models/animals/other/low-poly-horse-free-3dmodel
[13]
Jean-Rémy Chardonnet, Mohammad Ali Mirzaei, and Frédéric Merienne. 2020. Influence of navigation parameters on cybersickness in virtual reality. Virtual Reality 25, 3 (oct 2020), 565–574. https://doi.org/10.1007/s10055-020-00474-2 .
[14]
Isaac Cho, Jialei Li, and Zachary Wartell. 2018. Multi-Scale 7DOF View Adjustment. IEEE Transactions on Visualization and Computer Graphics 24, 3 (2018), 1331–1344. https://doi.org/10.1109/TVCG.2017.2668405 .
[15]
Sohan Chowdhury, A K M Amanat Ullah, Nathan Bruce Pelmore, Pourang Irani, and Khalad Hasan. 2022. WriArm: Leveraging Wrist Movement to Design Wrist+Arm Based Teleportation in VR. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 317–325. https://doi.org/10.1109/ISMAR55827.2022.00047 .
[16]
Chris G. Christou and Poppy Aristidou. 2017. Steering Versus Teleport Locomotion for Head Mounted Displays. In Lecture Notes in Computer Science. Springer International Publishing, 431–446. https://doi.org/10.1007/978-3-319-60928-7_37 .
[17]
Robert Codd-Downey and Wolfgang Stuerzlinger. 2014. LeapLook: A Free-Hand Gestural Travel Technique Using the Leap Motion Finger Tracker. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (Honolulu, Hawaii, USA) (SUI ’14). Association for Computing Machinery, New York, NY, USA, 153. https://doi.org/10.1145/2659766.2661218 .
[18]
Rudolph P. Darken, William R. Cockayne, and David Carmein. 1997. The Omni-Directional Treadmill: A Locomotion Device for Virtual Worlds. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (Banff, Alberta, Canada) (UIST ’97). Association for Computing Machinery, New York, NY, USA, 213–221. https://doi.org/10.1145/263407.263550
[19]
VIVE Developer. 2021. Tracking Overview - Introduction. https://hub.vive.com/storage/tracking/overview/introduction.html
[20]
Yasin Farmani and Robert J. Teather. 2018. Viewpoint Snapping to Reduce Cybersickness in Virtual Reality. In Proceedings of the 44th Graphics Interface Conference (Toronto, Canada) (GI ’18). Canadian Human-Computer Communications Society, Waterloo, CAN, 168–175. https://doi.org/10.20380/GI2018.23 .
[21]
Shuo Feng, Weiping He, Shaohua Zhang, and Mark Billinghurst. 2022. Seeing is believing: AR-assisted blind area assembly to support hand–eye coordination. The International Journal of Advanced Manufacturing Technology 119, 11-12 (jan 2022), 8149–8158. https://doi.org/10.1007/s00170-021-08546-6 .
[22]
Carlo Flemming, Benjamin Weyers, and Daniel Zielasko. 2022. How to Take a Brake from Embodied Locomotion – Seamless Status Control Methods for Seated Leaning Interfaces. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 728–736. https://doi.org/10.1109/VR51125.2022.00094 .
[23]
Hong Gao, Lasse Frommelt, and Enkelejda Kasneci. 2022. The Evaluation of Gait-Free Locomotion Methods with Eye Movement in Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 530–535. https: //doi.org/10.1109/ISMAR-Adjunct57072.2022.00112 .
[24]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9 .
[25]
M. A. Hollands, A. E. Patla, and J. N. Vickers. 2002. “Look where you're going!”: gaze behaviour associated with maintaining and changing the direction of locomotion. Experimental Brain Research 143, 2 (jan 2002), 221–230. https://doi.org/10.1007/s00221-001-0983-7 .
[26]
Jan Hombeck, Henrik Voigt, Timo Heggemann, Rabi R. Datta, and Kai Lawonn. 2023. Tell Me Where To Go: Voice-Controlled Hands-Free Locomotion for Virtual Reality Systems. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 123–134. https://doi.org/10.1109/VR55154.2023.00028 .
[27]
Li-Jen Hsin, Yi-Ping Chao, Hai-Hua Chuang, Terry B. J. Kuo, Cheryl C. H. Yang, Chung-Guei Huang, Chung-Jan Kang, Wan-Ni Lin, Tuan-Jen Fang, Hsueh-Yu Li, and Li-Ang Lee. 2022. Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial. Virtual Reality 27, 4 (Sept. 2022), 3345–3361. https://doi.org/10.1007/s10055-022-00688-6 .
[28]
S Q Hu, Robert M. Stern, M W Vasey, and Kenneth L Koch. 1989. Motion sickness and gastric myoelectric activity as a function of speed of rotation of a circular vection drum. Aviation, space, and environmental medicine 60 5 (1989), 411–4. https://api.semanticscholar.org/ CorpusID:45853591 .
[29]
Takao Imai, Steven T. Moore, Theodore Raphan, and Bernard Cohen. 2001. Interaction of the body, head, and eyes during walking and turning. Experimental Brain Research 136, 1 (jan 2001), 1–18. https://doi.org/10.1007/s002210000533 .
[30]
Robert J. K. Jacob. 1990. What You Look at is What You Get: Eye Movement-Based Interaction Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’90). Association for Computing Machinery, New York, NY, USA, 11–18. https://doi.org/10.1145/97243.97246 .
[31]
Patrick W Jordan, Bruce Thomas, Ian Lyall McClelland, and Bernard Weerdmeester. 1996. Usability evaluation in industry. CRC Press. .
[32]
Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology 3, 3 (jul 1993), 203–220. https://doi.org/10.1207/s15327108ijap0303_3 .
[33]
Chengyuan Lai, Xinyu Hu, Afham Ahmed Aiyaz, Ann Segismundo, Ananya Phadke, and Ryan P. McMahan. 2021. The Cognitive Loads and Usability of Target-based and Steering-based Travel Techniques. IEEE Transactions on Visualization and Computer Graphics 27, 11 (2021), 4289–4299. https://doi.org/10.1109/TVCG.2021.3106507 .
[34]
Joseph J LaViola Jr, Ernst Kruijff, Ryan P McMahan, Doug Bowman, and Ivan P Poupyrev. 2017. 3D user interfaces: theory and practice. Addison-Wesley Professional. .
[35]
Jean-Luc Lugrin, Andreas Juchno, Philipp Schaper, Maximilian Landeck, and Marc Erich Latoschik. 2019. Drone-Steering: A Novel VR Traveling Technique. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 63, 2 pages. https://doi.org/10.1145/3359996.3364780 .
[36]
Mathias N. Lystbæk, Peter Rosenberg, Ken Pfeuffer, Jens Emil Grønbæk, and Hans Gellersen. 2022. Gaze-Hand Alignment: Combining Eye Gaze and Mid-Air Pointing for Interacting with Menus in Augmented Reality. Proc. ACM Hum.-Comput. Interact. 6, ETRA, Article 145 (may 2022), 18 pages. https://doi.org/10.1145/3530886 .
[37]
Esteban Segarra Martinez, Annie S. Wu, and Ryan P. McMahan. 2022. Research Trends in Virtual Reality Locomotion Techniques. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 270–280. https://doi.org/10.1109/VR51125.2022.00046 .
[38]
Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. USA. .
[39]
Florian Müller, Arantxa Ye, Dominik Schön, and Julian Rasch. 2023. UndoPort: Exploring the Influence of Undo-Actions for Locomotion in Virtual Reality on the Efficiency, Spatial Understanding and User Experience. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 234, 15 pages. https://doi.org/10.1145/3544548.3581557
[40]
Ken Pfeuffer, Jason Alexander, Ming Ki Chong, Yanxia Zhang, and Hans Gellersen. 2015. Gaze-Shifting: Direct-Indirect Input with Pen and Touch Modulated by Gaze. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 373–383. https://doi.org/10.1145/2807442.2807460 .
[41]
Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze + Pinch Interaction in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 99–108. https://doi.org/10.1145/3131277.3132180 .
[42]
Thammathip Piumsomboon, Gun A. Lee, Barrett Ens, Bruce H. Thomas, and Mark Billinghurst. 2018. Superman vs Giant: A Study on Spatial Perception for a Multi-Scale Mixed Reality Flying Telepresence Interface. IEEE Transactions on Visualization and Computer Graphics 24, 11 (2018), 2974–2982. https://doi.org/10.1109/TVCG.2018.2868594 .
[43]
Parinya Punpongsanon, Emilie Guy, Daisuke Iwai, Kosuke Sato, and Tamy Boubekeur. 2017. Extended LazyNav: Virtual 3D Ground Navigation for Large Displays and Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 23, 8 (2017), 1952–1963. https://doi.org/10.1109/TVCG.2016.2586071 .
[44]
Yuan Yuan Qian and Robert J. Teather. 2018. Look to Go: An Empirical Evaluation of Eye-Based Travel in Virtual Reality. In Proceedings of the 2018 ACM Symposium on Spatial User Interaction (Berlin, Germany) (SUI ’18). Association for Computing Machinery, New York, NY, USA, 130–140. https://doi.org/10.1145/3267782.3267798 .
[45]
Muhammad Raees, Sehat Ullah, and Sami Ur Rahman. 2018. VEN-3DVE: vision based egocentric navigation for 3D virtual environments. International Journal on Interactive Design and Manufacturing (IJIDeM) 13, 1 (may 2018), 35–45. https://doi.org/10.1007/s12008-018-0481-9 .
[46]
Sharif Razzaque, David Swapp, Mel Slater, Mary C. Whitton, and Anthony Steed. 2002. Redirected Walking in Place. In Proceedings of the Workshop on Virtual Environments 2002 (Barcelona, Spain) (EGVE ’02). Eurographics Association, Goslar, DEU, 123–130. .
[47]
Kunhee Ryu, Joong-Jae Lee, and Jung-Min Park. 2019. GG Interaction: a gaze–grasp pose interaction for 3D virtual object selection. Journal on Multimodal User Interfaces 13, 4 (July 2019), 383–393. https://doi.org/10.1007/s12193-019-00305-y .
[48]
M. M. Samson, A. Crowe, P. L. de Vreede, J. A. G. Dessens, S. A. Duursma, and H. J. J. Verhaar. 2001. Differences in gait parameters at a preferred walking speed in healthy subjects due to age, height and body weight. Aging Clinical and Experimental Research 13, 1 (feb 2001), 16–21. https://doi.org/10.1007/bf03351489 .
[49]
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures. In Virtual Reality and Mixed Reality, Gabriel Zachmann, Mariano Alcañiz Raya, Patrick Bourdot, Maud Marchal, Jeanine Stefanucci, and Xubo Yang (Eds.). Springer International Publishing, Cham, 191–205. .
[50]
Martin Schrepp, Andreas Hinderks, and Jorg Thomaschewski. 2017. Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S). International Journal of Interactive Multimedia and Artificial Intelligence 4, 6 (2017), 103. https://doi.org/10.9781/ ijimai.2017.09.001 .
[51]
Mel Slater, Martin Usoh, and Anthony Steed. 1995. Taking Steps: The Influence of a Walking Technique on Presence in Virtual Reality. ACM Trans. Comput.-Hum. Interact. 2, 3 (sep 1995), 201–219. https://doi.org/10.1145/210079.210084 .
[52]
Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual reality on a WIM. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95. ACM Press. https://doi.org/10.1145/223904.223938 .
[53]
Evan A. Suma, Sabarish Babu, and Larry F. Hodges. 2007. Comparison of Travel Techniques in a Complex, Multi-Level 3D Environment. In 2007 IEEE Symposium on 3D User Interfaces. https://doi.org/10.1109/3DUI.2007.340788 .
[54]
Evan A. Suma, Samantha L. Finkelstein, Seth Clark, Paula Goolkasian, and Larry F. Hodges. 2010. Effects of travel technique and gender on a divided attention task in a virtual environment. In 2010 IEEE Symposium on 3D User Interfaces (3DUI). 27–34. https: //doi.org/10.1109/3DUI.2010.5444726 .
[55]
Vildan Tanriverdi and Robert J. K. Jacob. 2000. Interacting with Eye Movements in Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands) (CHI ’00). Association for Computing Machinery, New York, NY, USA, 265–272. https://doi.org/10.1145/332040.332443 .
[56]
HTC Vive. Vive Pro Eye Overview. https://www.vive.com/kr/product/vive-pro-eye/overview/
[57]
Anette von Kapri, Tobias Rick, and Steven Feiner. 2011. Comparing steering-based travel techniques for search tasks in a CAVE. In 2011 IEEE Virtual Reality Conference. 91–94. https://doi.org/10.1109/VR.2011.5759443 .
[58]
Fan Zhang, Shaowei Chu, Ruifang Pan, Naye Ji, and Lian Xi. 2017. Double hand-gesture interaction for walk-through in VR environment. In 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS). 539–544. https://doi.org/10.1109/ICIS.2017. 7960051 .
[59]
Daniel Zielasko, Sven Horn, Sebastian Freitag, Benjamin Weyers, and Torsten W. Kuhlen. 2016. Evaluation of hands-free HMDbased navigation techniques for immersive data analysis. In 2016 IEEE Symposium on 3D User Interfaces (3DUI). 113–119. https: //doi.org/10.1109/3DUI.2016.7460040 .
[60]
Daniel Zielasko, Yuen C. Law, and Benjamin Weyers. 2020. Take a Look Around – The Impact of Decoupling Gaze and Travel-direction in Seated and Ground-based Virtual Reality Utilizing Torso-directed Steering. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 398–406. https://doi.org/10.1109/VR46266.2020.00060 .
[61]
F.R.H. Zijlstra. 1993. Efficiency in Work Behaviour: A Design Approach for Modern Tools. Delft University Press. https://books.google.co. kr/books?id=q_ftAQAACAAJ

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. gaze-ray
  2. navigation
  3. virtual reality

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '24

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 1,033
    Total Downloads
  • Downloads (Last 12 months)1,033
  • Downloads (Last 6 weeks)54
Reflects downloads up to 08 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media