research-article

Analysis of Detection Thresholds for Hand Redirection during Mid-Air Interactions in Virtual Reality

Authors:

Judith Hartfill,

Susanne Schmidt,

Kevin Riebandt,

Frank SteinickeAuthors Info & Claims

VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

Article No.: 35, Pages 1 - 10

https://doi.org/10.1145/3489849.3489866

Published: 08 December 2021 Publication History

Abstract

Avatars in virtual reality (VR) with fully articulated hands enable users to naturally interact with the virtual environment (VE). Interactions are often performed in a one-to-one mapping between the movements of the user’s real body, for instance, the hands, and the displayed body of the avatar. However, VR also allows manipulating this mapping to introduce non-isomorphic techniques. In this context, research on manipulations of virtual hand movements typically focuses on increasing the user’s interaction space to improve the overall efficiency of hand-based interactions.

In this paper, we investigate a hand retargeting method for decelerated hand movements. With this technique, users need to perform larger movements to reach for an object in the VE, which can be utilized, for example, in therapeutic applications. If these gain-based redirections of virtual hand movements are small enough, users become unable to reliably detect them due to the dominance of the visual sense. In a psychophysical experiment, we analyzed detection thresholds for six different motion paths in mid-air for both hands. We found significantly different detection thresholds between movement directions on each spatial axis. To verify our findings, we applied the identified gains in a playful application in a confirmatory study.

References

[1]

Eric Burns, Sharif Razzaque, Abigail T Panter, Mary C Whitton, Matthew R McCallus, and Frederick P Brooks Jr. 2006. The hand is more easily fooled than the eye: Users are more sensitive to visual interpenetration than to visual-proprioceptive discrepancy. Presence: teleoperators & virtual environments 15, 1(2006), 1–15.

[2]

Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. Association for Computing Machinery, New York, NY, USA, 3718–3728. https://doi.org/10.1145/3025453.3025753

Digital Library

[3]

Yoon-Hee Choi, Jeonghun Ku, Hyunmi Lim, Yeo Hyung Kim, and Nam-Jong Paik. 2016. Mobile game-based virtual reality rehabilitation program for upper limb dysfunction after ischemic stroke. Restorative neurology and neuroscience 34, 3 (2016), 455–463.

[4]

Geert Crombez, Johan WS Vlaeyen, Peter HTG Heuts, and Roland Lysens. 1999. Pain-related fear is more disabling than pain itself: evidence on the role of pain-related fear in chronic back pain disability. Pain 80, 1 (1999), 329–339. https://doi.org/10.1016/S0304-3959(98)00229-2

[5]

Kim Dockx, Esther MJ Bekkers, Veerle Van den Bergh, Pieter Ginis, Lynn Rochester, Jeffrey M Hausdorff, Anat Mirelman, and Alice Nieuwboer. 2016. Virtual reality for rehabilitation in Parkinson’s disease. Cochrane Database of Systematic Reviews12 (2016).

[6]

Justin Dunn, Elizabeth Yeo, Parisah Moghaddampour, Brian Chau, and Sarah Humbert. 2017. Virtual and augmented reality in the treatment of phantom limb pain: A literature review. NeuroRehabilitation 40, 4 (2017), 595–601.

[7]

Alexander Eiselmayer, Chat Wacharamanotham, Michel Beaudouin-Lafon, and Wendy E Mackay. 2019. Touchstone2: An interactive environment for exploring trade-offs in hci experiment design. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.

Digital Library

[8]

Shaghayegh Esmaeili, Brett Benda, and Eric D Ragan. 2020. Detection of scaled hand interactions in virtual reality: The effects of motion direction and task complexity. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 453–462.

[9]

Hao Feng, Cuiyun Li, Jiayu Liu, Liang Wang, Jing Ma, Guanglei Li, Lu Gan, Xiaoying Shang, and Zhixuan Wu. 2019. Virtual reality rehabilitation versus conventional physical therapy for improving balance and gait in parkinson’s disease patients: A randomized controlled trial. Medical science monitor: international medical journal of experimental and clinical research 25(2019), 4186.

[10]

Jenny Gabel. 2020. A Framework for Manipulation of Hand and Arm Movements in Virtual Reality. Masterarbeit. Human-Computer Interaction, Department of Informatics, University of Hamburg. http://basilic.informatik.uni-hamburg.de/Publications/2020/Gab20

[11]

Eric J Gonzalez and Sean Follmer. 2019. Investigating the Detection of Bimanual Haptic Retargeting in Virtual Reality. In 25th ACM Symposium on Virtual Reality Software and Technology. ACM, 1–5. https://doi.org/10.1145/3359996.3364248

Digital Library

[12]

Alexander Hänsel, Bigna Lenggenhager, Roland von Känel, Michele Curatolo, and Olaf Blanke. 2011. Seeing and identifying with a virtual body decreases pain perception. 15 (Sep 2011), 874–879. https://doi.org/10.1016/j.ejpain.2011.03.013

[13]

Omar Janeh, Odette Fründt, Beate Schönwald, Alessandro Gulberti, Carsten Buhmann, Christian Gerloff, Frank Steinicke, and Monika Pötter-Nerger. 2019. Gait training in virtual reality: short-term effects of different virtual manipulation techniques in Parkinson’s disease. Cells 8, 5 (2019), 419.

[14]

Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.

[15]

So-Yeon Kim, Hyojin Park, Myeongul Jung, and Kwanguk Kim. 2020. Impact of Body Size Match to an Avatar on the Body Ownership Illusion and User’s Subjective Experience. Cyberpsychology, Behavior, and Social Networking 23, 4(2020), 234–241.

[16]

Luv Kohli. 2013. Redirected touching. Ph.D. Dissertation. The University of North Carolina at Chapel Hill.

[17]

Luv Kohli, Mary C Whitton, and Frederick P Brooks. 2012. Redirected touching: The effect of warping space on task performance. In 2012 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 105–112.

[18]

Yongseok Lee, Inyoung Jang, and Dongjun Lee. 2015. Enlarging just noticeable differences of visual-proprioceptive conflict in VR using haptic feedback. In 2015 IEEE World Haptics Conference (WHC). IEEE, 19–24.

[19]

Scott M Lephart, Danny M Pincivero, Jorge L Giraido, and Freddie H Fu. 1997. The role of proprioception in the management and rehabilitation of athletic injuries. The American journal of sports medicine 25, 1 (1997), 130–137.

[20]

Matthew R Longo, Viviana Betti, Salvatore M Aglioti, and Patrick Haggard. 2009. Visually induced analgesia: seeing the body reduces pain. Journal of Neuroscience 29, 39 (2009), 12125–12130.

[21]

Florella Magora, Sarale Cohen, Mara Shochina, and Ehud Dayan. 2006. Virtual reality immersion method of distraction to control experimental ischemic pain. IMAJ-RAMAT GAN- 8, 4 (2006), 261.

[22]

Oculus. 2018. Unity Integration. https://docs.unity3d.com/Packages/[email protected]/manual/index.html. [Online; accessed 18-09-2021].

[23]

Oculus. 2020. Unity Integration. https://developer.oculus.com/downloads/package/unity-integration/. [Online; accessed 18-09-2021].

[24]

Nami Ogawa, Takuji Narumi, and Michitaka Hirose. 2020. Effect of Avatar Appearance on Detection Thresholds for Remapped Hand Movements. IEEE Transactions on Visualization and Computer Graphics (2020), 1–1. https://doi.org/10.1109/TVCG.2020.2964758

Digital Library

[25]

Tabitha C Peck and Mar Gonzalez-Franco. 2021. Avatar embodiment. a standardized questionnaire. Frontiers in Virtual Reality 1 (2021), 44.

[26]

Michael I Posner, Mary J Nissen, and Raymond M Klein. 1976. Visual dominance: an information-processing account of its origins and significance.Psychological review 83, 2 (1976), 157.

[27]

Pragathi Praveena, Daniel Rakita, Bilge Mutlu, and Michael Gleicher. 2020. Supporting Perception of Weight through Motion-induced Sensory Conflicts in Robot Teleoperation. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 509–517. https://doi.org/10.1145/3319502.3374841

Digital Library

[28]

Vilayanur S Ramachandran and Diane Rogers-Ramachandran. 1996. Synaesthesia in phantom limbs induced with mirrors. Proceedings of the Royal Society of London. Series B: Biological Sciences 263, 1369(1996), 377–386.

[29]

Thomas Rutledge, Deborah Velez, Colin Depp, John R McQuaid, Garland Wong, R Carter W Jones III, J Hampton Atkinson, Bosco Giap, Alex Quan, and Huan Giap. 2019. A virtual reality intervention for the treatment of phantom limb pain: development and feasibility results. Pain Medicine 20, 10 (2019), 2051–2059.

[30]

Jonas Spillmann, Stefan Tuchschmid, and Matthias Harders. 2013. Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator. IEEE transactions on visualization and computer graphics 19, 4(2013), 626–633.

Digital Library

[31]

Jaimie F Veale. 2014. Edinburgh handedness inventory–short form: a revised version based on confirmatory factor analysis. Laterality: Asymmetries of Body, Brain and Cognition 19, 2 (2014), 164–177.

[32]

Johan WS Vlaeyen, Ank MJ Kole-Snijders, Ruben GB Boeren, and H Van Eek. 1995. Fear of movement/(re) injury in chronic low back pain and its relation to behavioral performance. Pain 62, 3 (1995), 363–372.

[33]

Lynne M Weber, Dawn M Nilsen, Glen Gillen, Jin Yoon, and Joel Stein. 2019. Immersive virtual reality mirror therapy for upper limb recovery following stroke: A pilot study. American journal of physical medicine & rehabilitation 98, 9(2019), 783.

[34]

Wolf3D. 2019. Ready Player Me. https://readyplayer.me/. [Online; accessed 18-09-2021].

[35]

André Zenner and Antonio Krüger. 2019. Estimating Detection Thresholds for Desktop-Scale Hand Redirection in Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 47–55. https://doi.org/10.1109/VR.2019.8798143

[36]

André Zenner, Kora Persephone Regitz, and Antonio Krüger. 2021. Blink-Suppressed Hand Redirection. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 75–84. https://doi.org/10.1109/VR50410.2021.00028

Cited By

Xiong PZhang YZhang NFu SLi XZheng YZhou JHu XFan M(2024)To Reach the Unreachable: Exploring the Potential of VR Hand Redirection for Upper Limb RehabilitationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642912(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642912
Clarence AKnibbe JCordeil MWybrow M(2024)Stacked Retargeting: Combining Redirected Walking and Hand Redirection to Expand Haptic Retargeting's CoverageProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642228(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642228
Zenner AKarr CFeick MAriza OKrüger A(2024)Beyond the Blink: Investigating Combined Saccadic & Blink-Suppressed Hand Redirection in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642073(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642073
Show More Cited By

Recommendations

HaRT - The Virtual Reality Hand Redirection Toolkit
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Past research has proposed various hand redirection techniques for virtual reality (VR). Such techniques modify a user’s hand movements and have been successfully used to enhance haptics and 3D user interfaces. Up to now, however, no unified framework ...
The Detectability of Saccadic Hand Offset in Virtual Reality
VRST '23: Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology

On the way towards novel hand redirection (HR) techniques that make use of change blindness, the next step is to take advantage of saccades for hiding body warping. A prerequisite for saccadic HR algorithms, however, is to know how much the user’s ...
Beyond the Blink: Investigating Combined Saccadic & Blink-Suppressed Hand Redirection in Virtual Reality
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

In pursuit of hand redirection techniques that are ever more tailored to human perception, we propose the first algorithm for hand redirection in virtual reality that makes use of saccades, i.e., fast ballistic eye movements that are accompanied by the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

December 2021

563 pages

ISBN:9781450390927

DOI:10.1145/3489849

Editors:
Yuichi Itoh
Aoyama Gakuin University, Japan
,
Kazuki Takashima
Tohoku University, Japan
,
Parinya Punpongsanon
Osaka University, Japan
,
Misha Sra
University of California, Santa Barbara, USA
,
Kazuyuki Fujita
Tohoku University, Japan
,
Shigeo Yoshida
The University of Tokyo, Japan
,
Tham Piumsomboon
University of Canterbury, New Zealand

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRST '21

Sponsor:

VRST '21: 27th ACM Symposium on Virtual Reality Software and Technology

December 8 - 10, 2021

Osaka, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Upcoming Conference

VRST '24

Sponsor:
sigchi
sigchi

30th ACM Symposium on Virtual Reality Software and Technology

October 9 - 11, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
598
Total Downloads

Downloads (Last 12 months)172
Downloads (Last 6 weeks)22

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xiong PZhang YZhang NFu SLi XZheng YZhou JHu XFan M(2024)To Reach the Unreachable: Exploring the Potential of VR Hand Redirection for Upper Limb RehabilitationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642912(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642912
Clarence AKnibbe JCordeil MWybrow M(2024)Stacked Retargeting: Combining Redirected Walking and Hand Redirection to Expand Haptic Retargeting's CoverageProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642228(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642228
Zenner AKarr CFeick MAriza OKrüger A(2024)Beyond the Blink: Investigating Combined Saccadic & Blink-Suppressed Hand Redirection in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642073(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642073
Feick MZenner ASeibert STang AKrüger A(2024)The Impact of Avatar Completeness on Embodiment and the Detectability of Hand Redirection in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641933(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641933
Mavromatis MHoyet LLécuyer ADewez DArgelaguet F(2024)To Stick or Not to Stick? Studying the Impact of Offset Recovery Techniques During Mid-Air InteractionsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329520930:8(5493-5506)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3295209
Groth CScholz TCastillo STauscher JMagnor M(2023)Instant Hand Redirection in Virtual Reality Through Electrical Muscle Stimulation-Triggered Eye BlinksProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615717(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615717
Yang XZhang YYang X(2023)Redirected Placement: Evaluating the Redirection of Passive Props during Reach-to-Place in Virtual RealityProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615688(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615688
Tanaka KNakamura TMatsumoto KKuzuoka H(2023)Effect of Hanger Reflex on Detection Thresholds for Hand Redirection during Forearm RotationACM Symposium on Applied Perception 202310.1145/3605495.3605792(1-8)Online publication date: 5-Aug-2023
https://dl.acm.org/doi/10.1145/3605495.3605792
Gonzalez EFollmer S(2023)Sensorimotor Simulation of Redirected Reaching using Stochastic Optimal Feedback ControlProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580767(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580767
Feick MRegitz KTang AJungbluth TRekrut MKrüger A(2023)Investigating Noticeable Hand Redirection in Virtual Reality using Physiological and Interaction Data2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00035(194-204)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00035
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents