research-article

Virtually-Extended Proprioception: Providing Spatial Reference in VR through an Appended Virtual Limb

Authors:

Shengdong Zhao,

Pheng Ann HengAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 12

https://doi.org/10.1145/3313831.3376557

Published: 23 April 2020 Publication History

Abstract

Selecting targets directly in the virtual world is difficult due to the lack of haptic feedback and inaccurate estimation of egocentric distances. Proprioception, the sense of self-movement and body position, can be utilized to improve virtual target selection by placing targets on or around one's body. However, its effective scope is limited closely around one's body. We explore the concept of virtually-extended proprioception by appending virtual body parts mimicking real body parts to users' avatars, to provide spatial reference to virtual targets. Our studies suggest that our approach facilitates more efficient target selection in VR as compared to no reference or using an everyday object as reference. Besides, by cultivating users' sense of ownership on the appended virtual body part, we can further enhance target selection performance. The effects of transparency and granularity of the virtual body part on target selection performance are also discussed.

Supplementary Material

MP4 File (paper430pv.mp4)

Preview video

Download
10.90 MB

References

[1]

Matthew Botvinick and Jonathan Cohen. 1998. Rubber hands "feel" touch that eyes see. Nature 391, 6669 (1998), 756.

[2]

Sarah H Creem-Regehr, Jeanine K Stefanucci, William B Thompson, Nathan Nash, and Michael McCardell. 2015. Egocentric distance perception in the Oculus Rift (DK2). In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception. ACM, 47--50.

Digital Library

[3]

Sarah H Creem-Regehr, Peter Willemsen, Amy A Gooch, and William B Thompson. 2005. The influence of restricted viewing conditions on egocentric distance perception: Implications for real and virtual indoor environments. Perception 34, 2 (2005), 191--204.

[4]

James Cutting and Peter Vishton. 1995. Perceiving layout and knowing distances: The interaction, relative potency, and contextual use of different information about depth. Vol. 5. 69--177.

[5]

Daniel J Finnegan, Eamonn O'Neill, and Michael J Proulx. 2016. Compensating for distance compression in audiovisual virtual environments using incongruence. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 200--212.

Digital Library

[6]

Daniel J Finnegan, Eamonn O'Neill, and Michael J Proulx. 2017. An approach to reducing distance compression in audiovisual virtual environments. In 2017 IEEE 3rd VR Workshop on Sonic Interactions for Virtual Environments (SIVE). IEEE, 1--6.

[7]

Nicolas Gerig, Johnathan Mayo, Kilian Baur, Frieder Wittmann, Robert Riener, and Peter Wolf. 2018. Missing depth cues in virtual reality limit performance and quality of three dimensional reaching movements. PLoS one 13, 1 (2018), e0189275.

[8]

Mar Gonzalez-Franco and Tabitha C. Peck. 2018. Avatar Embodiment. Towards a Standardized Questionnaire. Frontiers in Robotics and AI 5, Article 74 (2018).

[9]

Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. Facetouch: Enabling touch interaction in display fixed uis for mobile virtual reality. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 49--60.

Digital Library

[10]

Yves Guiard. 1987. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior 19, 4 (1987), 486--517.

[11]

Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: appropriating the body as an input surface. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 453--462.

Digital Library

[12]

Ludovic Hoyet, Ferran Argelaguet, Corentin Nicole, and Anatole Lécuyer. 2016. "Wow! I have six Fingers!": would you accept structural changes of your hand in VR? Frontiers in Robotics and AI 3 (2016), 27.

[13]

Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. HiFinger: One-Handed Text Entry Technique for Virtual Environments Based on Touches between Fingers. Sensors 19 (07 2019), 3063.

[14]

Shunichi Kasahara, Keina Konno, Richi Owaki, Tsubasa Nishi, Akiko Takeshita, Takayuki Ito, Shoko Kasuga, and Junichi Ushiba. 2017. Malleable Embodiment: Changing Sense of Embodiment by Spatial-Temporal Deformation of Virtual Human Body. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 6438--6448.

Digital Library

[15]

Konstantina Kilteni, Antonella Maselli, Konrad P. Kording, and Mel Slater. 2015. Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience 9, Article 141 (2015).

[16]

Joshua M Knapp and Jack M Loomis. 2004. Limited field of view of head-mounted displays is not the cause of distance underestimation in virtual environments. Presence: Teleoperators & Virtual Environments 13, 5 (2004), 572--577.

Digital Library

[17]

Ryota Kondo, Maki Sugimoto, Kouta Minamizawa, Takayuki Hoshi, Masahiko Inami, and Michiteru Kitazaki. 2018. Illusory body ownership of an invisible body interpolated between virtual hands and feet via visual-motor synchronicity. Scientific reports 8, 1 (2018), 7541.

[18]

Chiuhsiang Joe Lin, Bereket Haile Woldegiorgis, Dino Caesaron, and Lai-Yu Cheng. 2015. Distance estimation with mixed real and virtual targets in stereoscopic displays. Displays 36 (2015), 41--48.

[19]

Robert W Lindeman, John L Sibert, and James K Hahn. 1999. Towards usable VR: an empirical study of user interfaces for immersive virtual environments. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 64--71.

Digital Library

[20]

Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 939--948.

Digital Library

[21]

A. Mablekos-Alexiou, G. A. Bertos, and E. Papadopoulos. 2015. A biomechatronic Extended Physiological Proprioception (EPP) controller for upper-limb prostheses. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 6173--6178.

Digital Library

[22]

Mark R Mine, Frederick P Brooks Jr, and Carlo H Sequin. 1997. Moving objects in space: exploiting proprioception in virtual-environment interaction. In SIGGRAPH, Vol. 97. 19--26.

Digital Library

[23]

M Morel, B Bideau, J Lardy, and R Kulpa. 2015. Advantages and limitations of virtual reality for balance assessment and rehabilitation. Neurophysiologie Clinique/Clinical Neurophysiology 45, 4--5 (2015), 315--326.

[24]

Alex Peer and Kevin Ponto. 2019. Mitigating Incorrect Perception of Distance in Virtual Reality through Personalized Rendering Manipulation. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 244--250.

[25]

Etienne Peillard, Thomas Thebaud, Jean-Marie Normand, Ferran Argelaguet, Guillaume Moreau, and Anatole Lécuyer. 2019. Virtual Objects Look Farther on the Sides: The Anisotropy of Distance Perception in Virtual Reality. In IEEE VR Conference 2019.

[26]

Lane Phillips, Brian Ries, Victoria Interrante, Michael Kaeding, and Lee Anderson. 2009. Distance perception in NPR immersive virtual environments, revisited. In Proceedings of the 6th Symposium on Applied Perception in Graphics and Visualization. ACM, 11--14.

Digital Library

[27]

David J Reinkensmeyer and Sarah J Housman. 2007. "If I can't do it once, why do it a hundred times?": Connecting volition to movement success in a virtual environment motivates people to exercise the arm after stroke. In 2007 Virtual Rehabilitation. IEEE, 44--48.

[28]

Rebekka S Renner, Boris M Velichkovsky, and Jens R Helmert. 2013. The perception of egocentric distances in virtual environments-a review. ACM Computing Surveys (CSUR) 46, 2 (2013), 23.

Digital Library

[29]

Robert Riener, Mathias Wellner, Tobias Nef, Joachim Von Zitzewitz, Alexander Duschau-Wicke, Gery Colombo, and L Lunenburger. 2006. A view on VR-enhanced rehabilitation robotics. In 2006 International Workshop on Virtual Rehabilitation. IEEE, 149--154.

[30]

Daniel Roth, Jean-Luc Lugrin, Marc Erich Latoschik, and Stephan Huber. 2017. Alpha IVBO - Construction of a Scale to Measure the Illusion of Virtual Body Ownership. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, NY, NY, USA, 2875--2883.

Digital Library

[31]

Marcos Serrano, Barrett Ens, and Pourang Irani. 2014. Exploring the Use of Hand-To-Face Input for Interacting with Head-Worn Displays. Conference on Human Factors in Computing Systems - Proceedings (05 2014).

Digital Library

[32]

Brandon M. Sexton, Yang Liu, and Hannah J. Block. 2019. Increase in weighting of vision vs. proprioception associated with force field adaptation. Scientific reports 9, 10167 (2019).

[33]

Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin & review 20, 1 (2013), 21--53.

[34]

DC Simpson and others. 1974. The choice of control system for the multimovement prosthesis: extended physiological proprioception (epp). The control of upper-extremity prostheses and orthoses (1974), 146--150.

[35]

William Steptoe, Anthony Steed, and Mel Slater. 2013. Human tails: ownership and control of extended humanoid avatars. IEEE transactions on visualization and computer graphics 19, 4 (2013), 583--590.

[36]

William B Thompson, Peter Willemsen, Amy A Gooch, Sarah H Creem-Regehr, Jack M Loomis, and Andrew C Beall. 2004. Does the quality of the computer graphics matter when judging distances in visually immersive environments? Presence: Teleoperators & Virtual Environments 13, 5 (2004), 560--571.

Digital Library

[37]

David Waller and Adam R Richardson. 2008. Correcting distance estimates by interacting with immersive virtual environments: Effects of task and available sensory information. Journal of Experimental Psychology: Applied 14, 1 (2008), 61.

[38]

Katrin Wolf, Christian Müller-Tomfelde, Kelvin Cheng, and Ina Wechsung. 2012. Does proprioception guide back-of-device pointing as well as vision?. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 1739--1744.

Digital Library

[39]

Andrea Stevenson Won, Jeremy Bailenson, Jimmy Lee, and Jaron Lanier. 2015. Homuncular Flexibility in Virtual Reality. Journal of Computer-Mediated Communication 20, 3 (01 2015), 241--259.

Digital Library

[40]

Bing Wu, Teng Leng Ooi, and Zijiang J He. 2004. Perceiving distance accurately by a directional process of integrating ground information. Nature 428, 6978 (2004), 73.

[41]

Koki Yamashita, Takashi Kikuchi, Katsutoshi Masai, Maki Sugimoto, Bruce Thomas, and Yuta Sugiura. 2017. CheekInput: turning your cheek into an input surface by embedded optical sensors on a head-mounted display. 1--8.

Digital Library

[42]

Xiaoqi Yan, Chi-Wing Fu, Pallavi Mohan, and Wooi Boon Goh. 2016. CardboardSense: Interacting with DIY Cardboard VR Headset by Tapping. In ACM Conference on Designing Interactive Systems. ACM, 229--233.

Digital Library

[43]

Ye Yuan and Anthony Steed. 2010. Is the rubber hand illusion induced by immersive virtual reality?. In 2010 IEEE Virtual Reality Conference (VR). IEEE, 95--102.

Digital Library

Cited By

Faleel SSodhi RIrani P(2024)Comparison of Unencumbered Interaction Technique for Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981468:ISS(500-516)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698146
Tian YBai HZhao SFu CYu CQin HWang QHeng P(2024)Kine-Appendage: Enhancing Freehand VR Interaction Through Transformations of Virtual AppendagesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.323074630:7(3298-3313)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3230746
Yi XWang XLi JLi H(2023)Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00058(427-437)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00058
Show More Cited By

Index Terms

Virtually-Extended Proprioception: Providing Spatial Reference in VR through an Appended Virtual Limb
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

We explore how to add haptics to walls and other heavy objects in virtual reality. When a user tries to push such an object, our system actuates the user's shoulder, arm, and wrist muscles by means of electrical muscle stimulation, creating a counter ...
VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Haptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...
Large displays enhance spatial knowledge of a virtual environment
APGV '06: Proceedings of the 3rd symposium on Applied perception in graphics and visualization

Previous research has found performance for several egocentric tasks to be superior on physically large displays relative to smaller ones, even when visual angle is held constant. This finding is believed to be due to the more immersive nature of large ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

the Key R&D Program of Guangdong Province, China
Shenzhen Science and Technology Program
the Research Grants Council of the Hong Kong Special Administrative Region
the NUS School of Computing Strategic Initiatives

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
851
Total Downloads

Downloads (Last 12 months)111
Downloads (Last 6 weeks)16

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Faleel SSodhi RIrani P(2024)Comparison of Unencumbered Interaction Technique for Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981468:ISS(500-516)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698146
Tian YBai HZhao SFu CYu CQin HWang QHeng P(2024)Kine-Appendage: Enhancing Freehand VR Interaction Through Transformations of Virtual AppendagesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.323074630:7(3298-3313)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3230746
Yi XWang XLi JLi H(2023)Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00058(427-437)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00058
Serino SSansoni MDi Lernia DParisi ATuena CRiva G(2023)360-degree video-based body-ownership illusion for inducing embodiment: development and feasibility resultsVirtual Reality10.1007/s10055-023-00836-627:3(2665-2672)Online publication date: 21-Jul-2023
https://dl.acm.org/doi/10.1007/s10055-023-00836-6
Dewez DHoyet LLecuyer AArgelaguet F(2022)Do You Need Another Hand? Investigating Dual Body Representations During Anisomorphic 3D ManipulationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315050128:5(2047-2057)Online publication date: May-2022
https://doi.org/10.1109/TVCG.2022.3150501
Kim JKim SLee J(2022)The Effect of Multisensory Pseudo-Haptic Feedback on Perception of Virtual WeightIEEE Access10.1109/ACCESS.2022.314043810(5129-5140)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3140438
Vatavu RSchipor O(2022)Formalizing Digital Proprioception for Devices, Environments, and UsersAmbient Intelligence – Software and Applications – 12th International Symposium on Ambient Intelligence10.1007/978-3-031-06894-2_1(1-10)Online publication date: 1-Sep-2022
https://doi.org/10.1007/978-3-031-06894-2_1

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents