research-article

Open access

Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive Interactions

Authors:

Alexander Chen,

Yang ZhangAuthors Info & Claims

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Article No.: 429, Pages 1 - 16

https://doi.org/10.1145/3491102.3501898

Published: 29 April 2022 Publication History

All formats PDF

Abstract

Augmented reality (AR) and virtual reality (VR) technologies create exciting new opportunities for people to interact with computing resources and information. Less exciting is the need for holding hand controllers, which limits applications that demand expressive, readily available interactions. Prior research investigated freehand AR/VR input by transforming the user’s body into an interaction medium. In contrast to previous work that has users’ hands grasp virtual objects, we propose a new interaction technique that lets users’ hands become virtual objects by imitating the objects themselves. For example, a thumbs-up hand pose is used to mimic a joystick. We created a wide array of interaction designs around this idea to demonstrate its applicability in object retrieval and interactive control tasks. Collectively, we call these interaction designs Hand Interfaces. From a series of user studies comparing Hand Interfaces against various baseline techniques, we collected quantitative and qualitative feedback, which indicates that Hand Interfaces are effective, expressive, and fun to use.

Supplemental Material

MP4 File

Video Preview

Transcript for: Video Preview

References

[1]

Parastoo Abtahi, Mar González-Franco, Eyal Ofek, and Anthony Steed. 2019. I’m a Giant: Walking in Large Virtual Environments at High Speed Gains. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, Glasgow, Scotland, UK, May 04-09, 2019. ACM, 522. https://doi.org/10.1145/3290605.3300752

Digital Library

[2]

Takumi Azai, Mai Otsuki, Fumihisa Shibata, and Asako Kimura. 2018. Open Palm Menu: A Virtual Menu Placed in Front of the Palm. In Proceedings of the 9th Augmented Human International Conference. 1–5.

Digital Library

[3]

Joanna Bergström and Kasper Hornbæk. 2019. Human-Computer Interaction on the Skin. ACM Comput. Surv. 52, 4 (2019), 77:1–77:14. https://doi.org/10.1145/3332166

Digital Library

[4]

Joanna Bergstrom-Lehtovirta, Sebastian Boring, and Kasper Hornbæk. 2017. Placing and Recalling Virtual Items on the Skin. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, May 06-11, 2017. ACM, 1497–1507. https://doi.org/10.1145/3025453.3026030

Digital Library

[5]

Joanna Bergstrom-Lehtovirta, Kasper Hornbæk, and Sebastian Boring. 2018. It’s a Wrap: Mapping On-Skin Input to Off-Skin Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21-26, 2018. ACM, 564. https://doi.org/10.1145/3173574.3174138

Digital Library

[6]

Sidney Bovet and Ronan Boulic. 2017. Ensuring Self-Haptic Consistency for Immersive Amplified Embodiment. (2017).

[7]

Sidney Bovet, Henrique Galvan Debarba, Bruno Herbelin, Eray Molla, and Ronan Boulic. 2018. The Critical Role of Self-Contact for Embodiment in Virtual Reality. IEEE Trans. Vis. Comput. Graph. 24, 4 (2018), 1428–1436. https://doi.org/10.1109/TVCG.2018.2794658

Digital Library

[8]

Julia Chatain, Danielle M. Sisserman, Lea Reichardt, Violaine Fayolle, Manu Kapur, Robert W. Sumner, Fabio Zünd, and Amit H. Bermano. 2020. DigiGlo: Exploring the Palm as an Input and Display Mechanism through Digital Gloves. In CHI PLAY ’20: The Annual Symposium on Computer-Human Interaction in Play, Virtual Event, Canada, November 2-4, 2020. ACM, 374–385. https://doi.org/10.1145/3410404.3414260

Digital Library

[9]

Jiawen Chen, Shahram Izadi, and Andrew W. Fitzgibbon. 2012. KinÊtre: animating the world with the human body. In The 25th Annual ACM Symposium on User Interface Software and Technology, UIST ’12, Cambridge, MA, USA, October 7-10, 2012. ACM, 435–444. https://doi.org/10.1145/2380116.2380171

Digital Library

[10]

Diane Dewez, Ludovic Hoyet, Anatole Lécuyer, and Ferran Argelaguet-Sanz. 2021. Towards ”Avatar-Friendly” 3D Manipulation Techniques: Bridging the Gap Between Sense of Embodiment and Interaction in Virtual Reality. In CHI ’21: CHI Conference on Human Factors in Computing Systems, Virtual Event / Yokohama, Japan, May 8-13, 2021. ACM, 264:1–264:14. https://doi.org/10.1145/3411764.3445379

Digital Library

[11]

John J. Dudley, Hrvoje Benko, Daniel Wigdor, and Per Ola Kristensson. 2019. Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019, Beijing, China, October 14-18, 2019. IEEE, 289–300. https://doi.org/10.1109/ISMAR.2019.00027

[12]

Andreas Dünser, Raphaël Grasset, Hartmut Seichter, and Mark Billinghurst. 2007. Applying HCI principles to AR systems design. (2007).

[13]

Tristan C Endsley, Kelly A Sprehn, Ryan M Brill, Kimberly J Ryan, Emily C Vincent, and James M Martin. 2017. Augmented reality design heuristics: Designing for dynamic interactions. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 61. SAGE Publications Sage CA: Los Angeles, CA, 2100–2104.

[14]

Cathy Mengying Fang and Chris Harrison. 2021. Retargeted Self-Haptics for Increased Immersion in VR without Instrumentation. In UIST ’21: The 34th Annual ACM Symposium on User Interface Software and Technology, Virtual Event, USA, October 10-14, 2021. ACM, 1109–1121. https://doi.org/10.1145/3472749.3474810

Digital Library

[15]

Jacqui Fashimpaur, Kenrick Kin, and Matt Longest. 2020. PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, CHI 2020, Honolulu, HI, USA, April 25-30, 2020. ACM, 1–7. https://doi.org/10.1145/3334480.3382888

Digital Library

[16]

Tiare M. Feuchtner and Jörg Müller. 2017. Extending the Body for Interaction with Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, May 06-11, 2017. ACM, 5145–5157. https://doi.org/10.1145/3025453.3025689

Digital Library

[17]

Frank Spillers and Ditte Hvas Mortensen. 2020. How to Design Gesture Interactions for Virtual and Augmented Reality. https://www.interaction-design.org/literature/article/how-to-design-gesture-interactions-for-virtual-and-augmented-reality Retrieved January 01, 2022.

[18]

Danilo Gasques, Janet G. Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, Konrad Davis, Michael Yip, and Nadir Weibel. 2021. ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. In CHI ’21: CHI Conference on Human Factors in Computing Systems, Virtual Event / Yokohama, Japan, May 8-13, 2021. ACM, 662:1–662:14. https://doi.org/10.1145/3411764.3445576

Digital Library

[19]

Mar Gonzalez-Franco and Jaron Lanier. 2017. Model of Illusions and Virtual Reality. Frontiers in Psychology 8 (2017), 1125. https://doi.org/10.3389/fpsyg.2017.01125

[20]

Alon Grinshpoon, Shirin Sadri, Gabrielle J. Loeb, Carmine Elvezio, and Steven K. Feiner. 2018. Hands-Free Interaction for Augmented Reality in Vascular Interventions. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018, Tuebingen/Reutlingen, Germany, 18-22 March 2018. IEEE Computer Society, 751–752. https://doi.org/10.1109/VR.2018.8446259

[21]

Tovi Grossman and Ravin Balakrishnan. 2006. The design and evaluation of selection techniques for 3D volumetric displays. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, Montreux, Switzerland, October 15-18, 2006. ACM, 3–12. https://doi.org/10.1145/1166253.1166257

Digital Library

[22]

Sean Gustafson, Daniel Bierwirth, and Patrick Baudisch. 2010. Imaginary interfaces: spatial interaction with empty hands and without visual feedback. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. 3–12.

Digital Library

[23]

Hand Physics Lab. 2021. Hand Physics Lab on Oculus Quest. https://www.oculus.com/experiences/quest/3392175350802835/?locale=en_US Retrieved January 01, 2022.

[24]

Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Santa Barbara, CA, USA, October 16-19, 2011. ACM, 441–450. https://doi.org/10.1145/2047196.2047255

Digital Library

[25]

Chris Harrison, Desney S. Tan, and Dan Morris. 2010. Skinput: appropriating the body as an input surface. In Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010, Atlanta, Georgia, USA, April 10-15, 2010. ACM, 453–462. https://doi.org/10.1145/1753326.1753394

Digital Library

[26]

Devamardeep Hayatpur, Seongkook Heo, Haijun Xia, Wolfgang Stuerzlinger, and Daniel Wigdor. 2019. Plane, Ray, and Point: Enabling Precise Spatial Manipulations with Shape Constraints. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019, New Orleans, LA, USA, October 20-23, 2019. ACM, 1185–1195. https://doi.org/10.1145/3332165.3347916

Digital Library

[27]

Kenneth Holstein, Bruce M. McLaren, and Vincent Aleven. 2018. Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms. In Artificial Intelligence in Education - 19th International Conference, AIED 2018, London, UK, June 27-30, 2018, Proceedings, Part I(Lecture Notes in Computer Science, Vol. 10947). Springer, 154–168. https://doi.org/10.1007/978-3-319-93843-1_12

[28]

Justinmind. 2019. 18 AR, MR and VR design principles. https://www.justinmind.com/blog/vr-design/ Retrieved January 01, 2022.

[29]

Hannes Kaufmann and Andreas Dünser. 2007. Summary of Usability Evaluations of an Educational Augmented Reality Application. In Virtual Reality, Second International Conference, ICVR 2007, Held as part of HCI International 2007, Beijing, China, July 22-27, 2007, Proceedings(Lecture Notes in Computer Science, Vol. 4563). Springer, 660–669. https://doi.org/10.1007/978-3-540-73335-5_71

[30]

Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence Teleoperators Virtual Environ. 21, 4 (2012), 373–387. http://www.mitpressjournals.org/doi/abs/10.1162/PRES_a_00124

Digital Library

[31]

David Kim, Otmar Hilliges, Shahram Izadi, Alex Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In The 25th Annual ACM Symposium on User Interface Software and Technology, UIST ’12, Cambridge, MA, USA, October 7-10, 2012. ACM, 167–176. https://doi.org/10.1145/2380116.2380139

Digital Library

[32]

Sang Min Ko, Wonsuk Chang, and Yong Gu Ji. 2013. Usability Principles for Augmented Reality Applications in a Smartphone Environment. Int. J. Hum. Comput. Interact. 29, 8 (2013), 501–515. https://doi.org/10.1080/10447318.2012.722466

[33]

Luv Kohli and Mary C. Whitton. 2005. The haptic hand: providing user interface feedback with the non-dominant hand in virtual environments. In Proceedings of the Graphics Interface 2005 Conference, May 9-11, 2005, Victoria, British Columbia, Canada. Canadian Human-Computer Communications Society, 1–8. https://dl.acm.org/citation.cfm?id=1089510

[34]

Irina Lediaeva and Joseph J. LaViola. 2020. Evaluation of Body-Referenced Graphical Menus in Virtual Environments. In Proceedings of the 45th Graphics Interface Conference 2020, Toronto, ON, Canada, May 28-29, 2020. Canadian Human-Computer Communications Society, 308–316. https://doi.org/10.20380/GI2020.31

[35]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, May 06-11, 2017. ACM, 1471–1482. https://doi.org/10.1145/3025453.3025600

Digital Library

[36]

Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21-26, 2018. ACM, 446. https://doi.org/10.1145/3173574.3174020

Digital Library

[37]

Pattie Maes. 2009. SixthSense: Integrating information and the real world. In Science & Technology Proceedings, 8th IEEE International Symposium on Mixed and Augmented Reality 2009, ISMAR 2009, Orlando, Florida, USA, October 19-22, 2009. IEEE Computer Society. https://doi.org/10.1109/ISMAR.2009.5336511

Digital Library

[38]

Alexander Masurovsky, Paul Chojecki, Detlef Runde, Mustafa Lafci, David Przewozny, and Michael Gaebler. 2020. Controller-Free Hand Tracking for Grab-and-Place Tasks in Immersive Virtual Reality: Design Elements and Their Empirical Study. Multimodal Technologies and Interaction 4, 4 (2020). https://doi.org/10.3390/mti4040091

[39]

Rory McGloin, Kirstie Farrar, and Marina Krcmar. 2013. Video Games, Immersion, and Cognitive Aggression: Does the Controller Matter?Media Psychology 16 (01 2013), 65. https://doi.org/10.1080/15213269.2012.752428

[40]

Meta. 2019. Introducing hand tracking on oculus quest-bringing your real hands into vr. https://www.oculus.com/blog/introducing-hand-tracking-on-oculus-quest-bringing-your-real-hands-into-vr/ Retrieved January 01, 2022.

[41]

Microsoft. 2019. Hand menu. https://docs.microsoft.com/en-us/windows/mixed-reality/design/hand-menu Retrieved January 01, 2022.

[42]

Microsoft. 2019. Introducing instinctual interactions. https://docs.microsoft.com/en-us/windows/mixed-reality/design/interaction-fundamentals Retrieved January 01, 2022.

[43]

Microsoft. 2021. Hand tracking - mixed reality toolkit. https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/input/hand-tracking Retrieved January 01, 2022.

[44]

Adiyan Mujibiya, Xiang Cao, Desney S. Tan, Dan Morris, Shwetak N. Patel, and Jun Rekimoto. 2013. The sound of touch: on-body touch and gesture sensing based on transdermal ultrasound propagation. In The ACM International Conference on Interactive Tabletops and Surfaces, ITS ’13, St Andrews, United Kingdom - October 06 - 09, 2013. ACM, 189–198. https://doi.org/10.1145/2512349.2512821

Digital Library

[45]

Nick Babich. 2020. UX Design Principles for Augmented Reality. https://xd.adobe.com/ideas/principles/emerging-technology/ux-design-principles-for-augmented-reality/ Retrieved January 01, 2022.

[46]

Jakob Nielsen and Rolf Molich. 1990. Heuristic evaluation of user interfaces. In Conference on Human Factors in Computing Systems, CHI 1990, Seattle, WA, USA, April 1-5, 1990, Proceedings. ACM, 249–256. https://doi.org/10.1145/97243.97281

Digital Library

[47]

Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.

[48]

Ken Pfeuffer, Lukas Mecke, Sarah Delgado Rodriguez, Mariam Hassib, Hannah Maier, and Florian Alt. 2020. Empirical Evaluation of Gaze-enhanced Menus in Virtual Reality. In VRST ’20: 26th ACM Symposium on Virtual Reality Software and Technology, Virtual Event, Canada, November 1-4, 2020. ACM, 20:1–20:11. https://doi.org/10.1145/3385956.3418962

Digital Library

[49]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, UIST 1996, Seattle, WA, USA, November 6-8, 1996. ACM, 79–80. https://doi.org/10.1145/237091.237102

Digital Library

[50]

Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John F. Hughes, and Jeff Huang. 2019. Portal-ble: Intuitive free-hand manipulation in unbounded smartphone-based augmented reality. Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (Oct 2019). https://doi.org/10.1145/3332165.3347904

Digital Library

[51]

Zulqarnain Rashid, Joan Melià-Seguí, Rafael Pous, and Enric Peig. 2017. Using Augmented Reality and Internet of Things to improve accessibility of people with motor disabilities in the context of Smart Cities. Future Gener. Comput. Syst. 76 (2017), 248–261. https://doi.org/10.1016/j.future.2016.11.030

Digital Library

[52]

Sofia Seinfeld, Tiare M. Feuchtner, Antonella Maselli, and Jörg Müller. 2021. User Representations in Human-Computer Interaction. Hum. Comput. Interact. 36, 5-6 (2021), 400–438. https://doi.org/10.1080/07370024.2020.1724790

[53]

Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces(Tokyo, Japan) (ISS ’18). Association for Computing Machinery, New York, NY, USA, 177–187. https://doi.org/10.1145/3279778.3279799

Digital Library

[54]

Srinath Sridhar, Anders Markussen, Antti Oulasvirta, Christian Theobalt, and Sebastian Boring. 2017. WatchSense: On- and Above-Skin Input Sensing through a Wearable Depth Sensor. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, May 06-11, 2017. ACM, 3891–3902. https://doi.org/10.1145/3025453.3026005

Digital Library

[55]

Jürgen Steimle, Joanna Bergstrom-Lehtovirta, Martin Weigel, Aditya Shekhar Nittala, Sebastian Boring, Alex Olwal, and Kasper Hornbæk. 2017. On-skin interaction using body landmarks. Computer 50, 10 (2017), 19–27.

Digital Library

[56]

Jürgen Steimle, Joanna Bergstrom-Lehtovirta, Martin Weigel, Aditya Shekhar Nittala, Sebastian Boring, Alex Olwal, and Kasper Hornbæk. 2017. On-Skin Interaction Using Body Landmarks. Computer 50, 10 (2017), 19–27. https://doi.org/10.1109/MC.2017.3641636

Digital Library

[57]

Frank Steinicke, Timo Ropinski, and Klaus Hinrichs. 2006. Object selection in virtual environments using an improved virtual pointer metaphor. In Computer vision and graphics. Springer, 320–326.

[58]

Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2019. Experimental Analysis of Barehand Mid-air Mode-Switching Techniques in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, Glasgow, Scotland, UK, May 04-09, 2019. ACM, 196. https://doi.org/10.1145/3290605.3300426

Digital Library

[59]

Amato Tsuji, Keita Ushida, and Qiu Chen. 2018. Real Time Animation of 3D Models with Finger Plays and Hand Shadow. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces, ISS 2018, Tokyo, Japan, November 25-28, 2018. ACM, 441–444. https://doi.org/10.1145/3279778.3279918

Digital Library

[60]

Tyler Wilson. 2017. The principles of good UX for Augmented Reality. https://uxdesign.cc/the-principles-of-good-user-experience-design-for-augmented-reality-d8e22777aabd Retrieved January 01, 2022.

[61]

Ultraleap. [n.d.]. Leap motion controller. https://www.ultraleap.com/product/leap-motion-controller/

[62]

Ultraleap. 2021. Designing for Hand Tracking. https://docs.ultraleap.com/xr-guidelines/designing-hand-tracking/ Retrieved January 01, 2022.

[63]

Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments. In IEEE Symposium on 3D User Interfaces, 3DUI 2007, Charlotte, North Carolina, USA, 10-11 March, 2007. IEEE Computer Society, 27. https://doi.org/10.1109/3DUI.2007.340783

[64]

Yukang Yan, Chun Yu, Xiaojuan Ma, Shuai Huang, Hasan Iqbal, and Yuanchun Shi. 2018. Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21-26, 2018. ACM, 42. https://doi.org/10.1145/3173574.3173616

Digital Library

[65]

Yukang Yan, Chun Yu, Xiaojuan Ma, Xin Yi, Ke Sun, and Yuanchun Shi. 2018. VirtualGrasp: Leveraging Experience of Interacting with Physical Objects to Facilitate Digital Object Retrieval. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21-26, 2018. ACM, 78. https://doi.org/10.1145/3173574.3173652

Digital Library

[66]

Zhixin Yan, Robert W. Lindeman, and Arindam Dey. 2016. Let your fingers do the walking: A unified approach for efficient short-, medium-, and long-distance travel in VR. In 2016 IEEE Symposium on 3D User Interfaces, 3DUI 2016, Greenville, SC, USA, March 19-20, 2016. IEEE Computer Society, 27–30. https://doi.org/10.1109/3DUI.2016.7460027

[67]

Shumin Zhai, William Buxton, and Paul Milgram. 1994. The ”Silk Cursor”: investigating transparency for 3D target acquisition. In Conference on Human Factors in Computing Systems, CHI 1994, Boston, Massachusetts, USA, April 24-28, 1994, Proceedings. ACM, 459–464. https://doi.org/10.1145/191666.191822

Digital Library

[68]

Yang Zhang, Wolf Kienzle, Yanjun Ma, Shiu S. Ng, Hrvoje Benko, and Chris Harrison. 2019. ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019, New Orleans, LA, USA, October 20-23, 2019. ACM, 1151–1159. https://doi.org/10.1145/3332165.3347869

Digital Library

[69]

Yuhang Zhao, Edward Cutrell, Christian Holz, Meredith Ringel Morris, Eyal Ofek, and Andrew D. Wilson. 2019. SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, Glasgow, Scotland, UK, May 04-09, 2019. ACM, 111. https://doi.org/10.1145/3290605.3300341

Digital Library

[70]

Yuhang Zhao, Elizabeth Kupferstein, Brenda Veronica Castro, Steven Feiner, and Shiri Azenkot. 2019. Designing AR Visualizations to Facilitate Stair Navigation for People with Low Vision. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019, New Orleans, LA, USA, October 20-23, 2019. ACM, 387–402. https://doi.org/10.1145/3332165.3347906

Digital Library

Cited By

Campos TCastello MDamasceno EValentim N(2025)An Updated Systematic Mapping Study on Usability and User Experience Evaluation of Touchable Holographic SolutionsJournal on Interactive Systems10.5753/jis.2025.469416:1(172-198)Online publication date: 1-Jan-2025
https://doi.org/10.5753/jis.2025.4694
Dritsas ETrigka MTroussas CMylonas P(2025)Multimodal Interaction, Interfaces, and Communication: A SurveyMultimodal Technologies and Interaction10.3390/mti90100069:1(6)Online publication date: 14-Jan-2025
https://doi.org/10.3390/mti9010006
Park MLee JYang HKim J(2025)Designing and Analyzing Virtual Avatar Based on Rigid-Body Tracking in Immersive Virtual EnvironmentsIEEE Access10.1109/ACCESS.2025.352563013(5522-5533)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3525630
Show More Cited By

Index Terms

Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive Interactions
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

User-elicited dual-hand interactions for manipulating 3D objects in virtual reality environments

Virtual reality technologies (VR) have advanced rapidly in the last few years. Prime examples include the Oculus RIFT and HTC Vive that are both head-worn/mounted displays (HMDs). VR HMDs enable a sense of immersion and allow enhanced natural interaction ...
Grasping 3D Objects With Virtual Hand in VR Environment
VRCAI '22: Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Virtual hands are typically hidden after grasping an object in Virtual Reality (VR) environments in existing virtual hand grasping works, which significantly impact user experience. In this paper, we build a real-time, flexible, robust and natural ...
EgoTouch: On-Body Touch Input Using AR/VR Headset Cameras
UIST '24: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

In augmented and virtual reality (AR/VR) experiences, a user’s arms and hands can provide a convenient and tactile surface for touch input. Prior work has shown on-body input to have significant speed, accuracy, and ergonomic benefits over in-air ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

10459 pages

ISBN:9781450391573

DOI:10.1145/3491102

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA
,
Steven Drucker
Microsoft Research, USA
,
Julie Williamson
University of Glasgow, UK
,
Koji Yatani
University of Tokyo, Japan

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
7,496
Total Downloads

Downloads (Last 12 months)2,289
Downloads (Last 6 weeks)253

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Campos TCastello MDamasceno EValentim N(2025)An Updated Systematic Mapping Study on Usability and User Experience Evaluation of Touchable Holographic SolutionsJournal on Interactive Systems10.5753/jis.2025.469416:1(172-198)Online publication date: 1-Jan-2025
https://doi.org/10.5753/jis.2025.4694
Dritsas ETrigka MTroussas CMylonas P(2025)Multimodal Interaction, Interfaces, and Communication: A SurveyMultimodal Technologies and Interaction10.3390/mti90100069:1(6)Online publication date: 14-Jan-2025
https://doi.org/10.3390/mti9010006
Park MLee JYang HKim J(2025)Designing and Analyzing Virtual Avatar Based on Rigid-Body Tracking in Immersive Virtual EnvironmentsIEEE Access10.1109/ACCESS.2025.352563013(5522-5533)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3525630
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Chatain JGashaj VMuttappillil BSumner RKapur M(2024)Designing for Embodied Sense-making of Mathematics: Perspectives on Directed and Spontaneous Bodily ActionsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661571(3318-3335)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661571
Cheon EXu S(2024)Creative Precarity in Motion: Revealing the Hidden Labor Behind Animating Virtual CharactersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661545(3471-3484)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661545
Oshiro WKataoka HYokoyama MYamamoto R(2024)A Study of Haptic Interaction Techniques Utilizing Body Possession by Virtual CharactersProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3689522(1-2)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3689522
Hajika RGunasekaran THaigh CPai YHayashi ELien JLottridge DBillinghurst M(2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3617365
Hung CLiang CChen B(2024)FingerPuppet: Finger-Walking Performance-based Puppetry for Human AvatarExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650840(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650840
Wang XLafreniere BZhao J(2024)Exploring Visualizations for Precisely Guiding Bare Hand Gestures in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642935(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642935
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten