poster

Open access

Shapeshifter: Gesture Typing in Virtual Reality with a Force-based Digital Thimble

Authors:

Tafadzwa Joseph Dube,

Ahmed Sabbir ArifAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 230, Pages 1 - 9

https://doi.org/10.1145/3491101.3519679

Published: 28 April 2022 Publication History

All formats PDF

Abstract

Existing text entry techniques for virtual reality are either slow and error-prone, stationary, break immersion, or physically demanding. We present Shapeshifter, a technique that enables text entry in virtual reality by performing gestures and fluctuating contact force on any opaque diffusely reflective surface, including the human body. For this, we developed a digital thimble that users wear in their index finger. The thimble uses an optical sensor to track the finger and a pressure sensor to detect touch and contact force. In a week-long in-the-wild pilot study, Shapeshifter yielded on average 11 wpm on flat surfaces (e.g., a desk) and 9 wpm on the lap when sitting down, and 8 wpm on the palm and back of the hand when standing up in text composition tasks. A simulation study predicted a 27.3 wpm error-free text entry rate for novice users in transcription typing tasks on a desk.

Supplementary Material

MP4 File (3491101.3519679-video-figure.mp4)

Video Figure

Download
15.73 MB

MP4 File (3491101.3519679-video-preview.mp4)

Video Preview

Download
1.70 MB

MP4 File (3491101.3519679-talk-video.mp4)

Talk Video

Download
16.45 MB

References

[1]

Ahmed Sabbir Arif and Wolfgang Stuerzlinger. 2009. Analysis of Text Entry Performance Metrics. In 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH). IEEE, Washington, DC, USA, 100–105. https://doi.org/10.1109/TIC-STH.2009.5444533

[2]

Ahmed Sabbir Arif and Wolfgang Stuerzlinger. 2010. Predicting the Cost of Error Correction in Character-Based Text Entry Technologies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’10). ACM, New York, NY, USA, 5–14. https://doi.org/10.1145/1753326.1753329 event-place: Atlanta, Georgia, USA.

Digital Library

[3]

Patrick Baudisch, Mike Sinclair, and Andrew Wilson. 2006. Soap: A Pointing Device That Works in Mid-Air. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology - UIST ’06. ACM Press, Montreux, Switzerland, 43. https://doi.org/10.1145/1166253.1166261

Digital Library

[4]

Sabah Boustila, Thomas Guégan, Kazuki Takashima, and Yoshifumi Kitamura. 2019. Text Typing in VR Using Smartphones Touchscreen and HMD. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka,Japan, 860–861. https://doi.org/10.1109/VR.2019.8798238

[5]

Sidney Bovet, Aidan Kehoe, Katie Crowley, Noirin Curran, Mario Gutierrez, Mathieu Meisser, Damien O Sullivan, and Thomas Rouvinez. 2018. Using Traditional Keyboards in VR: SteamVR Developer Kit and Pilot Game User Study. In 2018 IEEE Games, Entertainment, Media Conference (GEM). IEEE, Galway, Ireland, 1–9. https://doi.org/10.1109/GEM.2018.8516449

[6]

Doug A Bowman. 2020. Embracing Physical Keyboards for Virtual Reality. IEEE Annals of the History of Computing 53, 09 (Sept. 2020), 9–10. https://doi.org/10.1109/MC.2020.3004605

[7]

Ulrich Burgbacher and Klaus Hinrichs. 2015. Modeling Human Performance of Stroke-Based Text Entry. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’15). Association for Computing Machinery, Copenhagen, Denmark, 137–143. https://doi.org/10.1145/2785830.2785858

Digital Library

[8]

Xiang Cao and Shumin Zhai. 2007. Modeling Human Performance of Pen Stroke Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). Association for Computing Machinery, San Jose, California, USA, 1495–1504. https://doi.org/10.1145/1240624.1240850

Digital Library

[9]

Sibo Chen, Junce Wang, Santiago Guerra, Neha Mittal, and Soravis Prakkamakul. 2019. Exploring Word-Gesture Text Entry Techniques in Virtual Reality. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). Association for Computing Machinery, Glasgow, Scotland Uk, 1–6. https://doi.org/10.1145/3290607.3312762

Digital Library

[10]

Seyed Amir Ahmad Didehkhorshid, Siju Philip, Elaheh Samimi, and Robert J. Teather. 2020. Text Input in Virtual Reality Using a Tracked Drawing Tablet. In HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality(Lecture Notes in Computer Science). Springer International Publishing, Cham, Switzerland, 314–329. https://doi.org/10.1007/978-3-030-59990-4_24

Digital Library

[11]

Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies(Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33

Digital Library

[12]

Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2020. Impact of Key Shape and Dimension on Text Entry in Virtual Reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems Extended Abstracts(CHI ’20). Association for Computing Machinery, Honolulu, HI, USA, 1–10. https://doi.org/10.1145/3334480.3382882

[13]

John Dudley, Hrvoje Benko, Daniel Wigdor, and Per Ola Kristensson. 2019. Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Beijing, China, 289–300. https://doi.org/10.1109/ISMAR.2019.00027

[14]

Cynthia Ann Edwards. 2005. The Writing Processes of College Students With and Without Learning Disabilities: A Protocol Analysis. Ph.D. Dissertation. University of Maryland, College Park. https://drum.lib.umd.edu/handle/1903/3104 Accepted: 2006-02-04T06:54:29Z.

[15]

Sascha E Engelbrecht. 2001. Minimum Principles in Motor Control. Journal of Mathematical Psychology 45, 3 (June 2001), 497–542. https://doi.org/10.1006/jmps.2000.1295

Digital Library

[16]

Jacqui Fashimpaur, Kenrick Kin, and Matt Longest. 2020. PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–7. https://doi.org/10.1145/3334480.3382888

Digital Library

[17]

J. Grubert, L. Witzani, E. Ofek, M. Pahud, M. Kranz, and P. O. Kristensson. 2018. Effects of Hand Representations for Typing in Virtual Reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Reutlingen, Germany, 151–158. https://doi.org/10.1109/VR.2018.8446250

[18]

Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Reutlingen, Germany, 159–166. https://doi.org/10.1109/VR.2018.8446059

[19]

Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16). Association for Computing Machinery, Tokyo, Japan, 49–60. https://doi.org/10.1145/2984511.2984576

Digital Library

[20]

Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, and Daniel Vogel. 2019. RotoSwype: Word-Gesture Typing Using a Ring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, Glasgow, Scotland Uk, 1–12. https://doi.org/10.1145/3290605.3300244

Digital Library

[21]

A. Gupta, M. Samad, K. Kin, P. O. Kristensson, and H. Benko. 2020. Investigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Recife/Porto de Galinhas, Brazil, 350–360. https://doi.org/10.1109/ISMAR50242.2020.00062

[22]

J. Haves. 1980. Identifying the Organization of Writing Processes. In Cognitive Processes in Writing(1st ed.), Lee W. Gregg and Erwin R. Steinberg (Eds.). Lawrence Erlbaum Assosiates.

[23]

Jay Henderson, Jessy Ceha, and Edward Lank. 2020. STAT: Subtle Typing Around the Thigh for Head-Mounted Displays. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3379503.3403549

Digital Library

[24]

Adrian H. Hoppe, Leonard Otto, Florian van de Camp, Rainer Stiefelhagen, and Gabriel Unmüßig. 2018. qVRty: Virtual Keyboard with a Haptic, Real-World Representation. In HCI International 2018 – Posters’ Extended Abstracts(Communications in Computer and Information Science), Constantine Stephanidis (Ed.). Springer International Publishing, Cham, 266–272. https://doi.org/10.1007/978-3-319-92279-9_36

[25]

Bret Jackson, Logan B Caraco, and Zahara M Spilka. 2020. Arc-Type and Tilt-Type: Pen-Based Immersive Text Input for Room-Scale VR. In Symposium on Spatial User Interaction. ACM, Virtual Event Canada, 1–10. https://doi.org/10.1145/3385959.3418454

Digital Library

[26]

Haiyan Jiang and Dongdong Weng. 2020. HiPad: Text Entry for Head-Mounted Displays Using Circular Touchpad. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Atlanta, GA, USA, 692–703. https://doi.org/10.1109/VR46266.2020.1581236395562

[27]

Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. HiFinger: One-Handed Text Entry Technique for Virtual Environments Based on Touches between Fingers. Sensors (Basel, Switzerland) 19, 14 (July 2019), 3063. https://doi.org/10.3390/s19143063

[28]

Janis G. Jimenez and Jürgen P. Schulze. 2018. Continuous-Motion Text Input in Virtual Reality. Electronic Imaging 2018, 3 (Jan. 2018), 450–1–450–6. https://doi.org/10.2352/ISSN.2470-1173.2018.03.ERVR-450

[29]

Josh Kaufman. 2020. First20hours/Google-10000-English. https://github.com/first20hours/google-10000-english.

[30]

Wolf Kienzle and Ken Hinckley. 2014. LightRing: Always-Available 2D Input on Any Surface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(UIST ’14). Association for Computing Machinery, New York, NY, USA, 157–160. https://doi.org/10.1145/2642918.2647376

Digital Library

[31]

David Kieras. 1993. Using the Keystroke-Level Model to Estimate Execution Times. Technical Report, University of Michigan 555 (1993), 11.

[32]

Junhyeok Kim, William Delamare, and Pourang Irani. 2018. ThumbText: Text Entry for Wearable Devices Using a Miniature Ring. In Proceedings of the 44th Graphics Interface Conference (Toronto, Canada) (GI ’18). Canadian Human-Computer Communications Society, Waterloo, CAN, 18–25. https://doi.org/10.20380/GI2018.04

Digital Library

[33]

Sooyoung Kim and Gerard Jounghyun Kim. 2004. Using Keyboards with Head Mounted Displays. In Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry(VRCAI ’04). Association for Computing Machinery, Singapore, 336–343. https://doi.org/10.1145/1044588.1044662

Digital Library

[34]

Youngwon R. Kim and Gerard J. Kim. 2017. HoVR-Type: Smartphone as a Typing Interface in VR Using Hovering. In 2017 IEEE International Conference on Consumer Electronics (ICCE). IEEE, Las Vegas, NV, USA, 200–203. https://doi.org/10.1109/ICCE.2017.7889285

[35]

Pascal Knierim, Thomas Kosch, Johannes Groschopp, and Albrecht Schmidt. 2020. Opportunities and Challenges of Text Input in Portable Virtual Reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, Honolulu, HI, USA, 1–8. https://doi.org/10.1145/3334480.3382920

Digital Library

[36]

Pascal Knierim, Valentin Schwind, Anna Maria Feit, Florian Nieuwenhuizen, and Niels Henze. 2018. Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3173574.3173919

Digital Library

[37]

Per-Ola Kristensson and Shumin Zhai. 2004. SHARK2: A Large Vocabulary Shorthand Writing System for Pen-Based Computers. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology(UIST ’04). Association for Computing Machinery, Santa Fe, NM, USA, 43–52. https://doi.org/10.1145/1029632.1029640

Digital Library

[38]

Reena Lee. 2016. Gboard, Now Available for Android. https://blog.google/products/search/gboard-now-on-android/

[39]

Xueshi Lu, Difeng Yu, Hai-Ning Liang, Xiyu Feng, and Wenge Xu. 2019. DepthText: Leveraging Head Movements towards the Depth Dimension for Hands-Free Text Entry in Mobile Virtual Reality Systems. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, Japan, 1060–1061. https://doi.org/10.1109/VR.2019.8797901

[40]

X. Lu, D. Yu, H.-N. Liang, W. Xu, Y. Chen, X. Li, and K. Hasan. 2020. Exploration of Hands-Free Text Entry Techniques For Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Recife/Porto de Galinhas, Brazil, 344–349. https://doi.org/10.1109/ISMAR50242.2020.00061

[41]

Kent Lyons. 2020. Wearable Magnetic Field Sensing for Finger Tracking. In Proceedings of the 2020 International Symposium on Wearable Computers(ISWC ’20). Association for Computing Machinery, New York, NY, USA, 63–67. https://doi.org/10.1145/3410531.3414304

Digital Library

[42]

I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. In CHI ’03 Extended Abstracts on Human Factors in Computing Systems(CHI EA ’03). Association for Computing Machinery, Ft. Lauderdale, Florida, USA, 754–755. https://doi.org/10.1145/765891.765971

Digital Library

[43]

Anders Markussen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2014. Vulture: A Mid-Air Word-Gesture Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). Association for Computing Machinery, Toronto, Ontario, Canada, 1073–1082. https://doi.org/10.1145/2556288.2556964

Digital Library

[44]

Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, Seoul, Republic of Korea, 2143–2152. https://doi.org/10.1145/2702123.2702382

Digital Library

[45]

Tim Menzner, Alexander Otte, Travis Gesslein, Jens Grubert, Philipp Gagel, and Daniel Schneider. 2019. A Capacitive-Sensing Physical Keyboard for VR Text Entry. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, Japan, 1080–1081. https://doi.org/10.1109/VR.2019.8797754

[46]

Anh Nguyen, Samuel Bittman, and Markus Zank. 2020. Text Input Methods in Virtual Reality Using Radial Layouts. In 26th ACM Symposium on Virtual Reality Software and Technology(VRST ’20). Association for Computing Machinery, New York, NY, USA, 1–3. https://doi.org/10.1145/3385956.3422114

Digital Library

[47]

Tao Ni and Patrick Baudisch. 2009. Disappearing Mobile Devices. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology - UIST ’09. ACM Press, Victoria, BC, Canada, 101. https://doi.org/10.1145/1622176.1622197

Digital Library

[48]

Keunwoo Park, Daehwa Kim, Seongkook Heo, and Geehyuk Lee. 2020. MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in Magnetometer. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, Honolulu, HI, USA, 1–13. https://doi.org/10.1145/3313831.3376234

Digital Library

[49]

Duc-Minh Pham and Wolfgang Stuerzlinger. 2019. HawKEY: Efficient and Versatile Text Entry for Virtual Reality. In 25th ACM Symposium on Virtual Reality Software and Technology(VRST ’19). Association for Computing Machinery, Parramatta, NSW, Australia, 1–11. https://doi.org/10.1145/3359996.3364265

Digital Library

[50]

Philip Quinn and Shumin Zhai. 2018. Modeling Gesture-Typing Movements. Human–Computer Interaction 33, 3 (May 2018), 234–280. https://doi.org/10.1080/07370024.2016.1215922

[51]

Vijay Rajanna and John Paulin Hansen. 2018. Gaze Typing in Virtual Reality: Impact of Keyboard Design, Selection Method, and Motion. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications(ETRA ’18). Association for Computing Machinery, Warsaw, Poland, 1–10. https://doi.org/10.1145/3204493.3204541

Digital Library

[52]

Grand View Research. 2017. Virtual Reality Market Size, Industry Growth Analysis Report, 2025. Technical Report GVR-1-68038-831-2. Grand View Research. 125 pages.

[53]

Mark Richardson, Matt Durasoff, and Robert Wang. 2020. Decoding Surface Touch Typing from Hand-Tracking. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology(UIST ’20). Association for Computing Machinery, New York, NY, USA, 686–696. https://doi.org/10.1145/3379337.3415816

Digital Library

[54]

Jochen Rick. 2010. Performance Optimizations of Virtual Keyboards for Stroke-Based Text Entry on a Touch-Based Tabletop. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology(UIST ’10). Association for Computing Machinery, New York, New York, USA, 77–86. https://doi.org/10.1145/1866029.1866043

Digital Library

[55]

Daniel Schneider, Alexander Otte, Travis Gesslein, Philipp Gagel, Bastian Kuth, Mohamad Shahm Damlakhi, Oliver Dietz, Eyal Ofek, Michel Pahud, Per Ola Kristensson, Jörg Müller, and Jens Grubert. 2019. ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 25, 11 (Nov. 2019), 3190–3201. https://doi.org/10.1109/TVCG.2019.2932239

Digital Library

[56]

Maximilian Schrapel, Florian Herzog, Steffen Ryll, and Michael Rohs. 2020. Watch My Painting: The Back of the Hand as a Drawing Space for Smartwatches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, Honolulu, HI, USA, 1–10. https://doi.org/10.1145/3334480.3383040

Digital Library

[57]

Valentin Schwind, Pascal Knierim, Cagri Tasci, Patrick Franczak, Nico Haas, and Niels Henze. 2017. ”These Are Not My Hands!”: Effect of Gender on the Perception of Avatar Hands in Virtual Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1577–1582.

Digital Library

[58]

Brian A. Smith, Xiaojun Bi, and Shumin Zhai. 2015. Optimizing Touchscreen Keyboards for Gesture Typing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, Seoul, Republic of Korea, 3365–3374. https://doi.org/10.1145/2702123.2702357

Digital Library

[59]

Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–13. https://doi.org/10.1145/3173574.3174221

Digital Library

[60]

Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, and Christian Theobalt. 2015. Fast and Robust Hand Tracking Using Detection-Guided Optimization. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3213–3221. https://doi.org/10.1109/CVPR.2015.7298941 ISSN: 1063-6919, 1063-6919.

[61]

Dylan Vester. 2015. Mouse Gesture and Shape Recognition with.NET. http://dylanvester.com/2015/10/mouse-gesture-and-shape-recognition-with-dotnet.

[62]

Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen. 2015. PalmType: Using Palms as Keyboards for Smart Glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 153–160. https://doi.org/10.1145/2785830.2785886

Digital Library

[63]

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept. 2017), 113:1–113:21. https://doi.org/10.1145/3130978

Digital Library

[64]

Stephen P. Witte and Roger D. Cherry. 1986. Writing Processes and Written Products in Composition Research. In Studying Writing: Linguistic Approaches (1 ed.). Vol. 1. Sage Publications, Beverly Hills, CA, USA, 112–153.

[65]

Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A Virtual Reality Keyboard with Realistic Haptic Feedback in a Fully Immersive Virtual Environment. Virtual Reality 21, 1 (March 2017), 19–29. https://doi.org/10.1007/s10055-016-0296-6

Digital Library

[66]

Wang Xin and Katsunori Shida. 2008. Optical Mouse Sensor for Detecting Height Variation and Translation of a Surface. In 2008 IEEE International Conference on Industrial Technology. IEEE, Chengdu, China, 1–6. https://doi.org/10.1109/ICIT.2008.4608448

[67]

Wenge Xu, Hai-Ning Liang, Anqi He, and Zifan Wang. 2019. Pointing and Selection Methods for Text Entry in Augmented Reality Head Mounted Displays. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). Beijing, China, IEEE, 279–288. https://doi.org/10.1109/ISMAR.2019.00026

[68]

Wenge Xu, Hai-Ning Liang, Yuxuan Zhao, Tianyu Zhang, Difeng Yu, and Diego Monteiro. 2019. RingText: Dwell-Free and Hands-Free Text Entry for Mobile Head-Mounted Displays Using Head Motions. IEEE Transactions on Visualization and Computer Graphics 25, 5 (May 2019), 1991–2001. https://doi.org/10.1109/TVCG.2019.2898736

[69]

Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376306

Digital Library

[70]

Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. 2019. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology(UIST ’19). Association for Computing Machinery, New York, NY, USA, 883–899. https://doi.org/10.1145/3332165.3347865

Digital Library

[71]

Naoki Yanagihara, Buntarou Shizuki, and Shin Takahashi. 2019. Text Entry Method for Immersive Virtual Environments Using Curved Keyboard. In 25th ACM Symposium on Virtual Reality Software and Technology(VRST ’19). Association for Computing Machinery, Parramatta, NSW, Australia, 1–2. https://doi.org/10.1145/3359996.3365026

[72]

Xing-Dong Yang, Tovi Grossman, Daniel Wigdor, and George Fitzmaurice. 2012. Magic Finger: Always-Available Input through Finger Instrumentation. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology(UIST ’12). Association for Computing Machinery, New York, NY, USA, 147–156. https://doi.org/10.1145/2380116.2380137

Digital Library

[73]

Chun Yu, Yizheng Gu, Zhican Yang, Xin Yi, Hengliang Luo, and Yuanchun Shi. 2017. Tap, Dwell or Gesture? Exploring Head-Based Text Entry Techniques for HMDs. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, Denver, Colorado, USA, 4479–4488. https://doi.org/10.1145/3025453.3025964

Digital Library

[74]

Shumin Zhai and Per Ola Kristensson. 2012. The Word-Gesture Keyboard: Reimagining Keyboard Interaction. Commun. ACM 55, 9 (Sept. 2012), 91–101. https://doi.org/10.1145/2330667.2330689

Digital Library

Cited By

Dube TArif A(2024)Free-Hand Input and Interaction in Virtual Reality Using a Custom Force-Based Digital ThimbleApplied Sciences10.3390/app14231101814:23(11018)Online publication date: 27-Nov-2024
https://doi.org/10.3390/app142311018
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Wan TZhang LYang HIrani PYu LLiang H(2024)Exploration of Foot-based Text Entry Techniques for Virtual Reality EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642757(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642757
Show More Cited By

Recommendations

Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Entering text is one of the most common tasks when interacting with computing systems. Virtual Reality (VR) presents a challenge as neither the user's hands nor the physical input devices are directly visible. Hence, conventional desktop peripherals are ...
Why Is Gesture Typing Promising for Older Adults?: Comparing Gesture and Tap Typing Behavior of Older with Young Adults
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Gesture typing has been a widely adopted text entry method on touchscreen devices. We have conducted a study to understand whether older adults could gesture type, how they type, what are the strengths and weaknesses of gesture typing, and how to further ...
Effect of Contact Points Feedback on Two-Thumb Touch Typing in Virtual Reality
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Two-thumb touch typing (4T) is a touchpad-based text-entry technique also used in virtual reality (VR) systems. However, the performance of 4T in VR is far below that of 4T in a real environment, such as on a smartphone. Unlike “real 4T”, 4T in VR ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
790
Total Downloads

Downloads (Last 12 months)302
Downloads (Last 6 weeks)26

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Dube TArif A(2024)Free-Hand Input and Interaction in Virtual Reality Using a Custom Force-Based Digital ThimbleApplied Sciences10.3390/app14231101814:23(11018)Online publication date: 27-Nov-2024
https://doi.org/10.3390/app142311018
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Wan TZhang LYang HIrani PYu LLiang H(2024)Exploration of Foot-based Text Entry Techniques for Virtual Reality EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642757(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642757
Wu JWang ZWang LDuan YLi J(2024)FanPad: A Fan Layout Touchpad Keyboard for Text Entry in VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00045(222-232)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00045
Boem ATurchet L(2024)Selection as TappingInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103231185:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103231
Dube TArif A(2023)Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual RealityProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3573117(1-8)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3573117
Dudley JZheng JGupta ABenko HLongest MWang RKristensson P(2023)Evaluating the Performance of Hand-Based Probabilistic Text Input Methods on a Mid-Air Virtual Qwerty KeyboardIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332023829:11(4567-4577)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320238
Kern FNiebling FLatoschik M(2023)Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324709829:5(2658-2669)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247098

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten