research-article

Typing on Glasses: Adapting Text Entry to Smart Eyewear

Authors:

Xiang Anthony Chen,

George FitzmauriceAuthors Info & Claims

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

Pages 144 - 152

https://doi.org/10.1145/2785830.2785867

Published: 24 August 2015 Publication History

Abstract

Text entry for smart eyewear is generally limited to speech-based input due to constraints of the input channels. However, many smart eyewear devices are now including a side touchpad making gesture-based text entry feasible. The Swipeboard technique, recently proposed for ultra-small touch screens such as smart watches, may be particularly suitable for smart eyewear: unlike other recent text-entry techniques for small devices, it supports eyes-free input. We investigate the limitations and feasibility of implementing Swipeboard on smart eyewear, using the side touch pad for input. Our first study reveals usability and recognition problems of using the side touch pad to perform the required gestures. To address these problems, we propose SwipeZone, which replaces diagonal gestures with zone-specific swipes. In a text entry study, we show that our redesign achieved a WPM rate of 8.73, 15.2% higher than Swipeboard, with a statistically significant improvement in the last half of the study blocks.

Supplementary Material

grossman (p144-grossman-suppl.zip)

Supplemental movie and image files for, Typing on Glasses: Adapting Text Entry to Smart Eyewear

Download
55.52 MB

References

[1]

Amma, C., Georgi, M., & Schultz, T. Airwriting: Hands-free mobile text input by spotting and continuous recognition of 3D-space handwriting with inertial sensors. ISWC '12. 52--59.

Digital Library

[2]

Arif, A. S., Pahud, M., Hinckley, K., & Buxton, B. (2014). Experimental study of stroke shortcuts for a touchscreen keyboard with gesture-redundant keys removed. Graphics Interface. 43--50.

Digital Library

[3]

Bajer, B., MacKenzie, I. S., & Baljko, M. (2012). Huffman Base-4 Text Entry Glove (H4 TEG). In International Symposium on Wearable Computers. 41--47.

Digital Library

[4]

Blasko, G. and Feiner, S. Evaluation of an Eyes-Free Cursorless Numeric Entry System for Wearable Computers. Wearable Computers, (2006), 21--28.

[5]

Bederson, B. B., Hollan, J. D., Perlin, K., Meyer, J., Bacon, D., & Furnas, G. Pad+++: A zoomable graphical sketchpad for exploring alternate interface physics. JVLC. 1996, 7(1), 3--32.

[6]

Castellucci, S. J., & MacKenzie, I. S. Graffiti vs. unistrokes : an empirical comparison. CHI '08. 305--308.

Digital Library

[7]

Chen, X. A., Grossman, T., & Fitzmaurice, G. Swipeboard: A Text Entry Technique for Ultra-Small Interfaces That Supports Novice to Expert Transitions. To appear UIST '14.

Digital Library

[8]

Clawson, J., Lyons, K., Starner, T., & Clarkson, E.(2005). The impacts of limited visual feedback on mobile text entry for the twiddler and mini-qwerty keyboards. International Symposium on Wearable Computers. 170--177.

Digital Library

[9]

Hong, J., Heo, S., Isokoski, P., & Lee, G. (2015). SplitBoard: A Simple Split Soft Keyboard for Wristwatch-sized Touch Screens. CHI. 1233--1236.

Digital Library

[10]

Isokoski, P., & Raisamo, R. (2000). Device independent text input: A rationale and an example. In Proceedings of the working conference on Advanced visual interfaces (pp. 76--83).

Digital Library

[11]

Kim, S., Sohn, M., Pak, J., & Lee, W. One-key keyboard: a very small QWERTY keyboard supporting text entry for wearable computing. OzCHI '06. 305--308.

Digital Library

[12]

Kristensson, P. O., & Zhai, S. SHARK 2: a large vocabulary shorthand writing system for pen-based computers. UIST '04. 43--52.

Digital Library

[13]

Leiva, L. A., Sahami, A., Catalá, A., Henze, N., & Schmidt, A. (2015). Text Entry on Tiny QWERTY Soft Keyboards. ACM CHI. 669--678.

Digital Library

[14]

Li, F. C. Y., Guy, R. T., Yatani, K., & Truong, K. N. The 1line keyboard: a QWERTY layout in a single line.UIST '11. 461--470.

Digital Library

[15]

Liu, Y., Liu, X., & Jia, Y. Hand-gesture based text input for wearable computers. ICVS '06. 8--14.

Digital Library

[16]

Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., & Looney, E. W. Twiddler typing: One-handed chording text entry for mobile phones. CHI '04. 671--678.

Digital Library

[17]

MacKenzie, S. Mobile text entry using three keys. CHI'02. 27--34.

Digital Library

[18]

MacKenzie, I. S., & Soukoreff, R. W. Phrase sets for evaluating text entry techniques. CHI '03 EA. 754--755.

Digital Library

[19]

MacKenzie, I. S., Soukoreff, R. W., & Helga, J. 1 thumb, 4 buttons, 20 words per minute: Design and evaluation of H4-Writer. UIST '11. 471--480.

Digital Library

[20]

Matias, E., MacKenzie, I. S., & Buxton, W. (1994). Half-QWERTY: Typing with one hand using your two-handed skills. CHI Companion. 51--52.

Digital Library

[21]

Nesbat, S. B. (2003). A system for fast, full-text entry for small electronic devices. Proceedings of ACM Multimodal interfaces. 4--11.

Digital Library

[22]

Oney, S., Harrison, C., Ogan, A., & Wiese, J. ZoomBoard: a diminutive QWERTY soft keyboard using iterative zooming for ultra-small devices. CHI '13. 2799--2802.

Digital Library

[23]

Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G., & Want, R. TiltType: accelerometer-supported text entry for very small devices. UIST '02. 201--204.

Digital Library

[24]

Perlin, K. Quikwriting: continuous stylus-based text entry. UIST '98. 215--216.

Digital Library

[25]

Rico, J., & Brewster, S. Usable gestures for mobile interfaces. CHI '10. 887--896.

Digital Library

[26]

Rico, J., & Brewster, S. 2010. Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces. International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction. Article 16.

Digital Library

[27]

Rosenberg, R., & Slater, M. The chording glove: aglove-based text input device. ToSMC. 1999, 29(2), 186--191.

Digital Library

[28]

Wigdor, D., & Balakrishnan, R. TiltText: using tilt for text input to mobile phones. CHI '03. 81--90.

Digital Library

[29]

Wigdor, D., & Balakrishnan, R. A comparison of consecutive and concurrent input text entry techniques for mobile phones. CHI '04. 81--88.

Digital Library

[30]

Wobbrock, J.O., Fogarty, J., Liu, S.-Y.S., Kimuro, S., and Harada, S. The angle mouse: target-agnostic dynamic gain adjustment based on angular deviation. CHI '09, 1401--1410.

Digital Library

[31]

Wobbrock, J. O., Myers, B. A., & Kembel, J. A. EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion. UIST '06. 61--70.

Digital Library

[32]

Zhao, S., Agrawala, & Hinckley, K. Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus. CHI'06. 1088--1086.

Digital Library

Cited By

Beier RWolling FHornecker EMichahelles F(2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670669
Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Show More Cited By

Recommendations

Typing on a Smartwatch for Smart Glasses
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

While smart glasses make information more accessible in mobile scenarios, entering text on these devices is still difficult. In this paper, we suggest using a smartwatch as an indirect input device for smart glasses text entry. With the watch-glasses ...
Gaze-Assisted Typing for Smart Glasses
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Text entry is expected to be a common task for smart glass users, which is generally performed using a touchpad on the temple or by a promising approach using eye tracking. However, each approach has its own limitations. For more efficient text entry, ...
3D Displays without Glasses: Coming to a Screen near You

The most common 3D displays require users to wear special glasses, which has limited the technology's popularity. Now, researchers and vendors are working on glasses-free 3D displays.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 2015

611 pages

ISBN:9781450336529

DOI:10.1145/2785830

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
1,100
Total Downloads

Downloads (Last 12 months)65
Downloads (Last 6 weeks)3

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Beier RWolling FHornecker EMichahelles F(2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670669
Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Shen JBoldu RKalla AGlueck MSurale HKarlson A(2024)RingGesture: A Ring-Based Mid-Air Gesture Typing System Powered by a Deep-Learning Word Prediction FrameworkIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345617930:11(7441-7451)Online publication date: Nov-2024
https://doi.org/10.1109/TVCG.2024.3456179
Yamaguchi TNishikawa YShizuki B(2024)Preliminary Study on Flick-Based Text Input on HMD’s FrontHuman-Computer Interaction10.1007/978-3-031-60449-2_15(215-227)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60449-2_15
Medeiros DDubus RWilliamson JWilson GPöhlmann KMcGill M(2023)Surveying the Social Comfort of Body, Device, and Environment-Based Augmented Reality Interactions in Confined Passenger Spaces Using Mixed Reality Composite VideosProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109237:3(1-25)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610923
Kim KLee G(2023)Virtual Rolling Temple: Expanding the Vertical Input Space of a Smart Glasses TouchpadAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615813(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3615813
Zhao MPierce ATan RZhang TWang TJonker TBenko HGupta A(2023)Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual RealityProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584072(595-606)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584072
Fang FZhang HZhan LGuo SZhang MLin JQin YFu H(2023)Handwriting VelcroProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694616:4(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569461
Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten