research-article

Bimanual gesture keyboard

Authors:

Ciprian Chelba,

Kurt Partridge,

Shumin ZhaiAuthors Info & Claims

UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

Pages 137 - 146

https://doi.org/10.1145/2380116.2380136

Published: 07 October 2012 Publication History

Abstract

Gesture keyboards represent an increasingly popular way to input text on mobile devices today. However, current gesture keyboards are exclusively unimanual. To take advantage of the capability of modern multi-touch screens, we created a novel bimanual gesture text entry system, extending the gesture keyboard paradigm from one finger to multiple fingers. To address the complexity of recognizing bimanual gesture, we designed and implemented two related interaction methods, finger-release and space-required, both based on a new multi-stroke gesture recognition algorithm. A formal experiment showed that bimanual gesture behaviors were easy to learn. They improved comfort and reduced the physical demand relative to unimanual gestures on tablets. The results indicated that these new gesture keyboards were valuable complements to unimanual gesture and regular typing keyboards.

Supplementary Material

JPG File (paper_0385-file3.jpg)

Download
10.27 KB

suppl.mov (paper_0385-file3.mov)

Supplemental video

Download
35.71 MB

References

[1]

Anthony, L. and Wobbrock, J.O. (2010). A lightweight multistroke recognizer for user interface prototypes. Graphics Interface 245--252.

Digital Library

[2]

Balakrishnan, R., and Hinckley, K. (2000). Symmetric bimanual interaction. ACM CHI. 33--40

Digital Library

[3]

Balakrishnan, R., and Kurtenbach, G. (1999). Exploring bimanual camera control and object manipulation in 3D graphics interfaces. ACM CHI. 56--6

Digital Library

[4]

Bier, E. A., Stone, M., Pier, K., Buxton, W. & DeRose. T. (1993). Toolglass and magic lenses: the see-through

[5]

interface. SIGGRAPH, 73--80.

[6]

Bi, X., Smith, B., and Zhai, S. (2010). Quasi-qwerty soft keyboard optimization. ACM CHI. 283--28

Digital Library

[7]

Bi, X., Smith, B., and Zhai, S. (2012) Multilingual Touchscreen Keyboard Design and Optimization, Hu-man Computer Interaction, to appear. Available online.

[8]

Buxton, W., and Myers, B. (1986). A study in two-handed input. ACM CHI, 321--326.

Digital Library

[9]

Findlater, L., Wobbrock, O., Wigdor, D. (2011). Typing on flat glass: examining ten-finger expert typing pat-terns on touch surfaces. ACM CHI 2453--2462.

Digital Library

[10]

Guiard, Y. (1987). Asymmetric division of labor in hu-man skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4), pp. 486--517.

[11]

Hart, S. and Staveland, L. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload P. A. Hancock and N. Meshkati, Eds., North-Holland: Elsevier Science, 139--183.

[12]

1Kane, S.K., Wobbrock, J.O. and Ladner, R.E. (2011) Usable gestures for blind people: Understanding prefer-ence and performance. ACM CHI. 413 422

Digital Library

[13]

Kristensson, P.O,. Zhai, S. (2007) Command Strokes with and without Preview: Using Pen Gestures on Key-board for Command Selection, ACM CHI. 1137 1146

Digital Library

[14]

Kristensson, P-O., Zhai, S., S (2004) SHARK2: A Large Vocabulary Shorthand Writing System for Pen-based Computers, ACM UIST, 43--52.

Digital Library

[15]

Kristensson, P-O., Zhai, S. (2005) Relaxing Stylus Typ-ing Precision by Geometric Pattern Matching. ACM IUI 151--158.

Digital Library

[16]

Li, F.C.Y, Guy, R.T., Yatani, K., Truong, K.N. (2011). The 1line keyboard: a QWERTY layout in a single line. ACM UIST, 461--470.

Digital Library

[17]

Li, Y. (2010). Protractor: A Fast and Accurate Gesture Recognizer, ACM CHI, 2169 2172

Digital Library

[18]

Li, Y. (2010). Gesture Search: A Tool for Fast Mobile Data Access ACM UIST, 87 96

Digital Library

[19]

MacKenzie, I.S., Soukoreff, R. W. (2003). Phrase sets for evaluating text entry techniques. Extended Abstracts CHI, 754--755.

Digital Library

[20]

Ouyang, T., and Davis, R. (2009). A Visual Approach to Sketched Symbol Recognition, IJCAI, 1463 1468

Digital Library

[21]

Ouyang, T., and Li, Y. (2012), Bootstrapping Personal Gesture Shortcuts with the Wisdom of the Crowd and Handwriting Recognition, ACM CHI, to appear.

Digital Library

[22]

2Rick, J. (2010). Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop. ACM UIST, 77--86.

Digital Library

[23]

2Soukoreff, R.W., MacKenzie, I.S. (2003) Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. ACM CHI, 113--120.

Digital Library

[24]

Wobbrock, J.O. (2007) Measures of text entry perfor-mance. In Text Entry Systems: Mobility, Accessibility, Universality, I. S. MacKenzie and K. Tanaka-Ishii (eds.) San Francisco: Morgan Kaufmann, 47--74

[25]

Wobbrock, J.O., Wilson, A.D. and Li, Y. (2007). Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. ACM UIST 159--168.

Digital Library

[26]

www.americannationalcorpus.org/

[27]

Zhai, S. Kristensson, P.O. Introduction to Shape Writ-ing, IBM Research Report RJ10393 (A0611-006), No-vember1, 2006

[28]

Zhai, S., Kristensson, P-O., (2003) Shorthand Writing on Stylus Keyboard, ACM CHI. 97--104.

Digital Library

[29]

Zhai, S., Kristensson, P.O., Gong, P., Greiner, M., Peng, S., Liu, L. Dunnigan, A., (2009) Shapewriter on the iPhone: from the laboratory to the

Cited By

Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Wan TZhang LYang HIrani PYu LLiang H(2024)Exploration of Foot-based Text Entry Techniques for Virtual Reality EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642757(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642757
Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2024)The Guided Evaluation MethodInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103317190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103317
Show More Cited By

Index Terms

Bimanual gesture keyboard
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

We present a bimanual text input method on a miniature fingertip keyboard, that invisibly resides on the first segment of a user's index finger on both hands. Text entry can be carried out using the thumb-tip to tap the tip of the index finger. The ...
Arranging touch screen software keyboard split-keys based on contact surface
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Touch screen devices, which have become ubiquitous in our daily lives, offer users flexible input and output operations. Typical operation methods for touch screen devices include the use of a stylus or a finger. A touch screen user can select a stylus ...
Investigating Tilt-based Gesture Keyboard Entry for Single-Handed Text Entry on Large Devices
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

The popularity of mobile devices with large screens is making single-handed interaction difficult. We propose and evaluate a novel design point around a tilt-based text entry technique which supports single handed usage. Our technique is based on the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

October 2012

608 pages

ISBN:9781450315807

DOI:10.1145/2380116

General Chair:
Rob Miller
MIT CSAIL, USA
,
Program Chairs:
Hrvoje Benko
Microsoft Research, USA
,
Celine Latulipe
University of North Carolina at Charlotte, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '12

Sponsor:

UIST '12: The 25th Annual ACM Symposium on User Interface Software and Technology

October 7 - 10, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
1,574
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)2

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Wan TZhang LYang HIrani PYu LLiang H(2024)Exploration of Foot-based Text Entry Techniques for Virtual Reality EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642757(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642757
Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2024)The Guided Evaluation MethodInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103317190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103317
Perelman GDubois ESerrano M(2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103203
Liang CHsia CYu CYan YWang YShi Y(2023)DRG-KeyboardProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694636:4(1-30)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569463
Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2023)Does Repeatedly Typing the Same Phrase Provide a Good Estimate of Expert Text Entry Performance?Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585647(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585647
Chu JAn DMa YCui WZhai SGu XBi X(2023)WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial NetworkProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581279(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581279
Cui WLiu RLi ZWang YWang AZhao XRashidian SBaig FRamakrishnan IWang FBi X(2023)GlanceWriter: Writing Text by Glancing Over Letters with GazeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581269(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581269
Shen JDudley JKristensson P(2023)Fast and Robust Mid-Air Gesture Typing for AR Headsets using 3D Trajectory DecodingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332021829:11(4622-4632)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320218
Sun AWang LLeng JKei Im S(2023)Light-Occlusion Text Entry in Mixed RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.228564640:24(8607-8622)Online publication date: 28-Nov-2023
https://doi.org/10.1080/10447318.2023.2285646
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten