research-article

Improving Virtual Keyboards When All Finger Positions Are Known

Authors:

Hyeonjoong Cho,

Joono CheongAuthors Info & Claims

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Pages 529 - 538

https://doi.org/10.1145/2807442.2807491

Published: 05 November 2015 Publication History

Abstract

Current virtual keyboards are known to be slower and less convenient than physical QWERTY keyboards because they simply imitate the traditional QWERTY keyboards on touchscreens. In order to improve virtual keyboards, we consider two reasonable assumptions based on the observation of skilled typists. First, the keys are already assigned to each finger for typing. Based on this assumption, we suggest restricting each finger to entering pre-allocated keys only. Second, non-touching fingers move in correlation with the touching finger because of the intrinsic structure of human hands. To verify of our assumptions, we conducted two experiments with skilled typists. In the first experiment, we statistically verified the second assumption. We then suggest a novel virtual keyboard using our observations. In the second experiment, we show that our suggested keyboard outperforms existing virtual keyboards.

Supplementary Material

suppl.mov (uist3856.mp4)

Supplemental video

Download
7.37 MB

MP4 File (p529.mp4)

Download
54.97 MB

References

[1]

Barret, J., and Krueger, H. Performance effects of reduced proprioceptive feedback on touch typists and casual users in a typing task. Behaviour & Information Technology 13, 6 (1994), 373--381

[2]

Buschek, D., Schoenleben, O., and Oulasvirta, A. Improving accuracy in back-of-device multitouch typing: a clustering-based approach to keyboard updating. In Proceedings of the 19th international conference on Intelligent User Interfaces (pp. 57--66). ACM, 2014

Digital Library

[3]

Chan YH. Biostatistics 305. Multinomial logistic regression. Singapore Med J 2005, 46, 259--268.

[4]

Chaparro, B., Nguyen, B., Phan, M., Smith, A., and Teves, J. Keyboard performance: ipad versus netbook. Usability News 12, 2 (2010).

[5]

D. Choi, H. Cho, J. Cheong. Toward designing a new virtual keyboard when all finger movements are known. CHI'15 Extended Abstracts, ACM., to appear

Digital Library

[6]

FindLater, L., Wobbrock, J.O. Personalized Input: Improving ten-finger touchscreen typing through automatic adaptation. In Proc. CHI'12, ACM (2012), 2679--2682.

Digital Library

[7]

FindLater, L., Wobbrock, J.O., and Wigdor, D., Typing on flat glass: Examining ten-finger expert typing patterns on touch surfaces. In Proceedings of the 2011 annual conference on Human factors in computing systems, CHI 2011, ACM, 2453--2462.

Digital Library

[8]

Go, K., and Endo, Y. CATKey: Customizable and adaptable touchscreen keyboard with bubble cursor-like visual feedback. Proc. HCII'07, 493--496

Digital Library

[9]

Grudin, J.T. 1984. Error patterns in skilled and novice transcription typing. In Cognitive Aspects of Skilled Typewriting, W. E. Cooper (ed.). New York: SpringerVerlag, 121--143.

[10]

Gunawardana, A., Peak, T., and Meek, C. Usability guided key-target resizing for soft keyboards. Proc. IUI'10, 111--118.

Digital Library

[11]

Hosmer Jr, D. W., Lemeshow, S. Applied logistic regression. John Wiley & Sons, 2004.

[12]

Huan, D., Edoardo, C., A virtual keyboard system based on multi-level feature matching. Human System Interactions, 2008.

[13]

Kuno, Y., Shizuki, B., and Tanaka, J. Long-term study of a software keyboard that places keys at positions of finger and their surroundings, Proc. 15th International Conference on Human-Computer Interaction, HCI International 2013, Part V, 723--724.

[14]

Learning typing http://www.learntyping.org

[15]

Li, F., Guy, R., Yatani, K., and Truong, K. The 1line keyboard: a QWERTY layout in a single line. In Proc. UIST'11, ACM (2011), 461--470.

Digital Library

[16]

Mackenzie I. S., Soukoreff, R. W. Phrase sets for evaluating text entry techniques. CHI 2003 extended abstracts on Human factors in computing systems. ACM, 754--755.

Digital Library

[17]

Mackenzie I.S., Zhang, S. X. An empirical investigation of the novice experience with soft keyboards. Behaviour & Information Technology (2001), 20, 411--418.

[18]

Mackenzie, I.S., Zhang, S. X. The design and evaluation of a high-performance soft keyboard. Proc. CHI'99, 2531.

Digital Library

[19]

McAdam, C., Mobile phones as a tactile display for tabletop typing

[20]

McAdam, C., Brewster, S. Distal tactile feedback for text entry on tabletop computers. Proc. BCS-HCI'09, 504--511.

Digital Library

[21]

NUI group community http://www.nuigroup.com

[22]

Pollmann, F., Wenig, D., & Malaka, R. HoverZoom: making on-screen keyboards more accessible. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 1261--1266). ACM, 2014.

Digital Library

[23]

Ryall, K., Forlines, C., Shen, C., Ringel Morris, M., Everitt, K. Experiences with observations of directtouch tabletops. Proc. Tabletop 2006, 89--96.

Digital Library

[24]

S. Kim, J. Son, G. Lee, H. Kim, and W. Lee. TapBoard: making a touch screen keyboard more touchable. in Proc. of ACM CHI, 2013.

Digital Library

[25]

Salthouse, T.A. 1985. Anticipatory processing in transcription typing. Journal of Applied Psychology 70, 264--271.

[26]

Salthouse, T.A. 1984. Effects of age and skill in typing. Journal of Experimental Psychology: General 113, 345371.

[27]

Salthouse, T.A. 1986. Perceptual, cognitive, and motoric aspects of transcription typing. Psych. Bulletin 99(3), 303--319.

[28]

Sax, C., Lau, H., and Lawrence, E. Liquidkeyboard: an ergonomic, adaptive QWERTY keyboard for touchscreens and surfaces. In Proc. ICDS'11 (2011), 117--122.

[29]

Schoenleben, O., and Oulasvirta, A. Sandwich keyboard: fast ten-finger typing on a mobile device with adaptive touch sensing on the back side. In Proceedings of the 15th international conference on Humancomputer interaction with mobile devices and services (pp. 175--178). ACM, 2013.

Digital Library

[30]

Sears, A. Improving touchscreen keyboards: design issues and a comparison with other devices. Interacting with Computers 3, 3 (1991), 253--269.

[31]

Sears, A., Revis, D., Swatski, J., Crittenden, R., Shneiderman, B. 1993. Investigating touchscreen typing: the effect of keyboard size on typing speed. Behavour & Information Technology 12(1), 17--22.

[32]

Soukoreff, R. W., and MacKenzie, I. S. Metrics for text entry research: an evaluation of msd and kspc, and a new unified error metric. In Proc. CHI'03, ACM (2003), 113--120.

Digital Library

[33]

Taichi, M., Atsunori, M., Noriaki, O. Nobuyuki, H., Takehiro, N., Katsuhito, F., Gesture keyboard requiring only one camera. Proceedings of the 25th annual ACM symposium adjunct on User interface software and technology, UIST 2011, ACM.

Digital Library

[34]

Weiss, M., Wagner, J., Jansen, Y., Jennings, R., Khoshabeh, R., Hollan, J. D., and Borchers, J. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. Proc. CHI'09, 481--490.

Digital Library

[35]

Wigdor, D., Penn, G., Ryall, K., Esenther, A., Shen, C. Living with a Tabletop: Analysis and observations of long term office use of a multi-touch table. Proc. Tabletop 2007. 60--67.

Cited By

Faleel SLiu YCody RRey BDu LYu JHuang DIrani PLi W(2023)T-Force: Exploring the Use of Typing Force for Three State Virtual KeyboardsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580915(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580915
Choi DCho HSeo KLee SLee JKo J(2019)Designing Hand Pose Aware Virtual Keyboard With Hand Drift ToleranceIEEE Access10.1109/ACCESS.2019.29293107(96035-96047)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2929310
Shi WYu CYi XLi ZShi Y(2018)TOASTProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31917652:1(1-23)Online publication date: 26-Mar-2018
https://dl.acm.org/doi/10.1145/3191765
Show More Cited By

Index Terms

Improving Virtual Keyboards When All Finger Positions Are Known
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Toward Designing a New Virtual Keyboard When All Finger Movements Are Known
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

Compared with the physical QWERTY keyboards, the virtual keyboards are slow, inaccurate, and inconvenient because they simply imitate the traditional QWERTY keyboard. To improve the virtual keyboards, we focus on two observations. First, all alphabetic ...
Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Touch screen surfaces large enough for ten-finger input have become increasingly popular, yet typing on touch screens pales in comparison to physical keyboards. We examine typing patterns that emerge when expert users of physical keyboards touch-type on ...
Observational and experimental investigation of typing behaviour using virtual keyboards for mobile devices
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

With the rise of current smartphones, virtual keyboards for touchscreens became the dominant mobile text entry technique. We developed a typing game that records how users touch on the standard Android keyboard to investigate users' typing behaviour. 47,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

November 2015

686 pages

ISBN:9781450337793

DOI:10.1145/2807442

General Chair:
Celine Latulipe
UNC Charlotte, USA
,
Program Chairs:
Bjoern Hartmann
UC Berkeley, USA
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '15

Sponsor:

UIST '15: The 28th Annual ACM Symposium on User Interface Software and Technology

November 11 - 15, 2015

NC, Charlotte, USA

Acceptance Rates

UIST '15 Paper Acceptance Rate 70 of 297 submissions, 24%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
547
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Faleel SLiu YCody RRey BDu LYu JHuang DIrani PLi W(2023)T-Force: Exploring the Use of Typing Force for Three State Virtual KeyboardsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580915(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580915
Choi DCho HSeo KLee SLee JKo J(2019)Designing Hand Pose Aware Virtual Keyboard With Hand Drift ToleranceIEEE Access10.1109/ACCESS.2019.29293107(96035-96047)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2929310
Shi WYu CYi XLi ZShi Y(2018)TOASTProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31917652:1(1-23)Online publication date: 26-Mar-2018
https://dl.acm.org/doi/10.1145/3191765
Serim BKlouche KJacucci GMival OSmyth MDalsgaard P(2017)Gaze-Adaptive Above and On-Surface InteractionProceedings of the 2017 Conference on Designing Interactive Systems10.1145/3064663.3064744(115-127)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1145/3064663.3064744

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents