research-article

Public Access

ThumbStroke: A Virtual Keyboard in Support of Sight-Free and One-Handed Text Entry on Touchscreen Mobile Devices

Authors:

Dongsong Zhang,

Isil Doga Yakut Kilic,

Lina ZhouAuthors Info & Claims

ACM Transactions on Management Information Systems (TMIS), Volume 10, Issue 3

Article No.: 11, Pages 1 - 19

https://doi.org/10.1145/3343858

Published: 07 September 2019 Publication History

All formats PDF

Abstract

The QWERTY keyboard on mobile devices usually requires users’ full visual attention and both hands, which is not always possible. We propose a thumb-stroke-based keyboard, ThumbStroke, to support both sight-free and one-handed text entry. Text entry via ThumbStroke completely relies on the directions of thumb strokes at any place on the screen of a mobile device. It does not require physical press on any specific keys, thus eliminating the need for visual attention and reducing errors due to tiny key size, fat thumbs, limited thumb reachability, and visual occlusion. We empirically evaluated ThumbStroke through a 20-session longitudinal controlled lab experiment. ThumbStroke shows advantages in typing accuracy and user perceptions in comparison to the Escape and QWERTY keyboards and results in faster typing speed than QWERTY in sight-free and one-handed text entry. This study provides novel research contributions to mobile HCI, advancing the design of soft keyboards for one-handed interaction with mobile devices and mobile accessibility.

References

[1]

B. Adipat, D. Zhang, and L. Zhou. 2011. The effects of tree-view based presentation adaptation on mobile web browsing. MIS Quarterly 35 (2011), 1.

Digital Library

[2]

N. Banovic, K. Yatani, and K. N. Truong. 2013. Escape-keyboard: A sight-free one-handed text entry method for mobile touch-screen devices. International Journal of Mobile Human Computer Interaction (IJMHCI) 5, 3 (2013), 42--61.

Digital Library

[3]

J. Bergstrom-Lehtovirta, A. Oulasvirta, and S. Brewster. 2011. The effects of walking speed on target acquisition on a touchscreen interface. In 13th International Conference on Human-Computer Interaction with Mobile Devices and Services. 143--146.

Digital Library

[4]

R. Blanch, Y. Guiard, and M. Beaudouin-Lafon. 2004. Semantic pointing: Improving target acquisition with control-display ratio adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 519--526.

Digital Library

[5]

M. N. Bonner, J. T. Brudvik, G. D. Abowd, and W. K. Edwards. 2010. No-look notes: Accessible eyes-free multi-touch text entry. In International Conference on Pervasive Computing. 409--426.

Digital Library

[6]

A. Bragdon, E. Nelson, Y. Li, and K. Hinckley. 2011. Experimental analysis of touch-screen gesture designs in mobile environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 403--412.

Digital Library

[7]

X. A. Chen, T. Grossman, and G. Fitzmaurice. 2014. Swipeboard: A text entry technique for ultra-small interfaces that supports novice to expert transitions. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. 615--620.

Digital Library

[8]

G. Costagliola, V. Fuccella, and M. Di Capua. 2011. Text entry with keyscretch. In Proceedings of the 16th International Conference on Intelligent User Interfaces. 277--286.

Digital Library

[9]

G. Costagliola, V. Fuccella, and M. Di Capua. 2013. Interpretation of strokes in radial menus: The case of the keyscretch text entry method. Journal of Visual Languages 8 Computing 24, 4 (2013), 234--247.

Digital Library

[10]

A. R. Façanha, W. Viana, M. C. Pequeno, M. de Borba Campos, and J. Sánchez. 2014. Touchscreen mobile phones virtual keyboarding for people with visual disabilities. In International Conference on Human-Computer Interaction. 134--145.

[11]

P. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology. 47, 6 (1954), 381--391.

[12]

Y. Fukatsu, B. Shizuki, and J. Tanaka. 2013. No-look flick: Single-handed and eyes-free japanese text input system on touch screens of mobile devices. In Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services. 161--170.

Digital Library

[13]

J. Gold, J. Driban, N. Thomas, T. Chakravarty, V. Channell, and E.-G. Komaroff. 2012. Postures, typing strategies, and gender differences in mobile device usage: An observational study. Applied Ergonomics. 43, 2 (2012), 408--412.

[14]

D. A. Grant. 1948. The Latin square principle in the design and analysis of psychological experiments. Psychological Bulletin 45, 5 (1948), 427.

[15]

B. Han and K. Kim. 2015. Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices. Journal on Multimodal User Interfaces 9, 3 (2015), 173--181.

[16]

A. Hevner, S. T. March, J. Park, and S. Ram. 2004. Design science in information systems research. MIS Quarterly 28, 1 (2004), 75--105.

[17]

H. Hoehle and V. Venkatesh. 2015. Mobile application usability: Conceptualization and instrument development. MIS Quarterly 39 (2015), 2.

Digital Library

[18]

A. Kano, J. C. Read, and A. Dix. 2006. Children's phrase set for text input method evaluations. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles. 449--452.

Digital Library

[19]

A. Karlson and B. Bederson. 2007. Thumbspace: Generalized one-handed input for touchscreen-based mobile devices. In Human-Computer Interaction (INTERACT’07). 324--338.

Digital Library

[20]

H. Korhonen, J. Holm, and M. Heikkinen. 2007. Utilizing sound effects in mobile user interface design. Human-Computer Interaction (INTERACT’07). 283--296.

Digital Library

[21]

G. Kurtenbach and W. Buxton. 1994. User learning and performance with marking menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 258--264.

Digital Library

[22]

J. Lai and D. Zhang. 2014. A study of direction's impact on single-handed thumb interaction with touch-screen mobile phones. In CHI’04 Extended Abstracts on Human Factors in Computing Systems. 2311--2316.

Digital Library

[23]

J. Lai and D. Zhang. 2015. Extendedthumb: A target acquisition approach for one-handed interaction with touch-screen mobile phones. IEEE Transactions on Human-Machine Systems 45, 3 (2015), 362--370.

[24]

E. M. Lamberg and L. M. Muratori. 2012. Cell phones change the way we walk. Gait 8 Posture 35, 4 (2012), 688--690.

[25]

J. R. Lewis. 1995. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human‐Computer Interaction 7, 1 (1995), 57--78.

Digital Library

[26]

W. H. A. Li, H. Fu, and K. Zhu. 2016. Bezelcursor: Bezel-initiated cursor for one-handed target acquisition on mobile touch screens. International Journal of Mobile Human Computer Interaction (IJMHCI) 8, 1 (2016), 1--22.

Digital Library

[27]

K. Lyons, T. Starner, and B. Gane. 2006. Experimental evaluations of the twiddler one-handed chording mobile keyboard. Human-Computer Interaction 21, 4 (2006), 343--392.

Digital Library

[28]

I. S. Mackenzie and T. Felzer. 2010. Sak: Scanning ambiguous keyboard for efficient one-key text entry. ACM Transactions on Computer-Human Interaction (TOCHI) 17, 3 (2010), 11.

Digital Library

[29]

I. S. MacKenzie and R. W. Soukoreff. 2003. Phrase sets for evaluating text entry techniques. In CHI’03 Extended Abstracts on Human Factors in Computing Systems. 754--755.

Digital Library

[30]

E. Mattheiss, G. Regal, J. Schrammel, M. Garschall, and M. Tscheligi. 2014. Dots and letters: Accessible braille-based text input for visually impaired people on mobile touchscreen devices. In International Conference on Computers for Handicapped Persons. 650--657.

[31]

C. Middleton, R. Scheepers, and V. K. Tuunainen. 2014. When mobile is the norm: Researching mobile information systems and mobility as post-adoption phenomena. European Journal of Information Systems 23, 5 (2014), 503--512.

[32]

B. Millet. 2009. Design and evaluation of three alternative keyboard layouts for a five-key text entry technique. Open Access Dissertations. 513. Retrieved from https://scholarlyrepository.miami.edu/oa_dissertations/513.

[33]

National Accident Helpline. 2016. Everyday Tech Dangers Driving Brits to Distraction. Retrieved from https://www.national-accident-helpline.co.uk/accident-claims/accident-awareness-week.

[34]

H. Nicolau, K. Montague, T. Guerreiro, A. Rodrigues, and V. L. Hanson. 2015. Holibraille: Multipoint vibrotactile feedback on mobile devices. In Proceedings of the 12th Web for All Conference. 30.

Digital Library

[35]

F. Niederman and S. T. March. 2012. Design science and the accumulation of knowledge in the information systems discipline. ACM Transactions on Management Information Systems (TMIS) 3, 1 (2012), 1.

Digital Library

[36]

J. F. Nunamaker and R. O. Briggs. 2011. Toward a broader vision for information systems. ACM Transactions on Management Information Systems (TMIS) 2, 4 (2011), 20.

Digital Library

[37]

T. Page. 2013. Usability of text input interfaces in smartphones. Journal of Design Research 11, 1 (2013), 39--56.

[38]

K. Pfeuffer, K. Hinckley, M. Pahud, and B. Buxton. 2017. Thumb+ pen interaction on tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3254--3266.

Digital Library

[39]

A. Roudaut, S. Huot, and E. Lecolinet. 2008. Taptap and magstick: Improving one-handed target acquisition on small touch-screens. In Proceedings of the Working Conference on Advanced Visual Interfaces. 146--153.

Digital Library

[40]

S. M. Schabrun, W. van den Hoorn, A. Moorcroft, C. Greenland, and P. W. Hodges. 2014. Texting and walking: Strategies for postural control and implications for safety. PLoS One 9, 1 (2014), e84312.

[41]

J.-B. Scheibel, C. Pierson, B. Martin, N. Godard, V. Fuccella, and P. Isokoski. 2013. Virtual stick in caret positioning on touch screens. In Proceedings of the 25 Ième Conférence Francophone on l'Interaction Homme-Machine. 107.

Digital Library

[42]

T. Siang. 2019. Using mobile apps—the one thumb, one eyeball test for good mobile design. Retrieved from https://www.interaction-design.org/literature/article/using-mobile-apps-the-one-thumb-one-eyeball-test-for-good-mobile-design.

[43]

R. W. Soukoreff and I. S. MacKenzie. 2003. Metrics for text entry research: An evaluation of MSD and KSPC, and a new unified error metric. In SIGCHI Conference on Human Factors in Computing Systems. 113--120.

Digital Library

[44]

C. Southern, J. Clawson, B. Frey, G. Abowd, and M. Romero. 2012. An evaluation of brailletouch: Mobile touchscreen text entry for the visually impaired. In 14th International Conference on Human-Computer Interaction with Mobile Devices and Services. 317--326.

Digital Library

[45]

P. J. Steinbart, M. J. Keith, and J. Babb. 2016. Examining the continuance of secure behavior: A longitudinal field study of mobile device authentication. Information Systems Research 27, 2 (2016), 219--239.

[46]

N. S. Subash, S. Nambiar, and V. Kumar. 2012. Braillekey: An alternative Braille text input system: Comparative study of an innovative simplified text input system for the visually impaired. In 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI’12). 1--4.

[47]

S. Tatro and O. Fleming. 2015. Man, distracted by electronic device, identified after falling to death at sunset cliffs. Retrieved from https://www.nbcsandiego.com/news/local/Man-Dies-After-Falling-Off-Cliff-at-Sunset-Cliffs-Lifeguards-363534491.html.

[48]

J. O. Wobbrock and B. A. Myers. 2006. Analyzing the input stream for character-level errors in unconstrained text entry evaluations. ACM Transactions on Computer-Human Interaction (TOCHI) 13, 4 (2006), 458--489.

Digital Library

[49]

J. O. Wobbrock, B. A. Myers, and J. A. Kembel. 2003. Edgewrite: A stylus-based text entry method designed for high accuracy and stability of motion. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology. 61--70.

Digital Library

[50]

P. C. Wong, H. Fu, and K. Zhu. 2016. Back-mirror: Back-of-device one-handed interaction on smartphones. In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications. 10.

Digital Library

[51]

P. C. Wong, K. Zhu, and H. Fu. 2018. Fingert9: Leveraging thumb-to-finger interaction for same-side-hand text entry on smartwatches. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 178.

Digital Library

[52]

B. Yi, X. Cao, M. Fjeld, and S. Zhao. 2012. Exploring user motivations for eyes-free interaction on mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2789--2792.

Digital Library

[53]

S. Zhai, P. O. Kristensson, P. Gong, M. Greiner, S. A. Peng, L. M. Liu, and A. Dunnigan. 2009. Shapewriter on the iPhone: From the laboratory to the real world. In CHI’09 Extended Abstracts on Human Factors in Computing Systems. 2667--2670.

Digital Library

Cited By

Komninos AStefanis VGarofalakis J(2023)A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind PersonsMultimodal Technologies and Interaction10.3390/mti70200227:2(22)Online publication date: 17-Feb-2023
https://doi.org/10.3390/mti7020022
Li ZYu CGu YShi Y(2023)ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting FingersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581055(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581055
Zhou LWang KLai JZhang D(2023)A Comparison of a Touch-Gesture- and a Keystroke-Based Password Method: Toward Shoulder-Surfing Resistant Mobile User AuthenticationIEEE Transactions on Human-Machine Systems10.1109/THMS.2023.323632853:2(303-314)Online publication date: Apr-2023
https://doi.org/10.1109/THMS.2023.3236328
Show More Cited By

Index Terms

ThumbStroke: A Virtual Keyboard in Support of Sight-Free and One-Handed Text Entry on Touchscreen Mobile Devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Keyboards
    2. Interaction techniques
      1. Gestural input
      2. Text input

Recommendations

fingerT9: leveraging thumb-to-finger interaction for one-handed text entry on smartwatches
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications

We introduce FingerT9, leveraging the action of thumb-to-finger touching and the surface of the finger segments, to support one-handed text entry on smartwatches. This is achieved by mapping a T9 keyboard layout on the surface of finger segments, ...
Back keyboard: a physical keyboard on backside of mobile phone using qwerty
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Since smart phones adopted touchscreen, users have been enjoying large displays. However, when using soft keyboard, the available size of the display becomes less than 50%. In this paper Back Keyboard, a physical keyboard installed backside of mobile ...
DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Thumb-to-fingers interfaces augment touch widgets on fingers, which are manipulated by the thumb. Such interfaces are ideal for one-handed eyes-free input since touch widgets on the fingers enable easy access by the stylus thumb. This study presents ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Management Information Systems

ACM Transactions on Management Information Systems Volume 10, Issue 3

Research Commentary and Regular Paper

September 2019

83 pages

ISSN:2158-656X

EISSN:2158-6578

DOI:10.1145/3361142

Editor:
Daniel Zeng
Chinese Academy of Sciences, China

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2019

Accepted: 01 July 2019

Revised: 01 May 2019

Received: 01 January 2019

Published in TMIS Volume 10, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation (NSF)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
1,665
Total Downloads

Downloads (Last 12 months)322
Downloads (Last 6 weeks)39

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Komninos AStefanis VGarofalakis J(2023)A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind PersonsMultimodal Technologies and Interaction10.3390/mti70200227:2(22)Online publication date: 17-Feb-2023
https://doi.org/10.3390/mti7020022
Li ZYu CGu YShi Y(2023)ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting FingersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581055(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581055
Zhou LWang KLai JZhang D(2023)A Comparison of a Touch-Gesture- and a Keystroke-Based Password Method: Toward Shoulder-Surfing Resistant Mobile User AuthenticationIEEE Transactions on Human-Machine Systems10.1109/THMS.2023.323632853:2(303-314)Online publication date: Apr-2023
https://doi.org/10.1109/THMS.2023.3236328
Ahmed IFarrok O(2023)SwingBoard: introducing swipe based virtual keyboard for visually impaired and blind usersDisability and Rehabilitation: Assistive Technology10.1080/17483107.2023.219979319:4(1482-1493)Online publication date: 25-Apr-2023
https://doi.org/10.1080/17483107.2023.2199793
Zhou Y(2022)The Application Research of Visual Touch Based on Computer Vision in Artistic Visual Image DesignWireless Communications & Mobile Computing10.1155/2022/57107762022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/5710776
Tu JJeyachandra ANagesh DPrabhu NStarner T(2021)Typing on Tap: Estimating a Finger-Worn One-Handed Chording Keyboard’s Text Entry RateProceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460421.3480428(156-158)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460421.3480428
Alajarmeh N(2021)Non-visual access to mobile devices: A survey of touchscreen accessibility for users who are visually impairedDisplays10.1016/j.displa.2021.10208170(102081)Online publication date: Dec-2021
https://doi.org/10.1016/j.displa.2021.102081
Stefanis VKomninos AGarofalakis J(2020)Challenges in Mobile Text Entry using Virtual Keyboards for Low-Vision UsersProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428391(42-46)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3428391

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents