research-article

DualKey: Miniature Screen Text Entry via Finger Identification

Authors:

Ravin BalakrishnanAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 59 - 70

https://doi.org/10.1145/2858036.2858052

Published: 07 May 2016 Publication History

Abstract

Fast and accurate access to keys for text entry remains an open question for miniature screens. Existing works typically use a cumbersome two-step selection process, first to zero-in on a particular zone and second to make the key selection. We introduce DualKey, a miniature screen text entry technique with a single selection step that relies on finger identification. We report on the results of a 10 day longitudinal study with 10 participants that evaluated speed, accuracy, and learning. DualKey outperformed the existing techniques on long-term performance with a speed of 19.6 WPM. We then optimized the keyboard layout for reducing finger switching time based on the study data. A second 10 day study with eight participants showed that the new sweqty layout improved upon DualKey even further to 21.59 WPM for long-term speed, was comparable to existing techniques on novice speed and outperformed existing techniques on novice accuracy rate.

Supplementary Material

ZIP File (pn0206-file4.zip)

pn0206-file4.zip

Download
.34 KB

suppl.mov (pn0206-file3.mp4)

Supplemental video

Download
70.26 MB

MP4 File (p59-gupta.mp4)

Download
219.39 MB

References

[1]

Oscar Kin-Chung Au and Chiew-Lan Tai. 2010. Multitouch finger registration and its applications. Proceedings of the 22nd Conference of the ComputerHuman Interaction Special Interest Group of Australia on Computer-Human Interaction - OZCHI '10, ACM Press, 41. http://doi.org/10.1145/1952222.1952233

Digital Library

[2]

Hrvoje Benko, T. Scott Saponas, Dan Morris, and Desney Tan. 2009. Enhancing input on and above the interactive surface with muscle sensing. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces ITS '09, ACM Press, 93. http://doi.org/10.1145/1731903.1731924

Digital Library

[3]

Sebastian Boring, David Ledo, Xiang "Anthony" Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The fat thumb. Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services MobileHCI '12, ACM Press, 39. http://doi.org/10.1145/2371574.2371582

Digital Library

[4]

Xiang "Anthony" Chen, Tovi Grossman, and George Fitzmaurice. 2014. Swipeboard. Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14, ACM Press, 615--620. http://doi.org/10.1145/2642918.2647354

[5]

Hyeonjoong Cho, Miso Kim, and Kyeongeun Seo. 2014. A text entry technique for wrist-worn watches with tiny touchscreens. Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology - UIST'14 Adjunct, ACM Press, 79--80. http://doi.org/10.1145/2658779.2658785

Digital Library

[6]

Ashley Colley and Jonna Häkkilä. 2014. Exploring finger specific touch screen interaction for mobile phone user interfaces. Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures the Future of Design - OzCHI '14, ACM Press, 539--548. http://doi.org/10.1145/2686612.2686699

Digital Library

[7]

Ashley Colley, Jani Väyrynen, and Jonna Häkkilä. 2015. In-Car Touch Screen Interaction: Comparing Standard, Finger-Specific and Multi-Finger Interaction. Proceedings of the 4th International Symposium on Pervasive Displays - PerDis '15: 131--137.

Digital Library

[8]

Paul Dietz and Darren Leigh. 2001. DiamondTouch. Proceedings of the 14th annual ACM symposium on User interface software and technology - UIST '01, ACM Press, 219. http://doi.org/10.1145/502348.502389

[9]

Mark D. Dunlop, Andreas Komninos, and Naveen Durga. 2014. Towards high quality text entry on smartwatches. Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems CHI EA '14, ACM Press, 2365--2370. http://doi.org/10.1145/2559206.2581319

Digital Library

[10]

Philipp Ewerling, Alexander Kulik, and Bernd Froehlich. 2012. Finger and hand detection for multitouch interfaces based on maximally stable extremal regions. Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces ITS '12, ACM Press, 173. http://doi.org/10.1145/2396636.2396663

Digital Library

[11]

Alix Goguey, Géry Casiez, Daniel Vogel, Fanny Chevalier, Thomas Pietrzak, and Nicolas Roussel. 2014. A three-step interaction pattern for improving discoverability in finger identification techniques. Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology - UIST'14 Adjunct, ACM Press, 33--34. http://doi.org/10.1145/2658779.2659100

Digital Library

[12]

Chris Harrison and Scott Hudson. 2012. Using shear as a supplemental two-dimensional input channel for rich touchscreen interaction. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems CHI '12, ACM Press, 3149. http://doi.org/10.1145/2207676.2208730

Digital Library

[13]

Chris Harrison, Munehiko Sato, and Ivan Poupyrev. 2012. Capacitive fingerprinting. Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12, ACM Press, 537. http://doi.org/10.1145/2380116.2380183

Digital Library

[14]

Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense. Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11, ACM Press, 627. http://doi.org/10.1145/2047196.2047279

[15]

Christian Holz and Patrick Baudisch. 2013. Fiberio. Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13, ACM Press, 41--50. http://doi.org/10.1145/2501988.2502021

Digital Library

[16]

Jonggi Hong, Seongkook Heo, Poika Isokoski, and Geehyuk Lee. 2015. SplitBoard. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems CHI '15, ACM Press, 1233--1236. http://doi.org/10.1145/2702123.2702273

Digital Library

[17]

Da-Yuan Huang, Ming-Chang Tsai, Ying-Chao Tung, et al. 2014. TouchSense. Proceedings of the 32nd annual ACM conference on Human factors in computing systems CHI '14, ACM Press, 189--192. http://doi.org/10.1145/2556288.2557258

Digital Library

[18]

Luis A. Leiva, Alireza Sahami, Alejandro Catala, Niels Henze, and Albrecht Schmidt. 2015. Text Entry on Tiny QWERTY Soft Keyboards. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems CHI '15, ACM Press, 669--678. http://doi.org/10.1145/2702123.2702388

Digital Library

[19]

Frank Chun Yat Li, Richard T. Guy, Koji Yatani, and Khai N. Truong. 2011. The 1line keyboard. Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11, ACM Press, 461. http://doi.org/10.1145/2047196.2047257

[20]

I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase sets for evaluating text entry techniques. CHI '03 extended abstracts on Human factors in computing systems CHI '03, ACM Press, 754. http://doi.org/10.1145/765891.765971

Digital Library

[21]

Nicolai Marquardt, Johannes Kiemer, David Ledo, Sebastian Boring, and Saul Greenberg. 2011. Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces ITS '11, ACM Press, 21. http://doi.org/10.1145/2076354.2076358

Digital Library

[22]

Peter Norvig. 2013. English Letter Frequency Counts: Mayzner Revisited or ETAOIN SRHLDCU. norvig.com. Retrieved August 24, 2015 from http://norvig.com/mayzner.html

[23]

Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, ACM Press, 2799. http://doi.org/10.1145/2470654.2481387

[24]

Graham Alasdair Wilson Phd Thesis. Using Pressure Input and Thermal Feedback to Broaden Haptic Interaction with Mobile Devices. Retrieved September 8, 2015 from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1. 1.368.9401

[25]

Quentin Roy, Yves Guiard, Gilles Bailly, Éric Lecolinet, and Olivier Rioul. 2015. Glass+Skin: An Empirical Evaluation of the Added Value of Finger Identification to Basic Single-Touch Interaction on Touch Screens. INTERACT: IFIP International Conference on Human-Computer Interaction, Springer.

[26]

Atsushi Sugiura and Yoshiyuki Koseki. 1998. A user interface using fingerprint recognition. Proceedings of the 11th annual ACM symposium on User interface software and technology - UIST '98, ACM Press, 71--79. http://doi.org/10.1145/288392.288575

Digital Library

[27]

Nate Swanner. 2015. Sonavation has bonded 3D fingerprint sensors to Gorilla Glass. thenextweb.com. Retrieved September 11, 2015 from http://thenextweb.com/insider/2015/07/21/sonovationhas-bonded-3d-fingerprint-sensors-to-gorilla-glasskiss-your-home-button-goodbye/

[28]

Julie Wagner, Eric Lecolinet, and Ted Selker. 2014. Multi-finger chords for hand-held tablets. Proceedings of the 32nd annual ACM conference on Human factors in computing systems CHI '14, ACM Press, 2883--2892. http://doi.org/10.1145/2556288.2556958

Digital Library

[29]

M Yousefpor and JM Bussat. 2014. Fingerprint Sensor in an Electronic Device. US Patent App. 14/. ... Retrieved September 11, 2015 from https://www.google.com/patents/US20150036065

[30]

Shumin Zhai, Per Ola Kristensson, Pengjun Gong, et al. 2009. Shapewriter on the iphone. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems CHI EA '09, ACM Press, 2667. http://doi.org/10.1145/1520340.1520380

Digital Library

Cited By

Lu YDing DWang RXue GKostakos VKay JHoang T(2024)HCMG: Human-Capacitance based Micro Gesture for VR/ARCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678386(766-770)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678386
Lu YDing DPan HLi YZhou JFu YZhang YChen YXue G(2024)HandPad: Make Your Hand an On-the-go Writing Pad via Human CapacitanceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676328(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676328
Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643559
Show More Cited By

Index Terms

DualKey: Miniature Screen Text Entry via Finger Identification
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

WrisText: One-handed Text Entry on Smartwatch using Wrist Gestures
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present WrisText - a one-handed text entry technique for smartwatches using the joystick-like motion of the wrist. A user enters text by whirling the wrist of the watch hand, towards six directions which each represent a key in a circular keyboard, ...
TriTap: Identifying Finger Touches on Smartwatches
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

The small screens of smartwatches provide limited space for input tasks. Finger identification is a promising technique to address this problem by associating different functions with different fingers. However, current technologies for finger ...
TipText: Eyes-Free Text Entry on a Fingertip Keyboard
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

In this paper, we propose and investigate a new text entry technique using micro thumb-tip gestures. Our technique features a miniature QWERTY keyboard residing invisibly on the first segment of the user's index finger. Text entry can be carried out ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

NSERC

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

69
Total Citations
View Citations
1,489
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)6

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lu YDing DWang RXue GKostakos VKay JHoang T(2024)HCMG: Human-Capacitance based Micro Gesture for VR/ARCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678386(766-770)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678386
Lu YDing DPan HLi YZhou JFu YZhang YChen YXue G(2024)HandPad: Make Your Hand an On-the-go Writing Pad via Human CapacitanceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676328(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676328
Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643559
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Liao YDesai RPierce ATaylor KBenko HJonker TGupta A(2024)A Meta-Bayesian Approach for Rapid Online Parametric Optimization for Wrist-based InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642071(1-38)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642071
Rakhmetulla GArif A(2023)Crownboard: A One-Finger Crown-Based Smartwatch Keyboard for Users with Limited DexterityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580770(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580770
Raad HRashid F(2023)The Metaverse: Applications, Concerns, Technical Challenges, Future Directions and RecommendationsIEEE Access10.1109/ACCESS.2023.332165011(110850-110861)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3321650
Jannat MYang XHasan K(2023)Around-device finger input on commodity smartwatches with learning guidance through discoverabilityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103105179:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103105
Kim JOakley I(2022)SonarID: Using Sonar to Identify Fingers on a SmartwatchProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501935(1-10)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501935
Jang RJung CMohaisen DLee KNyang D(2022)A One-Page Text Entry Method Optimized for Rectangle SmartwatchesIEEE Transactions on Mobile Computing10.1109/TMC.2021.305722621:10(3443-3454)Online publication date: 1-Oct-2022
https://doi.org/10.1109/TMC.2021.3057226
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents