research-article

Faster Command Selection on Touchscreen Watches

Authors:

Benjamin Lafreniere,

Tovi GrossmanAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 4663 - 4674

https://doi.org/10.1145/2858036.2858166

Published: 07 May 2016 Publication History

Abstract

Small touchscreens worn on the wrist are becoming increasingly common, but standard interaction techniques for these devices can be slow, requiring a series of coarse swipes and taps to perform an action. To support faster command selection on watches, we investigate two related interaction techniques that exploit spatial memory. WristTap uses multitouch to allow selection in a single action, and TwoTap uses a rapid combination of two sequential taps. In three quantitative studies, we investigate the design and performance of these techniques in comparison to standard methods. Results indicate that both techniques are feasible, able to accommodate large numbers of commands, and fast users are able to quickly learn the techniques and reach performance of ~1.0 seconds per selection, which is approximately one-third of the time of standard commercial techniques. We also provide insights into the types of applications for which these techniques are well-suited, and discuss how the techniques could be extended.

Supplementary Material

ZIP File (pn0766-file4.zip)

pn0766-file4.zip

Download
.42 KB

suppl.mov (pn0766-file3.mp4)

Supplemental video

Download
42.82 MB

MP4 File (p4663-lafreniere.mp4)

Download
171.96 MB

References

[1]

Daniel L. Ashbrook. 2010. Enabling Mobile Microinteractions. PhD thesis, GA Institute of Technology.

Digital Library

[2]

Daniel Ashbrook, Kent Lyons, and Thad Starner. 2008. An Investigation into Round Touchscreen Wristwatch Interaction. Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08), ACM, 311-314. http://doi.org/10.1145/1409240.1409276

Digital Library

[3]

Gilles Bailly, Eric Lecolinet, and Yves Guiard. 2010. Finger-count & Radial-stroke Shortcuts: 2 Techniques for Augmenting Linear Menus on Multi-touch Surfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), ACM, 591--594. http://doi.org/10.1145/1753326.1753414

Digital Library

[4]

Patrick Baudisch and Gerry Chu. 2009. Back-of-device Interaction Allows Creating Very Small Touch Devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), ACM, 1923--1932. http://doi.org/10.1145/1518701.1518995

Digital Library

[5]

Xiang "Anthony" Chen, Tovi Grossman, and George Fitzmaurice. 2014. Swipeboard: A Text Entry Technique for Ultra-small Interfaces That Supports Novice to Expert Transitions. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14), ACM, 615--620. http://doi.org/10.1145/2642918.2647354

Digital Library

[6]

Andrew Crossan, John Williamson, Stephen Brewster, and Rod Murray-Smith. 2008. Wrist Rotation for Interaction in Mobile Contexts. Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08), ACM, 435--438. http://doi.org/10.1145/1409240.1409307

Digital Library

[7]

Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria, and Scott C. Olson. 2014. Faster Command Selection on Tablets with FastTap. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), ACM, 2617--2626. http://doi.org/10.1145/2556288.2557136

Digital Library

[8]

Chris Harrison and Scott E. Hudson. 2009. Abracadabra: Wireless, High-precision, and Unpowered Finger Input for Very Small Mobile Devices. Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST '09), ACM, 121--124. http://doi.org/10.1145/1622176.1622199

Digital Library

[9]

Da-Yuan Huang, Ming-Chang Tsai, Ying-Chao Tung, et al. 2014. TouchSense: Expanding Touchscreen Input Vocabulary Using Different Areas of Users' Finger Pads. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), ACM, 189--192. http://doi.org/10.1145/2556288.2557258

Digital Library

[10]

Mohit Jain and Ravin Balakrishnan. 2012. User Learning and Performance with Bezel Menus. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), ACM, 2221--2230. http://doi.org/10.1145/2207676.2208376

Digital Library

[11]

Jungsoo Kim, Jiasheng He, Kent Lyons, and Thad Starner. 2007. The Gesture Watch: A Wireless Contact-free Gesture Based Wrist Interface. Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers (ISWC '07), IEEE Computer Society, 1--8. http://doi.org/10.1109/ISWC.2007.4373770

Digital Library

[12]

Gordon Kurtenbach and William Buxton. 1994. User Learning and Performance with Marking Menus. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), ACM, 258--264. http://doi.org/10.1145/191666.191759

Digital Library

[13]

Gordon Paul Kurtenbach. 1993. The Design and Evaluation of Marking Menus. PhD thesis, University of Toronto.

[14]

Gordon P. Kurtenbach, Abigail J. Sellen, and William A. S. Buxton. 1993. An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus. Hum.-Comput. Interact. 8, 1: 1--23. http://doi.org/10.1207/s15327051hci0801_1

Digital Library

[15]

Gierad Laput, Robert Xiao, Xiang "Anthony" Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin Buttons: Cheap, Small, Low-powered and Clickable Fixed-icon Laser Projectors. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14), ACM, 389--394. http://doi.org/10.1145/2642918.2647356

Digital Library

[16]

G. Julian Lepinski, Tovi Grossman, and George Fitzmaurice. 2010. The Design and Evaluation of Multitouch Marking Menus. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), ACM, 2233--2242. http://doi.org/10.1145/1753326.1753663

Digital Library

[17]

Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard: A Diminutive Qwerty Soft Keyboard Using Iterative Zooming for Ultra-small Devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), ACM, 2799--2802. http://doi.org/10.1145/2470654.2481387

Digital Library

[18]

Simon T. Perrault, Eric Lecolinet, James Eagan, and Yves Guiard. 2013. Watchit: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), ACM, 1451--1460. http://doi.org/10.1145/2470654.2466192

Digital Library

[19]

Gonzalo A. Ramos and Ravin Balakrishnan. 2007. Pressure Marks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07), ACM, 1375--1384. http://doi.org/10.1145/1240624.1240834

Digital Library

[20]

Joey Scarr, Andy Cockburn, Carl Gutwin, and Andrea Bunt. 2012. Improving Command Selection with CommandMaps. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), ACM, 257--266. http://doi.org/10.1145/2207676.2207713

Digital Library

[21]

Joey Scarr, Andy Cockburn, Carl Gutwin, and Sylvain Malacria. 2013. Testing the Robustness and Performance of Spatially Consistent Interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), ACM, 3139--3148. http://doi.org/10.1145/2470654.2466430

Digital Library

[22]

Marcos Serrano, Eric Lecolinet, and Yves Guiard. 2013. Bezel-Tap Gestures: Quick Activation of Commands from Sleep Mode on Tablets. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), ACM, 3027--3036. http://doi.org/10.1145/2470654.2481421

Digital Library

[23]

Katie A. Siek, Yvonne Rogers, and Kay H. Connelly. 2005. Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs. Proceedings of the 2005 IFIP TC13 International Conference on Human-Computer Interaction (INTERACT'05), Springer-Verlag, 267--280. http://doi.org/10.1007/11555261_24

Digital Library

[24]

Robert Xiao, Gierad Laput, and Chris Harrison. 2014. Expanding the Input Expressivity of Smartwatches with Mechanical Pan, Twist, Tilt and Click. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), ACM, 193--196. http://doi.org/10.1145/2556288.2557017

Digital Library

Cited By

Jannat MHasan K(2023)Exploring the Effects of Virtually-Augmented Display Sizes on Users’ Spatial Memory in Smartwatches2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00070(553-562)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00070
Kim HOakley I(2023)Improving Hand Gesture Recognition via Infrared Tomography of the Wrist over Multiple Wearing SessionsHuman-Computer Interaction10.1007/978-3-031-35596-7_33(519-531)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_33
Rey BZhu KPerrault SBardot SNeshati AIrani P(2022)Understanding and Adapting Bezel-to-Bezel Interactions for Circular Smartwatches in Mobile and Encumbered ScenariosProceedings of the ACM on Human-Computer Interaction10.1145/35467366:MHCI(1-28)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546736
Show More Cited By

Index Terms

Faster Command Selection on Touchscreen Watches
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Faster command selection on tablets with FastTap
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Touch-based tablet UIs provide few shortcut mechanisms for rapid command selection; as a result, command selection on tablets often requires slow traversal of menus. We developed a new selection technique for multi-touch tablets, called FastTap, that ...
Dual-Thumb pointing and command selection techniques for tablets
Highlights
- An optimal Dual-Thumb technique outperforms Single-Thumb pointing techniques.
- Similar usage of both thumbs improves the pointing efficiency.
- Relative pointing for the coarse step improves the efficiency.
- Two thumbs are better ...
Abstract
Tablets are often used as a distant input device to interact with large displays. Users can hold the tablet with two hands when interacting for a long time to avoid fatigue or dropping it. Still, most previous distant interaction techniques ...
Drag-and-drop for older adults using touchscreen devices: effects of screen sizes and interaction techniques on accuracy
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

This study investigates the accuracy of drag-and-drop interaction for older adults by analyzing the number of supplementary attempts for positioning a target during the execution of tactile puzzle games on two different screen sizes, tablet and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
604
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)2

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jannat MHasan K(2023)Exploring the Effects of Virtually-Augmented Display Sizes on Users’ Spatial Memory in Smartwatches2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00070(553-562)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00070
Kim HOakley I(2023)Improving Hand Gesture Recognition via Infrared Tomography of the Wrist over Multiple Wearing SessionsHuman-Computer Interaction10.1007/978-3-031-35596-7_33(519-531)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_33
Rey BZhu KPerrault SBardot SNeshati AIrani P(2022)Understanding and Adapting Bezel-to-Bezel Interactions for Circular Smartwatches in Mobile and Encumbered ScenariosProceedings of the ACM on Human-Computer Interaction10.1145/35467366:MHCI(1-28)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546736
Kim JOakley I(2022)SonarID: Using Sonar to Identify Fingers on a SmartwatchProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501935(1-10)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501935
Fennedy KSrivastava AMalacria SPerrault S(2022)Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard HotkeysACM Transactions on Computer-Human Interaction10.1145/347651029:1(1-39)Online publication date: 7-Jan-2022
https://dl.acm.org/doi/10.1145/3476510
Zhang QWang DZhao RYu YJing J(2021)Write, Attend and SpellProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34781005:3(1-25)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3478100
Sami Uddin MGutwin CKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)The Image of the Interface: How People Use Landmarks to Develop Spatial Memory of Commands in Graphical InterfacesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445050(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445050
Yoon HPark S(2020)A Non-Touchscreen Tactile Wearable Interface as an Alternative to Touchscreen-Based Wearable DevicesSensors10.3390/s2005127520:5(1275)Online publication date: 26-Feb-2020
https://doi.org/10.3390/s20051275
Fruchard BLecolinet EChapuis O(2020)Side-Crossing MenusProceedings of the ACM on Human-Computer Interaction10.1145/34273174:ISS(1-19)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3427317
Lewis BVogel D(2020)Longer Delays in Rehearsal-based Interfaces Increase Expert UseACM Transactions on Computer-Human Interaction10.1145/341819627:6(1-41)Online publication date: 25-Nov-2020
https://dl.acm.org/doi/10.1145/3418196
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents