research-article

Augmented letters: mnemonic gesture-based shortcuts

Authors:

Sylvain Malacria,

Eric Lecolinet,

James EaganAuthors Info & Claims

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2325 - 2328

https://doi.org/10.1145/2470654.2481321

Published: 27 April 2013 Publication History

Abstract

We propose Augmented Letters, a new technique aimed at augmenting gesture-based techniques such as Marking Menus [9] by giving them natural, mnemonic associations. Augmented Letters gestures consist of the initial of command names, sketched by hand in the Unistroke style, and affixed with a straight tail. We designed a tentative touch device interaction technique that supports fast interactions with large sets of commands, is easily discoverable, improves user's recall at no speed cost, and supports fluid transition from novice to expert mode. An experiment suggests that Augmented Letters outperform Marking Menu in terms of user recall.

Supplementary Material

suppl.mov (chi0289-file3.mp4)

Supplemental video

Download
9.15 MB

References

[1]

Bailly, G., Lecolinet, E., and Nigay, L. Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization. In Proc. of AVI, ACM (2008), 15--22.

Digital Library

[2]

Bau, O., and Mackay, W. OctoPocus: a dynamic guide for learning gesture-based command sets. In Proc. of UIST '08, ACM, New York, NY, USA, 37--46.

Digital Library

[3]

Beaudouin-Lafon, M. (2004). Designing interaction, not interfaces. In Proc. of AVI '04, ACM, New York, NY, USA, 15--22.

Digital Library

[4]

Brainard, R. W., Irby, T. S., Fitts, P. M., and Alluisi, E. A. Some variables influencing the rate of gain of information. Journal of Experimental Psychology 63, 2 (1962), 105--110.

[5]

Castellucci, S. J. and MacKenzie, I. S. Graffiti vs. unistrokes. In Proc. of CHI '08, ACM Press (2008), 305--308.

Digital Library

[6]

Grossman, T., Dragicevic, P., and Balakrishnan, R. Strategies for accelerating on-line learning of hotkeys. In Proc. of CHI '07, ACM Press (2007), 1591--1600.

Digital Library

[7]

Hyman, R. Stimulus information as a determinant of reaction time. Journal of Experimental Psychology 45, 3 (1953), 188--196.

[8]

Jones, G. V. Tests of the dual-mechanism theory of recall. Acta Psychologica 50, 1 (1982), 61--72.

[9]

Kurtenbach, G. and Buxton, W. Issues in combining marking and direct manipulation techniques. In Proc. of UIST '91, ACM Press (1991), 137--144.

Digital Library

[10]

Kurtenbach, G. and Buxton, W. The limits of expert performance using hierarchic marking menus. In Proc. of INTERACT/CHI, ACM (1993), 482--487.

Digital Library

[11]

Li, Y. Gesture search. In Proc. of UIST '10, ACM Press (2010), 87--96.

[12]

Roudaut, A., Bailly, G., Lecolinet, E., and Nigay, L. Leaf Menus: Linear Menus with Stroke Shortcuts for Small Handheld Devices. In Proc. of INTERACT, Springer-Verlag (2009), 616--619.

Digital Library

[13]

Saussure, F. de (1916). Course in General Linguistics.

[14]

Shneiderman, B. Seven plus or minus two central issues in human-computer interaction. ACM SIGCHI Bulletin 17, 4 (1986), 343--349.

Digital Library

[15]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proc. of UIST '07, ACM Press (2007), 159--168.

Digital Library

Cited By

Xu SSykes SAbtahi PGrossman TWalden DGlueck MRognon C(2024)Designing Haptic Feedback for Sequential Gestural InputsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642735(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642735
Gori JFruchard BBailly G(2024)Model-based Evaluation of Recall-based Interaction TechniquesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642637(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642637
Abdullah SUddin M(2024)Revisiting FastTap: Effects of Increasing Command Capacity of Spatial Memory Menus in Tablets2024 IEEE 15th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON62879.2024.10754660(0683-0689)Online publication date: 17-Oct-2024
https://doi.org/10.1109/UEMCON62879.2024.10754660
Show More Cited By

Index Terms

Augmented letters: mnemonic gesture-based shortcuts
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Touching character segmentation of Devanagari script
ICCCNT '16: Proceedings of the 7th International Conference on Computing Communication and Networking Technologies

Segmentation of characters is one of the major step in OCR system. Devanagari script is a two dimensional form of symbol. It is very inconvenient to treat each form of character as a separate symbol because such combinations are very large in number. ...
User-defined gestures for augmented reality
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Recently there has been an increase in research of hand gestures for interaction in the area of Augmented Reality (AR). However this research has focused on developer designed gestures, and little is known about user preference and behavior for gestures ...
Haptic Learning of Semaphoric Finger Gestures
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Haptic learning of gesture shortcuts has never been explored. In this paper, we investigate haptic learning of a freehand semaphoric finger tap gesture shortcut set using haptic rings. We conduct a two-day study of 30 participants where we couple haptic ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2013

3550 pages

ISBN:9781450318990

DOI:10.1145/2470654

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
586
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xu SSykes SAbtahi PGrossman TWalden DGlueck MRognon C(2024)Designing Haptic Feedback for Sequential Gestural InputsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642735(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642735
Gori JFruchard BBailly G(2024)Model-based Evaluation of Recall-based Interaction TechniquesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642637(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642637
Abdullah SUddin M(2024)Revisiting FastTap: Effects of Increasing Command Capacity of Spatial Memory Menus in Tablets2024 IEEE 15th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON62879.2024.10754660(0683-0689)Online publication date: 17-Oct-2024
https://doi.org/10.1109/UEMCON62879.2024.10754660
Rateau HRekik YLank E(2023)Ether-Mark: An Off-Screen Marking Menu For Mobile DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614150(224-233)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614150
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Sluÿters AOusmer MRoselli PVanderdonckt J(2022)QuantumLeap, a Framework for Engineering Gestural User Interfaces based on the Leap Motion ControllerProceedings of the ACM on Human-Computer Interaction10.1145/35322116:EICS(1-47)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532211
Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Vatavu RUngurean O(2022)Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor ImpairmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501964(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501964
Schipor OVatavu R(2022)GearWheels: A Software Tool to Support User Experiments on Gesture Input with Wearable DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.209890739:18(3527-3545)Online publication date: 22-Jul-2022
https://doi.org/10.1080/10447318.2022.2098907
Ahn SSantosa SParent MWigdor DGrossman TGiordano MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)StickyPie: A Gaze-Based, Scale-Invariant Marking Menu Optimized for AR/VRProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445297(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445297
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents