research-article

Arpège: learning multitouch chord gestures vocabularies

Authors:

Stéphane Huot,

Michel Beaudouin-Lafon,

Wendy E. MackayAuthors Info & Claims

ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Pages 209 - 218

https://doi.org/10.1145/2512349.2512795

Published: 06 October 2013 Publication History

Abstract

This paper presents Arpège, a progressive multitouch input technique for learning chords, as well as a robust recognizer and guidelines for building large chord vocabularies. Experiment one validated our design guidelines and suggests implications for designing vocabularies, i.e. users prefer relaxed to tense chords, chords with fewer fingers and chords with fewer tense fingers. Experiment two demonstrated that users can learn and remember a large chord vocabulary with both Arpège and cheat sheets, and Arpège encourages the creation of effective mmnemonics.

Supplementary Material

suppl.mov (its123.mp4)

Supplemental video

Download
40.74 MB

References

[1]

Bailly, G., Demeure, A., Lecolinet, E., and Nigay, L. Multitouch menu (mtm). In Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine, IHM '08, ACM (2008), 165--168.

Digital Library

[2]

Bailly, G., Lecolinet, E., and Guiard, Y. Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces. In Proceedings of the SIGCHI conference on Human Factors in computing systems, CHI '10, ACM (2010), 591--594.

Digital Library

[3]

Bau, O., and Mackay, W. E. Octopocus: a dynamic guide for learning gesture-based command sets. In Proceedings of the 21st annual ACM symposium on User interface software and technology, UIST '08, ACM (2008), 37--46.

Digital Library

[4]

Baudel, T., and Beaudouin-Lafon, M. Charade: Remote control of objects using free-hand gestures. Comm. ACM 36 (1993), 28--35.

Digital Library

[5]

Bragdon, A., Uguray, A., Wigdor, D., Anagnostopoulos, S., Zeleznik, R., and Feman, R. Gesture play: motivating online gesture learning with fun, positive reinforcement and physical metaphors. In ACM International Conference on Interactive Tabletops and Surfaces, ITS '10, ACM (2010), 39--48.

Digital Library

[6]

Davis, C. Statistical Methods for the Analysis of Repeated Measurements. Springer, 2002.

[7]

Engelbart, D. C. Augmenting human intellect: A conceptual framework. SRI Summary Report AFOSR-3223 (1962).

[8]

Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. Shadowguides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS '09, ACM (New York, NY, USA, 2009), 165--172.

Digital Library

[9]

Ghomi, E., Faure, G., Huot, S., Chapuis, O., and Beaudouin-Lafon, M. Using rhythmic patterns as an input method. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (2012), 1253--1262.

Digital Library

[10]

Koh, J. Scales And Arpeggios For Piano - Fingering Method. Wells Music Publishers, 2010.

[11]

Kurtenbach, G. P. The design and evaluation of marking menus. PhD thesis, University of Toronto, 1993.

Digital Library

[12]

Lahav, A., Boulanger, A., Schlaug, G., and Saltzman, E. The power of listening: auditory-motor interactions in musical training. Annals of the New York Academy of Sciences 1060 (2005), 189--94.

[13]

Lang, C. E., and Schieber, M. H. Human finger independence: limitations due to passive mechanical coupling versus active neuromuscular control. Journal of neurophysiology 92, 5 (Nov. 2004), 2802--2810.

[14]

Lee, J., and Kunii, T. L. Model-based analysis of hand posture. IEEE Comput. Graph. Appl. 15, 5 (1995), 77--86.

Digital Library

[15]

Lepinski, G. J., Grossman, T., and Fitzmaurice, G. The design and evaluation of multitouch marking menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, ACM (2010), 2233--2242.

Digital Library

[16]

Lin, J., Wu, Y., and Huang, T. S. Modeling the constraints of human hand motion. In Proceedings of the Workshop on Human Motion (HUMO'00), HUMO '00, IEEE (2000), 121--127.

Digital Library

[17]

Miller, F. P., Vandome, A. F., and McBrewster, J. Keyboard Layout. Alpha Press, 2009.

[18]

Morris, M. R., Wobbrock, J. O., and Wilson, A. D. Understanding users' preferences for surface gestures. In Proceedings of Graphics Interface 2010, GI '10, CIPS (2010), 261--268.

Digital Library

[19]

Scarr, J., Cockburn, A., Gutwin, C., and Quinn, P. Dips and ceilings: understanding and supporting transitions to expertise in user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11, ACM (2011), 2741--2750.

Digital Library

[20]

Vanacken, D., Demeure, A., Luyten, K., and Coninx, K. Ghosts in the interface: Meta-user interface visualizations as guides for multi-touch interaction. In 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems. TABLETOP 2008., IEEE (2008), 81--84.

[21]

Vogel, D., and Casiez, G. Hand occlusion on a multi-touch tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (2012), 2307--2316.

Digital Library

[22]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09, ACM (2009), 1083--1092.

Digital Library

[23]

Zeleznik, R., Bragdon, A., Adeputra, F., and Ko, H.-S. Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving. In Proceedings of the 23rd annual ACM symposium on User interface software and technology, UIST '10, ACM (2010), 17--26.

Digital Library

Cited By

Rubab SZaman MRashid UYu LWu Y(2024)Audio-visual training and feedback to learn touch-based gesturesJournal of Visualization10.1007/s12650-024-01012-xOnline publication date: 17-Jun-2024
https://doi.org/10.1007/s12650-024-01012-x
Tricaud MBeaudouin-Lafon M(2023)Revisiting creative behaviour as an epistemic process: lessons from 12 computational artists and designersProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638395(175-190)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638395
Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272
Show More Cited By

Index Terms

Arpège: learning multitouch chord gestures vocabularies
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Evaluation of Flick Gestures on Multitouch Tabletop Surfaces
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

This work is observing the impacts/influence of different mapping functions between the user's flick gesture and the animation of the flicked object. The flick gesture, in which the user quickly swipes a finger across the screen and lifts the finger ...
Investigating the Potential of a Two-finger Chord Button in Multi-touch Applications
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

With the increasing use of multi-touch (MT) capable devices, MT interaction has become a commodity during the last years. From personal devices to larger multi-user screens, MT functionality is nowadays considered as a standard way of performing rich ...
T(ether): spatially-aware handhelds, gestures and proprioception for multi-user 3D modeling and animation
SUI '14: Proceedings of the 2nd ACM symposium on Spatial user interaction

T(ether) is a spatially-aware display system for multi-user, collaborative manipulation and animation of virtual 3D objects. The handheld display acts as a window into virtual reality, providing users with a perspective view of 3D data. T(ether) tracks ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

October 2013

514 pages

ISBN:9781450322713

DOI:10.1145/2512349

General Chairs:
Aaron Quigley
University of St. Andrews, UK
,
Giulio Jacucci
HIIT / University of Helsinki, Finland
,
Program Chairs:
Michael Horn
Northwestern University, USA
,
Miguel Nacenta
University of St. Andrews, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS '13

Sponsor:

SIGCHI

ITS '13: The ACM International Conference on Interactive Tabletops and Surfaces

October 6 - 9, 2013

St. Andrews, Scotland, United Kingdom

Acceptance Rates

ITS '13 Paper Acceptance Rate 35 of 121 submissions, 29%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
404
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)3

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rubab SZaman MRashid UYu LWu Y(2024)Audio-visual training and feedback to learn touch-based gesturesJournal of Visualization10.1007/s12650-024-01012-xOnline publication date: 17-Jun-2024
https://doi.org/10.1007/s12650-024-01012-x
Tricaud MBeaudouin-Lafon M(2023)Revisiting creative behaviour as an epistemic process: lessons from 12 computational artists and designersProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638395(175-190)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638395
Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272
Chaffangeon Caillet AGoguey ANigay L(2023)µGlyph: a Microgesture NotationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580693(1-28)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580693
Goguey AOrtega M(2023)Studies and guidelines for two concurrent stroke gesturesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102942170:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102942
Filho GGuerino GValentim NSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)A systematic mapping study on usability and user eXperience evaluation of multi-touch systemsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559131(1-12)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559131
Bailly GMalacria S(2022)Command SelectionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_19-1(1-35)Online publication date: 12-Mar-2022
https://doi.org/10.1007/978-3-319-27648-9_19-1
Fennedy KHartmann JRoy QPerrault SVogel D(2021)OctoPocus in VR: Using a Dynamic Guide for 3D Mid-Air Gestures in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310185427:12(4425-4438)Online publication date: 1-Dec-2021
https://doi.org/10.1109/TVCG.2021.3101854
Le HMayer SHenze N(2020)Imprint-Based Input Techniques for Touch-Based Mobile DevicesProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428393(32-41)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3428393
Chen DBalakrishnan RGrossman T(2020)Disambiguation Techniques for Freehand Object Manipulations in Virtual Reality2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.00048(285-292)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.00048
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents