research-article

User-defined motion gestures for mobile interaction

Authors:

Edward LankAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 197 - 206

https://doi.org/10.1145/1978942.1978971

Published: 07 May 2011 Publication History

Abstract

Modern smartphones contain sophisticated sensors to monitor three-dimensional movement of the device. These sensors permit devices to recognize motion gestures - deliberate movements of the device by end-users to invoke commands. However, little is known about best-practices in motion gesture design for the mobile computing paradigm. To address this issue, we present the results of a guessability study that elicits end-user motion gestures to invoke commands on a smartphone device. We demonstrate that consensus exists among our participants on parameters of movement and on mappings of motion gestures onto commands. We use this consensus to develop a taxonomy for motion gestures and to specify an end-user inspired motion gesture set. We highlight the implications of this work to the design of smartphone applications and hardware. Finally, we argue that our results influence best practices in design for all gestural interfaces.

References

[1]

Android Open Source Project. Google Inc.

[2]

Etch A Sketch. Ohio Art.

[3]

Ashbrook, D. and Starner, T. MAGIC: A Motion Gesture Design Tool. Proceedings of CHI '10, ACM (2010) 2159--2168.

Digital Library

[4]

Bartlett, J. F. Rock 'n' Scroll Is Here to Stay. IEEE Comput. Graph. Appl. 20, 3 (2000), 40--45.

Digital Library

[5]

Good, M. D., Whiteside, J. A., Wixon, D. R., and Jones, S. J. Building a user-derived interface. Communications of the ACM 27, 10 (1984), 1032--1043.

Digital Library

[6]

Harrison, B. L., Fishkin, K. P., Gujar, A., Mochon, C., and Want, R. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. Proceedings of CHI '98, ACM Press/Addison-Wesley Publishing Co. (1998), 17--24.

Digital Library

[7]

Harrison, C. and Hudson, S. E. Scratch input. Proceedings of UIST '08, (2008), 205.

Digital Library

[8]

Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S. R. Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. Proceedings of CHI '07, (2007), 145.

Digital Library

[9]

Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. Proceedings of UIST '00. ACM (2000), 91--100.

Digital Library

[10]

Hutchins, E., Hollan, J., and Norman, D. Direct Manipulation Interfaces. Human-Computer Interact 1, 4 (1985), 311--338.

Digital Library

[11]

Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. GesText: Accelerometer-based Gestural Text-Entry Systems. Proceedings of CHI '10, (2010).

Digital Library

[12]

Liu, J., Zhong, L., Wickramasuriya, J., and Vasudevan, V. User evaluation of lightweight user authentication with a single tri-axis accelerometer. Proceedings of MobileHCI '09. ACM (2009), 1--10.

Digital Library

[13]

Mignot, C., Valot, C., and Carbonell, N. An experimental study of future "natural" multimodal human-computer interaction. Proceddings of INTERACT '93 and CHI '93. (1993), 67--68.

Digital Library

[14]

Montero, C. S., Alexander, J., Marshall, M. T., and Subramanian, S. Would you do that? Proceedings of MobileHCI '10, (2010), 275.

Digital Library

[15]

Morris, M. R., Huang, A., Paepcke, A., and Winograd, T. Cooperative gestures. Proceedings of CHI '06, (2006), 1201.

Digital Library

[16]

Morris, M. R., Wobbrock, J. O., and Wilson, A. D. Understanding users' preferences for surface gestures. Proceedings of GI 2010, CIPS (2010), 261--268.

Digital Library

[17]

Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G., and Want, R. TiltType: accelerometer-supported text entry for very small devices. Proc. UIST '02, ACM (2002), 201--204.

Digital Library

[18]

Rekimoto, J. Tilting operations for small screen interfaces. Proceedings of UIST '96, ACM (1996), 167--168.

Digital Library

[19]

Rico, J. and Brewster, S. Usable gestures for mobile interfaces: evaluating social acceptability. Proceedings of CHI '10, ACM (2010), 887--896.

Digital Library

[20]

Ruiz, J. and Li, Y. DoubleFlip: A Motion Gesture for Mobile Interaction. Proceedings of CHI '11, ACM (2011).

Digital Library

[21]

Schuler, D. Participatory design : principles and practices. L. Erlbaum Associates, Hillsdale N.J., 1993.

Digital Library

[22]

Small, D. and Ishii, H. Design of spatially aware graspable displays. CHI '97 extended abstracts, ACM (1997), 367--368.

Digital Library

[23]

Tang, J. Findings from observational studies of collaborative work. International Journal of Man-Machine Studies 34, 2 (1991), 143--160.

Digital Library

[24]

Voida, S., Podlaseck, M., Kjeldsen, R., and Pinhanez, C. A study on the manipulation of 2D objects in a projector/camera-based augmented reality environment. Proceedings of CHI '05, (2005), 611.

Digital Library

[25]

Weberg, L., Brange, T., and Hansson, W. A piece of butter on the PDA display. CHI '01 extended abstracts, ACM (2001), 435--436.

Digital Library

[26]

Wigdor, D. and Balakrishnan, R. TiltText: using tilt for text input to mobile phones. Proc UIST '03, ACM (2003), 81--90.

Digital Library

[27]

Wobbrock, J. O., Aung, H. H., Rothrock, B., and Myers, B. A. Maximizing the guessability of symbolic input. CHI '05 extended abstracts, (2005), 1869.

Digital Library

[28]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. Proceedings of CHI '09, (2009), 1083.

Digital Library

[29]

Wu, M., Chia Shen, Ryall, K., Forlines, C., and Balakrishnan, R. Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces. Proceedings of TABLETOP '06, 185--192.

Digital Library

[30]

Yee, K. Peephole displays. Proceedings of CHI '03, ACM (2003), 1--8.

Digital Library

Cited By

Bernardos AWang XBergesio LBesada JCasar J(2024)Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: An Empirical StudyJournal of Sensor and Actuator Networks10.3390/jsan1302002513:2(25)Online publication date: 9-Apr-2024
https://doi.org/10.3390/jsan13020025
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Wang NZielasko DMaurer F(2024)User Preferences for Interactive 3D Object Transitions in Cross Reality - An Elicitation StudyProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656698(1-9)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656698
Show More Cited By

Index Terms

User-defined motion gestures for mobile interaction
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Teaching motion gestures via recognizer feedback
IUI '14: Proceedings of the 19th international conference on Intelligent User Interfaces

When using motion gestures, 3D movements of a mobile phone, as an input modality, one significant challenge is how to teach end users the movement parameters necessary to successfully issue a command. Is a simple video or image depicting movement of a ...
iWink: Exploring Eyelid Gestures on Mobile Devices
HuMA'20: Proceedings of the 1st International Workshop on Human-centric Multimedia Analysis

Although gaze has been widely studied for mobile interactions, eyelid-based gestures are relatively understudied and limited to few basic gestures (e.g., blink). In this work, we propose a gesture grammar to construct both basic and compound eyelid ...
Leap gestures for TV: insights from an elicitation study
TVX '14: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

We present insights from a gesture elicitation study in the context of interacting with TV, during which 18 participants contributed and rated the execution difficulty and recall likeliness of free-hand gestures for 21 distinct TV tasks. Our study ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

308
Total Citations
View Citations
5,090
Total Downloads

Downloads (Last 12 months)252
Downloads (Last 6 weeks)25

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bernardos AWang XBergesio LBesada JCasar J(2024)Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: An Empirical StudyJournal of Sensor and Actuator Networks10.3390/jsan1302002513:2(25)Online publication date: 9-Apr-2024
https://doi.org/10.3390/jsan13020025
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Wang NZielasko DMaurer F(2024)User Preferences for Interactive 3D Object Transitions in Cross Reality - An Elicitation StudyProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656698(1-9)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656698
Tian JWang YYu KXu LXie JLi FNiu YFan M(2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642884
Sun QHu YFan MLi JWang S(2024)“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with DystoniaProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642378(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642378
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Kyung-Chan AJun-Ying LChu-Feng YTimothy NVarku SQinjie WKajal PMathews NBasu AKim T(2024)A Dynamic Gesture Recognition Algorithm Using Single Halide Perovskite Photovoltaic Cell for Human-Machine Interaction2024 International Conference on Electronics, Information, and Communication (ICEIC)10.1109/ICEIC61013.2024.10457182(1-4)Online publication date: 28-Jan-2024
https://doi.org/10.1109/ICEIC61013.2024.10457182
Xiao YLiu L(2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3404876
Liao Y(2024)Innovative Interaction Mode in VR GamesFrontier Computing on Industrial Applications Volume 410.1007/978-981-99-9342-0_9(77-86)Online publication date: 21-Jan-2024
https://doi.org/10.1007/978-981-99-9342-0_9
Alyamani H(2023)Gesture Vocabularies for Hand Gestures for Controlling Air Conditioners in Home and Vehicle EnvironmentsElectronics10.3390/electronics1207151312:7(1513)Online publication date: 23-Mar-2023
https://doi.org/10.3390/electronics12071513
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents