short-paper

Unravelling seams: improving mobile gesture recognition with visual feedback techniques

Authors:

Rafael BallagasAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 937 - 940

https://doi.org/10.1145/1518701.1518844

Published: 04 April 2009 Publication History

Abstract

Gesture recognition is emerging as an engaging interaction technique in mobile scenarios, and high recognition rates promote user acceptance. Several factors influence recognition rates including the nature of the gesture set and the suitability of the gesture recognition algorithm. This work explores how seamfulness in gesture stroke visualization affects recognition rates. We present the results of a user evaluation of a gesture recognition system that shows that raw (seamful) visualization of low-delity gesture stroke data has recognition rates comparable to no feedback. Providing filtered (seamless) stroke visualization to the user, while retaining the un-filtered input data for recognition, resulted in a 34.9% improvement in gesture recognition rate over raw stroke data. The results provide insights into the broader design space of seamful design, and identifies areas where seamlessness is advantageous.

References

[1]

Ballagas, R., Kuntze, A., and Walz, S. P. Gaming Tourism: Lessons from Evaluating REXplorer, a Pervasive Game for Tourists. Proc. Pervasive '08. Springer (2008), 244--261.

Digital Library

[2]

Ballagas, R., and Walz, S. REXplorer: Using Iterative Design Techniques for Pervasive Games. Pervasive Gaming Applications - A Reader for Pervasive Gaming Research. Shaker Verlag (2007), C. Magerkurth and C. Roecker, Eds., vol. 2, 255--284.

[3]

Benford, S., Crabtree, A., Flintham, M., Drozd, A., Anastasi, R., Paxton, M., Tandavanitj, N., Adams, M., and Row-Farr, J. Can you see me now? ACM TOCHI 13, 1 (2006), 100--133.

Digital Library

[4]

Cao, X., and Balakrishnan, R. VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. Proc. UIST '03. ACM Press (2003), 173--182.

Digital Library

[5]

Chalmers, M., Bell, M., Brown, B., Hall, M., Sherwood, S., and Tennent, P. Gaming on the edge: using seams in ubicomp games. Proc. CHI '05. ACM (2005), 306--309.

Digital Library

[6]

Chalmers, M., MacColl, I., and Bell, M. Seamful design: showing the seams in wearable computing. Eurowearable. IEE (2003), 11--16.

[7]

Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. Proc. UIST '00. ACM (2000), 91--100.

Digital Library

[8]

Kallio, S., Kela, J., Mäntyjärvi, J., and Plomp, J. Visualization of hand gestures for pervasive computing environments. Proc. AVI '06. ACM (2006), 480--483.

Digital Library

[9]

Kratz, S. A camera-based gesture recognition system for mobile devices. Master's thesis, RWTH Aachen University, Aachen, Germany, 2007.

[10]

Magerkurth, C., Cheok, A., Mandryk, R., and Nilsen, T. Pervasive games: bringing computer entertainment back to the real world. Computers in Entertainment (CIE) 3, 3 (2005), 7--17.

Digital Library

[11]

Overbeeke, K., Djajadiningrat, T., Hummels, C., Wensveen, S., and Frens, J. Let's make things engaging. Funology From Usability to Enjoyment. Kluwer Academic Publishers (2004), M. Blythe, K. Overbeeke, A. Monk, and P. Wright, Eds., 7--17.

Digital Library

[12]

Patel, S. N., Pierce, J. S., and Abowd, G. D. A gesture-based authentication scheme for untrusted public terminals. Proc. UIST '04:. ACM Press (2004), 157--160.

Digital Library

[13]

Rohs, M. Real-world interaction with camera phones. Proc. UCS '04. Springer (2005), 74--89.

Digital Library

[14]

Takayama, L. Throwing Voices: Investigating the Psychological Effects of the Spatial Location of Projected Voices. PhD thesis, Dept. of Communication, Stanford University, 2008.

[15]

Turner, D. The Nintendo Wii: A game console with underwhelming graphics wins with neat controllers. TECHNOLOGY REVIEW 110, 4 (2007), 22.

[16]

Wang, J., Zhai, S., and Canny, J. Camera phone based motion sensing: Interaction techniques, applications and performance study. Proc. UIST '06. ACM (2006), 101--110.

Digital Library

[17]

Wilson, A., and Shafer, S. XWand: UI for intelligent spaces. Proc. CHI '03. ACM (2003), 545--552.

Digital Library

[18]

Wobbrock, J., Wilson, A., and Li, Y. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. Proc. UIST '07. 159--168.

Digital Library

[19]

Wobbrock, J. O., Chau, D. H., and Myers, B. A. An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry. Proc. CHI '07. ACM (2007), 667--676.

Digital Library

[20]

Wobbrock, J. O., Myers, B. A., and Kembel, J. A. Edgewrite: a stylus-based text entry method designed for high accuracy and stability of motion. Proc. UIST '03. ACM (New York, NY, USA, (2003), 61--70.

Digital Library

Cited By

Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Vatavu RUngurean O(2022)Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor ImpairmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501964(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501964
Inman SRibes DBrewster SFitzpatrick GCox AKostakos V(2019)"Beautiful Seams"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300508(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300508
Show More Cited By

Index Terms

Unravelling seams: improving mobile gesture recognition with visual feedback techniques
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Undoing Seamlessness: Exploring Seams for Critical Visualization
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

While seamful design has been part of discourses and work within HCI contexts for some time, it has not yet been fully explored in data visualization design. At the same time, critics of visualization have been arguing that the representation of data as ...
Time-segmentation and position-free recognition of air-drawn gestures and characters in videos

We report the recognition in video streams of isolated alphabetic characters and connected cursive textual characters, such as alphabetic, hiragana and kanji characters, that are drawn in the air. This topic involves a number of difficult problems in ...
Kinect-based Taiwanese sign-language recognition system

Gesture-recognition is an important component for many intelligent human---computer interaction applications. For example, a realtime sign-language recognition system would detect and interpret hand gestures. Many vision-based sign-language recognition ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
1,149
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Vatavu RUngurean O(2022)Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor ImpairmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501964(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501964
Inman SRibes DBrewster SFitzpatrick GCox AKostakos V(2019)"Beautiful Seams"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300508(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300508
Köpsel AMajaranta PIsokoski PHuckauf A(2016)Effects of auditory, haptic and visual feedback on performing gestures by gaze or by handBehaviour & Information Technology10.1080/0144929X.2016.119447735:12(1044-1062)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1080/0144929X.2016.1194477
Rodrigues MMacedo DSerpa YSerpa YWainwright RCorchado JBechini AHong J(2015)Beyond funProceedings of the 30th Annual ACM Symposium on Applied Computing10.1145/2695664.2695915(239-246)Online publication date: 13-Apr-2015
https://dl.acm.org/doi/10.1145/2695664.2695915
Fonteles JSousa ÉRodrigues M(2015)Visual and Interactive Performance of Particles Conducted by the Leap Motion for an Orchestral ArrangementProceedings of the 2015 XVII Symposium on Virtual and Augmented Reality10.1109/SVR.2015.43(255-264)Online publication date: 25-May-2015
https://dl.acm.org/doi/10.1109/SVR.2015.43
Silva ÉRodrigues M(2015)Gesture Interaction and Evaluation Using the Leap Motion for Medical VisualizationProceedings of the 2015 XVII Symposium on Virtual and Augmented Reality10.1109/SVR.2015.31(160-169)Online publication date: 25-May-2015
https://dl.acm.org/doi/10.1109/SVR.2015.31
Schönauer CMossel AZaiți IVatavu R(2015)Touch, Movement and Vibration: User Perception of Vibrotactile Feedback for Touch and Mid-Air GesturesHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22723-8_14(165-172)Online publication date: 30-Aug-2015
https://doi.org/10.1007/978-3-319-22723-8_14
Zamborlin BBevilacqua FGillies MD'inverno M(2014)Fluid gesture interaction designACM Transactions on Interactive Intelligent Systems10.1145/25439213:4(1-30)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1145/2543921
Silva ÉRodrigues M(2014)A Gesture Control System for Aiding Surgical ProceduresProceedings of the 2014 Fifth International Conference on Intelligent Systems Design and Engineering Applications10.1109/SVR.2014.34(287-296)Online publication date: 15-Jun-2014
https://dl.acm.org/doi/10.1109/SVR.2014.34
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents