research-article

A Systematic Review of Gesture Elicitation Studies: What Can We Learn from 216 Studies?

Authors:

Santiago Villarreal-Narvaez,

Jean Vanderdonckt,

Radu-Daniel Vatavu,

Jacob O. WobbrockAuthors Info & Claims

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

Pages 855 - 872

https://doi.org/10.1145/3357236.3395511

Published: 03 July 2020 Publication History

Abstract

Gesture elicitation studies represent a popular and resourceful method in HCI to inform the design of intuitive gesture commands, reflective of end-users' behavior, for controlling all kinds of interactive devices, applications, and systems. In the last ten years, an impressive body of work has been published on this topic, disseminating useful design knowledge regarding users' preferences for finger, hand, wrist, arm, head, leg, foot, and whole-body gestures. In this paper, we deliver a systematic literature review of this large body of work by summarizing the characteristics and findings ofN=216gesture elicitation studies subsuming 5,458 participants, 3,625 referents, and 148,340 elicited gestures. We highlight the descriptive, comparative, and generative virtues of our examination to provide practitioners with an effective method to (i) understand how new gesture elicitation studies position in the literature; (ii) compare studies from different authors; and (iii) identify opportunities for new research. We make our large corpus of papers accessible online as a Zotero group library at https://www.zotero.org/groups/2132650/gesture_elicitation_studies.

Supplementary Material

PDF File (disfp6904aux.pdf)

An appendix containing the corpus of references

Download
180.44 KB

References

[1]

Jason Alexander, Teng Han, William Judd, Pourang Irani, and Sriram Subramanian. 2012. Putting Your Best Foot Forward: Investigating Real-world Mappings for Foot-based Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1229--1238.

Digital Library

[2]

Abdullah X. Ali, Meredith Ringel Morris, and Jacob O. Wobbrock. 2018. Crowdsourcing Similarity Judgments for Agreement Analysis in End-User Elicitation Studies. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 177--188.

Digital Library

[3]

Abdullah X. Ali, Meredith Ringel Morris, and Jacob O. Wobbrock. 2019. Crowdlicit: A System for Conducting Distributed End-User Elicitation and Identification Studies. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 255:1--255:12.

Digital Library

[4]

Leonardo Angelini, Francesco Carrino, Stefano Carrino, Maurizio Caon, Omar Abou Khaled, Jürgen Baumgartner, Andreas Sonderegger, Denis Lalanne, and Elena Mugellini. 2014. Gesturing on the Steering Wheel: A User-elicited Taxonomy. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '14). ACM, New York, NY, USA, 31:1--31:8.

Digital Library

[5]

Leonardo Angelini, Denis Lalanne, Elise van den Hoven, Omar Abou Khaled, and Elena Mugellini. 2015. Move, Hold and Touch: A Framework for Tangible Gesture Interactive Systems. Machines 3, 3 (Aug. 2015), 173--207.

[6]

Ilhan Aslan, Tabea Schmidt, Jens Woehrle, Lukas Vogel, and Elisabeth André. 2018. Pen + Mid-Air Gestures: Eliciting Contextual Gestures. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (ICMI '18). ACM, New York, NY, USA, 135--144.

Digital Library

[7]

Gilles Bailly, Thomas Pietrzak, Jonathan Deber, and Daniel J. Wigdor. 2013. MéTamorphe: Augmenting Hotkey Usage with Actuated Keys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 563--572.

Digital Library

[8]

Michel Beaudouin-Lafon. 2004. Designing Interaction, Not Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '04). ACM, New York, NY, USA, 15--22.

Digital Library

[9]

Joeran Beel, Bela Gipp, Stefan Langer, and Corinna Breitinger. 2016. Research-paper recommender systems: a literature survey. International Journal on Digital Libraries 17, 4 (01 Nov 2016), 305--338.

Digital Library

[10]

Roger Boldu, Alexandru Dancu, Denys J.C. Matthies, Pablo Gallego Cascón, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction (SUI '18). ACM, New York, NY, USA, 150--157.

Digital Library

[11]

Michael L. Boucher. 2018. Participant Empowerment Through Photo-elicitation in Ethnographic Education. Research, New Perspectives and Approaches. Springer International Publishing, Cham, Switzerland.

[12]

Pearl Brereton, Barbara A. Kitchenham, David Budgen, Mark Turner, and Mohamed Khalil. 2007. Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software 80, 4 (2007), 571 -- 583.

Digital Library

[13]

Daniel Buschek, Bianka Roppelt, and Florian Alt. 2018. Extending Keyboard Shortcuts with Arm and Wrist Rotation Gestures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 21, 12 pages.

Digital Library

[14]

Francesco Cafaro, Leilah Lyons, and Alissa N. Antle. 2018. Framed Guessability: Improving the Discoverability of Gestures and Body Movements for Full-Body Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 593:1--593:12.

Digital Library

[15]

Gaëlle Calvary, Joëlle Coutaz, David Thevenin, Quentin Limbourg, Laurent Bouillon, and Jean Vanderdonckt. 2003. A Unifying Reference Framework for multi-target user interfaces. Interacting with Computers 15, 3 (2003), 289--308.

[16]

John M. Carroll. 1982. Learning, using and designing filenames and command paradigms. Behaviour & Information Technology 1, 4 (1982), 327--346.

[17]

Jessica R. Cauchard, Jane L. E, Kevin Y. Zhai, and James A. Landay. 2015. Drone & Me: An Exploration into Natural Human-drone Interaction. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 361--365.

Digital Library

[18]

Edwin Chan, Teddy Seyed, Wolfgang Stuerzlinger, Xing-Dong Yang, and Frank Maurer. 2016. User Elicitation on Single-hand Microgestures (CHI '16). ACM, New York, NY, USA, 3403--3414.

Digital Library

[19]

Xiang 'Anthony' Chen, Julia Schwarz, Chris Harrison, Jennifer Mankoff, and Scott E. Hudson. 2014. Air+Touch: Interweaving Touch + In-air Gestures. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 519--525.

Digital Library

[20]

Zhen Chen, Xiaochi Ma, Zeya Peng, Ying Zhou, Mengge Yao, Zheng Ma, Ci Wang, Zaifeng Gao, and Mowei Shen. 2018. User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts. International Journal of Human--Computer Interaction 34, 3 (March 2018), 238--250.

[21]

Sabrina Connell, Pei-Yi Kuo, Liu Liu, and Anne Marie Piper. 2013. A Wizard-of-Oz Elicitation Study Examining Child-defined Gestures with a Whole-body Interface. In Proceedings of the 12th International Conference on Interaction Design and Children (IDC '13). ACM, New York, NY, USA, 277--280.

Digital Library

[22]

Joëlle Coutaz, Laurence Nigay, Daniel Salber, Ann Blandford, Jon May, and Richard M. Young. 1995. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE Properties. Springer US, Boston, MA, 115--120.

[23]

Suranjith De Silva, Michael Barlow, and Adam Easton. 2013. Harnessing Multi-user Design and Computation to Devise Archetypal Whole-of-body Gestures: A Novel Framework. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI '13). ACM, New York, NY, USA, 85--94.

Digital Library

[24]

Linda Di Geronimo, Marica Bertarini, Julia Badertscher, Maria Husmann, and Moira C. Norrie. 2017. Exploiting Mid-air Gestures to Share Data Among Devices. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, 35:1--35:11.

Digital Library

[25]

Nem Khan Dim, Chaklam Silpasuwanchai, Sayan Sarcar, and Xiangshi Ren. 2016. Designing Mid-Air TV Gestures for Blind People Using User- and Choice-Based Elicitation Approaches. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 204--214.

Digital Library

[26]

Tilman Dingler, Rufat Rzayev, Alireza Sahami Shirazi, and Niels Henze. 2018. Designing Consistent Gestures Across Device Types: Eliciting RSVP Controls for Phone, Watch, and Glasses. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 419:1--419:12.

Digital Library

[27]

Haiwei Dong, A. Danesh, Nadia Figueroa, and Abdulmotaleb. Saddik. 2015a. An Elicitation Study on Gesture Preferences and Memorability Toward a Practical Hand-Gesture Vocabulary for Smart Televisions. IEEE Access 3 (2015), 543--555.

[28]

Haiwei Dong, Nadia Figueroa, and Abdulmotaleb El Saddik. 2015b. An Elicitation Study on Gesture Attitudes and Preferences Towards an Interactive Hand-Gesture Vocabulary. In Proceedings of the 23rd ACM International Conference on Multimedia (MM '15). ACM, New York, NY, USA, 999--1002.

Digital Library

[29]

Ted Dunning. 1993. Accurate Methods for the Statistics of Surprise and Coincidence. Computational Linguistics 19, 1 (March 1993), 61--74. http://dl.acm.org/citation.cfm?id=972450.972454

Digital Library

[30]

Jane L. E, Ilene L. E, James A. Landay, and Jessica R. Cauchard. 2017. Drone & Wo: Cultural Influences on Human-Drone Interaction Techniques. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6794--6799.

Digital Library

[31]

Peter Emerson. 2013. The original Borda count and partial voting. Social Choice and Welfare 40, 2 (01 Feb 2013), 353--358. https://doi.org/10.1007/s00355-011-0603--9

[32]

Hessam Jahani Fariman, Hasan J. Alyamani, Manolya Kavakli, and Len Hamey. 2016. Designing a User-defined Gesture Vocabulary for an In-vehicle Climate Control System. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI '16). ACM, New York, NY, USA, 391--395.

Digital Library

[33]

Yasmin Felberbaum and Joel Lanir. 2016. Step by Step: Investigating Foot Gesture Interaction. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '16). ACM, New York, NY, USA, 306--307.

Digital Library

[34]

Yasmin Felberbaum and Joel Lanir. 2018. Better Understanding of Foot Gestures: An Elicitation Study. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 334:1--334:12.

Digital Library

[35]

Leah Findlater, Ben Lee, and Jacob Wobbrock. 2012. Beyond QWERTY: Augmenting Touch Screen Keyboards with Multi-touch Gestures for Non-alphanumeric Input (CHI '12). ACM, New York, NY, USA, 2679--2682.

Digital Library

[36]

Jon Fraenkel and Bernard Grofman. 2014. The Borda Count and its real-world alternatives: Comparing scoring rules in Nauru and Slovenia. Australian Journal of Political Science 49, 2 (2014), 186--205.

[37]

Euan Freeman, Gareth Griffiths, and Stephen A. Brewster. 2017. Rhythmic Micro-gestures: Discreet Interaction On-the-go. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (ICMI 2017). ACM, New York, NY, USA, 115--119.

Digital Library

[38]

Mathias Frisch, Jens Heydekorn, and Raimund Dachselt. 2009. Investigating Multi-touch and Pen Gestures for Diagram Editing on Interactive Surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 149--156.

Digital Library

[39]

Bogdan-Florin Gheran, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2018a. Gestures for Smart Rings: Empirical Results, Insights, and Design Implications. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 623--635.

Digital Library

[40]

Bogdan-Florin Gheran, Radu-Daniel Vatavu, and Jean Vanderdonckt. 2018b. Ring x2: Designing Gestures for Smart Rings Using Temporal Calculus. In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems (DIS '18 Companion). ACM, New York, NY, USA, 117--122.

Digital Library

[41]

Steven N. Goodman, Daniele Fanelli, and John P. A. Ioannidis. 2016. What does research reproducibility mean? Science Translational Medicine 8, 341 (2016), 341ps12--341ps12.

[42]

Robin Guérit, Alessandro Cierro, Jean Vanderdonckt, and Jorge Luis Pérez-Medina. 2019. Gesture Elicitation and Usability Testing for an Armband Interacting with Netflix and Spotify. In Information Technology and Systems (Advances in Intelligent Systems and Computing), Álvaro Rocha, Carlos Ferras, and Manolo Paredes (Eds.). Springer International Publishing, 625--637.

[43]

Douglas Harper. 1988. Visual sociology: Expanding sociological vision. The American Sociologist 19, 1 (01 Mar 1988), 54--70.

[44]

Hayati Havlucu, Mehmet Yarkin Ergin, "Idil Bostan, Oguz Turan Buruk, Tilbe Göksun, and Oguzhan Özcan. 2017. It Made More Sense: Comparison of User-Elicited On-skin Touch and Freehand Gesture Sets. In Distributed, Ambient and Pervasive Interactions (Lecture Notes in Computer Science). Springer, Cham, 159--171.

[45]

Lynn Hoff, Eva Hornecker, and Sven Bertel. 2016. Modifying Gesture Elicitation: Do Kinaesthetic Priming and Increased Production Reduce Legacy Bias?. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 86--91.

Digital Library

[46]

Hessam Jahani-Fariman. 2017. Developing a User-defined Interface for In-vehicle Mid-air Gestural Interactions. In Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion (IUI '17 Companion). ACM, New York, NY, USA, 165--168.

Digital Library

[47]

Shaun K. Kane, Jacob O. Wobbrock, and Richard E. Ladner. 2011. Usable Gestures for Blind People: Understanding Preference and Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 413--422.

Digital Library

[48]

Frederic Kerber, Markus Löchtefeld, Antonio Krüger, Jess McIntosh, Charlie McNeill, and Mike Fraser. 2016. Understanding Same-Side Interactions with Wrist-Worn Devices. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA, 28:1--28:10.

Digital Library

[49]

Barbara Kitchenham, Rialette Pretorius, David Budgen, O. Pearl Brereton, Mark Turner, Mahmood Niazi, and Stephen Linkman. 2010. Systematic literature reviews in software engineering -- A tertiary study. Information and Software Technology 52, 8 (2010), 792--805.

Digital Library

[50]

Anne Köpsel and Nikola Bubalo. 2015. Benefiting from Legacy Bias. interactions 22, 5 (Aug. 2015), 44--47.

Digital Library

[51]

Christine Kühnel, Tilo Westermann, Fabian Hemmert, Sven Kratz, Alexander Müller, and Sebastian Möller. 2011. I'm home: Defining and evaluating a gesture set for smart-home control. International Journal of Human-Computer Studies 69, 11 (Oct. 2011), 693--704.

[52]

DoYoung Lee, Youryang Lee, Yonghwan Shin, and Ian Oakley. 2018. Designing Socially Acceptable Hand-to-Face Input. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 711--723.

Digital Library

[53]

Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How Users Manipulate Deformable Displays As Input Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1647--1656.

Digital Library

[54]

Hoo Yong Leng, Noris Mohd Norowi, and Azrul Hazri Jantan. 2017. A User-Defined Gesture Set for Music Interaction in Immersive Virtual Environment. In Proceedings of the 3rd International Conference on Human-Computer Interaction and User Experience in Indonesia (CHIuXiD '17). ACM, New York, NY, USA, 44--51.

Digital Library

[55]

Xuan Li, Daisong Guan, Jingya Zhang, Xingtong Liu, Siqi Li, and Hui Tong. 2019. Exploration of Ideal Interaction Scheme on Smart TV: Based on User Experience Research of Far-Field Speech and Mid-air Gesture Interaction. In Design, User Experience, and Usability. User Experience in Advanced Technological Environments (Lecture Notes in Computer Science), Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, 144--162.

[56]

Alessandro Liberati, Douglas G. Altman, Jennifer Tetzlaff, Cynthia Mulrow, Peter C. Gø tzsche, John P.A. Ioannidis, Mike Clarke, P. J. Devereaux, Jos Kleijnen, and David Moher. July 2009. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Medicine 6, 7 (July 2009), 1--22.

[57]

Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle Arms-down Mid-air Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 63--71.

Digital Library

[58]

Yihua Lou, Wenjun Wu, Radu-Daniel Vatavu, and Wei-Tek Tsai. 2017. Personalized gesture interactions for cyber-physical smart-home environments. Science China Information Sciences 60, 7 (July 2017), 072104.

[59]

Naveen Madapana, Glebys Gonzalez, Richard Rodgers, Lingsong Zhang, and Juan P. Wachs. 2018. Gestures for Picture Archiving and Communication Systems (PACS) operation in the operating room: Is there any standard? PLOS ONE 13, 6 (June 2018), e0198092.

[60]

Nathan Magrofuoco, Jorge Luis Pérez-Medina, Paolo Roselli, Jean Vanderdonckt, and Santiago Villarreal. 2019. Eliciting Contact-Based and Contactless Gestures With Radar-Based Sensors. IEEE Access 7 (2019), 176982--176997.

[61]

Nathan Magrofuoco and Jean Vanderdonckt. 2019. Gelicit: A Cloud Platform for Distributed Gesture Elicitation Studies. Proc. ACM Hum.-Comput. Interact. 3, EICS (June 2019), 6:1--6:41.

Digital Library

[62]

Diako Mardanbegi, Dan Witzner Hansen, and Thomas Pederson. 2012. Eye-based Head Gestures. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12). ACM, New York, NY, USA, 139--146.

Digital Library

[63]

Francisco J. Martínez-Ruiz, Sebastian F. Rauh, and Gerrit Meixner. 2020. Understanding Peripheral Audiences: From Subtle to Full Body Gestures. In Human Interaction and Emerging Technologies (Advances in Intelligent Systems and Computing), Tareq Ahram, Redha Taiar, Serge Colson, and Arnaud Choplin (Eds.). Springer International Publishing, 489--495.

[64]

Kohei Matsumura. 2015. Studying User-Defined Gestures Toward Off the Screen Interactions. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 295--300.

Digital Library

[65]

Dan Mauney, Jonathan Howarth, Andrew Wirtanen, and Miranda Capra. 2010. Cultural Similarities and Differences in User-defined Gestures for Touchscreen User Interfaces. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 4015--4020.

Digital Library

[66]

Keenan R. May, Thomas M. Gable, and Bruce N. Walker. 2017. Designing an In-Vehicle Air Gesture Set Using Elicitation Methods. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 74--83.

Digital Library

[67]

Erin McAweeney, Haihua Zhang, and Michael Nebeling. 2018. User-Driven Design Principles for Gesture Representations. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 547, 13 pages.

Digital Library

[68]

John C. McClelland, Robert J. Teather, and Audrey Girouard. 2017. Haptobend: Shape-changing Passive Haptic Feedback in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (SUI '17). ACM, New York, NY, USA, 82--90.

Digital Library

[69]

David McNeill. August-December 1981. Action, Thought and Language. Cognition 10, 1--3 (August-December 1981), 201--208.

[70]

Meredith Ringel Morris. 2012. Web on the Wall: Insights from a Multimodal Interaction Elicitation Study. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 95--104.

Digital Library

[71]

Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, m. c. schraefel, and Jacob O. Wobbrock. 2014. Reducing Legacy Bias in Gesture Elicitation Studies. interactions 21, 3 (May 2014), 40--45.

Digital Library

[72]

Meredith Ringel Morris, Jacob O. Wobbrock, and Andrew D. Wilson. 2010. Understanding Users' Preferences for Surface Gestures. In Proceedings of Graphics Interface 2010 (GI '10). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 261--268. http://dl.acm.org/citation.cfm?id=1839214.1839260

Digital Library

[73]

Miguel A. Nacenta, Yemliha Kamber, Yizhou Qiang, and Per Ola Kristensson. 2013. Memorability of Pre-designed and User-defined Gesture Sets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1099--1108.

Digital Library

[74]

Andrés Adolfo Navarro-Newball, Isidro Moreno, Edmond Prakash, Ali Arya, Victoria E. Contreras, Victor A. Quiceno, Santiago Lozano, Juan David Mejìa, and Diego Fernando Loaiza. 2016. Gesture based human motion and game principles to aid understanding of science and cultural practices. Multimedia Tools and Applications 75, 19 (Oct. 2016), 11699--11722.

[75]

Michael Nebeling, Alexander Huber, David Ott, and Moira C. Norrie. 2014. Web on the Wall Reloaded: Implementation, Replication and Refinement of User-Defined Interaction Sets. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). ACM, New York, NY, USA, 15--24.

Digital Library

[76]

Michael Nebeling, David Ott, and Moira C. Norrie. 2015. Kinect Analysis: A System for Recording, Analysing and Sharing Multimodal Interaction Elicitation Studies. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 142--151.

Digital Library

[77]

Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2004. A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In Gesture-Based Communication in Human-Computer Interaction, Antonio Camurri and Gualtiero Volpe (Eds.). Springer, Berlin, 409--420.

[78]

F. R. Ortega, A. Galvan, K. Tarre, A. Barreto, N. Rishe, J. Bernal, R. Balcazar, and J. L. Thomas. 2017. Gesture elicitation for 3D travel via multi-touch and mid-Air systems for procedurally generated pseudo-universe. In Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI '17). 144--153.

[79]

Mehdi Ousmer, Jean Vanderdonckt, and Sabin Buraga. 2019. An Ontology for Reasoning on Body-based Gestures. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '19). ACM, New York, NY, USA, 17:1--17:6.

Digital Library

[80]

Tran Pham, Jo Vermeulen, Anthony Tang, and Lindsay MacDonald Vermeulen. 2018. Scale Impacts Elicited Gestures for Manipulating Holograms: Implications for AR Gesture Design. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 227--240.

Digital Library

[81]

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013a. User-defined Gestures for Augmented Reality. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 955--960.

Digital Library

[82]

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013b. User-Defined Gestures for Augmented Reality. In Human-Computer Interaction - INTERACT 2013 (Lecture Notes in Computer Science). Springer, Berlin, Heidelberg, 282--299.

[83]

Marcus Pivato. 2015. Condorcet meets Bentham. Journal of Mathematical Economics 59 (2015), 58 -- 65.

[84]

F. Quek, D. McNeill, R. Ansari, Xin-Feng Ma, R. Bryll, S. Duncan, and K. E. McCullough. 1999. Gesture cues for conversational interaction in monocular video. In International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 1999. Proceedings. 119--126.

[85]

Francis Quek, David McNeill, Robert Bryll, Susan Duncan, Xin-Feng Ma, Cemil Kirbas, Karl E. McCullough, and Rashid Ansari. 2002. Multimodal Human Discourse: Gesture and Speech. ACM Trans. Comput.-Hum. Interact. 9, 3 (Sept. 2002), 171--193.

Digital Library

[86]

Roman Rädle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. 2015. Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions (CHI '15). ACM, New York, NY, USA, 3913--3922.

Digital Library

[87]

Julie Rico and Stephen Brewster. 2010. Usable Gestures for Mobile Interfaces: Evaluating Social Acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 887--896.

Digital Library

[88]

P. Riehmann, M. Hanfler, and B. Froehlich. 2005. Interactive Sankey diagrams. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005. 233--240.

[89]

Isabel Benavente Rodriguez and Nicolai Marquardt. 2017. Gesture Elicitation Study on How to Opt-in & Opt-out from Interactions with Public Displays (ISS '17). ACM, New York, NY, USA, 32--41.

Digital Library

[90]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined Motion Gestures for Mobile Interaction (CHI '11). ACM, New York, NY, USA, 197--206.

Digital Library

[91]

Jaime Ruiz and Daniel Vogel. 2015. Soft-Constraints to Reduce Legacy and Performance Bias to Elicit Whole-body Gestures with Low Arm Fatigue (CHI '15). ACM, New York, NY, USA, 3347--3350.

Digital Library

[92]

Ovidia Schipor and Radu-Daniel Vatavu. 2018. Invisible, Inaudible, and Impalpable: Users' Preferences and Memory Performance for Digital Content in Thin Air. IEEE Pervasive Computing 17, 4 (Oct. 2018), 76--85.

[93]

Marcos Serrano, Barrett M. Ens, and Pourang P. Irani. 2014. Exploring the Use of Hand-to-face Input for Interacting with Head-worn Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3181--3190.

Digital Library

[94]

Matthias Seuter, Eduardo Rodriguez Macrillante, Gernot Bauer, and Christian Kray. 2018. Running with Drones: Desired Services and Control Gestures. In Proceedings of the 30th Australian Conference on Computer-Human Interaction (OzCHI '18). ACM, New York, NY, USA, 384--395.

Digital Library

[95]

Teddy Seyed, Chris Burns, Mario Costa Sousa, Frank Maurer, and Anthony Tang. 2012. Eliciting Usable Gestures for Multi-display Environments. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 41--50.

Digital Library

[96]

Alex Shaw and Lisa Anthony. 2016a. Analyzing the Articulation Features of Children's Touchscreen Gestures. In Proceedings of the 18th ACM International Conference on Multimodal Interaction (ICMI 2016). ACM, New York, NY, USA, 333--340.

Digital Library

[97]

Alex Shaw and Lisa Anthony. 2016b. Toward a Systematic Understanding of Children's Touchscreen Gestures. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, 1752--1759.

Digital Library

[98]

Chaklam Silpasuwanchai and Xiangshi Ren. 2014. Jump and Shoot!: Prioritizing Primary and Alternative Body Gestures for Intense Gameplay (CHI '14). ACM, New York, NY, USA, 951--954.

Digital Library

[99]

Chaklam Silpasuwanchai and Xiangshi Ren. 2015. Designing concurrent full-body gestures for intense gameplay. International Journal of Human-Computer Studies 80 (Aug. 2015), 1--13.

Digital Library

[100]

Tiffanie R. Smith and Juan E. Gilbert. 2018. Dancing to Design: A Gesture Elicitation Study. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18). ACM, New York, NY, USA, 638--643.

Digital Library

[101]

Nikita Soni, Schuyler Gleaves, Hannah Neff, Sarah Morrison-Smith, Shaghayegh Esmaeili, Ian Mayne, Sayli Bapat, Carrie Schuman, Kathryn A. Stofer, and Lisa Anthony. 2019. Do User-defined Gestures for Flatscreens Generalize to Interactive Spherical Displays for Adults and Children?. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (PerDis '19). ACM, New York, NY, USA, 24:1--24:7.

Digital Library

[102]

Maximilian Speicher and Michael Nebeling. 2018. GestureWiz: A Human-Powered Gesture Design Environment for User Interface Prototypes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 107, 11 pages.

Digital Library

[103]

Poorna Talkad Sukumar, Anqing Liu, and Ronald Metoyer. 2018. Replicating User-defined Gestures for Text Editing. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). ACM, New York, NY, USA, 97--106.

Digital Library

[104]

Yanke Tan, Sang Ho Yoon, and Karthik Ramani. 2017. BikeGesture: User Elicitation and Performance of Micro Hand Gesture As Input for Cycling (CHI EA '17). ACM, New York, NY, USA, 2147--2154.

Digital Library

[105]

Florent Taralle, Alexis Paljic, Sotiris Manitsaris, Jordane Grenier, and Christophe Guettier. 2015. A Consensual and Non-ambiguous Set of Gestures to Interact with UAV in Infantrymen (CHI EA '15). ACM, New York, NY, USA, 797--803.

Digital Library

[106]

Piotr Tarka. 2018. An overview of structural equation modeling: its beginnings, historical development, usefulness and controversies in the social sciences. Quality & Quantity 52, 1 (01 Jan 2018), 313--354.

[107]

Vuletic Tijana, Alex Duffy, Laura Hay, Chris McTeague, Gerard Campbell, and Madeleine Grealy. 2019. Systematic literature review of hand gestures used in human computer interaction interfaces. International Journal of Human-Computer Studies 129 (2019), 74 -- 94.

Digital Library

[108]

Deborah J. Tippins, Sophia (Sun Kyung) Jeong, Purita P. Bilbao, and Lourdes N. Morano. 2018. Participant Empowerment Through Photoelicitation in Ethnographic Education Research. Springer International Publishing, Cham, Switzerland, 93--113.

[109]

Theophanis Tsandilas. 2018. Fallacies of Agreement: A Critical Review of Consensus Assessment Methods for Gesture Elicitation. ACM Trans. Comput.-Hum. Interact. 25, 3, Article 18 (June 2018), 49 pages.

Digital Library

[110]

Jean Vanderdonckt, Nathan Magrofuoco, Suzanne Kieffer, Jorge Pérez, Ysabelle Rase, Paolo Roselli, and Santiago Villarreal. 2019. Head and Shoulders Gestures: Exploring User-Defined Gestures with Upper Body. In Design, User Experience, and Usability. User Experience in Advanced Technological Environments (Lecture Notes in Computer Science), Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, 192--213.

[111]

Radu-Daniel Vatavu. 2012. User-defined Gestures for Free-hand TV Control (EuroITV '12). ACM, New York, NY, USA, 45--48.

Digital Library

[112]

Radu-Daniel Vatavu. 2013. The Impact of Motion Dimensionality and Bit Cardinality on the Design of 3D Gesture Recognizers. International Journal of Human-Computer Studies 71, 4 (2013), 387--409.

Digital Library

[113]

Radu-Daniel Vatavu. 2019. The Dissimilarity-Consensus Approach to Agreement Analysis in Gesture Elicitation Studies. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 224:1--224:13. event-place: Glasgow, Scotland Uk.

Digital Library

[114]

Radu-Daniel Vatavu and Jacob O. Wobbrock. 2015. Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1325--1334.

Digital Library

[115]

Radu-Daniel Vatavu and Jacob O. Wobbrock. 2016. Between-Subjects Elicitation Studies: Formalization and Tool Support (CHI '16). ACM, New York, NY, USA, 3390--3402.

Digital Library

[116]

Radu-Daniel Vatavu and Ionut-Alexandru Zaiti. 2014. Leap Gestures for TV: Insights from an Elicitation Study (TVX '14). ACM, New York, NY, USA, 131--138.

Digital Library

[117]

Dong-Bach Vo, Eric Lecolinet, and Yves Guiard. 2014. Belly Gestures: Body Centric Gestures on the Abdomen. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 687--696.

Digital Library

[118]

Panagiotis Vogiatzidakis and Panayiotis Koutsabasis. 2018. Gesture Elicitation Studies for Mid-Air Interaction: A Review. Multimodal Technologies and Interaction 2, 4 (2018), 65--.

[119]

Panagiotis Vogiatzidakis and Panayiotis Koutsabasis. 2019. Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem. Informatics 6, 2 (June 2019), 23.

[120]

Päivi Majaranta. 2012. Enhanced Gaze Interaction Using Simple Head Gestures. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, New York, NY, USA, 705--710.

Digital Library

[121]

Markus L. Wittorf and Mikkel R. Jakobsen. 2016. Eliciting Mid-Air Gestures for Wall-Display Interaction (NordiCHI '16). ACM, New York, NY, USA, 3:1--3:4.

Digital Library

[122]

Jacob O. Wobbrock, Htet Htet Aung, Brandon Rothrock, and Brad A. Myers. 2005. Maximizing the Guessability of Symbolic Input. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1869--1872.

Digital Library

[123]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined Gestures for Surface Computing (CHI '09). ACM, New York, NY, USA, 1083--1092.

Digital Library

[124]

Jacob O. Wobbrock, Brad A. Myers, and John A. Kembel. 2003. EdgeWrite: A Stylus-based Text Entry Method Designed for High Accuracy and Stability of Motion. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST '03). ACM, New York, NY, USA, 61--70.

Digital Library

[125]

Huiyue Wu, Yu Wang, Jiayi Liu, Jiali Qiu, and Xiaolong (Luke) Zhang. 2019a. User-defined gesture interaction for in-vehicle information systems. Multimedia Tools and Applications (Aug. 2019).

[126]

Huiyue Wu, Liuqingqing Yang, Shengqian Fu, and Xiaolong (Luke) Zhang. 2019b. Beyond remote control: Exploring natural gesture inputs for smart TV systems. Journal of Ambient Intelligence and Smart Environments 11, 4 (Jan. 2019), 335--354.

Digital Library

[127]

Ying Yin and Randall Davis. 2013. Gesture Spotting and Recognition Using Salience Detection and Concatenated Hidden Markov Models. In Proceedings of the 15th ACM on International Conference on Multimodal Interaction (ICMI '13). ACM, New York, NY, USA, 489--494.

Digital Library

[128]

Ionu¸t-Alexandru Zai¸ti, ¸ Stefan-Gheorghe Pentiuc, and Radu-Daniel Vatavu. 2015. On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Personal and Ubiquitous Computing 19, 5--6 (Aug. 2015), 821--838.

[129]

Xiaojie Zha and Marie-Luce Bourguet. 2016. Experimental Study to Elicit Effective Multimodal Behaviour in Pedagogical Agents (DAA '16). ACM, New York, NY, USA, 1:1--1:6.

Digital Library

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Anastasiou DCoppens AMaquil V(2024)Gesture combinations during collaborative decision-making at wall displaysi-com10.1515/icom-2023-003723:1(57-69)Online publication date: 25-Mar-2024
https://doi.org/10.1515/icom-2023-0037
Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Show More Cited By

Index Terms

A Systematic Review of Gesture Elicitation Studies: What Can We Learn from 216 Studies?
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input
  2. Interaction design
    1. Empirical studies in interaction design
    2. Interaction design process and methods
      1. Participatory design
      2. User interface design

Recommendations

Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies
How do we determine highly effective and intuitive gesture sets for interactive systems tailored to end users’ preferences? A substantial body of knowledge is available on this topic, among which gesture elicitation studies stand out distinctively. In ...
Guidelines for snowballing in systematic literature studies and a replication in software engineering
EASE '14: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering

Background: Systematic literature studies have become common in software engineering, and hence it is important to understand how to conduct them efficiently and reliably.

Objective: This paper presents guidelines for conducting literature reviews using ...
A systematic literature review on vision based gesture recognition techniques

Human Computer Interaction (HCI) technologies are rapidly evolving the way we interact with computing devices and adapting to the constantly increasing demands of modern paradigms. One of the most useful tools in this regard is the integration of Human-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

July 2020

2264 pages

ISBN:9781450369749

DOI:10.1145/3357236

General Chairs:
Ron Wakkary
Simon Fraser University, CA and Eindhoven University of Technology, NL
,
Kristina Andersen
Eindhoven University of Technology, NL
,
Program Chairs:
Will Odom
Simon Fraser University, CA
,
Audrey Desjardins
University of Washington, USA
,
Marianne Graves Petersen
Aarhus University, DK

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Région Wallonne - MecaTech

Conference

DIS '20

Sponsor:

SIGCHI

DIS '20: Designing Interactive Systems Conference 2020

July 6 - 10, 2020

Eindhoven, Netherlands

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

113
Total Citations
View Citations
2,178
Total Downloads

Downloads (Last 12 months)483
Downloads (Last 6 weeks)46

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Anastasiou DCoppens AMaquil V(2024)Gesture combinations during collaborative decision-making at wall displaysi-com10.1515/icom-2023-003723:1(57-69)Online publication date: 25-Mar-2024
https://doi.org/10.1515/icom-2023-0037
Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Law YMendieta-Dávila HGarcía-Fallas DGonzález-Quirós RChacón-Rivas M(2024)User-Defined Interaction for Very Low-Cost Head-Mounted DisplaysCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3690157(1-5)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3690157
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Wang NZielasko DMaurer F(2024)User Preferences for Interactive 3D Object Transitions in Cross Reality - An Elicitation StudyProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656698(1-9)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656698
Suzuki SAmesaka TWatanabe HShizuki BSugiura Y(2024)EarHover: Mid-Air Gesture Recognition for Hearables Using Sound Leakage SignalsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676367(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676367
Aghel Manesh SZhang TOnishi YHara KBateman SLi JTang A(2024)How People Prompt Generative AI to Create Interactive VR ScenesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661547(2319-2340)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661547
Wu LLafreniere BGrossman TWhite TSantosa S(2024)Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User InterfacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660691(133-150)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660691
Bhaumik RMwaita KSolaroli FAhmed ADe Angeli AHaller M(2024)Interaction with a 3D Surface for an Innovative Input Experience on a Central ConsoleProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675707(136-148)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675707
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten