research-article

Gesture Elicitation Study on How to Opt-in & Opt-out from Interactions with Public Displays

Authors:

Isabel Benavente Rodriguez,

Nicolai MarquardtAuthors Info & Claims

ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

Pages 32 - 41

https://doi.org/10.1145/3132272.3134118

Published: 17 October 2017 Publication History

Abstract

Public interactive displays with gesture-recognizing cameras enable new forms of interactions. However, often such systems do not yet allow passers-by a choice to engage voluntarily or disengage from an interaction. To address this issue, this paper explores how people could use different kinds of gestures or voice commands to explicitly opt-in or opt-out of interactions with public installations. We report the results of a gesture elicitation study with 16 participants, generating gestures within five gesture-types for both a commercial and entertainment scenario. We present a categorization and themes of the 430 proposed gestures, and agreement scores showing higher consensus for torso gestures and for opting-out with face/head. Furthermore, patterns indicate that participants often chose non-verbal representations of opposing pairs such as 'close and open' when proposing gestures. Quantitative results showed overall preference for hand and arm gestures, and generally a higher acceptance for gestural interaction in the entertainment setting.

References

[1]

Akpan, I. et al. 2013. Exploring the effects of space and place on engagement with an interactive installation. Proc. of CHI '13. ACM.

Digital Library

[2]

Alexander, J. et al. 2012. Putting your best foot forward: investigating real-world mappings for foot-based gestures. Proc. of CHI '12. ACM.

Digital Library

[3]

Archer, D. 1997. Unspoken diversity: Cultural differences in gestures. Qualitative Sociology. 20, 1.

[4]

Bellotti, V. et al. 2002. Making sense of sensing systems: five questions for designers and researchers. Proc. of CHI '02. ACM.

Digital Library

[5]

Boring, S. et al. 2014. The Dark Patterns of Proxemic Sensing. Computer. 47, 8, 56--60.

Digital Library

[6]

Brignull, H. and Rogers, Y. 2003. Enticing people to interact with large public displays in public spaces. Proc. of Interact '13.

[7]

Chan, E. et al. 2016. User Elicitation on Single-hand Microgestures. Proc. of CHI '16. ACM.

Digital Library

[8]

Chong, M.K. and Gellersen, H. 2011. How users associate wireless devices. Proc. of CHI '11. ACM.

Digital Library

[9]

Connell, S. et al. 2013. A Wizard-of-Oz elicitation study examining child-defined gestures with a whole-body interface. Proc. of IDC '13. ACM.

Digital Library

[10]

Dalton, N.S. et al. 2015. Display Blindness?: Looking Again at the Visibility of Situated Displays using Eye-tracking. Proc. of CHI '15. ACM.

Digital Library

[11]

Fischer, P.T. and Hornecker, E. 2012. Urban HCI: spatial aspects in the design of shared encounters for media facades. Proc. of CHI '12. ACM.

Digital Library

[12]

Gatto, I. and Pittarello, F. 2012. Prototyping a gestural interface for selecting and buying goods in a public environment. Proc. of AVI '12. ACM.

Digital Library

[13]

Graham, J.A. and Argyle, M. 1975. A cross-cultural study of the communication of extra-verbal meaning by gestures (1). Int. Journal of Psyc. 10, 1, 57--67.

[14]

Greenberg, S. et al. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. DIS '14. ACM.

Digital Library

[15]

Harrison, S. and Dourish, P. 1996. Re-place-ing space: the roles of place and space in collaborative systems. Proc. of CSCW '96. ACM.

Digital Library

[16]

Holmes, T.G. 2007. Eco-visualization: combining art and technology to reduce energy consumption. Proc. of C&C '07. ACM.

Digital Library

[17]

Huang, E.M. et al. 2008. Overcoming assumptions and uncovering practices: When does the public really look at public displays? Proc. of Pervasive '08. Springer.

[18]

Ju, W. et al. 2008. Range: exploring implicit interaction through electronic whiteboard design. Proc. of CSCW '08. ACM.

Digital Library

[19]

Kinect for Windows. http://www.microsoft.com/enus/kinectforwindows/develop/.

[20]

Kinect for Windows Retail Clothing Scenario Video: https://www.youtube.com/watch?v=Mr71jrkzWq8.

[21]

Kinect-Powered Cube Unveiled at Decibel Festival: https://www.youtube.com/watch?v=1jzHcXZFJMw.

[22]

Krogh, P. et al. 2004. "Help Me Pull That Cursor" A Collaborative Interactive Floor Enhancing Community Interaction. Australasian Journal of Inf. Systems. 11, 2.

[23]

Mäkelä, V. et al. 2014. Information wall: evaluation of a gesture-controlled public display. Mobiquitous '14.

[24]

Mauney, D. et al. 2010. Cultural similarities and differences in user-defined gestures for touchscreen user interfaces. Proc. of CHI EA '10. ACM.

Digital Library

[25]

Morris, M.R. et al. 2014. Reducing legacy bias in gesture elicitation studies. interactions. 21, 3, 40--45.

[26]

Morris, M.R. 2012. Web on the wall: insights from a multimodal interaction elicitation study. ITS '12.

Digital Library

[27]

Müller, J. et al. 2009. Display blindness: The effect of expectations on attention towards digital signage. Proc. of Pervasive '09. Springer.

[28]

Müller, J. et al. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. CHI '12.

[29]

O'Hara, K. et al. 2008. Understanding collective play in an urban screen game. Proc. of CSCW '08. ACM.

Digital Library

[30]

Perry, M. et al. 2010. WaveWindow: public, performative gestural interaction. Proc. of ITS '10. ACM.

Digital Library

[31]

Preece, J. et al. 2015. Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons.

[32]

Seyed, T. et al. 2012. Eliciting Usable Gestures for Multi-display Environments. Proc. of ITS '12. ACM.

Digital Library

[33]

Vatavu, R.-D. and Wobbrock, J.O. 2015. Formalizing agreement analysis for elicitation studies: new measures, significance test, and toolkit. CHI '15.

[34]

Vatavu, R.-D. and Zaiti, I.-A. 2014. Leap gestures for TV: insights from an elicitation study. TVX '14. ACM.

Digital Library

[35]

Verma, S. et al. 2015. A Study for Investigating Suitable Gesture Based Selection for Gestural User Interfaces. Proc. of IndiaHCI '15. ACM.

[36]

Vermeulen, J. et al. 2015. Proxemic Flow: Dynamic Peripheral Floor Visualizations for Revealing and Mediating Large Surface Interactions. INTERACT 2015.

[37]

Vogel, D. and Balakrishnan, R. 2004. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. Proc. of UIST '04. ACM.

Digital Library

[38]

Walter, R. et al. 2013. StrikeAPose: revealing mid-air gestures on public displays. Proc. of CHI '13. ACM.

Digital Library

[39]

Wang, M. et al. 2012. A Public Advertising Display that Captures and Preserves the Attention of a Passerby. Proc. of PerDis '12. ACM.

Digital Library

[40]

Wobbrock, J.O. et al. 2005. Maximizing the guessability of symbolic input. Proc. of CHI EA '05. ACM.

Digital Library

[41]

Wobbrock, J.O. et al. 2009. User-defined gestures for surface computing. Proc. of CHI '09. ACM.

Digital Library

Cited By

Tanaka KOkafuji YIwamoto T(2024)Popping-Up Poster: A Pin-Based Promotional Poster Device for Engaging Customers through Physical Shape TransformationProceedings of the ACM on Human-Computer Interaction10.1145/36981388:ISS(283-300)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698138
Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Hosseini MMueller HBoll S(2024)Controlling the Rooms: How People Prefer Using Gestures to Control Their Smart HomesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642687(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642687
Show More Cited By

Index Terms

Gesture Elicitation Study on How to Opt-in & Opt-out from Interactions with Public Displays
1. Human-centered computing

Recommendations

Leap gestures for TV: insights from an elicitation study
TVX '14: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

We present insights from a gesture elicitation study in the context of interacting with TV, during which 18 participants contributed and rated the execution difficulty and recall likeliness of free-hand gestures for 21 distinct TV tasks. Our study ...
User gesture elicitation of common smartphone tasks for hand proximate user interfaces
AH '20: Proceedings of the 11th Augmented Human International Conference

The ubiquity of smartphone interactions along with the advancements made in mixed reality applications and gesture recognition present an intriguing space for novel interaction techniques using the hand as an interface. This paper explores the idea of ...
User-defined gesture interaction for in-vehicle information systems
Abstract
Gesture elicitation study, a technique emerging from the field of participatory design, has been extensively applied in emerging interaction and sensing technologies in recent years. However, traditional gesture elicitation study often suffers ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

October 2017

504 pages

ISBN:9781450346917

DOI:10.1145/3132272

General Chairs:
Sriram Subramanian
University of Sussex, UK
,
Jürgen Steimle
Saarland University, Germany
,
Program Chairs:
Raimund Dachselt
Technische Universität Dresden, Germany
,
Diego Martinez Plasencia
University of Sussex, UK
,
Tovi Grossman
Autodesk Research

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ISS '17

Sponsor:

SIGCHI

ISS '17: Interactive Surfaces and Spaces

October 17 - 20, 2017

Brighton, United Kingdom

Acceptance Rates

ISS '17 Paper Acceptance Rate 32 of 119 submissions, 27%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
586
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tanaka KOkafuji YIwamoto T(2024)Popping-Up Poster: A Pin-Based Promotional Poster Device for Engaging Customers through Physical Shape TransformationProceedings of the ACM on Human-Computer Interaction10.1145/36981388:ISS(283-300)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698138
Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Hosseini MMueller HBoll S(2024)Controlling the Rooms: How People Prefer Using Gestures to Control Their Smart HomesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642687(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642687
Xiao WLv XXue C(2023)Dynamic Visualization of VR Map Navigation Systems Supporting Gesture InteractionISPRS International Journal of Geo-Information10.3390/ijgi1203013312:3(133)Online publication date: 21-Mar-2023
https://doi.org/10.3390/ijgi12030133
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Ehtesham-Ul-Haque MBillah S(2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610898
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Okafuji YMitsui YMatsumura KBaba JNakanishi J(2023)Changes in Embarrassment Through Repeated Interactions with Robots in Public Spaces2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309409(2253-2258)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309409
Villarreal-Narvaez SPerez-Medina JVanderdonckt J(2023)Exploring user-defined gestures for lingual and palatal interactionJournal on Multimodal User Interfaces10.1007/s12193-023-00408-717:3(167-185)Online publication date: 10-Aug-2023
https://doi.org/10.1007/s12193-023-00408-7
Villarreal-Narvaez SSluÿters AVanderdonckt JMbaki Luzayisu E(2022)Theoretically-Defined vs. User-Defined Squeeze GesturesProceedings of the ACM on Human-Computer Interaction10.1145/35678056:ISS(73-102)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567805
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten