technical-note

Gesture-based interaction design: communication and cognition

Authors:

Mary Lou Maher,

Barbara Tversky,

Andreea Danielescu,

Kazjon GraceAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 61 - 64

https://doi.org/10.1145/2559206.2559220

Published: 26 April 2014 Publication History

Abstract

This workshop explores and identifies the cognitive issues fundamental to the design of gestural interactive systems. To achieve this, a dialogue will be facilitated among researchers in the cognitive science of gesture and gestural interaction within the HCI community. During the workshop we will discuss the different methodologies and results within the study of gestural interaction, with a focus on how the use of bodily movement in an interface affects the cognition of users, groups, communities and societies. We invite participants from cognitive science, HCI, user experience design, educational technology and interactive installation art to present their work on gestural interfaces and discuss how that work has been observed to impact user perceptual or cognitive faculties. The workshop's material outcomes include a book on gestural interaction and cognition, while the research outcomes include methodologies, heuristics, design principles and hypotheses for the further design and investigation of gestural and tangible technologies.

References

[1]

Bos. A. and Cienki, A. Inhibiting gesture reduces the amount of spatial metaphors in speech. In Gesture and Speech in Interaction, 2011.

[2]

Clausner, T.C. How conceptual metaphors are productive of spatial-graphical expressions. In W. D. Gray & C. D. Schunn (Eds.). Proceedings of the 24th Annual Conference of the Cognitive Science Society. (pp. 208--213). Mahwah, NJ: Erlbaum. 2002

[3]

Clausner, T.C., Palmer, E., Brown, C., Bates, C. and Kellman, P.J. Conceptualization of perceptual cues guided by metaphor, perception, and imagined perspective. Psychonomic Society: 50th Annual Meeting, 14, 102. Boston, MA. 2009

[4]

Goldin-Meadow, S. and Beilock, S. Action's influence on thought: The case of gesture. Perspectives on Psychological Science, 5(6):664--674, 2010.

[5]

Goldin-Meadow, S., Cook, S., and Mitchell, Z. Gesturing gives children new ideas about math. Psychological Science, 20(3):267--272, 2009.

[6]

S. Hunter, J. Kalanithi, and D. Merrill. 2010. Make a Riddle and TeleStory: designing children's applications for the siftables platform. In Proceedings of the 9th International Conference on Interaction Design and Children (IDC '10).

Digital Library

[7]

Jamalian, A., Giardino, V., and Tversky, B., Gestures for thinking. In M. Knauff, M. Pauen, N. Sabaenz, and I. Wachsmuth (Editors) Proceedings of the 35th Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive Science Society, 2013.

[8]

Jamalian, A. and Tversky, B. Gestures alter thinking about time. In N. Miyake, D. Peebles, & R. P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society,. Austin TX: Cognitive Science Society. IES Prize for Excellence in Research on Cognition and Student Learning, Pp. 551--557, 2012.

[9]

Kang, S., Tversky, B., and Black, J.B. From hands to minds: How gestures promote action understanding. . In N. Miyake, D. Peebles, & R. P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society, Pp. 551--557. Austin TX: Cognitive Science Society, 2012.

[10]

Kessell, A. and Tversky, B. Using diagrams and gestures to think and talk about insight problems. In Proceedings of the Meeting of the Cognitive Science Society, 2006.

[11]

Kim, M., and Maher, M. The impact of tangible user interfaces on designers' spatial cognition. Human-Computer Interaction, 23(2):101--137, 2008.

[12]

Kirsh, D. and Maglio, P. On distinguishing epistemic from pragmatic action. Cognitive science, 18(4):513--549, 1994.

[13]

Palmer, E.M., Brown, C.M., Bates, C.F., Kellman, P.J. and Clausner, T.C. Perceptual affordances and imagined viewpoints modulate visual search in air traffic control displays. Proceedings of the 53rd Annual Meeting of the Human Factors and Ergonomics Society. 53(17), 1111--1115, 2009

[14]

Visser, W. and Maher, M.L. Guest Editor of Special Issue: The role of gesture in designing, in Artificial Intelligence for Engineering Design, Analysis and Manufacturing, 25(3), 2011.

[15]

J. Ruiz, Y. Li, and E. Lank. 2011. User-defined motion gestures for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 197--206.

Digital Library

[16]

Wobbrock, J.O., Morris, M.R., and Wilson, A.D. User defined gestures for surface computing. Proceedings of CHI '09, (2009), 1083.

Digital Library

[17]

R. Maldonado, Y. Dimitriadis, K. Y. J. Kay, and M.T. Edbauer. Orchestrating a multi-tabletop classroom: from activity design to enactment and reflection. In Proceedings of ITS'2012 Interactive tabletops and Surfaces, page 119--128. ACM, 2012.

Digital Library

[18]

Spicer, R., Danielescu, A., Kelliher, A. and Tinapple, D. (2011). Responsive Spaces: Motion, Activity and Interactive Art. In proceedings of the ISEA 2011 Istanbul Conference. Istanbul, Turkey.

Cited By

Wan Husain WWan Shamsuddin SRahim N(2022)A Conceptual Framework for Road Safety Education using Serious Games with a Gesture-based Interaction ApproachPertanika Journal of Science and Technology10.47836/pjst.30.1.3430:1(621-640)Online publication date: 10-Jan-2022
https://doi.org/10.47836/pjst.30.1.34
Ardito CCostabile MJetter H(2018)Gestures that people can understand and useJournal of Visual Languages and Computing10.1016/j.jvlc.2014.07.00225:5(572-576)Online publication date: 25-Dec-2018
https://dl.acm.org/doi/10.1016/j.jvlc.2014.07.002
Maher MLee LGero JYu RClausner T(2017)Characterizing Tangible Interaction During a Creative Combination TaskDesign Computing and Cognition '1610.1007/978-3-319-44989-0_3(39-58)Online publication date: 3-Jan-2017
https://doi.org/10.1007/978-3-319-44989-0_3
Show More Cited By

Index Terms

Gesture-based interaction design: communication and cognition
1. Human-centered computing

Recommendations

A study of hand shape use in tabletop gesture interaction
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

Although manual gesture has long been suggested as an intuitive method of input for horizontal human-computer systems, little research has been conducted into observing user preferences for tabletop gesture interaction. This is particularly the case for ...
Human-Computer Interaction Design in Product Design
ETCS '09: Proceedings of the 2009 First International Workshop on Education Technology and Computer Science - Volume 02

The text from three aspects—a brief summary of the development of Human-Computer Interaction describes of the Human-Computer Interaction is an interaction between people and a machine with a computer, and Man-machine interface is the form and method to ...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Technical-note

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
643
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wan Husain WWan Shamsuddin SRahim N(2022)A Conceptual Framework for Road Safety Education using Serious Games with a Gesture-based Interaction ApproachPertanika Journal of Science and Technology10.47836/pjst.30.1.3430:1(621-640)Online publication date: 10-Jan-2022
https://doi.org/10.47836/pjst.30.1.34
Ardito CCostabile MJetter H(2018)Gestures that people can understand and useJournal of Visual Languages and Computing10.1016/j.jvlc.2014.07.00225:5(572-576)Online publication date: 25-Dec-2018
https://dl.acm.org/doi/10.1016/j.jvlc.2014.07.002
Maher MLee LGero JYu RClausner T(2017)Characterizing Tangible Interaction During a Creative Combination TaskDesign Computing and Cognition '1610.1007/978-3-319-44989-0_3(39-58)Online publication date: 3-Jan-2017
https://doi.org/10.1007/978-3-319-44989-0_3
Mahzoon MMaher MGrace KLocurto LOutcault B(2016)The Willful MarionetteProceedings, Part II, of the 10th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - Volume 974410.1007/978-3-319-39952-2_39(402-413)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39952-2_39

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents