Article

From a Typology of Gestures to a Procedure for Gesture Production

Author:

Isabella PoggiAuthors Info & Claims

GW '01: Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction

Pages 158 - 168

Published: 18 April 2001 Publication History

Abstract

A typology of gesture is presented based on four parameters: whether the gesture necessarily occurs with the verbal signal or not, whether it is represented in memory or created anew, how arbitrary or motivated it is, and what type of meaning it conveys. According to the second parameter, gestures are distinguished into codified gestures, ones represented in memory, and creative gestures, ones created on the spot by applying a set of generative rules. On the basis of this typology, a procedure is presented to generate the different types of gestures in a Multimodal Embodied Agent.

References

[1]

Kendon, A.: Some relationships between body motion and speech. In: Siegman, A., Pope, B. (eds.): Studies in dyadic communication. Pergamon Press, New York (1972).

[2]

Ekman, P., Friesen, W.: The repertoire of nonverbal Behavior. Semiotica 1 (1969) 49-98.

[3]

Mc Neill, D.: Hand and Mind. Chicago University Press, Chicago (1992).

[4]

Magno Caldognetto, E., Poggi, I.: Creative iconic gestures. In: Simone, R. (ed.): Iconicity in Language. John Benjamins, Amsterdam (1995).

[5]

Poggi, I.: Mind Markers. In: Rector, M., Poggi, I., Trigo, N. (eds.): Gestures, Meaning and Use. Universidad Fernando Pessoa, Porto (2002).

[6]

Mueller, C.: Conventional Gestures in Speech Pauses. In: Mueller,C., Posner, R. (eds.): The Semantics and Pragmatics of everyday Gestures. Berlin Verlag Arno Spitz, Berlin (2001).

[7]

Poggi, I., Magno Caldognetto, E.: Mani che parlano. Gesti e psicologia della comunicazione. Padova, Unipress (1997).

[8]

Kendon, A.:. Gestures as Illocutionary and Discourse Markers in Southern Italian Conversation. Journal of Pragmatics 23 (1995) 247-279.

[9]

Antinucci, F.: I presupposti teorici della linguistica di Franz Bopp. In: Vignuzzi, U., Ruggiero, G., Simone, R. (eds.): Teoria e Storia degli studi linguistici. Bulzoni, Roma (1975).

[10]

Yan, H.: Paired speech and gesture generation in embodied conversational agents. Master dissertation, MIT, Cambridge, Mass., 2000.

[11]

Cassell, J., Stone, M., Yan, H.: Coordination and context-dependence in the generation of embodied conversation. INLG 2000, Mitzpe Ramon, Israel, 2000.

[12]

Poggi, I., Pelachaud, C.: Performative Facial Expressions in Animated Faces. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge, Mass. (2000).

[13]

Pelachaud, C., Poggi, I. (eds.): Multimodal Communication and Context in Embodied Agents. 5th International Conference on Autonomous Agents. Montreal, Canada, May 29, 2001.

[14]

Sowa, T., Wachsmuth, I.: Coverbal iconic gestures for object descriptions in virtual environments: an empirical study. In: Rector, M., Poggi, I., Trigo, N. (eds.): Gestures, Meaning and Use. Universidad Fernando Pessoa, Porto (2001).

[15]

Lester, J., Stuart, S. Callaway, C, Voerman, J., Fitzgerald, P.: Deictic ad emotive communication in animated pedagogical agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge, Mass (2000).

[16]

Pelachaud, C., Hartmann, B., Poggi, I.: Gesture in a Conversational Agent. In prep.

Cited By

Grandhi SJoue GMittelberg I(2012)To move or to remove?Proceedings of the Designing Interactive Systems Conference10.1145/2317956.2318044(582-591)Online publication date: 11-Jun-2012
https://dl.acm.org/doi/10.1145/2317956.2318044
Bodiroža SStern HEdan YYanco HSteinfeld AEvers VJenkins O(2012)Dynamic gesture vocabulary design for intuitive human-robot dialogProceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction10.1145/2157689.2157710(111-112)Online publication date: 5-Mar-2012
https://dl.acm.org/doi/10.1145/2157689.2157710
Wright MLin CO'Neill ECosker DJohnson P(2011)3D gesture recognitionProceedings of the 9th international conference on Pervasive computing10.5555/2021975.2022002(294-313)Online publication date: 12-Jun-2011
https://dl.acm.org/doi/10.5555/2021975.2022002
Show More Cited By

Recommendations

Eye-based head gestures
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

A novel method for video-based head gesture recognition using eye information by an eye tracker has been proposed. The method uses a combination of gaze and eye movement to infer head gestures. Compared to other gesture-based methods a major advantage ...
Recognizing gaze aversion gestures in embodied conversational discourse
ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Eye gaze offers several key cues regarding conversational discourse during face-to-face interaction between people. While a large body of research results exist to document the use of gaze in human-to-human interaction, and in animating realistic ...
The Effect of Static and Dynamic Gesture Presentation on the Recognition of Two Manipulation Gestures
Human-Computer Interaction. Interaction Technologies
Abstract
Gesture is an important means of nonverbal communication and used in conveying messages before the advent of language. With the development of computer technology, gesture interaction has become a trend of natural and harmonious human-computer ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

GW '01: Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction

April 2001

323 pages

ISBN:3540436782

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 18 April 2001

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Grandhi SJoue GMittelberg I(2012)To move or to remove?Proceedings of the Designing Interactive Systems Conference10.1145/2317956.2318044(582-591)Online publication date: 11-Jun-2012
https://dl.acm.org/doi/10.1145/2317956.2318044
Bodiroža SStern HEdan YYanco HSteinfeld AEvers VJenkins O(2012)Dynamic gesture vocabulary design for intuitive human-robot dialogProceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction10.1145/2157689.2157710(111-112)Online publication date: 5-Mar-2012
https://dl.acm.org/doi/10.1145/2157689.2157710
Wright MLin CO'Neill ECosker DJohnson P(2011)3D gesture recognitionProceedings of the 9th international conference on Pervasive computing10.5555/2021975.2022002(294-313)Online publication date: 12-Jun-2011
https://dl.acm.org/doi/10.5555/2021975.2022002
Wobbrock JMorris MWilson AOlsen DArthur RHinckley KMorris MHudson SGreenberg S(2009)User-defined gestures for surface computingProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1518701.1518866(1083-1092)Online publication date: 4-Apr-2009
https://dl.acm.org/doi/10.1145/1518701.1518866

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents