Abstract
The previous literature has suggested that the hand movement in co-speech gestures and signs consists of a series of phases with qualitatively different dynamic characteristics. In this paper, we propose a syntagmatic rule system for movement phases that applies to both co-speech gestures and signs. Descriptive criteria for the rule system were developed for the analysis video-recorded continuous production of signs and gesture. It involves segmenting a stream of body movement into phases and identifying different phase types. Two human coders used the criteria to analyze signs and cospeech gestures that are produced in natural discourse. It was found that the criteria yielded good inter-coder reliability. These criteria can be used for the technology of automatic recognition of signs and co-speech gestures in order to segment continuous production and identify the potentially meaningbearing phase.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
McNeill, D.: Hand and Mind. University of Chicago Press, Chicago (1992)
Kendon, A.: Some Relationships Between Body Motion and Speech. In: Siegman, A., Pope, B. (eds.): Studies in Dyadic Communication. Pergamon Press, New York (1972) 177–210
Kendon, A.: Gesticulation and speech: Two Aspects of the Process of Utterance. In: Key, M. R. (ed.): The Relation Between Verbal and Nonverbal Communication. Mouton, The Hague (1980) 207–227
Liddel, S.K., Johnson R.E.: American Sign Language — Compound Formation Processes, Lexicalization, and Phonological Remnants. Natural Language and Linguistic Theory. 4 (1986) 445–513
Sandler, W.: The Spreading Hand Autosegment of American Sign Language. Sign Language Studies 50 (1986) 1–28
Perlmutter, D.M: Sonority and Syllable Structure in American Sign Language. Linguistic Inquiry 23 (1992) 407–442.
Birdwhistell, R. L: Kinesics and Context. University of Pennsylvania Press, Philadelphia (1970)
Calbris, G.: The Semiotics of French Gesture. Indiana University Press, Bloomington (1990)
Kendon, A.: Gestures as Illocutionary and Discourse Structure Markers in Southern Italian Conversation. Journal of Pragmatics (1995) 23 247–279
Liddel, S.K.: THINK and BELIEVE: Sequentiality in American Sign Language. Language 60. 372–399 (1984)
Liddel, S.K. Structure for Representing Hand Shape and Local Movement at the Phonemic Level. In: Fischer, S., Siple, P. (ed.): Theoretical Issues in Sign Language Research, Vol.1. University of Chicago Press, Chicago (1990) 37–65
Dell, C.: A Primer for Movement Description: Using Effort-Shape and Supplementary Concepts. Dance Notation Bureau, New York (1970)
Kita, S.: The Temporal Relationship between Gesture and Speech: A Study of Japanese-English Bilinguals. Master’s thesis, University of Chicago (1990)
de Ruiter, J.: Production of Gesture and Speech. unpublished Ph.D. dissertation, University of Nijmegen (1998)
McNeill, D.: A Straight Path — To Where? Reply to Butterworth and Hadar. Psychological Review. 96 (1989) 175–179.
Duncan, S.: Grammatical Form and ‘Thinking-for-Speaking’ in Mandarin Chinese and English: An Analysis Based on Speech-accompanying Gesture. Unpublished Ph.D. dissertation, University of Chicago (1996)
McNeill, D., Levy, E.T., Pedelty, L.L.: Gesture and Speech. In: Hammond, G.R. (ed.): Advances in Psychology: Cerebral Control of Speech and Limb Movements. Elsevier/North Holland Publishers, Amsterdam (1992) 203–256
van der Hulst, H: On the Other Hand. Lingua. 98 (1996) 121–143
van Gijn, I.: Vormkarakteristieken van Gestures en Gebaren [Form Characteristics of Signs and Gestures]. Master’s thesis, Leiden University (1997)
van Gijn, I., Kita, S., van der Hulst H.: Symmetry Condition in Sign Language Phonology and Gesture.(in preparation)
Brugman, H., Kita., S.: Impact of Digital Video Technology on Transcription: a Case of Spontaneous Gesture Transcription. KODIKAS/CODE: Ars Semeiotica 18 (1995) 95–112
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Kita, S., van Gijn, I., van der Hulst, H. (1998). Movement phases in signs and co-speech gestures, and their transcription by human coders. In: Wachsmuth, I., Fröhlich, M. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 1997. Lecture Notes in Computer Science, vol 1371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052986
Download citation
DOI: https://doi.org/10.1007/BFb0052986
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64424-8
Online ISBN: 978-3-540-69782-4
eBook Packages: Springer Book Archive