Abstract
SmartKom is a multi-modal dialogue system which combines speech with gesture and facial expression. In this paper, we want to deal with one of those phenomena which can be observed in such elaborated systems that we want to call ‘offtalk’, i.e., speech that is not directed to the system (speaking to oneself, speaking aside). We report the classification results of first experiments which use a large prosodic feature vector in combination with part-of-speech information.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
J. Alexandersson, B. Buschbeck-Wolf, T. Fujinami, M. Kipp, S. Koch, E. Maier, N. Reithinger, B. Schmitz, and M. Siegel. Dialogue Acts in VERBMOBIL2 — Second Edition. Verbmobil Report 226, Juli 1998.
A. Batliner, A. Buckow, H. Niemann, E. Nöth, and V. Warnke. The Prosody Module. In W. Wahlster, editor, Verbmobil: Foundations of Speech-to-Speech Translations, pages 106–121. Springer, Berlin, 2000.
A. Batliner, J. Buckow, R. Huber, V. Warnke, E. Nöth, and H. Niemann. Prosodic Feature Evaluation: Brute Force or Well Designed? In Proc. 14th Int. Congress of Phonetic Sciences, volume 3, pages 2315–2318, San Francisco, August 1999.
A. Batliner, J. Buckow, R. Huber, V. Warnke, E. Nöth, and H. Niemann. Boiling down Prosody for the Classification of Boundaries and Accents in German and English. In Proc. European Conf. on Speech Communication and Technology, volume 4, pages 2781–2784, Aalborg, September 2001.
A. Batliner, M. Nutt, V. Warnke, E. Nöth, J. Buckow, R. Huber, and H. Niemann. Automatic Annotation and Classification of Phrase Accents in Spontaneous Speech. In Proc. European Conf. on Speech Communication and Technology, volume 1, pages 519–522, Budapest, September 1999.
J. Carletta, N. Dahlbäck, N. Reithinger, and M. Walker. Standards for Dialogue Coding in Natural Language Processing. Dagstuhl-Seminar-Report 167, 1997.
N.M. Fraser and G.N. Gilbert. Simulating Speech Systems. Computer Speech & Language, 5(1):81–99, 1991.
W.R. Klecka. Discriminant Analysis. SAGE PUBLICATIONS Inc., Beverly Hills, 9 edition, 1988.
E. Nöth, A. Batliner, V. Warnke, J. Haas, M. Boros, J. Buckow, R. Huber, F. Gallwitz, M. Nutt, and H. Niemann. On the Use of Prosody in Automatic Dialogue Understanding. Speech Communication, 36(1–2), January 2002.
D. Oppermann, F. Schiel, S. Steininger, and N. Behringer. Off-Talk — a Problem for Human-Machine-Interaction? In Proc. European Conf. on Speech Communication and Technology, volume 3, pages 2197–2200, Aalborg, September 2001.
R. Siepmann, A. Batliner, and D. Oppermann. Using Prosodic Features to Characterize Off-Talk in Human-Computer-Interaction. In Proc. of the Workshop on Prosody and Speech Recognition 2001, 2001, pages 147–150, Red Bank, October 2001.
J. Spilker, A. Batliner, and E. Nöth. How to Repair Speech Repairs in an End-to-End System. In R. Lickley and L. Shriberg, editors, Proc. ISCA Workshop on Disflueny in Spontaneous Speech, pages 73–76, Edinburgh, September 2001.
W. Wahlster, N. Reithinger, and A. Blocher. SmartKom: Multimodal Communication with a Lifelike Character. In Proc. European Conf. on Speech Communication and Technology, volume 3, pages 1547–1550, Aalborg, September 2001.
P. Watzlawick, J.H. Beavin, and Don D. Jackson. Pragmatics of Human Communications. W.W. Norton & Company, New York, 1967.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Batliner, A., Zeißler, V., Nöth, E., Niemann, H. (2002). Prosodic Classification of Offtalk: First Experiments. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2002. Lecture Notes in Computer Science(), vol 2448. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46154-X_51
Download citation
DOI: https://doi.org/10.1007/3-540-46154-X_51
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44129-8
Online ISBN: 978-3-540-46154-8
eBook Packages: Springer Book Archive