Article

Free access

The SAMMIE system: multimodal in-car dialogue

Authors:

Ciprian Gerstenberger, and

Ivana Kruijff-KorbayováAuthors Info & Claims

COLING-ACL '06: Proceedings of the COLING/ACL on Interactive presentation sessions

July 2006

Pages 57 - 60

https://doi.org/10.3115/1225403.1225418

Published: 17 July 2006 Publication History

PDF eReader

Abstract

The SAMMIE system is an in-car multi-modal dialogue system for an MP3 application. It is used as a testing environment for our research in natural, intuitive mixed-initiative interaction, with particular emphasis on multimodal output planning and realization aimed to produce output adapted to the context, including the driver's attention state w.r.t. the primary driving task.

References

[1]

{Alexandersson and Becker2001} J. Alexandersson and T. Becker. 2001. Overlay as the basic operation for discourse processing in a multimodal dialogue system. In Proceedings of the 2nd IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Seattle, Washington, August.

Google Scholar

[2]

{Baldridge and Kruijff2003} J. M. Baldridge and G. J. M. Kruijff. 2003. Multi-Modal Combinatory Categorial Grammar. In Proceedings of the 10th Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL'03), Budapest, Hungary, April.

Digital Library

Google Scholar

[3]

{Blaylock and Allen2005} N. Blaylock and J. Allen. 2005. A collaborative problem-solving model of dialogue. In Laila Dybkjær and Wolfgang Minker, editors, Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue, pages 200--211, Lisbon, September 2--3.

Google Scholar

[4]

{Bunt et al.2005} H. Bunt, M. Kipp, M. Maybury, and W. Wahlster. 2005. Fusion and coordination for multi-modal interactive information presentation: Roadmap, architecture, tools, semantics. In O. Stock and M. Zancanaro, editors, Multimodal Intelligent Information Presentation, volume 27 of Text, Speech and Language Technology, pages 325--340. Kluwer Academic.

Google Scholar

[5]

{Kruijff-Korbayová et al. 2005} I. Kruijff-Korbayová, T. Becker, N. Blaylock, C. Gerstenberger, M. Kaiβer, P. Poller, J. Schehl, and V. Rieser. 2005. An experiment setup for collecting data for adaptive output planning in a multimodal dialogue system. In Proc. of ENLG, pages 191--196.

Google Scholar

[6]

{Mattes2003} S. Mattes. 2003. The lane-change-task as a tool for driver distraction evaluation. In Proc. of IGfA.

Google Scholar

[7]

{Pfleger et al.2003} N. Pfleger, J. Alexandersson, and T. Becker. 2003. A robust and generic discourse model for multimodal dialogue. In Proceedings of the 3rd Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Acapulco.

Google Scholar

[8]

{Pfleger2004} N. Pfleger. 2004. Context based multimodal fusion. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 265--272, New York, NY, USA. ACM Press.

Digital Library

Google Scholar

[9]

{Traum and Larsson2003} David R. Traum and Staffan Larsson. 2003. The information state approach to dialog management. In Current and New Directions in Discourse and Dialog. Kluwer.

Google Scholar

Cited By

View all

Tchankue PVogts DWesson JKotzé Pvan der Merwe AGerber A(2010)Design and evaluation of a multimodal interface for in-car communication systemsProceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists10.1145/1899503.1899538(314-321)Online publication date: 11-Oct-2010
https://dl.acm.org/doi/10.1145/1899503.1899538
Zukerman IYe PGupta KMakalic EHealey PPieraccini RByron DYoung S(2009)Towards the interpretation of utterance sequences in a dialogue systemProceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue10.5555/1708376.1708383(46-53)Online publication date: 11-Sep-2009
https://dl.acm.org/doi/10.5555/1708376.1708383

The SAMMIE system: multimodal in-car dialogue
1. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Generation of output style variation in the SAMMIE dialogue system
INLG '08: Proceedings of the Fifth International Natural Language Generation Conference

A dialogue system can present itself and/or address the user as an active agent by means of linguistic constructions in personal style, or suppress agentivity by using impersonal style. We describe how we generate and control personal and impersonal ...
Read More
The SAMMIE multimodal dialogue corpus meets the nite XML toolkit
NLPXML '06: Proceedings of the 5th Workshop on NLP and XML: Multi-Dimensional Markup in Natural Language Processing

We demonstrate work in progress using the Nite XML Toolkit on a corpus of multimodal dialogues with an MP3 player collected in a Wizard-of-Oz (WOZ) experiments and annotated with a rich feature set at several layers. We designed an NXT data model, ...
Read More
The GAZE groupware system: mediating joint attention in multiparty communication and collaboration
CHI '99: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

In this paper, we discuss why, in designing multiparty mediated systems, we should focus first on providing non-verbal cues which are less redundantly coded in speech than those normally conveyed by video. We show how conveying one such cue, gaze direction,...
Read More

Comments

Information & Contributors

Information

Published In

COLING-ACL '06: Proceedings of the COLING/ACL on Interactive presentation sessions

July 2006

90 pages

Conference Chair:
James Curran
University of Sydney

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 17 July 2006

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 1,537 of 1,537 submissions, 100%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
352
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)6

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tchankue PVogts DWesson JKotzé Pvan der Merwe AGerber A(2010)Design and evaluation of a multimodal interface for in-car communication systemsProceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists10.1145/1899503.1899538(314-321)Online publication date: 11-Oct-2010
https://dl.acm.org/doi/10.1145/1899503.1899538
Zukerman IYe PGupta KMakalic EHealey PPieraccini RByron DYoung S(2009)Towards the interpretation of utterance sequences in a dialogue systemProceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue10.5555/1708376.1708383(46-53)Online publication date: 11-Sep-2009
https://dl.acm.org/doi/10.5555/1708376.1708383

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations

Generation of output style variation in the SAMMIE dialogue system

The SAMMIE multimodal dialogue corpus meets the nite XML toolkit

The GAZE groupware system: mediating joint attention in multiparty communication and collaboration

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations