research-article

Open access

Flipper 2.0: A Pragmatic Dialogue Engine for Embodied Conversational Agents

Authors:

Jelte van Waterschoot,

Merijn Bruijnes,

Dennis Reidsma,

Daniel Davison,

Mariët Theune,

Dirk HeylenAuthors Info & Claims

IVA '18: Proceedings of the 18th International Conference on Intelligent Virtual Agents

Pages 43 - 50

https://doi.org/10.1145/3267851.3267882

Published: 05 November 2018 Publication History

Abstract

We present anew dialogue engine called Flipper 2.0 (Flipper) which aims to help developers of embodied conversational agents (ECAs) to quickly and flexibly create dialogues. Flipper provides a technically stable and robust dialogue management system to integrate with other components of ECAs such as behaviour realisers. We compare Flipper with state-of-the-art dialogue design systems. We describe the details of our dialogue engine, how it handles dialogue management and how it supports the authoring of dialogues. We demonstrate the use of the dialogue engine with examples of design patterns and discuss practical applications. Finally we give recommendations on the cases in which it is beneficial to use Flipper.

References

[1]

Dan Bohus and Alexander I Rudnicky. 2003. RavenClaw: Dialog management using hierarchical task decomposition and an expectation agenda. In Eighth European Conference on Speech Communication and Technology.

[2]

Daniel Braun, Adrian Hernandez-Mendez, Florian Matthes, and Manfred Langen. 2017. Evaluating natural language understanding services for conversational question answering systems. In 18th Annual SIGdial Meeting on Discourse and Dialogue. 174--185.

[3]

Angelo Cafaro, Merijn Bruijnes, Jelte van Waterschoot, Catherine Pelachaud, Mariët Theune, and Dirk Heylen. 2017. Selecting and Expressing Communicative Functions in a SAIBA-Compliant Agent Framework. In Intelligent Virtual Agents. 73--82.

[4]

Massimo Canonico and Luigi De Russis. 2018. A comparison and critique of natural language understanding tools. In Cloud Computing 2018. 110--115.

[5]

Pauline Chevalier, Jamy Jue Li, Eloise Ainger, Alyssa M. Alcorn, Snezana Babovic, Vicky Charisi, Suncica Petrovic, Bob Rinse Schadenberg, Elizabeth Pellicano, and Vanessa Evers. 2017. Dialogue design for a robot-based face-mirroring game to engage autistic children with emotional expressions. In International Conference on Social Robotics. 546--555.

[6]

Adam Cheyer and David Martin. 2001. The Open Agent Architecture. Autonomous Agents and MultiAgent Systems 4, 1-2 (March 2001), 143--148.

Digital Library

[7]

Patrick Gebhard, Gregor Mehlmann, and Michael Kipp. 2012. Visual SceneMaker --- a tool for authoring interactive virtual characters. Journal on Multimodal User Interfaces 6, 1-2 (2012), 3--11.

[8]

Jim Gray and Andreas Reuter. 1992. Transaction processing: concepts and techniques. Elsevier.

Digital Library

[9]

Alexander Gruenstein, Ian McGraw, and Ibrahim Badr. 2008. The WAMI toolkit for developing, deploying, and evaluating web-accessible multimodal interfaces. In 10th International Conference on Multimodal Interfaces. 141--148.

Digital Library

[10]

Arno Hartholt, David Traum, Stacy C. Marsella, Ari Shapiro, Giota Stratou, Anton Leuski, Louis-Philippe Morency, and Jonathan Gratch. 2013. All together now: Introducing the Virtual Human Toolkit. In Intelligent Virtual Agents. 368--381.

[11]

Jan Kolkmeier, Merijn Bruijnes, Dennis Reidsma, and Dirk Heylen. 2017. An ASAP Realizer-Unity3D bridge for virtual and mixed reality applications. In Intelligent Virtual Agents. 227--230.

[12]

Staffan Larsson and David Traum. 2000. Information state and dialogue management in the TRINDI Dialogue Move Engine Toolkit. Natural Language Engineering 1, 1 (2000), 1--17.

Digital Library

[13]

Oliver Lemon, Lawrence Cavedon, and Barbara Kelly. 2003. Managing dialogue interaction: A multi-layered approach. In 4th Annual SIGdial Meeting on Discourse and Dialogue.

[14]

Anton Leuski and David Traum. 2011. NPCEditor: A tool for building question-answering characters. In International Conference on Language Resources and Evaluation (LREC). 2463--2470.

[15]

Pierre Lison. 2015. A hybrid approach to dialogue management based on probabilistic rules. Computer Speech and Language 34, 1 (2015), 232--255.

Digital Library

[16]

Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In ACL 2014, System Demonstrations. 55--60.

[17]

Vikram Ramanarayanan, David Suendermann-Oeft, Alexei V Ivanov, and Keelan Evanini. 2015. A distributed cloud-based dialog system for conversational application development. In 16th Annual SIGdial Meeting on Discourse and Dialogue. 432--434.

[18]

Dennis Reidsma, Vicky Charisi, Daniel Davison, Frances Wijnen, Jan van der Meij, Vanessa Evers, David Cameron, Samuel Fernando, Roger Moore, Tony Prescott, Daniele Mazzei, Michael Pieroni, Lorenzo Cominelli, Roberto Garofalo, Danilo De Rossi, Vasiliki Vouloutsi, Riccardo Zucca, Klaudia Grechuta, Maria Blancas, and Paul Verschure. 2016. The EASEL project: Towards educational human-robot symbiotic interaction. In Living Machines 2016: Biomimetic and Biohybrid Systems. 297--306.

[19]

Charles Rich and Candace L. Sidner. {n. d.}. Using collaborative discourse Theory to partially Automate dialogue tree authoring. In Intelligent Virtual Agents. 327--340.

Digital Library

[20]

Kerstin Ruhland, Christopher E Peters, Sean Andrist, Jeremy B Badler, Norman I Badler, Michael Gleicher, Bilge Mutlu, and Rachel McDonnell. 2015. A review of eye gaze in virtual agents, social robotics and HCI: Behaviour generation, user interaction and perception. In Computer Graphics Forum, Vol. 34. 299--326.

Digital Library

[21]

Gabriel Skantze and Samer Al Moubayed. 2012. IrisTK: a statechart-based toolkit for multi-party face-to-face interaction. In 14th International Conference on Multimodal Interaction. 69--76.

Digital Library

[22]

Mark Ter Maat and Dirk Heylen. 2011. Flipper: An information state component for spoken dialogue systems. In Intelligent Virtual Agents. 470--472.

Digital Library

[23]

Mariët Theune, Daan Wiltenburg, Max Bode, and Jeroen Linssen. 2017. R3D3 in the Wild: Using A Robot for Turn Management in Multi-Party Interaction with a Virtual Human. In IVA Workshop on Interaction with Agents and Robots: Different Embodiments, Common Challenges.

[24]

Stefan Ultes, Lina M. Rojas Barahona, Pei-Hao Su, David Vandyke, Dongho Kim, Iñigo Casanueva, Paweł Budzianowski, Nikola Mrkšić, Tsung-Hsien Wen, Milica Gasic, and Steve Young. 2017. PyDial: A multi-domain statistical dialogue system toolkit. In ACL 2017, System Demonstrations. 73--78.

[25]

Michel Valstar, Tobias Baur, Angelo Cafaro, Alexandru Ghitulescu, Blaise Potard, Johannes Wagner, Elisabeth André, Laurent Durieu, Matthew Aylett, Soumia Dermouche, et al. 2016. Ask Alice: an artificial retrieval of information agent. In 18th International Conference on Multimodal Interaction. 419--420.

Digital Library

[26]

Herwin van Welbergen, Ramin Yaghoubzadeh, and Stefan Kopp. 2014. AsapRealizer 2.0: The next steps in fluent behavior realization for ECAs. In Intelligent Virtual Agents. 449--462.

[27]

Hannes Vilhjálmsson, Nathan Cantelmo, Justine Cassell, Nicolas E Chafai, Michael Kipp, Stefan Kopp, Maurizio Mancini, Stacy Marsella, Andrew N Marshall, Catherine Pelachaud, et al. 2007. The behavior markup language: Recent developments and challenges. In Intelligent Virtual Agents. 99--111.

Digital Library

[28]

Jered Vroon, Cristina Zaga, Daniel Davison, Jan Kolkmeier, and Jeroen Linssen. 2017. Snoozle--A robotic pillow that helps you go to sleep: HRI 2017 Student Design Competition. In Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. 399--400.

Digital Library

Cited By

Woo JShidara KAchard CTanaka HNakamura SPelachaud C(2024)Adaptive virtual agent: Design and evaluation for real-time human-agent interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103321190(103321)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijhcs.2024.103321
Vázquez ALópez Zorrilla AOlaso JTorres M(2023)Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User StudySensors10.3390/s2303142323:3(1423)Online publication date: 27-Jan-2023
https://doi.org/10.3390/s23031423
Saga TWoo JGerard ATanaka HAchard CNakamura SPelachaud C(2023)An Adaptive Virtual Agent Platform for Automated Social Skills TrainingCompanion Publication of the 25th International Conference on Multimodal Interaction10.1145/3610661.3620662(109-111)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3610661.3620662
Show More Cited By

Index Terms

Flipper 2.0: A Pragmatic Dialogue Engine for Embodied Conversational Agents
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Natural language interfaces
    2. Interactive systems and tools
      1. User interface toolkits
  2. Interaction design
    1. Systems and tools for interaction design
2. Information systems
  1. Information systems applications
    1. Collaborative and social computing systems and tools
      1. Open source software

Recommendations

Standard Dialogue Structure and Frequent Patterns in the Agent Dialogue System
Distributed, Ambient and Pervasive Interactions
Abstract
To design a dialogue well and easily implement it into an autonomous dialogue system, a dialogue with simple components in which interaction with the partners is smoothly achieved is required. In designing interactions to use in an autonomous ...
System-initiated digressive proposals in automated human-computer telephone dialogues: the use of contrasting politeness strategies

System-initiated digressive proposals may be used to introduce new and unexpected information into automated telephone services. These digressions may be viewed as particularly pronounced forms of unsolicited interruptions as they contain information ...
Development of the HRL route navigation dialogue system
HLT '01: Proceedings of the first international conference on Human language technology research

In this paper we report on our work on a prototype route navigation dialogue system for use in a vehicle. The system delivers spoken turn-by-turn directions, and has been developed to accept naturally phrased navigation queries, as part of our overall ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IVA '18: Proceedings of the 18th International Conference on Intelligent Virtual Agents

November 2018

381 pages

ISBN:9781450360135

DOI:10.1145/3267851

Conference Chairs:
Anton Bogdanovych
Western Sydney University
,
Deborah Richards
Macquarie University
,
Simeon Simoff
Western Sydney University
,
Program Chairs:
Catherine Pelachaud
CNRS - ISIR, Université Pierre et Marie Curie
,
Dirk Heylen
University of Twente
,
Tomas Trescak
Western Sydney University

Copyright © 2018 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Student Paper

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

IVA '18

Sponsor:

SIGAI

IVA '18: International Conference on Intelligent Virtual Agents

November 5 - 8, 2018

NSW, Sydney, Australia

Acceptance Rates

IVA '18 Paper Acceptance Rate 17 of 82 submissions, 21%;

Overall Acceptance Rate 53 of 196 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
1,183
Total Downloads

Downloads (Last 12 months)135
Downloads (Last 6 weeks)17

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Woo JShidara KAchard CTanaka HNakamura SPelachaud C(2024)Adaptive virtual agent: Design and evaluation for real-time human-agent interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103321190(103321)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijhcs.2024.103321
Vázquez ALópez Zorrilla AOlaso JTorres M(2023)Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User StudySensors10.3390/s2303142323:3(1423)Online publication date: 27-Jan-2023
https://doi.org/10.3390/s23031423
Saga TWoo JGerard ATanaka HAchard CNakamura SPelachaud C(2023)An Adaptive Virtual Agent Platform for Automated Social Skills TrainingCompanion Publication of the 25th International Conference on Multimodal Interaction10.1145/3610661.3620662(109-111)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3610661.3620662
Woo JGrimaldi MPelachaud CAchard CLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)Conducting Cognitive Behavioral Therapy with an Adaptive Virtual AgentProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607334(1-3)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607334
Woo JGrimaldi MPelachaud CAchard CLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)IAVAProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607326(1-8)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607326
Murali PSteenstra IYun HShamekhi ABickmore T(2023)Improving Multiparty Interactions with a Robot Using Large Language ModelsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585602(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585602
Beinema Top den Akker HHofs Dvan Schooten B(2022)The WOOL Dialogue Platform: Enabling Interdisciplinary User-Friendly Development of Dialogue for Conversational AgentsOpen Research Europe10.12688/openreseurope.14279.12(7)Online publication date: 13-Jan-2022
https://doi.org/10.12688/openreseurope.14279.1
Barange MRasendrasoa SBouabdelli MSaunier JPauchet AMartinho CDias JCampos JHeylen D(2022)Multimodal adaptive empathic agent architectureProceedings of the 22nd ACM International Conference on Intelligent Virtual Agents10.1145/3514197.3551251(1-3)Online publication date: 6-Sep-2022
https://dl.acm.org/doi/10.1145/3514197.3551251
Barange MRasendrasoa SBouabdelli MSaunier JPauchet AMartinho CDias JCampos JHeylen D(2022)Impact of adaptive multimodal empathic behavior on the user interactionProceedings of the 22nd ACM International Conference on Intelligent Virtual Agents10.1145/3514197.3549675(1-8)Online publication date: 6-Sep-2022
https://dl.acm.org/doi/10.1145/3514197.3549675
Shubham KVenkatesan LJayagopi DTumuluri R(2022)Multimodal Embodied Conversational Agents: A discussion of architectures, frameworks and modules for commercial applications2022 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)10.1109/AIVR56993.2022.00013(36-45)Online publication date: Dec-2022
https://doi.org/10.1109/AIVR56993.2022.00013
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents