Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/3060621.3060741guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Verbalization: narration of autonomous robot experience

Published: 09 July 2016 Publication History

Abstract

Autonomous mobile robots navigate in our spaces by planning and executing routes to destinations. When a mobile robot appears at a location, there is no clear way to understand what navigational path the robot planned and experienced just by looking at it. In this work, we address the generation of narrations of autonomous mobile robot navigation experiences. We contribute the concept of verbalization as a parallel to the well-studied concept of visualization. Through verbalizations, robots can describe through language what they experience, in particular in their paths. For every executed path, we consider many possible verbalizations that could be generated. We introduce the verbalization space that covers the variability of utterances that the robot may use to narrate its experience to different humans. We present an algorithm for segmenting a path and mapping each segment to an utterance, as a function of the desired point in the verbalization space, and demonstrate its application using our mobile service robot moving in our buildings. We believe our verbalization space and algorithm are applicable to different narrative aspects for many mobile robots, including autonomous cars.

References

[1]
Nicholas D Allen, John R Templon, Patrick Summerhays McNally, Larry Birnbaum, and Kristian J Hammond. Statsmonkey: A data-driven sports narrative writer. In AAAI Fall Symposium: Computational Models of Narrative , 2010.
[2]
Robert Belvin, Ron Burns, and Cheryl Hein. Development of the hrl route navigation dialogue system. In Proceedings of the first international conference on Human language technology research , pages 1-5. Association for Computational Linguistics, 2001.
[3]
Joydeep Biswas and Manuela Veloso. Localization and Navigation of the CoBots over Long-term Deployments. International Journal of Robotics Research , 32(14):1679-1694, 2013.
[4]
Joydeep Biswas and Manuela Veloso. Episodic Non-Markov Localization: Reasoning about Short-Term and Long-Term Features. In Proceedings of the International Conference on Robotics and Automation , 2014.
[5]
Dan Bohus, Chit W Saw, and Eric Horvitz. Directions robot: In-the-wild experiences and lessons learned. In Proceedings of the International Conference on Autonomous Agents and Multi-Agent Systems , pages 637-644, 2014.
[6]
Adrian Bussone, Simone Stumpf, and Dympna O'Sullivan. The role of explanations on trust and reliance in clinical decision support systems. IEEE International Conference on Healthcare Informatics , 2015.
[7]
Anind K Dey. Explanations in context-aware systems. In ExaCt , pages 84-93, 2009.
[8]
Rachel Kirby, Frank Broz, Jodi Forlizzi, Marek Piotr Michalowski, Anne Mundell, Stephanie Rosenthal, Brennan Peter Sellner, Reid Simmons, Kevin Snipes, Alan Schultz, and Jue Wang. Designing robots for long-term social interaction. In Proceedings of the International Conference on Intelligent Robots and Systems , pages 2199-2204, 2005.
[9]
Todd Kulesza, Simone Stumpf, Margaret Burnett, and Irwin Kwan. Tell me more?: the effects of mental model soundness on personalizing an intelligent agent. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , pages 1-10. ACM, 2012.
[10]
Todd Kulesza, Simone Stumpf, Margaret Burnett, Songping Yang, Irwin Kwan, and Weng-Keen Wong. Too much, too little, or just right? ways explanations impact end users' mental models. In Visual Languages and Human-Centric Computing (VL/HCC), 2013 IEEE Symposium on , pages 3-10. IEEE, 2013.
[11]
Brian Y Lim and Anind K Dey. Toolkit to support intelligibility in context-aware applications. In Proceedings of the 12th ACM international conference on Ubiquitous computing , pages 13-22. ACM, 2010.
[12]
Brian Y Lim, Anind K Dey, and Daniel Avrahami. Why and why not explanations improve the intelligibility of context-aware intelligent systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , pages 2119-2128. ACM, 2009.
[13]
Linus J Luotsinen, Hans Fernlund, and Ladislau Bölöni. Automatic annotation of team actions in observations of embodied agents. In Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems , page 9. ACM, 2007.
[14]
Alastair MacFadden, Lorin Elias, and Deborah Saucier. Males and females scan maps similarly, but give directions differently. Brain and Cognition , 53(2):297-300, 2003.
[15]
Vittorio Perera and Manuela Veloso. Handling Complex Commands for Service Robot Task Requests. In Proceedings of the International Joint Conference on Artificial Intelligence , 2015.
[16]
Vittorio Perera, Robin Soetens, Thomas Kollar, Mehdi Samadi, Yichao Sun, Daniele Nardi, René van de Molengraft, and Manuela Veloso. Learning task knowledge from dialog and web access. Robotics , 4(2):223-252, 2015.
[17]
Stephanie Rosenthal, Joydeep Biswas, and Manuela Veloso. An Effective Personal Mobile Robot Agent Through Symbiotic Human-Robot Interaction. In Proceedings of AAMAS'10, the Ninth International Joint Conference on Autonomous Agents and Multi-Agent Systems , Toronto, Canada, May 2010.
[18]
Jesse Thomason, Shiqi Zhang, Raymond Mooney, and Peter Stone. Learning to interpret natural language commands through human-robot dialog. In Proceedings of the 2015 International Joint Conference on Artificial Intelligence (IJCAI) , July 2015.
[19]
Manuela Veloso, Nicholas Armstrong-Crews, Sonia Chernova, Elisabeth Crawford, Colin McMillen, Maayan Roth, Douglas Vail, and Stefan Zickler. A team of humanoid game commentators. International Journal of Humanoid Robotics , 5(03):457-480, 2008.
[20]
Manuela Veloso, Joydeep Biswas, Brian Coltin, and Stephanie Rosenthal. CoBots: Robust Symbiotic Autonomous Mobile Service Robots. In Proceedings of the International Joint Conference on Artificial Intelligence , 2015.
[21]
Dirk Voelz, Elisabeth André, Gerd Herzog, and Thomas Rist. Rocco: A robocup soccer commentator system. In RoboCup-98 , pages 50-60. Springer, 1999.
[22]
Ameni Yengui and NEJI Mahmoud. Semantic annotation formalism of video-conferencing documents. Cognition and Exploratory Learning in Digital Age , 2009.

Cited By

View all
  • (2021)The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy PlayersACM Transactions on Interactive Intelligent Systems10.1145/339604711:1(1-46)Online publication date: 15-Mar-2021
  • (2019)Balancing explicability and explanations for human-aware planningProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367032.3367222(1335-1343)Online publication date: 10-Aug-2019
  • (2019)Designing Theory-Driven User-Centric Explainable AIProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300831(1-15)Online publication date: 2-May-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings
IJCAI'16: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
July 2016
4277 pages
ISBN:9781577357704

Sponsors

  • Sony: Sony Corporation
  • Arizona State University: Arizona State University
  • Microsoft: Microsoft
  • Facebook: Facebook
  • AI Journal: AI Journal

Publisher

AAAI Press

Publication History

Published: 09 July 2016

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2021)The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy PlayersACM Transactions on Interactive Intelligent Systems10.1145/339604711:1(1-46)Online publication date: 15-Mar-2021
  • (2019)Balancing explicability and explanations for human-aware planningProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367032.3367222(1335-1343)Online publication date: 10-Aug-2019
  • (2019)Designing Theory-Driven User-Centric Explainable AIProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300831(1-15)Online publication date: 2-May-2019
  • (2019)Enabling robots to communicate their objectivesAutonomous Robots10.1007/s10514-018-9771-043:2(309-326)Online publication date: 1-Feb-2019
  • (2018)Towards a Robust Interactive and Learning Social RobotProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237831(883-891)Online publication date: 9-Jul-2018
  • (2018)Trends and Trajectories for Explainable, Accountable and Intelligible SystemsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174156(1-18)Online publication date: 21-Apr-2018

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media