research-article

Multi-party interaction with a virtual character and a human-like robot

Authors:

Zerrin Yumak,

Nadia Magnenat-ThalmannAuthors Info & Claims

VRST '13: Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

Pages 153 - 156

https://doi.org/10.1145/2503713.2503736

Published: 06 October 2013 Publication History

Get Access

Abstract

Research on interactive virtual characters and social robots focuses mainly on one-to-one interactions and multi-party interactions concept are rather less explored. As we are developing these characters to be helpful to us in our daily lives as guides, companions, assistants or receptionists, they should be aware of the existence of multiple people and address their requirements in a natural way and act according to the social rules and norms. In contrast with previous work, we are interested in multi-party and multi-modal interactions between 3D virtual characters, real humans and social robots. This means that any of these participants can interact with each other. In this paper we present our on-going work, provide a discussion on multi-party interaction, describe the overall system architecture and mention our future work.

References

[1]

Bohus, D., and Horvitz, E. 2009. Open-world dialog: Challenges, directions and a prototype. In IJCAI Workshop on Knowledge and Reasoning in Practical Dialog Systems,.

Google Scholar

[2]

Cassell, J., Vilhjálmsson, H., Högni, and Bickmore, T. 2001. BEAT: the behavior expression animation toolkit. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, SIGGRAPH '01, 477--486.

Digital Library

Google Scholar

[3]

D. Traum, and Larsson, S. 2003. The information state approach to dialogue management. In Current and New Directions in Discourse and Dialogue, 325--353.

Google Scholar

[4]

Foster, M., Gaschler, A., Giuliani, M., Isard, A., Pateraki, M., and Petrick, R. 2012. Two people walk into a bar: Dynamic multi-party social interaction with a robot agent. In Proceedings of the ACM International Conference on Multi-modal Interaction (ICMI 2012), 3--10.

Digital Library

Google Scholar

[5]

Kasap, Z., and Magnenat-Thalmann, N. 2012. Building long-term relationships with virtual and robotic characters: The role of remembering. The Visual Computer 28, 1, 87--97.

Digital Library

Google Scholar

[6]

Kondo, Y., Takemura, K., Takamatsu, J., and Ogasawara, T. 2013. A gesture-centric android system for multi-party human-robot interaction. Journal of Human-Robot Interaction 2, 1, 133--151.

Digital Library

Google Scholar

[7]

Lee, C., Jung, S., Kim, K., Lee, D., and Lee, G. 2010. Recent approaches to dialogue management for spoken dialog systems. Journal of Computing Science and Engineering 4, 1, 1--22.

Crossref

Google Scholar

[8]

Matsuyama, Y., Taniyama, H., F., and Kobayashi, T. 2010. Framework of communication activation robot participating in multiparty conversation. In AAAI Fall Symposium.

Google Scholar

[9]

Rashobh, R. S., and Khong, A. W. H. 2012. A variable step-size adaptive algorithm for room acoustics equalization exploiting the sparseness constraint. In IEEE Int. Symp. Circuits and Systems.

Google Scholar

[10]

Ren, J., Jiang, X., and Yu, J. 2013. Relaxed local ternary pattern for face recognition. In IEEE Int. Conf. Image Processing.

Google Scholar

[11]

Traum, D. R., and Morency, L. P. 2010. Integration of visual perception in dialogue understanding for virtual humans in multi-party interaction. In AAMAS International Workshop on Interacting with ECAs as Virtual Characters, 1723--1726.

Google Scholar

[12]

Traum, D. 2004. Issues in multi-party dialoguess. In: F. Dignum, editor. Advances in Agent Communication (November), 201--211.

Google Scholar

[13]

Wu, K., Goh, S. T., and Khong, A. W. H. 2013. Speaker localization and tracking in the presence of sound interference by exploiting speech harmonicity. In IEEE. Int. Conf. Acoust., Speech, Signal Process. (ICASSP 13).

Google Scholar

[14]

Yang, X., Yuan, J., and Thalmann, D. 2013. Human-virtual human interaction by upper body gesture understanding. In The 19th ACM Symposium on Virtual Reality Software and Technology (VRST2013).

Digital Library

Google Scholar

Cited By

View all

Gillet SVázquez MPeters CYang FLeite I(2022)Multiparty Interaction Between Humans and Socially Interactive AgentsThe Handbook on Socially Interactive Agents10.1145/3563659.3563665(113-154)Online publication date: 27-Oct-2022
(2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
Zuo GYu SGong DLu JQiu Y(2017)Operator Attitude Algorithm for an Isomorphic Master-slave Telerobotic System2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER)10.1109/CYBER.2017.8446211(1457-1460)Online publication date: Jul-2017
Show More Cited By

Index Terms

Multi-party interaction with a virtual character and a human-like robot
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception
      2. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Demonstration of a Robot Receptionist with Multi-party Situated Interaction
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

We present a demonstration of a Robot Receptionist: a situated interactive robot that can coordinate turn-taking and handle multi-party engagement and dialogue in dynamic environments, where users might enter or leave the scene at any time. We use a ...
Multi-party Interaction with a Robot Receptionist
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

We introduce a situated interactive robot receptionist that can coordinate turn-taking and handle multi-party engagement and dialogue in dynamic environments, where users might enter or leave the scene at any time. The objective is to create a multi-user ...
A Holistic Evaluation Methodology for Multi-Party Spoken Conversational Agents
IVA '24: Proceedings of the 24th ACM International Conference on Intelligent Virtual Agents

While research in multi-party spoken conversation with intelligent embodied agents has made significant progress in sub-tasks like speaker identification and non-verbal cues, there’s a gap in fully autonomous applications users can directly interact ...

Comments

Information & Contributors

Information

Published In

VRST '13: Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

October 2013

271 pages

ISBN:9781450323796

DOI:10.1145/2503713

General Chairs:
Nadia Magnenat Thalmann
NTU, Singapore and MIRALab, University of Geneva, Switzerland
,
Enhua Wu
Academia Sinica and University of Macau, China
,
Susumi Tachi
Keio University, Japan
,
Program Chairs:
Daniel Thalmann
NTU, Singapore and EPFL, Switzerland
,
Luciana Nedel
Federal University of Rio Grande Del Sul, Brazil
,
Weiwei Xu
Hangzhou Normal University, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Research Foundation-Prime Minister's office, Republic of Singapore

Conference

VRST'13

Sponsor:

VRST'13: The 19th ACM Symposium on Virtual Reality Software and Technology

October 6 - 9, 2013

Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
210
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gillet SVázquez MPeters CYang FLeite I(2022)Multiparty Interaction Between Humans and Socially Interactive AgentsThe Handbook on Socially Interactive Agents10.1145/3563659.3563665(113-154)Online publication date: 27-Oct-2022
(2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
Zuo GYu SGong DLu JQiu Y(2017)Operator Attitude Algorithm for an Isomorphic Master-slave Telerobotic System2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER)10.1109/CYBER.2017.8446211(1457-1460)Online publication date: Jul-2017
Xu JSakazawa SMatsumura YKuzuoka H(2015)Perceptual evaluation of non-verbal cues from a humanoid robot for multi-party teleconferences2015 IEEE International Conference on Mechatronics and Automation (ICMA)10.1109/ICMA.2015.7237651(1168-1173)Online publication date: Aug-2015

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Demonstration of a Robot Receptionist with Multi-party Situated Interaction

Multi-party Interaction with a Robot Receptionist

A Holistic Evaluation Methodology for Multi-Party Spoken Conversational Agents