Article

An event-based architecture to manage virtual human non-verbal communication in 3d chatting environment

Authors:

Stéphane Gobron,

Quentin Silvestre,

Daniel Thalmann,

Ronan BoulicAuthors Info & Claims

AMDO'12: Proceedings of the 7th international conference on Articulated Motion and Deformable Objects

Pages 58 - 68

https://doi.org/10.1007/978-3-642-31567-1_6

Published: 11 July 2012 Publication History

Abstract

Non-verbal communication (NVC) makes up about two-thirds of all communication between two people or between one speaker and a group of listeners. However, this fundamental aspect of communicating is mostly omitted in 3D social forums or virtual world oriented games. This paper proposes an answer by presenting a multi-user 3D-chatting system enriched with NVC relative to motion. This event-based architecture tries to recreate a context by extracting emotional cues from dialogs and derives virtual human potential body expressions from that event triggered context model. We structure the paper by expounding the system architecture enabling the modeling NVC in a multi-user 3D-chatting environment. There, we present the transition from dialog-based emotional cues to body language, and the management of NVC events in the context of a virtual reality client-server system. Finally, we illustrate the results with graphical scenes and a statistical analysis representing the increase of events due to NVC.

References

[1]

Ahn, J., Gobron, S., Garcia, D., Silvestre, Q., Thalmann, D., Boulic, R.: An NVC Emotional Model for Conversational Virtual Humans in a 3D Chatting Environment. In: Perales, F.J., Fisher, R.B., Moeslund, T.B. (eds.) AMDO 2012. LNCS, vol. 7378, pp. 47-57. Springer, Heidelberg (2012).

Digital Library

[2]

Becheiraz, P., Thalmann, D.: A model of nonverbal communication and interpersonal relationship between virtual actors. In: Proceedings of Computer Animation 1996, pp. 58-67 (June 1996).

Digital Library

[3]

Becker, C., Kopp, S., Wachsmuth, I.: Simulating the Emotion Dynamics of a Multimodal Conversational Agent. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS 2004. LNCS (LNAI), vol. 3068, pp. 154-165. Springer, Heidelberg (2004).

[4]

Becker, C., Nakasone, A., Prendinger, H., Ishizuka, M., Wachsmuth, I.: Physiologically interactive gaming with the 3d agent max. In: Intl. Workshop on Conversational Informatics, pp. 37-42 (2005).

[5]

Boellstorff, T.: Coming of Age in Second Life: An Anthropologist Explores the Virtually Human. Princeton University Press (2008).

Digital Library

[6]

Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: Beat: Behavior expression animation toolkit. In: SIGGRAPH 2001, pp. 477-486 (2001).

Digital Library

[7]

de Melo, C.M., Zheng, L., Gratch, J.: Expression of Moral Emotions in Cooperating Agents. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 301-307. Springer, Heidelberg (2009).

Digital Library

[8]

Ekman, P.: Emotions revealed. Henry Holt and Company, LLC, New York (2004).

[9]

Gobron, S., Ahn, J., Silvestre, Q., Thalmann, D., Rank, S., Skoron, M., Paltoglou, G., Thelwall, M.: An interdisciplinary vr-architecture for 3d chatting with non-verbal communication. In: EG VE 2011: Proceedings of the Joint Virtual Reality Conference of EuroVR. ACM (September 2011).

Digital Library

[10]

Hatfield, E., Cacioppo, J.T., Rapson, R.L.: Emotional Contagion. Current Directions in Psychological Science 2(3), 96-99 (1993).

[11]

Kappas, A., Krämer, N.: Face-to-face communication over the Internet. Cambridge Univ. Press (2011).

[12]

Kappas, A.: Smile when you read this, whether you like it or not: Conceptual challenges to affect detection. IEEE Transactions on Affective Computing 1(1), 38-41 (2010).

Digital Library

[13]

Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A Conversational Agent as Museum Guide - Design and Evaluation of a Real-World Application. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 329-343. Springer, Heidelberg (2005).

Digital Library

[14]

Krämer, N.C., Simons, N., Kopp, S.: The Effects of an Embodied Conversational Agent's Nonverbal Behavior on User's Evaluation and Behavioral Mimicry. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 238-251. Springer, Heidelberg (2007).

Digital Library

[15]

Michael, R., Wagner, J.A.: Second Life: The Official Guide, 2nd edn. Wiley Publishing (2008).

[16]

Niewiadomski, R., Hyniewska, S.J., Pelachaud, C.: Constraint-based model for synthesis of multimodal sequential expressions of emotions. IEEE Transactions on Affective Computing 2(3), 134-146 (2011).

Digital Library

[17]

Pelachaud, C.: Studies on gesture expressivity for a virtual agent. Speech Commun. 51(7), 630-639 (2009).

Digital Library

[18]

Prestonand Frans, S.D., de Waal, B.M.: Empathy: Its ultimate and proximate bases. The Behavioral and Brain Sciences 25(1), 1-20 (2002).

[19]

Schweitzer, F., Garcia, D.: Frank Schweitzer and David Garcia. An agent-based model of collective emotions in online communities. The European Physical Journal B - Condensed Matter and Complex Systems 77, 533-545 (2010).

[20]

Weiner, M., Devoe, S., Rubinow, S., Geller, J.: Nonverbal behavior and nonverbal communication. Psychological Review 79, 185-214 (1972).

Cited By

Peña Pérez Negrón AMuñoz ELara López G(2019)A model for nonverbal interaction cues in collaborative virtual environmentsVirtual Reality10.1007/s10055-019-00421-w24:4(605-618)Online publication date: 21-Dec-2019
https://dl.acm.org/doi/10.1007/s10055-019-00421-w
Xiao YYuan JThalmann DThalmann NWu ETachi SThalmann DNedel LXu W(2013)Human-virtual human interaction by upper body gesture understandingProceedings of the 19th ACM Symposium on Virtual Reality Software and Technology10.1145/2503713.2503727(133-142)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2503713.2503727
Ahn JGobron SGarcia DSilvestre QThalmann DBoulic R(2012)An NVC emotional model for conversational virtual humans in a 3d chatting environmentProceedings of the 7th international conference on Articulated Motion and Deformable Objects10.1007/978-3-642-31567-1_5(47-57)Online publication date: 11-Jul-2012
https://dl.acm.org/doi/10.1007/978-3-642-31567-1_5

Recommendations

Inferring interaction to support collaborative learning in 3D virtual environments through the user's avatar Non-Verbal Communication

When a group of students, placed around a shared workspace and working on a predefined task, is observed, the teacher can intuitively, to a certain extent, understand the collaboration that is taking place within the group without listening to the ...
The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

This paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...
Analysis of Human Nodding Behavior during Group Work for Designing Nodding Robots
GROUP '16: Proceedings of the 2016 ACM International Conference on Supporting Group Work

Nodding has various communicative functions in humans, such as agreement, emphasis and turn-taking and can also create various positive impressions in communication by the person exhibiting the behavior. The ultimate aim of our research is to facilitate ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

AMDO'12: Proceedings of the 7th international conference on Articulated Motion and Deformable Objects

July 2012

294 pages

ISBN:9783642315664

Editors:
Francisco J. Perales
Dept. of Computer Science and Mathematics, UIB – Universitat de les Illes Balears, Palma de Mallorca, Spain
,
Robert B. Fisher
School of Informatics, University of Edinburgh, St., Edinburgh, UK
,
Thomas B. Moeslund
Dept. for Architecture, Design and Media Technology, Aalborg University, Aalborg East, Denmark

Sponsors

Ministerio De Educacion Y Ciencia: Ministerio De Educacion Y Ciencia
AERFAI: Spanish Association for Pattern Recognition and Image Analysis
Consell de Mallorca
Universitat de les Illes Balears: Universitat de les Illes Balears
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 11 July 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Peña Pérez Negrón AMuñoz ELara López G(2019)A model for nonverbal interaction cues in collaborative virtual environmentsVirtual Reality10.1007/s10055-019-00421-w24:4(605-618)Online publication date: 21-Dec-2019
https://dl.acm.org/doi/10.1007/s10055-019-00421-w
Xiao YYuan JThalmann DThalmann NWu ETachi SThalmann DNedel LXu W(2013)Human-virtual human interaction by upper body gesture understandingProceedings of the 19th ACM Symposium on Virtual Reality Software and Technology10.1145/2503713.2503727(133-142)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2503713.2503727
Ahn JGobron SGarcia DSilvestre QThalmann DBoulic R(2012)An NVC emotional model for conversational virtual humans in a 3d chatting environmentProceedings of the 7th international conference on Articulated Motion and Deformable Objects10.1007/978-3-642-31567-1_5(47-57)Online publication date: 11-Jul-2012
https://dl.acm.org/doi/10.1007/978-3-642-31567-1_5

View Options

View options

Figures

Tables

Media

View Table of Conten