article

Nonverbal communication interface for collaborative virtual environments

Authors:

A. Guye-Vuillème,

N. Magnenat Thalmann,

D. ThalmannAuthors Info & Claims

Virtual Reality, Volume 4, Issue 1

Pages 49 - 59

https://doi.org/10.1007/BF01434994

Published: 01 March 1999 Publication History

Abstract

Nonverbal communication is an important aspect of real-life face-to-face interaction and one of the most efficient ways to convey emotions, therefore users should be provided the means to replicate it in the virtual world. Because articulated embodiments are well suited to provide body communication in virtual environments, this paper first reviews some of the advantages and disadvantages of complex embodiments. After a brief introduction to nonverbal communication theories, we present our solution, taking into account the practical limitations of input devices and social science aspects. We introduce our sample of actions and implementation using our VLNET (Virtual Life Network) networked virtual environment and discuss the results of an informal evaluation experiment.

References

[1]

Argyle M. Bodily communication. Methuen, London, 1988

[2]

Capin TK, Pandzic IS, Noser H, Magnenat-Thalmann N, Thalmann D. Virtual human representation and communication in VLNET networked virtual environment. IEEE Computer Graphics and Applications 1997; 17(2):42---53

Digital Library

[3]

Benford SD, Bowers JM, Fahlén LE, Greenhalgh CM, Snowdon D. Embodiments, avatars, clones and agents for multi-user, multi-sensory virtual worlds. Multimedia Systems 1997; 5(2):93---104

Digital Library

[4]

Vilhjálmsson HH, Cassell J. BodyChat: autonomous communicative behaviors in avatars. In: Proceedings of the 2nd International Conference on Autonomous Agents ACM Press. 1998: 269---276

Digital Library

[5]

Corraze J. Les communications nonverbales. Presses Universitaires de France, Paris, 1980

[6]

Cassell J, Pelachaud C, Badler N. Animated conversation: rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In: Proceedings of SIGGRAPH'94 1994:413---420

Digital Library

[7]

Perlin K, Goldberg A. Improv: a system for scripting interactive actors in virtual worlds. In: Proceedings of SIGGRAPH'96 1996: 205---216

Digital Library

[8]

Capin TK. Virtual human representation in networked virtual environments. EPFL, Lausanne, 1998

[9]

Kendon A. Nonverbal communication, interaction, and gesture. Mouton, The Hague, 1981

[10]

Weitz S. Nonverbal communication: readings with commentary. Oxford University Press, New York, 1974

[11]

Ekman P, Friesen WV. Head and body cues in the judgement of emotion: a reformulation. Perceptual Motor Skills 1967; 24:711---724

[12]

Cassell J, Thórisson KR. The power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents. Journal of Applied Artificial Intelligence 1999; 13:519---538

[13]

Cañamero D, Van de Velde W. Socially emotional: using emotions to ground social interaction. In: Papers from the 1997 AAAI Fall Symposium 1997: 10---15

[14]

Rosenberg BG, Langer J. A study of postural-gestural communication. Journal of Personality and Social Psychology 1965; 2(4): 593---597

[15]

Morris D, Collet P, Marsh P, O'Shaughnessy M. Gestures. Jonathan Cape, London, 1979

[16]

Miller G. Explorations in interpersonal communication. Sage, New York, 1976

[17]

Boulic R, Capin T, Huang Z, Morozet L, Molet T, Katra P, et al. The HUMANOID environment for interactive animation of multiple deformable human characters. In: Proceedings of Eurographics '95 1995: 337---348

Digital Library

[18]

Bowers J, Pycock J, O'Brien J. Talk and embodiment in collaborative virtual environments. In: Proceedings of the ACM CHI'96, ACM Press. 1996: 58---65

Digital Library

Cited By

Yin MXiao R(2024)Press A or Wave: User Expectations for NPC Interactions and Nonverbal Behaviour in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36770988:CHI PLAY(1-25)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677098
Wan QLu Z(2024)Investigating VTubing as a Reconstruction of Streamer Self-Presentation: Identity, Performance, and GenderProceedings of the ACM on Human-Computer Interaction10.1145/36373578:CSCW1(1-22)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637357
Williamson JO'Hagan JGuerra-Gomez JWilliamson JCesar PShamma D(2022)Digital Proxemics: Designing Social and Collaborative Interaction in Virtual EnvironmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517594(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517594
Show More Cited By

Nonverbal communication interface for collaborative virtual environments
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Nonverbal communication in virtual reality: Nodding as a social signal in virtual interactions
Highlights
- We use VR technology to create an immersive environment that simulates social interaction between a human participant and a virtual human.
Graphical abstract

Display Omitted

Abstract
Nonverbal communication is an important part of human communication, including head nodding, eye gaze, proximity and body orientation. Recent research has identified specific patterns of head nodding linked to conversation, namely ...
A First Step Towards Considering Nonverbal Communicative Cues in Dialog Systems
PETRA '24: Proceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments

Currently, spoken dialogue systems mostly consider only voice interactions and do not consider nonverbal cues. This work aims to explore the domain of interaction with conversational assistants, taking into account not only verbal cues, but also the ...
Enabling Embodied Conversational Agents to Respond to Nonverbal Behavior of the Communication Partner
Human-Computer Interaction. User Experience and Behavior
Abstract
Humans communicate on three levels: words, paralanguage, and nonverbal. While conversational agents focus mainly on the interpretation of words that are being spoken, recently the focus has also shifted to how we say those words with our tone, ...

Comments

Information & Contributors

Information

Published In

cover image Virtual Reality

Virtual Reality Volume 4, Issue 1

March 1999

84 pages

ISSN:1359-4338

EISSN:1434-9957

Issue’s Table of Contents

Copyright © Copyright © 1999 Springer-Verlag London Ltd.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 March 1999

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yin MXiao R(2024)Press A or Wave: User Expectations for NPC Interactions and Nonverbal Behaviour in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36770988:CHI PLAY(1-25)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677098
Wan QLu Z(2024)Investigating VTubing as a Reconstruction of Streamer Self-Presentation: Identity, Performance, and GenderProceedings of the ACM on Human-Computer Interaction10.1145/36373578:CSCW1(1-22)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637357
Williamson JO'Hagan JGuerra-Gomez JWilliamson JCesar PShamma D(2022)Digital Proxemics: Designing Social and Collaborative Interaction in Virtual EnvironmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517594(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517594
Sykownik PMaloney DFreeman GMasuch M(2022)Something Personal from the Metaverse: Goals, Topics, and Contextual Factors of Self-Disclosure in Commercial Social VRProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502008(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502008
Regal GSchrom-Feiertag HNguyen QAust MMurtinger MSmit DTscheligi MBillinghurst M(2022)VR [we are] Training - Workshop on Collaborative Virtual Training for Challenging ContextsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503710(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503710
Raimbaud PJovane AZibrek KPacchierotti CChristie MHoyet LPettré JOlivier A(2021)Reactive Virtual AgentsProceedings of the 21st ACM International Conference on Intelligent Virtual Agents10.1145/3472306.3478351(164-166)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3472306.3478351
Vindenes JWasson B(2021)Show, don’t tell: Using Go-along Interviews in Immersive Virtual RealityProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462014(190-204)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462014
Maloney DFreeman GWohn D(2020)"Talking without a Voice"Proceedings of the ACM on Human-Computer Interaction10.1145/34152464:CSCW2(1-25)Online publication date: 15-Oct-2020
https://dl.acm.org/doi/10.1145/3415246
Tanenbaum THartoonian NBryan JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)"How do I make this thing smile?"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376606(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376606
Mayer SReinhardt JSchweigert RJelke BSchwind VWolf KHenze NBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Improving Humans' Ability to Interpret Deictic Gestures in Virtual RealityProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376340(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376340
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents