research-article

Model of the perception of smiling virtual character

Authors:

Catherine PelachaudAuthors Info & Claims

AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1

Pages 87 - 94

Published: 04 June 2012 Publication History

Abstract

A smile may convey different communicative intentions depending on subtle characteristics of the facial expression. Moreover, during an interaction, the expression of smile impacts on the observer's perception of both the social stance of the speaker and of the content of the talk. In this paper, we describe a perceptual study where we explore the effects of virtual characters displaying different types of smiles (namely politeness and amusement) when speaking on the user's perception. Based on the collected data, a model to automatically compute the user's potential perception of the virtual character's social stance depending on its smiling behavior and on its gender has been proposed.

References

[1]

Z. Ambadar, J. F. Cohn, and L. I. Reed. All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous. Journal of Nonverbal Behavior, 17--34:238--252, 2009.

[2]

E. Bevacqua, S. Hyniewska, and C. Pelachaud. Positive influence of smile backchannels in ECAs. In International Workshop on Interacting with ECAs as Virtual Characters (AAMAS), 2010.

[3]

L. Breiman, J. Friedman, R. Olsen, and C. Stone. Classification and Regression Trees. Chapman and Hall, 1984.

[4]

J. Cassell, T. Bickmore, L. Campbell, H. Vilhjálmsson, and H. Yan. More than just a pretty face: Conversational protocols and the affordances of embodiment. Knowledgebased Systems, 14(1--2):55--64, 2001.

[5]

D. C. Dennett. The Intentional Stance. Mit press edition, 1987.

[6]

F.M. Deutsch, D. LeBaron, and M. M. Fryer. What is in the Smile? Psychology of Women Quarterly, 11, 1987.

[7]

J.A. Edinger and M. L. Patterson. Nonverbal involvement and social control. Psychological Bulletin, 93:30--56, 1983.

[8]

P. Ekman and W. V. Friesen. Unmasking the Face. A guide to recognizing emotions from facial clues. Prentice-Hall, Inc., Englewood Cliffs, New Jersey, 1975.

[9]

P. Ekman and W. V. Friesen. Felt, False, And Miserable Smiles. Journal of Nonverbal Behavior, 6:238--252, 1982.

[10]

P. Ekman, W. V. Friesen, and J. C. Hager. The facial action coding system. Weidenfeld and Nicolson, 2002.

[11]

M. G. Frank, P. Ekman, and W. V. Friesen. Behavioral markers and recognizability of the smile of enjoyment. Journal of Personality and Social Psychology, 64:83--93, 1993.

[12]

U. Hess, S. Blairy, and R. E. Kleck. The influence of facial emotion displays, gender, and ethnicity on judgments of dominance and affiliation. Journal of Nonverbal Behavior, 24:275--283, 2000.

[13]

M. Katsikitis, I. Pilowsky, and J. M. Innes. Encoding and decoding of facial expression. Journal of General Psychology, 124:357--370, 1997.

[14]

E. Krumhuber, A. Manstead, D. Cosker, D. Marshall, and P. Rosin. Effects of Dynamic Attributes of Smiles in Human and Synthetic Faces: A Simulated Job Interview Setting. Journal of Nonverbal Behavior, 33:1--15, 2008.

[15]

E. Krumhuber, A. Manstead, and A. Kappas. Temporal aspects of facial displays in person and expression perception. The effects of smile dynamics, headtilt and gender. Journal of Nonverbal Behavior, 31:39--56, 2007.

[16]

P. Kulms, N. C. Krämer, J. Gratch, and S. Kang. It's in Their Eyes: A Study on Female and Male Virtual Humans' Gaze. In Intelligent Virtual Agent (IVA), pages 80--92, 2011.

Digital Library

[17]

M. LaFrance and M. A. Hecht. Why smiles generate leniency. Personality and Social Psychology Bulletin, 21(3):207--214, 1995.

[18]

S. Lau. The effect of smiling on person perception. Journal of Social Psychology, 117:63--67, 1982.

[19]

M. Mehu, A. C. Little, and R. I. M. Dunbar. Duchenne smiles and the perception of generosity and sociability in faces. Journal of Evolutionary Psychology, 5(1--4):133--146, 2007.

[20]

M. M. Moore. Nonverbal courtship patterns in women. Ethology and Sociobiology, 6:237--247, 1985.

[21]

R. Niewiadomski and C. Pelachaud. Model of Facial Expressions Management for an Embodied Conversational Agent. In 2nd International Conference on Affective Computing and Intelligent Interaction (ACII), pages 12--23, Lisbon, Portugal, 2007.

Digital Library

[22]

M. Ochs, R. Niewiadmoski, and C. Pelachaud. How a virtual agent should smile? morphological and dynamic characteristics of virtual agent's smiles. In Intelligent Virtual Agent (IVA), 2010.

Digital Library

[23]

M. Ochs, R. Niewiadomski, P. Brunet, and C. Pelachaud. Smiling virtual agent in social context. Cognitive Processing, Special Issue on "Social Agents", 2011.

[24]

I. Poggi and R. Chirico. The meaning of smile. In Oralite, gestualite, communication multimodale, interaction, pages 159--164. 1998.

[25]

I. Poggi and C. Pelachaud. Affective Interactions: Towards a New Generation of Computer Interfaces, chapter Emotional. 2000.

[26]

M. Rehm and E. André. Catch me if you can? Exploring lying agents in social settings. In AAMAS, pages 937--944. Academic Press Inc., 2005.

Digital Library

[27]

H. T. Reis, W. I. McDougal, C. Monestere, S. Bernstein, K. Clark, E. Seidl, M. Franco, E. Giodioso, L. Freeman, and K. Radoane. What is smiling is beautiful and good. European Journal of Social Psychology, 20:259--267, 1990.

[28]

K. R. Scherer. What are emotions? And how can they be measured? Social Science Information, 44(4):695--729, December 2005.

[29]

M. Schröder. The SEMAINE API: Towards a Standards-Based Framework for Building Emotion-Oriented Systems. Advances in Human-Computer Interaction, 2010.

Digital Library

[30]

E. Tanguy. Emotions: the art of communication applied to virtual actors. PhD thesis, Department of Computer Science, University of Bath, England, 2006.

[31]

G Theonas, D Hobbs, and D Rigas. Employing Virtual Lecturers' Facial Expressions in Virtual Educational Environments. International Journal of Virtual Reality, 7:31--44, 2008.

Cited By

Oralbayeva NAly ASandygulova ABelpaeme T(2023)Data-driven Communicative Behaviour Generation: A SurveyACM Transactions on Human-Robot Interaction10.1145/360923513:1(1-39)Online publication date: 16-Aug-2023
https://dl.acm.org/doi/10.1145/3609235
Janssoone TZhang ZCohen PBohus DHoraud RMeng H(2015)Temporal Association Rules for Modelling Multimodal Social SignalsProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2823305(575-579)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2823305
Ding YPrepin KHuang JPelachaud CArtières TBazzan AHuhns MLomuscio AScerri P(2014)Laughter animation synthesisProceedings of the 2014 international conference on Autonomous agents and multi-agent systems10.5555/2615731.2615856(773-780)Online publication date: 5-May-2014
https://dl.acm.org/doi/10.5555/2615731.2615856

Index Terms

Model of the perception of smiling virtual character
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Towards a smiling ECA: studies on mimicry, timing and types of smiles
SSPW '10: Proceedings of the 2nd international workshop on Social signal processing

Smile is one of the most often used nonverbal signals. Depending on when, how and where it is displayed, it may convey various meanings. We believe that introducing the variety of smiles may improve the communicative skills of embodied conversational ...
Smiling makes us happier: enhancing positive mood and communication with smile-encouraging digital appliances
UbiComp '11: Proceedings of the 13th international conference on Ubiquitous computing

William James, the noted psychologist and philosopher, believed that smiling has a positive effect on our mind. James' view, which was confirmed by several psychological studies, was that we become happier when we laugh. In this paper, we propose a new ...
Implementing and Evaluating a Laughing Virtual Character
Special Issue on Affect and Interaction in Agent-based Systems and Social Media and Regular Paper

Laughter is a social signal capable of facilitating interaction in groups of people: it communicates interest, helps to improve creativity, and facilitates sociability. This article focuses on: endowing virtual characters with computational models of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1

June 2012

592 pages

ISBN:0981738117

General Chairs:
Wiebe van der Hoek
University of Liverpool, UK
,
Lin Padgham
RMIT University, Australia
,
Program Chairs:
Vincent Conitzer
Duke University
,
Michael Winikoff
University of Otago, New Zealand

Sponsors

The International Foundation for Autonomous Agents and Multiagent Systems: The International Foundation for Autonomous Agents and Multiagent Systems

In-Cooperation

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

International Foundation for Autonomous Agents and Multiagent Systems

Richland, SC

Publication History

Published: 04 June 2012

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AAMAS 12

Sponsor:

The International Foundation for Autonomous Agents and Multiagent Systems

AAMAS 12: International Conference on Autonomous Agents and Multiagent Systems

June 4 - 8, 2012

Valencia, Spain

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
159
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Oralbayeva NAly ASandygulova ABelpaeme T(2023)Data-driven Communicative Behaviour Generation: A SurveyACM Transactions on Human-Robot Interaction10.1145/360923513:1(1-39)Online publication date: 16-Aug-2023
https://dl.acm.org/doi/10.1145/3609235
Janssoone TZhang ZCohen PBohus DHoraud RMeng H(2015)Temporal Association Rules for Modelling Multimodal Social SignalsProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2823305(575-579)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2823305
Ding YPrepin KHuang JPelachaud CArtières TBazzan AHuhns MLomuscio AScerri P(2014)Laughter animation synthesisProceedings of the 2014 international conference on Autonomous agents and multi-agent systems10.5555/2615731.2615856(773-780)Online publication date: 5-May-2014
https://dl.acm.org/doi/10.5555/2615731.2615856

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents