extended-abstract

Expressive Virtual Human: Impact of expressive wrinkles and pupillary size on emotion recognition

Authors:

Anne-Sophie Milcent,

Abdelmajid Kadri,

Simon RichirAuthors Info & Claims

IVA '19: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents

Pages 215 - 217

https://doi.org/10.1145/3308532.3329446

Published: 01 July 2019 Publication History

Abstract

Improving the expressiveness of virtual humans is essential for qualitative interactions and development of an emotional bond. It is certainly indicated for all applications using the user's cognitive processes, such as applications dedicated to training or health. Our study aims to contribute to the design of an expressive virtual human, by identifying and adapting visual factors promoting transcription of emotions. In this paper, we investigate the effect of expressive wrinkles and variation of pupil size. We propose to compare the recognition of basic emotions on a real human and on an expressive virtual human. The virtual human was subject to two different factors: expressive wrinkles and/or pupil size. Our results indicate that emotion recognition rates on the virtual agent are high. Moreover, expressive wrinkles affect emotion recognition. The effect of pupillary size is less significant. However, both are recommended to design an expressive virtual human.

References

[1]

Russell Beale and Chris Creed. 2009. Affective interaction: How emotional agents affect users . International Journal of Human-Computer Studies, Vol. 67, 9 (2009), 755--776.

Digital Library

[2]

Matthieu Courgeon, Sté phanie Buisine, and Jean-Claude Martin. 2009. Impact of expressive wrinkles on perception of a virtual character's facial expressions of emotions. In 9th International Conference, IVA 2009, Sep 2009, Netherlands. Springer, 201--214.

Digital Library

[3]

Miriam Dyck, Maren Winbeck, Susanne Leiberg, Yuhan Chen, Rurben C Gur, and Klaus Mathiak. 2008. Recognition profile of emotions in natural and virtual faces . PLoS One, Vol. 3, 11 (2008).

[4]

Paul Ekman. 2007. Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. Vol. 12. Macmillan.

Digital Library

[5]

Paul Ekman and Wallace V Friesen. 1978. Manual for the facial action coding system . Consulting Psychologists Press (1978).

[6]

Mara Fö lster, Ursula Hess, and Katja Werheid. 2014. Facial age affects emotional expression decoding . Frontiers in Psychology, Vol. 5 (2014), 30.

[7]

Neil A Harrison, C Ellie Wilson, and Hugo D Critchley. 2007. Processing of observed pupil size modulates perception of sadness and predicts empathy. Emotion, Vol. 7, 4 (2007), 724.

[8]

Eckhard H Hess. 1975. The role of pupil size in communication . Scientific American, Vol. 233, 5 (1975), 110--119.

[9]

Philip L Jackson, Pierre-Emmanuel Michon, Erik Geslin, Maxime Carignan, and Danny Beaudoin. 2015. EEVEE: the Empathy-Enhancing Virtual Evolving Environment. Frontiers in human neuroscience (2015).

[10]

Jari K"a tsyri and Mikko Sams. 2008. The effect of dynamics on identifying basic emotions from synthetic and natural faces . International Journal of Human-Computer Studies, Vol. 66, 4 (2008), 233--242.

Digital Library

[11]

Caroline Larboulette and M-P Cani. 2004. Real-time dynamic wrinkles. In Computer Graphics International, 2004. Proceedings. IEEE, 522--525.

Digital Library

[12]

Daniel H Lee and Adam K Anderson. 2017. Reading What the Mind Thinks From How the Eye Sees . Psychological Science, Vol. 28, 4 (2017), 494--503.

[13]

Zheng Li, Xia Mao, and Lei Liu. 2009. Providing expressive eye movement to virtual agents . Proceedings of the international conference on Multimodal interfaces - ICMI (2009), 241.

Digital Library

[14]

Masahiro Mori. 1970. The Uncanny Valley . Energy, Vol. 7, 4 (1970), 33--35.

[15]

Christopher Oat. 2007. Animated Wrinkle Maps. In ACM SIGGRAPH 2007 Courses (SIGGRAPH '07). ACM, New York, NY, USA, 33--37.

Digital Library

[16]

Magalie Ochs, Radoslaw Niewiadomski, and Catherine Pelachaud. 2015. 18 Facial Expressions of Emotions for Virtual Characters . The Oxford Handbook of Affective Computing (2015), 261.

[17]

Maja Pantic, Michel Valstar, Ron Rademaker, and Ludo Maat. 2005. Web-based database for facial expression analysis. In 2005 IEEE international conference on multimedia and Expo. IEEE, 5.

[18]

Timo Partala and Veikko Surakka. 2003. Pupil size variation as an indication of affective processing . International journal of human-computer studies, Vol. 59, 1--2 (2003), 185--198.

Digital Library

[19]

Michel Valstar and Maja Pantic. 2010. Induced disgust, happiness and surprise: an addition to the mmi facial expression database. In Proc. 3rd Intern. Workshop on EMOTION (satellite of LREC): Corpora for Research on Emotion and Affect. 65.

Cited By

田倍(2024)Robots with Emotions: Emotional Expression and Communication of Artificial AgentsAdvances in Psychology10.12677/ap.2024.14530514:05(212-220)Online publication date: 2024
https://doi.org/10.12677/ap.2024.145305
Verhoef TFosch-Villaronga E(2023)Towards affective computing that works for everyone2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII59096.2023.10388169(1-8)Online publication date: 10-Sep-2023
https://doi.org/10.1109/ACII59096.2023.10388169
Miller EFoo YMewton PDawel A(2023)How do people respond to computer-generated versus human faces? A systematic review and meta-analysesComputers in Human Behavior Reports10.1016/j.chbr.2023.10028310(100283)Online publication date: May-2023
https://doi.org/10.1016/j.chbr.2023.100283
Show More Cited By

Index Terms

Expressive Virtual Human: Impact of expressive wrinkles and pupillary size on emotion recognition
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Human-virtual human interaction by upper body gesture understanding
VRST '13: Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

In this paper, a novel human-virtual human interaction system is proposed. This system supports a real human to communicate with a virtual human using natural body language. Meanwhile, the virtual human is capable of understanding the meaning of human ...
Human perception of a conversational virtual human: an empirical study on the effect of emotion and culture

Virtual reality applications with virtual humans, such as virtual reality exposure therapy, health coaches and negotiation simulators, are developed for different contexts and usually for users from different countries. The emphasis on a virtual human's ...
Affective computing with primary and secondary emotions in a virtual human

We introduce the WASABI ([W]ASABI [A]ffect [S]imulation for [A]gents with [B]elievable [I]nteractivity) Affect Simulation Architecture, in which a virtual human's cognitive reasoning capabilities are combined with simulated embodiment to achieve the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IVA '19: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents

July 2019

282 pages

ISBN:9781450366724

DOI:10.1145/3308532

General Chairs:
Catherine Pelachaud
CNRS-ISIR, Sorbonne Universite, France
,
Jean-Claude Martin
CNRS-LIMSI, Universite Paris Saclay, France
,
Program Chairs:
Hendrik Buschmeier
Bielefeld University, Germany
,
Gale Lucas
University of Southern California, USA
,
Stefan Kopp
Bielefeld University, Germany

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2019

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

IVA '19

Sponsor:

SIGAI

IVA '19: ACM International Conference on Intelligent Virtual Agents

July 2 - 5, 2019

Paris, France

Acceptance Rates

IVA '19 Paper Acceptance Rate 15 of 63 submissions, 24%;

Overall Acceptance Rate 53 of 196 submissions, 27%

Upcoming Conference

IVA '24

Sponsor:
sigai

ACM International Conference on Intelligent Virtual Agents

September 16 - 19, 2024

GLASGOW , United Kingdom

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
245
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)3

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

田倍(2024)Robots with Emotions: Emotional Expression and Communication of Artificial AgentsAdvances in Psychology10.12677/ap.2024.14530514:05(212-220)Online publication date: 2024
https://doi.org/10.12677/ap.2024.145305
Verhoef TFosch-Villaronga E(2023)Towards affective computing that works for everyone2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII59096.2023.10388169(1-8)Online publication date: 10-Sep-2023
https://doi.org/10.1109/ACII59096.2023.10388169
Miller EFoo YMewton PDawel A(2023)How do people respond to computer-generated versus human faces? A systematic review and meta-analysesComputers in Human Behavior Reports10.1016/j.chbr.2023.10028310(100283)Online publication date: May-2023
https://doi.org/10.1016/j.chbr.2023.100283
Lau WSauter MHuckauf A(2022)Small Pupils Lead to Lower Judgements of a Person’s Characteristics for Exaggerated, but Not for Realistic PupilsBehavioral Sciences10.3390/bs1208028312:8(283)Online publication date: 12-Aug-2022
https://doi.org/10.3390/bs12080283
Milcent AKadri ARichir S(2021)Using Facial Expressiveness of a Virtual Agent to Induce Empathy in UsersInternational Journal of Human–Computer Interaction10.1080/10447318.2021.193838738:3(240-252)Online publication date: 18-Jun-2021
https://doi.org/10.1080/10447318.2021.1938387
Dubosc CGorisse GChristmann OFleury SPoinsot KRichir S(2021)Impact of avatar facial anthropomorphism on body ownership, attractiveness and social presence in collaborative tasks in immersive virtual environmentsComputers and Graphics10.1016/j.cag.2021.08.011101:C(82-92)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1016/j.cag.2021.08.011
Tisserand YAylett RMortillaro MRudrauf D(2020)Real-time simulation of virtual humans' emotional facial expressions, harnessing autonomic physiological and musculoskeletal controlProceedings of the 20th ACM International Conference on Intelligent Virtual Agents10.1145/3383652.3423904(1-8)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3383652.3423904
Cerda LGraziani PDel-Monte J(2020)Emotional Valence Recognition on Virtual, Robotic, and Human Faces: a Comparative StudyJournal of Technology in Behavioral Science10.1007/s41347-020-00172-5Online publication date: 8-Oct-2020
https://doi.org/10.1007/s41347-020-00172-5

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents