research-article

Free access

Computationally modeling human emotion

Authors:

Stacy Marsella,

Jonathan GratchAuthors Info & Claims

Communications of the ACM, Volume 57, Issue 12

Pages 56 - 67

https://doi.org/10.1145/2631912

Published: 26 November 2014 Publication History

All formats PDF

Abstract

Computer models of emotion inform theories of human intelligence and advance human-centric applications.

References

[1]

Armony, J.L., Servan-Schreiber, D., Cohen, J.D., and LeDoux, J.E. Computational modeling of emotion: Explorations through the anatomy and physiology of fear conditioning. Trends in Cognitive Science 1, 1 (Apr. 1997), 28--34.

Crossref

Google Scholar

[2]

Barrett, L.F. Are emotions natural kinds? Perspectives on Psychological Science 1, 1 (Apr. 2006), 28--58.

Crossref

Google Scholar

[3]

Bechara, A., Damásio, H., Damásio, A., and Lee, G. Different contributions of the human amygdala and ventromedial prefrontal cortex to decision making. Journal of Neuroscience 19, 13 (July 1, 1999), 5473--5481.

Crossref

Google Scholar

[4]

Becker-Asano, C. and Wachsmuth, I. Affect simulation with primary and secondary emotions. In Proceedings of the Eighth International Conference on Intelligent Virtual Agents (Tokyo). Springer, 2008, 15--28.

Digital Library

Google Scholar

[5]

Blanchard, A. and Cañamero, L. Developing affect-modulated behaviors: Stability, exploration, exploitation, or imitation? In Proceedings of the Sixth International Workshop on Epigenetic Robotics (Paris, 2006).

Google Scholar

[6]

Broekens, J. Modeling the experience of emotion. International Journal of Synthetic Emotions 1, 1 (Jan. 2010), 1--17.

Digital Library

Google Scholar

[7]

Broekens, J., Kosters, W.A., and Verbeek, F.J. On affect and self-adaptation: Potential benefits of valence-controlled action-selection. In Proceedings of the Second International Conference on Bio-inspired Modeling of Cognitive Tasks (Manga del Mar Menor, Spain). Springer, 2007, 357--366.

Digital Library

Google Scholar

[8]

Conati, C. and MacLaren, H. Evaluating a probabilistic model of student affect. In Proceedings of the Seventh International Conference on Intelligent Tutoring Systems (Maceio, Brazil, 2004).

Crossref

Google Scholar

[9]

Darwin, C. The Expression of the Emotions in Man and Animals, Third Edition. Oxford University Press, New York, 1998.

Google Scholar

[10]

de Melo, C., Gratch, J., and Carnevale, P.J. Reverse appraisal: Inferring from emotion displays who is the cooperator and the competitor in a social dilemma. In Proceedings of the Cognitive Science Conference (Boston, July 2011).

Google Scholar

[11]

DeSteno, D., Dasgupta, N., Bartlett, M.Y., and Cajdric, A. Prejudice from thin air. Psychological Science 15, 5 (May 2004), 319--324.

Crossref

Google Scholar

[12]

Dias, J. and Paiva, A. Feeling and reasoning: A computational model for emotional agents. In Proceedings of the 12^th Portuguese Conference on Artificial Intelligence (Covilhã, Portugal). Springer 2005, 127--140.

Digital Library

Google Scholar

[13]

Eisenberg, N., Fabes, R.A., Schaller, M., and Miller, P.A. Sympathy and personal distress: Development, gender differences, and interrelations of indexes. In Empathy and Related Emotional Responses New Directions in Child Development, N. Eisenberg, Ed. Jossey-Bass, San Francisco, CA, 1989, 107--126.

Google Scholar

[14]

Ekman, P. An argument for basic emotions. Cognition and Emotion 6, 3--4 (1992), 169--200.

Crossref

Google Scholar

[15]

Frank, R. Passions With Reason: The Strategic Role of the Emotions. W.W. Norton, New York, 1988.

Google Scholar

[16]

Gebhard, P. ALMA: A Layered Model of Affect. In Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems (Utrecht, the Netherlands), 2005.

Digital Library

Google Scholar

[17]

Gratch, J. and Marsella, S. A domain-independent framework for modeling emotion. Journal of Cognitive Systems Research 5, 4 (Dec. 2004), 269--306.

Digital Library

Google Scholar

[18]

Ito, J.Y. and Marsella, S.C. Contextually based utility: An appraisal-based approach at modeling framing and decisions. In Proceedings of the 25^th AAAI Conference on Artificial Intelligence (San Francisco, Aug. 7--11). AAAI Press, 2011, 1442--1448.

Google Scholar

[19]

Ito, J.Y., Pynadath, D.V., and Marsella, S.C. Modeling self-deception within a decision-theoretic framework. Autonomous Agents and Multi-Agent Systems 20, 1 (May 2010), 3--13.

Digital Library

Google Scholar

[20]

Keltner, D., and Haidt, J. Social functions of emotions at four levels of analysis. Cognition and Emotion 13, 5 (1999), 505--521.

Crossref

Google Scholar

[21]

Lazarus, R.S. Emotion and Adaptation. Oxford University Press, New York, 1991.

Google Scholar

[22]

Lester, J.C., Towns, S.G., Callaway, C.B., Voerman, J.L., and FitzGerald, P.J. Deictic and emotive communication in animated pedagogical agents. In Embodied Conversational Agents, J. Cassell, S. Prevost, J. Sullivan, and E. Churchill, Eds. MIT Press, Cambridge, MA, 2000, 123--154.

Digital Library

Google Scholar

[23]

Mao, W. and Gratch, J. Evaluating a computational model of social causality and responsibility. In Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems (Hakodate, Japan), 2006.

Digital Library

Google Scholar

[24]

Marsella, S. and Gratch, J. EMA: A process model of appraisal dynamics. Journal of Cognitive Systems Research 10, 1 (Mar. 2009), 70--90.

Digital Library

Google Scholar

[25]

Marsella, S. and Gratch, J. Modeling the interplay of plans and emotions in multi-agent simulations. In Proceedings of the 23^rd Annual Conference of the Cognitive Science Society (Edinburgh, Scotland, 2001).

Google Scholar

[26]

Marsella, S., Gratch, J., and Petta, P. Computational models of emotion. In A Blueprint for Affective Computing: A Sourcebook and Manual, K.R. Scherer, T. Bänziger, and E. Roesch, Eds. Oxford University Press, New York, 2010, 21--46.

Google Scholar

[27]

Marsella, S., Johnson, W.L., and LaBore, C. Interactive pedagogical drama. In Proceedings of the Fourth International Conference on Autonomous Agents (Montréal, Canada, 2000), 301--308.

Digital Library

Google Scholar

[28]

Mehrabian, A. and Russell, J.A. An Approach to Environmental Psychology. MIT Press, Cambridge, MA, 1974.

Google Scholar

[29]

Panskepp, J. Affective Neuroscience: The Foundations of Human and Animal Emotions. Oxford University Press, New York, 1998.

Google Scholar

[30]

Reisenzein, R. Exploring the strength of association between the components of emotion syndromes: The case of surprise. Cognition & Emotion 14, 1 (2000), 1--38.

Crossref

Google Scholar

[31]

Reisenzein, R., Hudlicka, E., Dastani, M., Gratch, J., Hindriks, K., Lorini, E., and Meyer, J.-J.C. Computational modeling of emotion: Toward improving the inter- and intradisciplinary exchange. IEEE Transactions on Affective Computing 4, 3 (July 2013), 242--245.

Digital Library

Google Scholar

[32]

Scherer, K.R. Appraisal considered as a process of multilevel sequential checking. In Appraisal Processes in Emotion: Theory, Methods, Research, K.R. Scherer, A. Schorr, and T. Johnstone, Eds. Oxford University Press, New York, 2001, 92--120.

Crossref

Google Scholar

[33]

Scheutz, M. and Sloman, A. Affect and agent control: Experiments with simple affective states. In Proceedings of the Second Asia-Pacific Conference on Intelligent Agent Technology (Maebashi City, Japan). World Scientific Publishing, 2001, 200--209.

Crossref

Google Scholar

[34]

Schwarz, N. and Clore, G.L. Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. Journal of Personality and Social Psychology 45, 3 (Sept. 1983), 513--523.

Crossref

Google Scholar

[35]

Simon, H.A. Motivational and emotional controls of cognition. Psychological Review 74 (Jan. 1967), 29--39.

Crossref

Google Scholar

[36]

Staller, A. and Petta, P. Introducing emotions into the computational study of social norms: A first evaluation. Journal of Artificial Societies and Social Simulation 4, 1 (Jan. 2001), 27--60.

Google Scholar

[37]

Swartout, W., Gratch, J., Hill, R., Hovy, E., Marsella, S., Rickel, J., and Traum, D. Toward virtual humans. AI Magazine 27, 1 (2006).

Digital Library

Google Scholar

[38]

Traum, D., Swartout, W., Marsella, S., and Gratch, J. Fight, flight, or negotiate. In Proceedings of the Intelligent Virtual Agents Conference (Kos, Greece). Springer, 2005.

Digital Library

Google Scholar

[39]

Tversky, A. and Kahneman, D. The framing of decisions and the psychology of choice. Science 211, 4481 (Jan. 30, 1981), 453--458.

Crossref

Google Scholar

[40]

Zajonc, R.B. Feeling and thinking: Preferences need no inferences. American Psychologist 35 (Feb. 1980), 151--175.

Crossref

Google Scholar

Cited By

View all

Gomes SRocha JDias JMartinho C(2024)Designing a Mood-Mediated Multi-Level ReasonerIEEE Transactions on Affective Computing10.1109/TAFFC.2023.329331015:3(787-798)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TAFFC.2023.3293310
Cimpeanu TPereira LHan TAgmon NAn BRicci AYeoh W(2023)Co-evolution of Social and Non-social Guilt in Structured PopulationsProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3599062(2739-2741)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3599062
Karnati MSeal ABhattacharjee DYazidi AKrejcar O(2023)Understanding Deep Learning Techniques for Recognition of Human Emotions Using Facial Expressions: A Comprehensive SurveyIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.324366172(1-31)Online publication date: 2023
https://doi.org/10.1109/TIM.2023.3243661
Show More Cited By

Index Terms

Computationally modeling human emotion
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
2. Computing methodologies
  1. Artificial intelligence
  2. Modeling and simulation

Recommendations

Learning Human Emotion Patterns for Modeling Virtual Humans
TAAI '11: Proceedings of the 2011 International Conference on Technologies and Applications of Artificial Intelligence

Emotion modeling is a crucial part in modeling virtual humans. Although various emotion models have been proposed, most of them focus on designing specific appraisal rules. As there is no unified framework for emotional appraisal, the appraisal ...
Human emotion and the uncanny valley: a GLM, MDS, and Isomap analysis of robot video ratings
HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction

The eerie feeling attributed to human-looking robots and animated characters may be a key factor in our perceptual and cognitive discrimination of the human and humanlike. This study applies regression, the generalized linear model (GLM), factor ...
Tensor-Based Human Body Modeling
CVPR '13: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition

In this paper, we present a novel approach to model 3D human body with variations on both human shape and pose, by exploring a tensor decomposition technique. 3D human body modeling is important for 3D reconstruction and animation of realistic human ...

Comments

Information & Contributors

Information

Published In

Communications of the ACM Volume 57, Issue 12

December 2014

92 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/2692965

Editor:
Moshe Y. Vardi
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2014

Published in CACM Volume 57, Issue 12

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

90
Total Citations
View Citations
26,038
Total Downloads

Downloads (Last 12 months)504
Downloads (Last 6 weeks)25

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gomes SRocha JDias JMartinho C(2024)Designing a Mood-Mediated Multi-Level ReasonerIEEE Transactions on Affective Computing10.1109/TAFFC.2023.329331015:3(787-798)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TAFFC.2023.3293310
Cimpeanu TPereira LHan TAgmon NAn BRicci AYeoh W(2023)Co-evolution of Social and Non-social Guilt in Structured PopulationsProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3599062(2739-2741)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3599062
Karnati MSeal ABhattacharjee DYazidi AKrejcar O(2023)Understanding Deep Learning Techniques for Recognition of Human Emotions Using Facial Expressions: A Comprehensive SurveyIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.324366172(1-31)Online publication date: 2023
https://doi.org/10.1109/TIM.2023.3243661
Kim SAn CCha JKim DPark E(2023)D-ViSA: A Dataset for Detecting Visual Sentiment from Art Images2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW60793.2023.00328(3043-3051)Online publication date: 2-Oct-2023
https://doi.org/10.1109/ICCVW60793.2023.00328
Genzer SBen Adiva YPerry A(2023)Empathy10.1017/9781009281072Online publication date: 5-Dec-2023
https://doi.org/10.1017/9781009281072
Vempati RSharma L(2023)A systematic review on automated human emotion recognition using electroencephalogram signals and artificial intelligenceResults in Engineering10.1016/j.rineng.2023.10102718(101027)Online publication date: Jun-2023
https://doi.org/10.1016/j.rineng.2023.101027
Ahmed NAghbari ZGirija S(2023)A systematic survey on multimodal emotion recognition using learning algorithmsIntelligent Systems with Applications10.1016/j.iswa.2022.20017117(200171)Online publication date: Feb-2023
https://doi.org/10.1016/j.iswa.2022.200171
C. Firmino De Souza DTikka PAjenaghughrure I(2023)Seeking Emotion Labels for Bodily Reactions: An Experimental Study in Simulated InterviewsDigital Interaction and Machine Intelligence10.1007/978-3-031-37649-8_13(127-138)Online publication date: 25-Jul-2023
https://doi.org/10.1007/978-3-031-37649-8_13
Gebhard PTsovaltzi DSchneeberger TNunnari F(2022)Serious Games with SIAsThe Handbook on Socially Interactive Agents10.1145/3563659.3563676(527-546)Online publication date: 27-Oct-2022
https://dl.acm.org/doi/10.1145/3563659.3563676
Murukannaiah PAjmeri NSingh MBaeza-Yates RWeller KPortela MSeneviratne OWeber IYasseri TBon ASrinivas SIbáñez L(2022)Enhancing Creativity as Innovation via Asynchronous CrowdworkProceedings of the 14th ACM Web Science Conference 202210.1145/3501247.3531555(66-74)Online publication date: 26-Jun-2022
https://dl.acm.org/doi/10.1145/3501247.3531555
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF Chinese translation

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Learning Human Emotion Patterns for Modeling Virtual Humans

Human emotion and the uncanny valley: a GLM, MDS, and Isomap analysis of robot video ratings

Tensor-Based Human Body Modeling

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Funding Sources

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations