Article

StressCam: non-contact measurement of users' emotional states through thermal imaging

Authors:

Ioannis Pavlidis,

Justin StarrenAuthors Info & Claims

CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

Pages 1725 - 1728

https://doi.org/10.1145/1056808.1057007

Published: 02 April 2005 Publication History

Abstract

We present a novel methodology for monitoring the affective states of computer users. The method is based on thermal imaging of the face. To the user, the imaging system appears much like a video-conferencing camera. The method does not require contact with the subject and is passive; therefore, monitoring can be continuous and transparent to the computer user. We have found that user stress is correlated with increased blood flow in the frontal vessel of the forehead. This increased blood flow dissipates convective heat, which can be monitored through thermal imaging. The system has been evaluated on 12 subjects, and compared against real-time measurements of Energy Expenditure (EE). The new method is highly correlated with the established, but awkward EE methodology. The StressCam methodology is applicable to many instances where the real time measurement of users' emotional state is needed.

References

[1]

Amsel, A. Frustration Theory: An Analysis of Dispositional Learning and Memory, Cambridge University Press, New York, NY, USA, 1992. CONCLUSION

[2]

Dell Inc. http://www.dell.com.

[3]

Indigo Systems. http://www.indigosystems.com.

[4]

Lisetti, C., and Nasoz, F. Maui: a multimodal affective user interface. In Proc. of the 10 th ACM International Conference on Multimedia, ACM Press (2002), 161--170.

Digital Library

[5]

Nakatsu, R., Nicholson, J. and Tosa, N. Emotion recognition and its application to computer agents with spontaneous interactive capabilities. In Proc. of the Seventh ACM International Conference on Multimedia (Part 1), ACM Press (1999), 343--351.

Digital Library

[6]

Olson, D., Computerized Stroop Ver 1.0., Rochester, MN, 2004.

[7]

Pavlidis, I., Eberhardt, N. L. and Levine, J. Human behavior: seeing through the face of deception. Nature, 415, 35 (2002).

[8]

Pavlidis, I., and Levine, J. Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine, 21, 6 (2002), 56--64.

[9]

Pearson, K. Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity, and Panmixia. Philosophical Transactions of the Royal Society of London, A, 187 (1896), 253-318.

[10]

Project Cyborg. http://www.rdg.ac.uk/KevinWarwick/index.html.

[11]

Reynolds, C. and Picard, R. Affective sensors, privacy, and ethical contracts. CHI2004, ACM Press (2004), 1103--1106.

Digital Library

[12]

Scheirer, J., Fernandez, R., Klein, J. and Picard, R. Frustrating the user on purpose: a step toward building an affective computer. Interacting with Computers, 14 (2002), 93--118.

[13]

Seematter, G., Dirlewanger, M., Rey, V., Schneiter, P. and Tappy, L., Metabolic effects of mental stress during over and underfeeding in healthy women. Obesity Research, 10 (2002), 49--55.

[14]

SensorMedics. http://www.viasyshealthcare.com/smc/default.htm.

[15]

Stroop, J.R. Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18 (1935) 643--662.

Cited By

Xiao YSharma HZhang ZBergen-Cico DRahman TSalekin A(2024)Reading Between the HeatProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314417:4(1-30)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631441
Liu ILi SMa DLuan JWu XLiu FShen YNi S(2024)Detecting Moral Emotions with Facial and Vocal Expressions: A Multimodal Emotion Recognition Approach2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS59971.2024.10555674(1-5)Online publication date: 15-May-2024
https://doi.org/10.1109/ICHMS59971.2024.10555674
Gioia FNardelli MScilingo EGreco A(2024)Investigating the Physiology Behind Nose Thermal Response to Stress: A Cross-Mapping ApproachMEDICON’23 and CMBEBIH’2310.1007/978-3-031-49062-0_9(77-85)Online publication date: 4-Jan-2024
https://doi.org/10.1007/978-3-031-49062-0_9
Show More Cited By

Index Terms

StressCam: non-contact measurement of users' emotional states through thermal imaging
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Skin Temperature Extraction Using Facial Landmark Detection and Thermal Imaging for Comfort Assessment
BuildSys '19: Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

Despite the large share of energy consumption, current HVAC systems in buildings fail to meet their primary purpose of maintaining comfortable indoor conditions. Current "one size fits all" approach to control the thermal conditions in an environment ...
Interacting with human physiology

We propose a novel system that incorporates physiological monitoring as part of the human-computer interface. The sensing element is a thermal camera that is employed as a computer peripheral. Through bioheat modeling of facial imagery almost the full ...
Thermographic evaluation of early melanoma within the vascularized skin using combined non-Newtonian blood flow and bioheat models

A theoretical study on vascularized skin model to predict the thermal evaluation criteria of early melanoma using the dynamic thermal imaging technique is presented in this article. Thermographic evaluation of melanoma has been carried out during the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

April 2005

1358 pages

ISBN:1595930027

DOI:10.1145/1056808

Conference Chair:
Gerrit van der Veer
Vrije Universiteit, The Netherlands
,
Program Chair:
Carolyn Gale
Stanford University, Stanford, CA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 April 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI05

Sponsor:

CHI05: CHI 2005 Conference on Human Factors in Computing Systems

April 2 - 7, 2005

OR, Portland, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

129
Total Citations
View Citations
1,601
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)4

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xiao YSharma HZhang ZBergen-Cico DRahman TSalekin A(2024)Reading Between the HeatProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314417:4(1-30)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631441
Liu ILi SMa DLuan JWu XLiu FShen YNi S(2024)Detecting Moral Emotions with Facial and Vocal Expressions: A Multimodal Emotion Recognition Approach2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS59971.2024.10555674(1-5)Online publication date: 15-May-2024
https://doi.org/10.1109/ICHMS59971.2024.10555674
Gioia FNardelli MScilingo EGreco A(2024)Investigating the Physiology Behind Nose Thermal Response to Stress: A Cross-Mapping ApproachMEDICON’23 and CMBEBIH’2310.1007/978-3-031-49062-0_9(77-85)Online publication date: 4-Jan-2024
https://doi.org/10.1007/978-3-031-49062-0_9
Li LTang WYang HXue C(2023)Classification of User Emotional Experiences on B2C Websites Utilizing Infrared Thermal ImagingSensors10.3390/s2318799123:18(7991)Online publication date: 20-Sep-2023
https://doi.org/10.3390/s23187991
Morampudi KKancharla CTanniru LBhupal Naik D(2023)Exploring Cognitive and Affective Processing Based on Webcam-Based Heartrate Activity2023 International Conference on Quantum Technologies, Communications, Computing, Hardware and Embedded Systems Security (iQ-CCHESS)10.1109/iQ-CCHESS56596.2023.10391099(1-8)Online publication date: 15-Sep-2023
https://doi.org/10.1109/iQ-CCHESS56596.2023.10391099
Basu ADasgupta ARoutray AMitra P(2023)Anisotropic Diffusion-Based Contrast Enhancement of Frontal Facial Thermograms to Extract the Facial Vasculature2023 IEEE Guwahati Subsection Conference (GCON)10.1109/GCON58516.2023.10183572(1-6)Online publication date: 23-Jun-2023
https://doi.org/10.1109/GCON58516.2023.10183572
Hong K(2023)Classification of emotional stress and physical stress using a multispectral based deep feature extraction modelScientific Reports10.1038/s41598-023-29903-313:1Online publication date: 15-Feb-2023
https://doi.org/10.1038/s41598-023-29903-3
Kretschmer SPaul MHeussen NLeonhardt SOrlikowsky THeimann K(2023)Facial thermal response to non-painful stressor in premature and term neonatesPediatric Research10.1038/s41390-023-02614-194:4(1422-1427)Online publication date: 9-May-2023
https://doi.org/10.1038/s41390-023-02614-1
Filippini CMerla A(2023)Systematic Review of Affective Computing Techniques for Infant Robot InteractionInternational Journal of Social Robotics10.1007/s12369-023-00985-315:3(393-409)Online publication date: 7-Mar-2023
https://doi.org/10.1007/s12369-023-00985-3
Ordun CCha ARaff EPurushotham SKwok KRule MGulley J(2023)A Generative Approach for Image Registration of Visible-Thermal (VT) Cancer FacesArtificial Intelligence Over Infrared Images for Medical Applications (AIIIMA 2023)10.1007/978-3-031-44511-8_7(91-100)Online publication date: 29-Sep-2023
https://doi.org/10.1007/978-3-031-44511-8_7
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents