Cited By
View all- Tian LOviatt SMuszynski MChamberlain BHealey JSano A(2022)Applied Affective ComputingundefinedOnline publication date: 25-Jan-2022
Appraisal theory-based mobile app for physiological data collection and labelling in the wild
Authors: 
Fanny Larradet, Radoslaw Niewiadomski, Giacinto Barresi, Leonardo S. MattosAuthors Info & Claims
Fanny Larradet, Radoslaw Niewiadomski, Giacinto Barresi, Leonardo S. MattosAuthors Info & ClaimsPages 752 - 756
Abstract
Numerous studies on emotion recognition from physiological signals have been conducted in laboratory settings. However, differences in the data on emotions elicited in the lab and in the wild have been observed. Thus, there is a need for systems collecting and labelling emotion-related physiological data in ecological settings. This paper proposes a new solution to collect and label such data: an open-source mobile application (app) based on the appraisal theory. Our approach exploits a commercially available wearable physiological sensor connected to a smartphone. The app detects relevant events from the physiological data, and prompts the users to report their emotions using a questionnaire based on the Ortony, Clore and Collins (OCC) Model. We believe that the app can be used to collect emotional and physiological data in ecological settings and to ensure high quality of ground truth labels.
References
[1]
L. Shu, J. Xie, M. Yang, Z. Li, Z. Li, D. Liao, X. Xu, X. Yang, A review of emotion recognition using physiological signals, Sensors 18 (7) (2018) 1--41.
[2]
F. H. Wilhelm, P. Grossman, Emotions beyond the laboratory: Theoretical fundaments, study design, and analytic strategies for advanced ambulatory assessment, Biological psychology 84 (3) (2010) 552--569.
[3]
P. Schmidt, A. Reiss, R. Dürichen, K. Van Laerhoven, Labelling affective states in the wild: Practical guidelines and lessons learned, in: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, ACM, 2018, pp. 654--659.
[4]
J. Healey, L. Nachman, S. Subramanian, J. Shahabdeen, M. Morris, Out of the lab and into the fray: towards modeling emotion in everyday life, in: International Conference on Pervasive Computing, Springer, 2010, pp. 156--173.
[5]
A. Ortony, G. L. Clore, A. Collins, The cognitive structure of emotions, Cambridge university press, 1990.
[6]
C. Conati, Probabilistic assessment of user's emotions in educational games, Applied artificial intelligence 16 (7--8) (2002) 555--575.
[7]
C. Bartneck, Integrating the occ model of emotions in embodied characters, in: Workshop on Virtual Conversational Characters, Citeseer, 2002, pp. 39--48.
[8]
M. Myrtek, G. Brügner, Perception of emotions in everyday life: studies with patients and normals, Biological psychology 42 (1--2) (1996) 147--164.
[9]
F. Nasoz, K. Alvarez, C. L. Lisetti, N. Finkelstein, Emotion recognition from physiological signals using wireless sensors for presence technologies, Cognition, Technology & Work 6 (1) (2004) 4--14.
[10]
E. A. Carroll, M. Czerwinski, A. Roseway, A. Kapoor, P. Johns, K. Rowan, M. Schraefel, Food and mood: Just-in-time support for emotional eating, in: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, IEEE, 2013, pp. 252--257.
[11]
D. Beukelman, S. Fager, A. Nordness, Communication support for people with als, Neurology Research International 2011 (2011) 1--6.
[12]
M. Gjoreski, M. Luštrek, M. Gams, H. Gjoreski, Monitoring stress with a wrist device using context, Journal of biomedical informatics 73 (2017) 159--170.
[13]
K. Plarre, A. Raij, S. M. Hossain, A. A. Ali, M. Nakajima, M. Al'Absi, E. Ertin, T. Kamarck, S. Kumar, M. Scott, et al., Continuous inference of psychological stress from sensory measurements collected in the natural environment, in: Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks, IEEE, 2011, pp. 97--108.
[14]
K. Hovsepian, M. alAbsi, E. Ertin, T. Kamarck, M. Nakajima, S. Kumar, cstress: towards a gold standard for continuous stress assessment in the mobile environment, in: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, ACM, 2015, pp. 493--504.
[15]
A. Zenonos, A. Khan, G. Kalogridis, S. Vatsikas, T. Lewis, M. Sooriya-bandara, Healthyoffice: Mood recognition at work using smartphones and wearable sensors, in: 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), IEEE, 2016, pp. 1--6.
[16]
E. K. Gray, D. Watson, R. Payne, C. Cooper, Emotion, mood, and temperament: Similarities, differences, and a synthesis, Emotions at work: Theory, research and applications for management (2001) 21--43.
[17]
K. R. Scherer, What are emotions? and how can they be measured?, Social science information 44 (4) (2005) 695--729.
[18]
M. Isomursu, M. Tähti, S. Väinämö, K. Kuutti, Experimental evaluation of five methods for collecting emotions in field settings with mobile applications, International Journal of Human-Computer Studies 65 (4) (2007) 404--418.
[19]
A. Muaremi, B. Arnrich, G. Tröster, Towards measuring stress with smartphones and wearable devices during workday and sleep, Bio-NanoScience 3 (2) (2013) 172--183.
[20]
R. Kocielnik, N. Sidorova, F. M. Maggi, M. Ouwerkerk, J. H. Westerink, Smart technologies for long-term stress monitoring at work, in: Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems, IEEE, 2013, pp. 53--58.
[21]
A. Meschtscherjakov, A. Weiss, T. Scherndl, Utilizing emoticons on mobile devices within esm studies to measure emotions in the field, Proc. MME in conjunction with MobileHCI 9 (2009) 3361--3366.
[22]
C. Dobbins, S. Fairclough, A mobile lifelogging platform to measure anxiety and anger during real-life driving, in: 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), IEEE, 2017, pp. 327--332.
[23]
G. N. Dikecligil, L. R. Mujica-Parodi, Ambulatory and challenge-associated heart rate variability measures predict cardiac responses to real-world acute emotional stress, Biological psychiatry 67 (12) (2010) 1185--1190.
[24]
Empatica, empatica, www.empatica.com (accessed 9 july 2019).
[25]
M. Mortillaro, B. Meuleman, K. R. Scherer, Advocating a componential appraisal model to guide emotion recognition, International Journal of Synthetic Emotions (IJSE) 3 (1) (2012) 18--32.
[26]
C. Smith, Dimensions of appraisal and physiological response in emotion, Journal of Personality and Social Psychology (1989) 339--353.
[27]
G. L. Clore, A. Ortony, Psychological construction in the occ model of emotion, Emotion Review 5 (4) (2013) 335--343.
[28]
I. B. Mauss, M. D. Robinson, Measures of emotion: A review, Cognition and emotion 23 (2) (2009) 209--237.
[29]
G. E. Schwartz, D. A. Weinberger, J. A. Singer, Cardiovascular differentiation of happiness, sadness, anger, and fear following imagery and exercise., Psychosomatic medicine 43 (4) (1981) 343--364.
[30]
F. Larradet, Mafed, https://gitlab.com/flarradet/mafed (accessed 9 july 2019).
Recommendations
How do Chinese undergraduates harness the potential of appraisal and emotions in generative AI-Powered learning? A multigroup analysis based on appraisal theory
AbstractThe rapid development of generative AI (GenAI) has sparked increasing interest in its potential impact on student learning. Drawing on cognitive appraisal theory and AI device use acceptance (AIDUA) model, this study aims to investigate the ...
Highlights- Social influence and hedonic motivation increased the challenge appraisal of GenAI.
- GenAI’s anthropomorphism increased undergraduates’ hindrance appraisal of GenAI.
- Challenge appraisal led to positive emotions, raising their ...
The Data Location in Emotional Physiological Reaction Experiments: Based on Data Cross-Correlation Analysis
ISCID '13: Proceedings of the 2013 Sixth International Symposium on Computational Intelligence and Design - Volume 02In emotional physiological reaction experiments, to pinpoint the physiological signals which contain reliable emotional physiological responses is significant for subsequent emotion analysis and recognition. Combined with the continuous emotional rating ...
An Explorative Study of the Mobile App Ecosystem from App Developers' Perspective
WWW '17: Proceedings of the 26th International Conference on World Wide WebWith the prevalence of smartphones, app markets such as Apple App Store and Google Play has become the center stage in the mobile app ecosystem, with millions of apps developed by tens of thousands of app developers in each major market. This paper ...
Comments
Information & Contributors
Information
Published In
September 2019
1234 pages
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 September 2019
Check for updates
Qualifiers
- Research-article
Funding Sources
- Fondazione Roma
Conference
UbiComp '19: The 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing
September 9 - 13, 2019
London, United Kingdom
Acceptance Rates
Overall Acceptance Rate 764 of 2,912 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 230Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)2
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
Cited By
View all- Tian LOviatt SMuszynski MChamberlain BHealey JSano A(2022)Applied Affective ComputingundefinedOnline publication date: 25-Jan-2022
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in