research-article

Towards recognizing the emotions of developers using biometrics: the design of a field study

Authors:

Daniela Girardi,

Filippo Lanubile,

Nicole Novielli,

Luigi Quaranta,

Alexander SerebrenikAuthors Info & Claims

SEmotion '19: Proceedings of the 4th International Workshop on Emotion Awareness in Software Engineering

Pages 13 - 16

https://doi.org/10.1109/SEmotion.2019.00010

Published: 28 May 2019 Publication History

Abstract

During their daily working activities, developers experience a wide range of emotions that are known to impact their personal wellbeing and, consequently, their work performance. As such, being aware of own and collaborators' emotions is crucial to enhance the collaborative development process. In this paper we present the design of a field study aimed at i) assessing the feasibility of emotion detection using non-invasive biometric sensors and ii) investigating the correlation between daily working activities and positive/negative emotions experienced by software developers. The long-term goal of our research is to provide recommendations to improve developers' mental well-being and productivity based on the emotions they experience.

References

[1]

A. E. Akgun, Halit Keskin, John C. Byrne, Ayse Gunsel. 2011. Antecedents and Results of Emotional Capability in Software Development Project Teams. Journal of Product Innovation Management. 5 (July 2011), 1--17.

[2]

M. M. Bradley and P. J. Lang. 1994. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavioral Therapy and Experimental Psychiatry, Volume 25, 49--59.

[3]

M.M. Bradley, P.J. Lang. 2007. Emotion and motivation. In J. T. Cacioppo, L. G. Tassinary, & G. G. Berntson (Eds.), Handbook of psychophysiology, pp. 581--607. New York, NY, US: Cambridge University Press.

[4]

F. Canento, A. Fred, H. Silva, H. Gamboa and A. Lourenço. 2011. Multimodal biosignal sensor data handling for emotion recognition. SENSORS, 2011IEEE, Limerick, 647--650.

[5]

P. Ekman and W. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, 1978.

[6]

T. Fritz, A. Begel, S. C. Müller, S. Yigit-Elliott, and M. Züger. 2014. Using psycho-physiological measures to assess task difficulty in software development. In Proceedings of the 36th International Conference on Software Engineering (ICSE 2014). ACM, New York, NY, USA, 402--413.

Digital Library

[7]

D. Girardi, N. Novielli, F. Lanubile. 2017. Emotion Detection Using Noninvasive Low Cost Sensors. In Proceedings of the 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII 2017), 125--130.

[8]

D. Graziotin, X. Wang, P. Abrahamsson. 2013. Are Happy Developers More Productive?. In Proceedings of PROFES 2013. Lecture Notes in Computer Science, vol 7983. Springer, Berlin, Heidelberg.

[9]

D. Graziotin, F. Fagerholm, X. Wang, and P. Abrahamsson. 2017. Consequences of unhappiness while developing software. In Proceedings of the 2nd International Workshop on Emotion Awareness in Software Engineering (SEmotion '17). IEEE press, Piscataway, NJ, USA, 42--47.

Digital Library

[10]

D. Graziotin, X. W., and P. Abrahamsson. 2015. Do feelings matter? On the correlation of affects and the self-assessed productivity in software engineering. J. Softw. Evol. Process 27, 7, 467--487.

Digital Library

[11]

K. Gouizi, C. Maaoui and F. Bereksi Reguig. 2014. Negative emotion detection using EMG signal. In Proceedings of International Conference on Control, Decision and Information Technologies (CoDIT), 690--695.

[12]

M. R. Islam and M. F. Zibran. 2018. DEVA: sensing emotions in the valence arousal space in software engineering text. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing (SAC '18). ACM, New York, NY, USA, 1536--1543.

Digital Library

[13]

S. Koelstra., C. Muhl, M. Soleymani, J. S. Lee, A.Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras. 2012. Deap: A database for emotion analysis; using physiological signals. IEEE Transactions on Affective Computing, Volume 3, 18--31.

Digital Library

[14]

M. Kuutila, M. V. Mäntylä, M. Claes, M. Elovainio, and B. Adams. 2018. Using experience sampling to link software repositories with emotions and work well-being. In Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '18). ACM, New York, NY, USA, Article 29, 10 pages.

Digital Library

[15]

R. Larson and M. Csikszentmihalyi. 1983. The Experience Sampling Method. New Directions for Methodology of Social & Behavioral Science, 15 (March 1983), 41--56.

[16]

T. D. LaToza, G. Venolia, and R. DeLine. 2006. Maintaining mental models: a study of developer work habits. In Proceedings of the 28th international conference on Software engineering (ICSE '06). ACM, New York, NY, USA, 492--501.

Digital Library

[17]

Linux 4.19-rc4 released, an apology, and a maintainership note. https://lkml.org/lkml/2018/9/16/167. Accessed: 2019-01-07

[18]

M. V. Mäntylä, N. Novielli, F. Lanubile, M. Claes, and M. Kuutila. 2017. Bootstrapping a lexicon for emotional arousal in software engineering. In Proceedings of the 14th International Conference on Mining Software Repositories (MSR '17). IEEE Press, Piscataway, NJ, USA, 198--202.

Digital Library

[19]

M. Mäntylä, B. Adams, G. Destefanis, D.l Graziotin, and M. Ortu. 2016. Mining valence, arousal, and dominance: possibilities for detecting burnout and productivity?. In Proceedings of the 13th International Conference on Mining Software Repositories (MSR '16). ACM, New York, NY, USA, 247--258.

Digital Library

[20]

A. N. Meyer, Gail C. Murphy, Thomas Zimmermann, and Thomas Fritz. 2017. Design Recommendations for Self-Monitoring in the Workplace: Studies in Software Development. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 79 (December 2017), 24 pages.

Digital Library

[21]

S. C. Müller and T. Fritz. 2015. Stuck and frustrated or in flow and happy: sensing developers' emotions and progress. In Proceedings of the 37th International Conference on Software Engineering - Volume 1 (ICSE '15), Vol. 1. IEEE Press, Piscataway, NJ, USA, 688--699.

Digital Library

[22]

M. Murugappan and S. Murugappan. 2013. Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT). IEEE 9th International Colloquium on Signal Processing and its Applications, 289--294.

[23]

R. W. Picard, E. Vyzas and J. Healey. 2001. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 10, 1175--1191.

Digital Library

[24]

J. A. Russell. 1980. A Circumplex Model of Affect. Journal of Personality and Social Psychology, Volume 33, 1161--1178

[25]

B. Sharif and H. Kagdi. 2011. On the use of eye tracking in software traceability. In Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering (TEFSE '11). ACM, New York, NY, USA, 67--70.

Digital Library

[26]

M. Soleymani, M. Pantic and T. Pun. 2012. Multimodal Emotion Recognition in Response to Videos. IEEE Transactions on Affective Computing, vol. 3, no. 2, 211--223.

Digital Library

[27]

G. Valenza and E.P. Scilingo. 2014. Autonomic Nervous System Dynamics for Mood and Emotional-State Recognition: Significant Advances in Data Acquisition. Springer, 2015.

Digital Library

[28]

M. Züger, S. C. Müller, A. N. Meyer, and Thomas Fritz. 2018. Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA.

Digital Library

Cited By

Ferrari AHuichapa TSpoletini PNovielli NFucci DGirardi D(2023)Using Voice and Biofeedback to Predict User Engagement during Product Feedback InterviewsACM Transactions on Software Engineering and Methodology10.1145/363571233:4(1-36)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3635712
Chen ZCao YYao HLu XPeng XMei HLiu X(2021)Emoji-powered Sentiment and Emotion Detection from Software Developers’ Communication DataACM Transactions on Software Engineering and Methodology10.1145/342430830:2(1-48)Online publication date: 27-Jan-2021
https://dl.acm.org/doi/10.1145/3424308
Girardi DNovielli NFucci DLanubile FRothermel GBae D(2020)Recognizing developers' emotions while programmingProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380374(666-677)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380374
Show More Cited By

Recommendations

Recognizing developers' emotions while programming
ICSE '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering

Developers experience a wide range of emotions during programming tasks, which may have an impact on job performance. In this paper, we present an empirical study aimed at (i) investigating the link between emotion and progress, (ii) understanding the ...
Sensing developers' emotions: the design of a replicated experiment
SEmotion '18: Proceedings of the 3rd International Workshop on Emotion Awareness in Software Engineering

Software developers experience a wide variety of emotions during their work and research is now focusing on the role played by these emotions on software developers productivity as well as on their wellbeing. In this paper, we propose a replication of a ...
Supporting Developers' Emotional Awareness: from Self-reported Emotions to Biometrics
EASE '24: Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering

This PhD research project investigates whether emotional awareness can be helpful to improve developers’ productivity and well-being. The aim is to provide insights, based on self-monitoring, which can help developers to prevent or reduce stress. To ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SEmotion '19: Proceedings of the 4th International Workshop on Emotion Awareness in Software Engineering

May 2019

58 pages

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS: Computer Society

Publisher

IEEE Press

Publication History

Published: 28 May 2019

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '19

Sponsor:

SIGSOFT
IEEE-CS

ICSE '19: 41st International Conference on Software Engineering

May 28, 2019

Quebec, Montreal, Canada

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
89
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ferrari AHuichapa TSpoletini PNovielli NFucci DGirardi D(2023)Using Voice and Biofeedback to Predict User Engagement during Product Feedback InterviewsACM Transactions on Software Engineering and Methodology10.1145/363571233:4(1-36)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3635712
Chen ZCao YYao HLu XPeng XMei HLiu X(2021)Emoji-powered Sentiment and Emotion Detection from Software Developers’ Communication DataACM Transactions on Software Engineering and Methodology10.1145/342430830:2(1-48)Online publication date: 27-Jan-2021
https://dl.acm.org/doi/10.1145/3424308
Girardi DNovielli NFucci DLanubile FRothermel GBae D(2020)Recognizing developers' emotions while programmingProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380374(666-677)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380374
Brants WSharif BSerebrenik A(2019)Assessing the Meaning of Emojis for Emotional Awareness - A Pilot StudyCompanion Proceedings of The 2019 World Wide Web Conference10.1145/3308560.3316550(419-423)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3308560.3316550

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents