research-article

Using Personality Detection Tools for Software Engineering Research: How Far Can We Go?

Authors:

Fabio Calefato,

Filippo LanubileAuthors Info & Claims

ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 31, Issue 3

Article No.: 42, Pages 1 - 48

https://doi.org/10.1145/3491039

Published: 09 April 2022 Publication History

Abstract

Assessing the personality of software engineers may help to match individual traits with the characteristics of development activities such as code review and testing, as well as support managers in team composition. However, self-assessment questionnaires are not a practical solution for collecting multiple observations on a large scale. Instead, automatic personality detection, while overcoming these limitations, is based on off-the-shelf solutions trained on non-technical corpora, which might not be readily applicable to technical domains like software engineering. In this article, we first assess the performance of general-purpose personality detection tools when applied to a technical corpus of developers’ e-mails retrieved from the public archives of the Apache Software Foundation. We observe a general low accuracy of predictions and an overall disagreement among the tools. Second, we replicate two previous research studies in software engineering by replacing the personality detection tool used to infer developers’ personalities from pull-request discussions and e-mails. We observe that the original results are not confirmed, i.e., changing the tool used in the original study leads to diverging conclusions. Our results suggest a need for personality detection tools specially targeted for the software engineering domain.

References

[1]

Neil R. Abramson. 2010. Internal reliability of the keirsey temperament sorter II: Cross-national application to American, Canadian, and Korean samples. Journal of Psychological Type 70, 2 (2010), 19–30.

[2]

Silvia T. Acuña, Marta Gómez, and Natalia Juristo. 2009. How do personality, team processes and task characteristics relate to job satisfaction and software quality?Information and Software Technology 51, 3 (mar 2009), 627–639. DOI:

Digital Library

[3]

Silvia T. Acuña, Marta N. Gómez, Jo E. Hannay, Natalia Juristo, and Dietmar Pfahl. 2015. Are team personality and climate related to satisfaction and software quality? Aggregating results from a twice replicated experiment. Information and Software Technology 57 (2015), 141–156. DOI:

[4]

Zulal Akarsu, Pinar Orgun, Hakan Dinc, Bora Gunyel, and Murat Yilmaz. 2019. Assessing personality traits in a large scale software development company: Exploratory industrial case study. In Proceedings of the European Conference on Software Process Improvement. Springer, 192–206.

[5]

Gordon W. Allport and Henry S. Odbert. 1936. Trait-names: A psycho-lexical study.Psychological Monographs 47, 1 (1936), i–171.

[6]

Shlomo Argamon, Sushant Dhawle, Moshe Koppel, and James W. Pennebaker. 2005. Lexical predictors of personality type. In Proceedings of Joint Annual Meeting of the Interface and the Classification Society of North America. 1–16. DOI:

[7]

Pierre-Hadrien Arnoux, Anbang Xu, Neil Boyette, Jalal Mahmud, Rama Akkiraju, and Vibha Sinha. 2017. 25 tweets to know you: A new model to predict personality with social media. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 11.

[8]

Danny Azucar, Davide Marengo, and Michele Settanni. 2018. Predicting the Big 5 personality traits from digital footprints on social media: A meta-analysis. Personality and Individual Differences 124, September 2017 (apr 2018), 150–159. DOI:

[9]

Sogol Balali, Igor Steinmacher, Umayal Annamalai, Anita Sarma, and Marco Aurelio Gerosa. 2018. Newcomers’ barriers. . . is that all? An analysis of mentors’ and newcomers’ barriers in OSS projects. Computer Supported Cooperative Work 27, 3–6 (dec 2018), 679–714. DOI:

Digital Library

[10]

Anderson S. Barroso, Jamille S. Madureira, Michel S. Soares, and Rogerio P. C. do Nascimento. 2017. Influence of human personality in software engineering-a systematic literature review. In Proceedings of the International Conference on Enterprise Information Systems, Vol. 2. SCITEPRESS, 53–62.

[11]

Blerina Bazelli, Abram Hindle, and Eleni Stroulia. 2013. On the personality traits of StackOverflow users. In Proceedings of the 2013 IEEE International Conference on Software Maintenance. IEEE, 460–463. DOI:

Digital Library

[12]

Gregory J. Boyle. 1995. Myers-briggs type indicator (MBTI): Some psychometric limitations. Australian Psychologist 30, 1 (1995), 71–74.

[13]

Gregory J. Boyle and Edward Helmes. 2009. Methods of personality assessment. The Cambridge Handbook of Personality Psychology (2009), 110. https://pure.bond.edu.au/ws/portalfiles/portal/33808818/fulltext.pdf.

[14]

Fabio Calefato, Filippo Lanubile, Federico Maiorano, and Nicole Novielli. 2018. Sentiment polarity detection for software development. Empirical Software Engineering 23, 3 (2018), 1352–1382.

Digital Library

[15]

Fabio Calefato, Filippo Lanubile, and Nicole Novielli. 2017. A preliminary analysis on the effects of propensity to trust in distributed software development. In Proceedings of the 2017 IEEE 12th International Conference on Global Software Engineering. IEEE, 56–60.

Digital Library

[16]

Fabio Calefato, Filippo Lanubile, Nicole Novielli, and Luigi Quaranta. 2019. EMTk-the emotion mining toolkit. In Proceedings of the 2019 IEEE/ACM 4th International Workshop on Emotion Awareness in Software Engineering. IEEE, 34–37.

Digital Library

[17]

Fabio Calefato, Filippo Lanubile, and Bogdan Vasilescu. 2019. A large-scale, in-depth analysis of developers’ personalities in the Apache ecosystem. Information and Software Technology 114 (2019), 1–20. DOI:

Digital Library

[18]

Erik Cambria, Bjorn Schuller, Yunqing Xia, and Catherine Havasi. 2013. New avenues in opinion mining and sentiment analysis. IEEE Intelligent Systems 28, 2 (mar 2013), 15–21. DOI:

Digital Library

[19]

Gerardo Canfora, Massimiliano Di Penta, Rocco Oliveto, and Sebastiano Panichella. 2012. Who is going to mentor newcomers in open source projects? In Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering. ACM Press, New York, New York, 1. DOI:

Digital Library

[20]

Giulio Carducci, Giuseppe Rizzo, Diego Monti, Enrico Palumbo, and Maurizio Morisio. 2018. TwitPersonality: Computing personality traits from tweets using word embeddings and supervised learning. Information 9, 5 (2018). DOI:

[21]

Fabio Celli, Fabio Pianesi, David Stillwell, and Michal Kosinski. 2013. Workshop on computational personality recognition: Shared task. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 7.

[22]

Max Coltheart. 1981. The MRC psycholinguistic database. The Quarterly Journal of Experimental Psychology Section A 33, 4 (1981), 497–505.

[23]

Paul T. Costa and Robert R. McCrae. 1985. The NEO Personality Inventory. Psychological assessment resources Odessa, FL.

[24]

Paul T. Costa Jr and Robert R. McCrae. 2008. The Revised NEO Personality Inventory (NEO-PI-R).Sage Publications, Inc.

[25]

Shirley Cruz, Fabio Q. B. da Silva, and Luiz Fernando Capretz. 2015. Forty years of research on personality in software engineering: A mapping study. Computers in Human Behavior 46 (2015), 94–113. DOI:

Digital Library

[26]

Andrea Di Sorbo, Sebastiano Panichella, Corrado A. Visaggio, Massimiliano Di Penta, Gerardo Canfora, and Harald C. Gall. 2015. Development emails content analyzer: Intention mining in developer discussions. In Proceedings of the 2015 30th International Conference on Automated Software Engineering.IEEE, 12–23. DOI:

Digital Library

[27]

J. M. Digman. 1990. Personality structure: Emergence of the five-factor model. Annual Review of Psychology 41, 1 (jan 1990), 417–440. DOI:

[28]

M. Brent Donnellan, Frederick L. Oswald, Brendan M. Baird, and Richard E. Lucas. 2006. The mini-IPIP scales: Tiny-yet-effective measures of the Big Five factors of personality.Psychological Assessment 18, 2 (2006), 192.

[29]

Golnoosh Farnadi, Geetha Sitaraman, Shanu Sushmita, Fabio Celli, Michal Kosinski, David Stillwell, Sergio Davalos, Marie Francine Moens, and Martine De Cock. 2016. Computational personality recognition in social media. User Modelling and User-Adapted Interaction 26, 2–3 (2016), 109–142. DOI:

Digital Library

[30]

Christopher J. Ferguson and Moritz Heene. 2012. A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science 7, 6 (2012), 555–561.

[31]

Andy Field, Jeremy Miles, and Zoë Field. 2012. Discovering Statistics Using R. Sage publications.

Digital Library

[32]

Robert L. Fowler. 1987. Power and robustness in product-moment correlation. Applied Psychological Measurement 11, 4 (1987), 419–428.

[33]

Daviti Gachechiladze, Filippo Lanubile, Nicole Novielli, and Alexander Serebrenik. 2017. Anger and its direction in collaborative software development. In Proceedings of the 2017 IEEE/ACM 39th International Conference on Software Engineering: New Ideas and Emerging Technologies Results Track. IEEE, 11–14.

Digital Library

[34]

Annie T. Ginty. 2013. Psychometric Properties. Springer New York, New York, NY, 1563–1564. DOI:

[35]

Jennifer Golbeck, Cristina Robles, Michon Edmondson, and Karen Turner. 2011. Predicting personality from Twitter. In Proceedings of the 2011 IEEE Third Int’l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int’l Conference on Social Computing. IEEE, 149–156. DOI:

[36]

Jennifer Goldbeck, Cristina Robles, and Karen Turner. 2011. Predicting personality with social media. In Proceedings of the 2011 Annual Conference Extended Abstracts on Human Factors in Computing Systems. 253. DOI:

Digital Library

[37]

Lewis R. Goldberg. 1981. Language and individual differences: The search for universals in personality lexicons. Review of Personality and Social Psychology 2, 1 (1981), 141–165.

[38]

Lewis R. Goldberg. 1993. The structure of phenotypic personality traits.The American Psychologist 48, 1 (jan 1993), 26–34. DOI:

[39]

Lewis R. Goldberg, John A. Johnson, Herbert W. Eber, Robert Hogan, Michael C. Ashton, C. Robert Cloninger, and Harrison G. Gough. 2006. The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality 40, 1 (2006), 84–96.

[40]

Margeret Hall and Simon Caton. 2017. Am i who i say i am? Unobtrusive self-representation and personality recognition on Facebook. PloS One 12, 9 (2017), e0184417.

[41]

Qiao Huang, Xin Xia, David Lo, and Gail C. Murphy. 2020. Automating intention mining. IEEE Transactions on Software Engineering, 10 (oct 2020), 1098–1119. DOI:

[42]

Rahul N. Iyer, S. Alex Yun, Meiyappan Nagappan, and Jesse Hoey. 2021. Effects of personality traits on pull request acceptance. IEEE Transactions on Software Engineering 47, 11 (2021), 2632–2643. DOI:

[43]

Hang Jiang, Xianzhe Zhang, and Jinho D. Choi. 2020. Automatic text-based personality recognition on monologues and multiparty dialogues using attentive networks and contextual embeddings (student abstract). In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 13821–13822.

[44]

Oliver P. John and Sanjay Srivastava. 1999. The big five trait taxonomy: History, measurement, and theoretical perspectives. In Proceedings of the Handbook of Personality: Theory and Research, 2nd ed., L. A. Pervin and O. P. John (Eds.), Guilford Press, 102–138.

[45]

Robbert Jongeling, Proshanta Sarkar, Subhajit Datta, and Alexander Serebrenik. 2017. On negative results when using sentiment analysis tools for software engineering research. Empirical Software Engineering 22, 5 (2017), 2543–2584.

Digital Library

[46]

Tanjila Kanij, Robert Merkel, and John Grundy. 2015. An empirical investigation of personality traits of software testers. In Proceedings of the 2015 IEEE/ACM 8th International Workshop on Cooperative and Human Aspects of Software Engineering. IEEE, 1–7. DOI:

Digital Library

[47]

Vishal Kaushal and Manasi Patwardhan. 2018. Emerging trends in personality identification using online social networks–a literature survey. ACM Transactions on Knowledge Discovery from Data 12, 2 (2018), 1–30.

Digital Library

[48]

Amirmohammad Kazameini, Samin Fatehi, Yash Mehta, Sauleh Eetemadi, and Erik Cambria. 2020. Personality trait detection using bagged SVM over BERT word embedding ensembles. In Proceedings of the 4th Widening Natural Language Processing Workshop. Association for Computational Linguistics.

[49]

David Keirsey. 1998. Please Understand Me II: Temperament, Character, Intelligence. Prometheus Nemesis Book Company.

[50]

Michal Kosinski, David Stillwell, and Thore Graepel. 2013. Private traits and attributes are predictable from digital records of human behavior. Proceedings of the National Academy of Sciences 110, 15 (2013), 5802–5805.

[51]

Makrina Viola Kosti, Robert Feldt, and Lefteris Angelis. 2016. Archetypal personalities of software engineers and their work preferences: A new perspective for empirical studies. Empirical Software Engineering 21, 4 (2016), 1509–1532.

Digital Library

[52]

Asadzadeh Laleh and Rahimi Shahram. 2017. Analyzing Facebook activities for personality recognition. In Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications. IEEE, 960–964.

[53]

Per Lenberg, Robert Feldt, and Lars Göran Wallgren. 2015. Behavioral software engineering: A definition and systematic literature review. Journal of Systems and Software 107, C (2015), 15–37.

Digital Library

[54]

Sherlock Licorish, Anne Philpott, and Stephen G. MacDonell. 2009. Supporting agile team composition: A prototype tool for identifying personality (in) compatibilities. In Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering. IEEE, 66–73.

Digital Library

[55]

Sherlock A. Licorish and Stephen G. MacDonell. 2015. Communication and personality profiles of global software developers. Information and Software Technology 64 (2015), 113–131. DOI:

Digital Library

[56]

Bin Lin, Fiorella Zampetti, Gabriele Bavota, Massimiliano Di Penta, and Michele Lanza. 2019. Pattern-based mining of opinions in q&a websites. In Proceedings of the 2019 IEEE/ACM 41st International Conference on Software Engineering. IEEE, 548–559.

Digital Library

[57]

Bin Lin, Fiorella Zampetti, Gabriele Bavota, Massimiliano Di Penta, Michele Lanza, and Rocco Oliveto. 2018. Sentiment analysis for software engineering: How far can we go? In Proceedings of the 40th International Conference on Software Engineering. Association for Computing Machinery, New York, NY, 94–104. DOI:

Digital Library

[58]

Zachary C. Lipton. 2018. The mythos of model interpretability. Communications of the ACM 61, 10 (Sept. 2018), 36–43. DOI:

Digital Library

[59]

Bing Liu. 2012. Sentiment analysis and opinion mining. In Proceedings of the Synthesis lectures on human language technologies.1–167.

[60]

Fei Liu, Julien Perez, and Scott Nowson. 2017. A language-independent and compositional model for personality trait recognition from short texts. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. 754–764.

[61]

Xiaoqian Liu and Tingshao Zhu. 2016. Deep learning for constructing microblog behavior representation to identify social media user’s personality. PeerJ Computer Science 2 (2016), e81. DOI:

[62]

Veronica Lynn, Niranjan Balasubramanian, and H. Andrew Schwartz. 2020. Hierarchical modeling for user personality prediction: The role of message-level attention. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 5306–5316.

[63]

François Mairesse, Marilyn A. Walker, Matthias R. Mehl, and Roger K. Moore. 2007. Using linguistic cues for the automatic recognition of personality in conversation and text. Journal of Artificial Intelligence Research 30 (2007), 457–500. DOI:

[64]

N. Majumder, S. Poria, A. Gelbukh, and E. Cambria. 2017. Deep learning-based document modeling for personality detection from text. IEEE Intelligent Systems 32, 2 (Mar 2017), 74–79. DOI:

Digital Library

[65]

Mika V. Mäntylä, Fabio Calefato, and Maelick Claes. 2018. Natural language or not (NLON) a package for software engineering text analysis pipeline. In Proceedings of the 15th International Conference on Mining Software Repositories. 387–391.

Digital Library

[66]

Davide Marengo and Christian Montag. 2020. Digital phenotyping of big five personality via Facebook data mining: A meta-analysis. Digital Psychology 1, 1 (jun 2020), 52–64. DOI:

[67]

Sandra C. Matz, Ruth E. Appel, and Michal Kosinski. 2020. Privacy in the age of psychological targeting. Current Opinion in Psychology 31 (2020), 116–121. DOI:. Privacy and Disclosure, Online and in Social Interactions.

[68]

Wolfgang Mauerer, Mitchell Joblin, Damian Andrew Andrew Tamburri, Carlos Paradis, Rick Kazman, and Sven Apel. 2021. In search of socio-technical congruence: A large-scale longitudinal study. IEEE Transactions on Software Engineering (2021). https://ieeexplore.ieee.org/document/9436025.

[69]

Robert R. McCrae. 2001. Trait psychology and culture: Exploring intercultural comparisons. Journal of Personality 69, 6 (2001), 819–846.

[70]

Robert R. McCrae. 2002. NEO-PI-R data from 36 cultures. In Proceedings of the The Five-factor Model of Personality Across Cultures. Springer, 105–125.

[71]

Robert R. McCrae and Paul T. Costa. 1987. Validation of the five-factor model of personality across instruments and observers.Journal of Personality and Social Psychology 52, 1 (1987), 81.

[72]

Yash Mehta, Samin Fatehi, Amirmohammad Kazameini, Clemens Stachl, Erik Cambria, and Sauleh Eetemadi. 2020. Bottom-up and top-down: Predicting personality with psycholinguistic and language model features. In Proceedings of the 2020 IEEE International Conference on Data Mining. IEEE, 1184–1189.

[73]

Yash Mehta, Navonil Majumder, Alexander Gelbukh, and Erik Cambria. 2020. Recent trends in deep learning based personality detection. Artificial Intelligence Review 53 (2020), 2313–2339.

[74]

E. Mellblom, I. Arason, L. Gren, and R. Torkar. 2019. The connection between burnout and personality types in software developers. IEEE Software 36, 5 (2019), 57–64. DOI:

Digital Library

[75]

Fabiana Mendes, Emília Mendes, Norsaremah Salleh, and Markku Oivo. 2021. Insights on the relationship between decision-making style and personality in Software Engineering. Information and Software Technology (2021), 106586. DOI:

Digital Library

[76]

Gregory J. Meyer, Stephen E. Finn, Lorraine D. Eyde, Gary G. Kay, Kevin L. Moreland, Robert R. Dies, Elena J. Eisman, Tom W. Kubiszyn, and Geoffrey M. Reed. 2001. Psychological testing and psychological assessment: A review of evidence and issues.American Psychologist 56, 2 (2001), 128.

[77]

Michael K. Mount, Murray R. Barrick, and J. Perkins Strauss. 1994. Validity of observer ratings of the big five personality factors.Journal of Applied Psychology 79, 2 (1994), 272.

[78]

Isabel Briggs Myers, Mary H. McCaulley, Naomi L. Quenk, and Allen L. Hammer. 1998. MBTI Manual: A Guide to the Development and Use of the Myers-Briggs Type Indicator, Vol. 3. Consulting Psychologists Press Palo Alto, CA.

[79]

Zhu Nanli, Zou Ping, L. I. Weiguo, and Cheng Meng. 2012. Sentiment analysis: A literature review. In Proceedings of the 2012 International Symposium on Management of Technology. IEEE, 572–576.

[80]

Nicole Novielli, Fabio Calefato, and Filippo Lanubile. 2015. The challenges of sentiment detection in the social programmer ecosystem. In Proceedings of the 7th International Workshop on Social Software Engineering. 33–40.

Digital Library

[81]

Nicole Novielli, Fabio Calefato, and Filippo Lanubile. 2018. A gold standard for emotion annotation in stack overflow. In Proceedings of the 2018 IEEE/ACM 15th International Conference on Mining Software Repositories. IEEE, 14–17.

Digital Library

[82]

Nicole Novielli, Fabio Calefato, Filippo Lanubile, and Alexander Serebrenik. 2021. Assessment of Off-the-Shelf SE-specific sentiment analysis tools: An extended replication study. Empirical Software Engineering 26, 2 (2021), 1–29.

[83]

Pavel Novikov, Larisa Mararitsa, and Victor Nozdrachev. 2021. Inferred vs traditional personality assessment: Are we predicting the same thing? (2021). arxiv:2103.09632. Retrieved from http://arxiv.org/abs/2103.09632.

[84]

Jon Oberlander and Scott Nowson. 2006. Whose thumb is it anyway? Classifying author personality from weblog text. In Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions. 627–634.

[85]

Richard F. Paige, Jordi Cabot, and Neil A. Ernst. 2017. Foreword to the special section on negative results in software engineering. Empirical Software Engineering 22, 5 (2017), 2453–2456. DOI:

Digital Library

[86]

O. H. Paruma Pabón, F. A. González, J. Aponte, J. E. Camargo, and F. Restrepo-Calle. 2016. Finding relationships between socio-technical aspects and personality traits by mining developer e-mails. In Proceedings of the 2016 IEEE/ACM Cooperative and Human Aspects of Software Engineering (CHASE). 8–14. DOI:

[87]

James W. Pennebaker, Ryan L. Boyd, Kayla Jordan, and Kate Blackburn. 2015. The Development and Psychometric Properties of LIWC2015. Technical Report.

[88]

James W. Pennebaker and Laura A. King. 1999. Linguistic styles: Language use as an individual difference.Journal of Personality and Social Psychology 77, 6 (1999), 1296.

[89]

Rosalind W. Picard. 2000. Affective Computing. MIT press.

Digital Library

[90]

Rod Plotnik and Haig Kouyoumdjian. 2013. Introduction to Psychology. Cengage Learning.

[91]

Daniele Quercia, Michal Kosinski, David Stillwell, and Jon Crowcroft. 2011. Our twitter profiles, our selves: Predicting personality with twitter. In Proceedings of the 2011 IEEE 3rd International Conference on Privacy, Security, Risk and Trust and 2011 IEEE 3rd International Conference on Social Computing. IEEE, 180–185. DOI:

[92]

Naveen Raman, Minxuan Cao, Yulia Tsvetkov, Christian Kästner, and Bogdan Vasilescu. 2020. Stress and burnout in open source: Toward finding, understanding, and mitigating unhealthy interactions. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: New Ideas and Emerging Results. 57–60.

Digital Library

[93]

Ricelli Ramos, Georges Neto, Barbara Silva, Danielle Monteiro, Ivandré Paraboni, and Rafael Dias. 2018. Building a corpus for personality-dependent natural language understanding and generation. In Proceedings of the 11th International Conference on Language Resources and Evaluation.

[94]

Francisco Rangel, Paolo Rosso, Martin Potthast, Benno Stein, and Walter Daelemans. 2015. Overview of the 3rd author profiling task at PAN 2015. In Proceedings of the CLEF2015 Evaluation Labs and Workshop Working Notes Papers.

[95]

Ayushi Rastogi and Nachiappan Nagappan. 2016. On the personality traits of GitHub contributors. In Proceedings of the 2016 IEEE 27th International Symposium on Software Reliability Engineering. IEEE, 77–86. DOI:

[96]

Louis M. Rea and Richard A. Parker. 2014. Designing and Conducting Survey Research: A Comprehensive Guide. John Wiley & Sons.

[97]

Peter C. Rigby and Ahmed E. Hassan. 2007. What can OSS mailing lists tell us? A preliminary psychometric text analysis of the apache developer mailing list. In Proceedings of the 4th International Workshop on Mining Software Repositories. IEEE, 23–23. DOI:

Digital Library

[98]

Brent W. Roberts, Nathan R. Kuncel, Rebecca Shiner, Avshalom Caspi, and Lewis R. Goldberg. 2007. The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes. Perspectives on Psychological Science 2, 4 (2007), 313–345.

[99]

Shade Ruangwan, Patanamon Thongtanunam, Akinori Ihara, and Kenichi Matsumoto. 2019. The impact of human factors on the participation decision of reviewers in modern code review. Empirical Software Engineering 24, 2 (apr 2019), 973–1016. DOI:

Digital Library

[100]

Richard M. Ryckman. 2012. Theories of Personality. Cengage Learning.

[101]

Norsaremah Salleh, Emilia Mendes, John Grundy, and Giles St J. Burch. 2010. An empirical study of the effects of conscientiousness in pair programming using the five-factor personality model. In Proceedings of the 2010 ACM/IEEE 32nd International Conference on Software Engineering. IEEE, 577–586.

Digital Library

[102]

Norsaremah Salleh, Emilia Mendes, John Grundy, and Giles St. J. Burch. 2010. The effects of neuroticism on pair programming. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement. ACM Press, 1–10. DOI:

Digital Library

[103]

Joni Salminen, Rohan Gurunandan Rao, Soon-gyo Jung, Shammur A. Chowdhury, and Bernard J. Jansen. 2020. Enriching social media personas with personality traits: A deep learning approach using the big five classes. In Proceedings of the International Conference on Human-Computer Interaction. Springer, 101–120.

Digital Library

[104]

Anand Ashok Sawant and Premkumar Devanbu. 2021. Naturally!: How breakthroughs in natural language processing can dramatically help developers. IEEE Software 38, 5 (2021), 118–123. DOI:

[105]

David P. Schmitt, Jüri Allik, Robert R. McCrae, Verónica Benet-Martínez, et al.2007. The geographic distribution of big five personality traits: Patterns and profiles of human self-description across 56 nations. Journal of Cross-Cultural Psychology 38, 2 (mar 2007), 173–212. DOI:

[106]

Patrick Schober, Christa Boer, and Lothar A. Schwarte. 2018. Correlation coefficients: Appropriate use and interpretation. Anesthesia & Analgesia 126, 5 (2018), 1763–1768.

[107]

H. Andrew Schwartz, Johannes C. Eichstaedt, Margaret L. Kern, Lukasz Dziurzynski, Stephanie M. Ramones, Megha Agrawal, Achal Shah, Michal Kosinski, David Stillwell, Martin E. P. Seligman, and Lyle H. Ungar. 2013. Personality, gender, and age in the language of social media: The open-vocabulary approach. PloS One 8, 9 (2013), e73791. DOI:

[108]

Ben Shneiderman. 1980. Software Psychology: Human Factors in Computer and Information Systems (Winthrop Computer Systems Series). Winthrop Publishers.

Digital Library

[109]

Forrest J. Shull, Jeffrey C. Carver, Sira Vegas, and Natalia Juristo. 2008. The role of replications in empirical software engineering. Empirical Software Engineering 13, 2 (2008), 211–218.

Digital Library

[110]

E. Smith, R. Loftin, E. Murphy-Hill, C. Bird, and T. Zimmermann. 2013. Improving developer participation rates in surveys. In Proceedings of the 2013 6th International Workshop on Cooperative and Human Aspects of Software Engineering. 89–92. DOI:

[111]

Edward K. Smith, Christian Bird, and Thomas Zimmermann. 2016. Beliefs, practices, and personalities of software engineers: A survey in a large software company. In Proceedings of the 9th International Workshop on Cooperative and Human Aspects of Software Engineering. 15–18.

Digital Library

[112]

Igor Steinmacher, Igor Scaliante Wiese, and Marco Aurelio Gerosa. 2012. Recommending mentors to software project newcomers. In Proceedings of the 2012 3rd International Workshop on Recommendation Systems for Software Engineering. IEEE, 63–67. DOI:

[113]

David J. Stillwell and Michal Kosinski. 2004. myPersonality project: Example of successful utilization of online social networks for large-scale social research. American Psychologist 59, 2 (2004), 93–104.

[114]

Chris Sumner, Alison Byers, Rachel Boochever, and Gregory J. Park. 2012. Predicting dark triad personality traits from twitter usage and a linguistic analysis of tweets. In Proceedings of the 2012 11th International Conference on Machine Learning and Applications. IEEE, 386–393.

Digital Library

[115]

Yla R. Tausczik and James W. Pennebaker. 2010. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology 29, 1 (2010), 24–54.

[116]

Louis Tay, Sang Eun Woo, Louis Hickman, and Rachel M. Saef. 2020. Psychometric and validity issues in machine learning approaches to personality assessment: A focus on social media text mining. European Journal of Personality 34, 5 (sep 2020), 826–844. DOI:

[117]

Walter F. Tichy. 2000. Hints for reviewing empirical work in software engineering. Empirical Software Engineering 5, 4 (2000), 309–312.

Digital Library

[118]

Marc Tomlinson, David Hinote, and David Bracewell. 2013. Predicting conscientiousness through semantic analysis of facebook posts. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 7.

[119]

Gias Uddin and Foutse Khomh. 2019. Automatic mining of opinions expressed about apis in stack overflow. IEEE Transactions on Software Engineering (2019).

[120]

Alessandro Vinciarelli and Gelareh Mohammadi. 2014. A survey of personality computing. IEEE Transactions on Affective Computing 5, 3 (2014), 273–291. DOI:

[121]

Sai Datta Vishnubhotla, Emilia Mendes, and Lars Lundberg. 2020. Investigating the relationship between personalities and agile team climate of software professionals in a telecom company. Information and Software Technology 126 (oct 2020), 106335. DOI:

[122]

Gerald M. Weinberg. 1971. The Psychology of Computer Programming. New York.

[123]

Aidan G. C. Wright. 2014. Current directions in personality science and the potential for advances through computing. IEEE Transactions on Affective Computing 5, 3 (2014), 292–296.

[124]

Tal Yarkoni. 2010. Personality in 100,000 words: A large-scale analysis of personality and word use among bloggers. Journal of Research in Personality 44, 3 (2010), 363–373.

[125]

Murat Yilmaz, Rory V. O’Connor, Ricardo Colomo-Palacios, and Paul Clarke. 2017. An examination of personality traits and how they impact on software development teams. Information and Software Technology 86 (2017), 101–122. DOI:

Digital Library

Cited By

Li XLenarduzzi VTaibi DGuéhéneuc YPetrillo FPolitowski C(2024)A Data-Driven Analysis of Player Personalities for Different Game GenresProceedings of the 1st ACM International Workshop on Foundations of Applied Software Engineering for Games10.1145/3663532.3664468(20-25)Online publication date: 16-Jul-2024
https://dl.acm.org/doi/10.1145/3663532.3664468
Vishnubhotla SMendes E(2024)Examining the effect of software professionals’ personality & additional capabilities on agile teams’ climateJournal of Systems and Software10.1016/j.jss.2024.112054214:COnline publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.jss.2024.112054
Vishnubhotla SMendes E(2024)Exploring the relation between personality traits and agile team climateJournal of Systems and Software10.1016/j.jss.2023.111937210:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.jss.2023.111937
Show More Cited By

Index Terms

Using Personality Detection Tools for Software Engineering Research: How Far Can We Go?
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing

Recommendations

A large-scale, in-depth analysis of developers’ personalities in the Apache ecosystem
Abstract Context
Large-scale distributed projects are typically the results of collective efforts performed by multiple developers with heterogeneous personalities.
Objective
We aim to find evidence ...
Personality Computing: How Machines Can Deal With Personality Traits
MAPTRAITS '14: Proceedings of the 2014 Workshop on Mapping Personality Traits Challenge and Workshop

Personality is a psychological construct aimed at explaining the wide variety of human behaviours in terms of a few, stable and measurable individual characteristics. In this respect, any technology involving understanding, prediction and synthesis of ...
The Risk-Taking Software Engineer: A Framed Portrait
ICSE-NIER '23: Proceedings of the 45th International Conference on Software Engineering: New Ideas and Emerging Results

Background: Risk-taking is prevalent in a host of activities performed by software engineers on a daily basis, yet there is scant research on it. Aims and Method: We study if software engineers' risk-taking is affected by framing effects and by ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Software Engineering and Methodology

ACM Transactions on Software Engineering and Methodology Volume 31, Issue 3

July 2022

912 pages

ISSN:1049-331X

EISSN:1557-7392

DOI:10.1145/3514181

Editor:
Mauro Pezzè
USI Università della Svizzera italiana and SIT Schaffhausen Institute of Technology, Switzerland

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2022

Online AM: 31 January 2022

Accepted: 01 October 2021

Revised: 01 September 2021

Received: 01 April 2021

Published in TOSEM Volume 31, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
610
Total Downloads

Downloads (Last 12 months)131
Downloads (Last 6 weeks)11

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li XLenarduzzi VTaibi DGuéhéneuc YPetrillo FPolitowski C(2024)A Data-Driven Analysis of Player Personalities for Different Game GenresProceedings of the 1st ACM International Workshop on Foundations of Applied Software Engineering for Games10.1145/3663532.3664468(20-25)Online publication date: 16-Jul-2024
https://dl.acm.org/doi/10.1145/3663532.3664468
Vishnubhotla SMendes E(2024)Examining the effect of software professionals’ personality & additional capabilities on agile teams’ climateJournal of Systems and Software10.1016/j.jss.2024.112054214:COnline publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.jss.2024.112054
Vishnubhotla SMendes E(2024)Exploring the relation between personality traits and agile team climateJournal of Systems and Software10.1016/j.jss.2023.111937210:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.jss.2023.111937
Silva LGurgel de Castro MBernardino Silva MSantos MKulesza ULima MMadeira H(2023)Using social media and personality traits to assess software developers’ emotional polarityPeerJ Computer Science10.7717/peerj-cs.14989(e1498)Online publication date: 27-Sep-2023
https://doi.org/10.7717/peerj-cs.1498
Graf-Vlachy LWagner S(2023)The Type to Take Out a Loan? A Study of Developer Personality and Technical Debt2023 ACM/IEEE International Conference on Technical Debt (TechDebt)10.1109/TechDebt59074.2023.00010(27-36)Online publication date: May-2023
https://doi.org/10.1109/TechDebt59074.2023.00010

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents