Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3491101.3519656acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

Moody Man: Improving creative teamwork through dynamic affective recognition

Published: 28 April 2022 Publication History

Abstract

While a significant part of communication in the workplace is now happening online, current platforms don’t fully support socio-cognitive nonverbal communication, which hampers the shared understanding and creativity of virtual teams. Given text-based communication being the main channel for virtual collaboration, we propose a novel solution leveraging an AI-based, dynamic affective recognition system. The app provides live feedback about the affective content of the communication in Slack, in the form of a visual representation and percentage breakdown of the ‘sentiment’ (tone, emoji) and main ‘emotion states’ (e.g. joy, anger). We tested the usability of the app in a quasi-experiment with 30 participants from diverse backgrounds, linguistic analysis and user interviews. The findings show that the app significantly increases shared understanding and creativity within virtual teams. Emerged themes included impression formation assisted by affective recognition, supporting long-term relationships development; identified challenges related to transparency and emotional complexity detected by AI.

Supplementary Material

MP4 File (3491101.3519656-talk-video.mp4)
Talk Video

References

[1]
Ahmad Abdellatif, Khaled Badran, Diego Elias Costa, and Emad Shihab. 2021. A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineering. arXiv:2012.02640 [cs] (July 2021). http://arxiv.org/abs/2012.02640 arXiv:2012.02640.
[2]
Mike Allen. 2017. The SAGE Encyclopedia of Communication Research Methods. SAGE Publications, Inc, 2455 Teller Road, Thousand Oaks California 91320. https://doi.org/10.4135/9781483381411
[3]
Teresa M Amabile. 1988. A model of creativity and innovation in organizations. Research in organizational behavior 10, 1 (1988), 123–167.
[4]
ARUP. [n.d.]. Drivers of Change. https://foresight.arup.com/our-tools/drivers-of-change/
[5]
Natalya N. Bazarova, Jessie G. Taft, Yoon Hyung Choi, and Dan Cosley. 2013. Managing Impressions and Relationships on Facebook: Self-Presentational and Relational Concerns Revealed Through the Analysis of Language Style. Journal of Language and Social Psychology 32, 2 (June 2013), 121–141. https://doi.org/10.1177/0261927X12456384 Publisher: SAGE Publications Inc.
[6]
Ivo Benke, Michael Knierim, and Alexander Maedche. 2020. Chatbot-based Emotion Management for Distributed Teams: A Participatory Design Study. Proceedings of the ACM on Human-Computer Interaction 4 (Oct. 2020). https://doi.org/10.1145/3415189
[7]
Michael Brooks, Cecilia R. Aragon, Katie Kuksenok, Megan K. Torkildson, Daniel Perry, John J. Robinson, Taylor J. Scott, Ona Anicello, Ariana Zukowski, and Paul Harris. 2013. Statistical affect detection in collaborative chat. In Proceedings of the 2013 conference on Computer supported cooperative work - CSCW ’13. ACM Press, San Antonio, Texas, USA, 317. https://doi.org/10.1145/2441776.2441813
[8]
Rafael A Calvo and Sidney D’Mello. 2010. Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Transactions on Affective Computing 1, 1 (Jan. 2010), 18–37. https://doi.org/10.1109/T-AFFC.2010.1
[9]
Janis A. Cannon-Bowers, Eduardo Salas, and Sharolyn Converse. 1993. Shared mental models in expert team decision making. In Individual and group decision making: Current issues. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US, 221–246.
[10]
Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis. sage.
[11]
Gerald L. Clore and Janet Palmer. 2009. Affective guidance of intelligent agents: How emotion controls cognition. Cognitive Systems Research 10, 1 (March 2009), 21–30. https://doi.org/10.1016/j.cogsys.2008.03.002
[12]
Juliet Corbin and Anselm Strauss. 2014. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage publications.
[13]
Henriette Cramer, Paloma de Juan, and Joel Tetreault. 2016. Sender-intended functions of emojis in US messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 504–509. https://doi.org/10.1145/2935334.2935370
[14]
Trudy C. DiLiello, Jeffery D. Houghton, and David Dawley. 2011. Narrowing the creativity gap: the moderating effects of perceived support for creativity. The Journal of Psychology 145, 3 (June 2011), 151–172. https://doi.org/10.1080/00223980.2010.548412
[15]
William Easley, Darius McCoy, Shawn Grimes, Steph Grimes, Foad Hamidi, Wayne G Lutters, and Amy Hurst. 2018. Understanding How Youth Employees Use Slack. (2018), 4.
[16]
Tatiana Ermakova, Max Henke, and Benjamin Fabian. 2021. Commercial Sentiment Analysis Solutions: A Comparative Study:. In Proceedings of the 17th International Conference on Web Information Systems and Technologies. SCITEPRESS - Science and Technology Publications, Online Streaming, — Select a Country —, 103–114. https://doi.org/10.5220/0010709400003058
[17]
Mohamed Ez-Zaouia, Aurélien Tabard, and Elise Lavoué. 2020. EMODASH: A dashboard supporting retrospective awareness of emotions in online learning. International Journal of Human-Computer Studies 139 (2020), 102411. Publisher: Elsevier.
[18]
Jonas Frich, Michael Mose Biskjaer, and Peter Dalsgaard. 2018. Why HCI and Creativity Research Must Collaborate to Develop New Creativity Support Tools. In Proceedings of the Technology, Mind, and Society. ACM, Washington DC USA, 1–6. https://doi.org/10.1145/3183654.3183678
[19]
Gartner. 2021. Magic Quadrant for Data Science and Machine Learning Platforms. https://www.gartner.com/doc/reprints?id=1-25DOZD29&ct=210304&st=sb
[20]
Cristina B. Gibson, Patrick D. Dunlop, Ann Majchrzak, and Terence Chia. 2021. Sustaining Effectiveness in Global Teams: The Coevolution of Knowledge Management Activities and Technology Affordances. Organization Science (Aug. 2021). https://doi.org/10.1287/orsc.2021.1478 Publisher: INFORMS.
[21]
Barney G Glaser and Anselm L Strauss. 1967. The discovery of grounded theory: strategies for qualitative research. OCLC: 253912.
[22]
Homer. 1998. The Iliad. Oxford University Press. Google-Books-ID: OT9pj8chUbQC.
[23]
Lauren J. Human, Gillian M. Sandstrom, Jeremy C. Biesanz, and Elizabeth W. Dunn. 2013. Accurate First Impressions Leave a Lasting Impression: The Long-Term Effects of Distinctive Self-Other Agreement on Relationship Development. Social Psychological and Personality Science 4, 4 (July 2013), 395–402. https://doi.org/10.1177/1948550612463735 Publisher: SAGE Publications Inc.
[24]
Jeroen Janssen, Gijsbert Erkens, Gellof Kanselaar, and Jos Jaspers. 2007. Visualization of participation: Does it contribute to successful computer-supported collaborative learning?Computers & Education 49, 4 (2007), 1037–1065. Publisher: Elsevier.
[25]
Karen A Jehn. 1995. A multimethod examination of the benefits and detriments of intragroup conflict. Administrative science quarterly(1995), 256–282. Publisher: JSTOR.
[26]
Ryan P Kennedy, Philip D Waggoner, and Matthew Ward. 2021. Trust in Public Policy Algorithms. The Journal of Politics (July 2021). https://doi.org/10.1086/716283 Publisher: The University of Chicago Press.
[27]
Miikka Kuutila, Mika V. Mãntylã, and Maëlick Claes. 2020. Chat activity is a better predictor than chat sentiment on software developers productivity. In Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops. ACM, Seoul Republic of Korea, 553–556. https://doi.org/10.1145/3387940.3392224
[28]
Gilly Leshed, Diego Perez, Jeffrey T. Hancock, Dan Cosley, Jeremy Birnholtz, Soyoung Lee, Poppy L. McLeod, and Geri Gay. 2009. Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, Boston, MA, USA, 537. https://doi.org/10.1145/1518701.1518784
[29]
Q. Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–15. https://doi.org/10.1145/3313831.3376590
[30]
Yu Liu, Yue Liu, and Kane Yue. 2021. Integration of Concept Maps into the Mixed Reality Learning Space: Quasi-Experimental Design and Preliminary Results. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 627–628. https://doi.org/10.1109/VRW52623.2021.00196
[31]
United Nations. 2021. Resource Guide on Artificial Intelligence (AI) Strategies | Department of Economic and Social Affairs. https://sdgs.un.org/documents/resource-guide-artificial-intelligence-ai-strategies-25128
[32]
R.J. Ocker. 2005. Influences on creativity in asynchronous virtual teams: a qualitative analysis of experimental teams. IEEE Transactions on Professional Communication 48, 1 (March 2005), 22–39. https://doi.org/10.1109/TPC.2004.843294 Conference Name: IEEE Transactions on Professional Communication.
[33]
Adam Ozimek. 2020. The Future of Remote Work. SSRN Electronic Journal(2020). https://doi.org/10.2139/ssrn.3638597
[34]
Ayellet Pelled, Tanya Zilberstein, Eran Pick, Yael Patkin, Alona Tsironlikov, and Nurit Tal-Or. 2016. Which Post Will Impress the Most? Impression Formation Based on Visual and Textual Cues in Facebook Profiles. In Proceedings of the 7th 2016 International Conference on Social Media & Society(SMSociety ’16). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/2930971.2930997
[35]
Zhenhui Peng, Taewook Kim, and Xiaojuan Ma. 2019. GremoBot: Exploring Emotion Regulation in Group Chat. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. ACM, Austin TX USA, 335–340. https://doi.org/10.1145/3311957.3359472
[36]
Sandra Walker Russ. 1993. Affect and Creativity: the Role of Affect and Play in the Creative Process. Routledge, New York. https://doi.org/10.4324/9780203772621
[37]
Samiha Samrose, Daniel McDuff, Robert Sim, Jina Suh, Kael Rowan, Javier Hernandez, Sean Rintel, Kevin Moynihan, and Mary Czerwinski. 2021. MeetingCoach: An Intelligent Dashboard for Supporting Effective & Inclusive Meetings. (2021), 13.
[38]
Samiha Samrose, Ru Zhao, Jeffery White, Vivian Li, Luis Nova, Yichen Lu, Mohammad Rafayet Ali, and Mohammed Ehsan Hoque. 2018. Coco: Collaboration coach for understanding team dynamics during video conferencing. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 1, 4 (2018), 1–24. Publisher: ACM New York, NY, USA.
[39]
Taylor Jackson Scott, Katie Kuksenok, Daniel Perry, Michael Brooks, Ona Anicello, and Cecilia Aragon. 2012. Adapting grounded theory to construct a taxonomy of affect in collaborative online chat. In Proceedings of the 30th ACM international conference on Design of communication - SIGDOC ’12. ACM Press, Seattle, Washington, USA, 197. https://doi.org/10.1145/2379057.2379096
[40]
Ben Shneiderman. 2009. Creativity Support Tools: A Grand Challenge for HCI Researchers. In Engineering the User Interface, Miguel Redondo, Crescencio Bravo, and Manuel Ortega (Eds.). Springer London, London, 1–9. https://doi.org/10.1007/978-1-84800-136-7_1
[41]
Paul Spector. 1997. Job Satisfaction: Application, Assessment, Causes, and Consequences. Thousand Oaks, California. https://doi.org/10.4135/9781452231549
[42]
Spiceworks. 2017. Distribution of collaboration tools used in organizations worldwide, as of 2016, by company size.
[43]
Statista. 2020. COVID-19 digital engagement report. http://www.statista.com/study/86023/covid-19-digital-engagement-report/
[44]
Statista. 2020. Remote work frequency before/after COVID-19 2020. https://www.statista.com/statistics/1122987/change-in-remote-work-trends-after-covid-in-usa/
[45]
Jamie S. Switzer. 2008. Impression Formation in Computer-Mediated Communication and Making a Good (Virtual) Impression. https://doi.org/10.4018/978-1-59904-893-2.ch008 ISBN: 9781599048932 Pages: 98-109 Publisher: IGI Global.
[46]
Thiemo Wambsganss, Christina Niklaus, Matthias Söllner, Siegfried Handschuh, and J. M. Leimeister. 2021. Supporting Cognitive and Emotional Empathic Writing of Students. SSRN Scholarly Paper ID 3910431. Social Science Research Network, Rochester, NY. https://papers.ssrn.com/abstract=3910431
[47]
L. Alan Witt and Mark N. Beorkrem. 1989. Climate for creative productivity as a predictor of research usefulness and organizational effectiveness in an R&D organization. Creativity Research Journal 2, 1-2 (1989), 30–40. https://doi.org/10.1080/10400418909534298 Place: US Publisher: Lawrence Erlbaum.
[48]
Douglas Zytko, Sukeshini A. Grandhi, and Quentin (Gad) Jones. 2014. Impression management through communication in online dating. In Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing(CSCW Companion ’14). Association for Computing Machinery, New York, NY, USA, 277–280. https://doi.org/10.1145/2556420.2556487

Cited By

View all
  • (2024)The Influence of Generative AI on Interpersonal Communication DynamicsThe Role of Generative AI in the Communication Classroom10.4018/979-8-3693-0831-8.ch009(167-190)Online publication date: 12-Feb-2024
  • (2024)Towards Understanding Emotions for Engaged Mental Health ConversationsCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663694(176-180)Online publication date: 1-Jul-2024
  • (2024)Augmenting Online Teamwork Dynamics: Investigating the Effects of a Generative AI Chatbot on Perceived Assistance and the Assessment of Team MembersInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2400406(1-13)Online publication date: 16-Sep-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
April 2022
3066 pages
ISBN:9781450391566
DOI:10.1145/3491101
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. affective recognition
  2. chat app
  3. creativity
  4. emotions
  5. virtual teams

Qualifiers

  • Poster
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '22
Sponsor:
CHI '22: CHI Conference on Human Factors in Computing Systems
April 29 - May 5, 2022
LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)83
  • Downloads (Last 6 weeks)12
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)The Influence of Generative AI on Interpersonal Communication DynamicsThe Role of Generative AI in the Communication Classroom10.4018/979-8-3693-0831-8.ch009(167-190)Online publication date: 12-Feb-2024
  • (2024)Towards Understanding Emotions for Engaged Mental Health ConversationsCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663694(176-180)Online publication date: 1-Jul-2024
  • (2024)Augmenting Online Teamwork Dynamics: Investigating the Effects of a Generative AI Chatbot on Perceived Assistance and the Assessment of Team MembersInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2400406(1-13)Online publication date: 16-Sep-2024
  • (2022)TroiProceedings of the ACM on Human-Computer Interaction10.1145/35467386:MHCI(1-22)Online publication date: 20-Sep-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media