research-article

KAIROS: Talking Heads and Moving Bodies for Successful Meetings

Authors:

Marios Constantinides,

Sagar Joglekar,

Daniele QuerciaAuthors Info & Claims

HotMobile '21: Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications

Pages 30 - 36

https://doi.org/10.1145/3446382.3448361

Published: 24 February 2021 Publication History

Abstract

Successful meetings create a safe environment for contribution; one that attendees feel engaged in and part of. Previous research has shown that meetings success depends not only on execution, but also on whether attendees feel psychologically safe. While this aspect is, to a great extent, partly observable through certain body cues during in-person meetings, they are often overlooked in virtual ones. To partly fix that, we developed "Kairos"-a system for multi-modal monitoring of virtual meetings that captures subtle body cues. We deployed it in 55 real-world corporate meetings and, upon six metrics for body cues, we built a model to predict a meeting's self-reported success, achieving an AUC as high as 79%. We found that certain body cues were more predictive of a meeting's success (defined as a linear combination of execution and psychological safety) than others (head movements, for example, were twice as predictive as hand movements), not least because they captured three typical meeting phases (its initiation, collective discussions, and turning points) whose presence (or absence) greatly mattered for success.

References

[1]

Andra Adams, Marwa Mahmoud, Tadas Baltrušaitis, and Peter Robinson. 2015. Decoupling facial expressions and head motions in complex emotions. In Proc. of the IEEE International Conference on Affective Computing and Intelligent Interaction. IEEE, 274--280.

Digital Library

[2]

Bon Adriel Aseniero, Marios Constantinides, Sagar Joglekar, Ke Zhou, and Daniele Quercia. 2020. MeetCues: Supporting online meetings experience. In Proc. of the IEEE Visualization Conference.

[3]

Sangwon Bae, Tammy Chung, Denzil Ferreira, Anind K. Dey, and Brian Suffoletto. 2018. Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: Implications for just-in-time adaptive interventions. Addictive Behaviors 83 (2018), 42--47.

[4]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77--101.

[5]

Kelly Caine. 2016. Local standards for sample size at CHI. In Proc. of the ACM Conference on Human Factors in Computing Systems. 981--992.

Digital Library

[6]

Fabio Calefato, Filippo Lanubile, Federico Maiorano, and Nicole Novielli. 2018. Sentiment polarity detection for software development. Empirical Software Engineering 23, 3 (2018), 1352--1382.

Digital Library

[7]

Andrew T. Campbell et al. 2008. The rise of people-centric sensing. IEEE Internet Computing 12, 4 (2008), 12--21.

Digital Library

[8]

Alexandru Caruntu, Gavril Toderean, and Alina Nica. 2005. Automatic silence/unvoiced/voiced classification of speech using a modified Teager energy feature. In Proc. of the WSEAS Conference on Dynamical Systems and Control. 62--65.

[9]

Marcela Charfuelan and Marc Schröder. 2011. Investigating the prosody and voice quality of social signals in scenario meetings. In Proc. of the International Conference on Affective Computing and Intelligent Interaction. Springer, 46--56.

[10]

Patrick Chiu, Ashutosh Kapuskar, Sarah Reitmeier, and Lynn Wilcox. 1999. NoteLook: Taking notes in meetings with digital video and ink. In Proc. of the ACM International Conference on Multimedia. 149--158.

Digital Library

[11]

Jun-Ho Choi and Jong-Seok Lee. 2019. EmbraceNet: A robust deep learning architecture for multimodal classification. Information Fusion 51 (2019), 259--270.

Digital Library

[12]

Minje Choi, Luca Maria Aiello, Krisztián Zsolt Varga, and Daniele Quercia. 2020. Ten social dimensions of conversations and relationships. In Proceedings of The Web Conference 2020.1514--1525.

Digital Library

[13]

Marios Constantinides, Sanja Šćepanović, Daniele Quercia, Hongwei Li, Ugo Sassi, and Michael Eggleston. 2020. ComFeel: Productivity is a matter of the senses too. Proc. of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--21.

Digital Library

[14]

Jean Costa, Malte F. Jung, Mary Czerwinski, François Guimbretière, Trinh Le, and Tanzeem Choudhury. 2018. Regulating feelings during interpersonal conflicts by changing voice self-perception. In Proc. of the ACM Conference on Human Factors in Computing Systems.

Digital Library

[15]

Keith Curtis, Gareth J. F. Jones, and Nick Campbell. 2015. Effects of good speaking techniques on audience engagement. In Proc. of the ACM International Conference on Multimodal Interaction. 35--42.

Digital Library

[16]

Andrea Gaggioli et al. 2013. A mobile data collection platform for mental health research. Personal and Ubiquitous Computing 17, 2 (2013), 241--251.

Digital Library

[17]

Arpit Gupta. 2020. Accelerating remote work after COVID-19. In Proc. of the Covid Recovery Symposium. 1--2.

[18]

Jennifer A. Healey and Rosalind W. Picard. 2005. Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans. on Intelligent Transportation Systems 6, 2 (2005), 156--166.

Digital Library

[19]

Julia Hirschberg. 2002. Communication and prosody: Functional aspects of prosody. Speech Communication 36, 1-2 (2002), 31--43.

Digital Library

[20]

Nis Hjortskov, Dag Rissén, Anne Katrine Blangsted, Nils Fallentin, Ulf Lundberg, and Karen Søgaard. 2004. The effect of mental stress on heart rate variability and blood pressure during computer work. European Journal of Applied Physiology 92, 1-2 (2004), 84--89.

[21]

Harmanpreet Kaur, Alex C. Williams, Daniel McDuff, Mary Czerwinski, Jaime Teevan, and Shamsi T. Iqbal. 2020. Optimizing for happiness and productivity: Modeling opportune moments for transitions and breaks at work. In Proc. of the ACM Conference on Human Factors in Computing Systems. 1--15.

[22]

Fahim Kawsar, Chulhong Min, Akhil Mathur, and Allesandro Montanari. 2018. Earables for personal-scale behavior analytics. IEEE Pervasive Computing 17, 3 (2018), 83--89.

Digital Library

[23]

Janice R Kelly and Sigal G Barsade. 2001. Mood and emotions in small groups and work teams. Organizational behavior and human decision processes 86, 1 (2001), 99--130.

[24]

Nicky Kern, Bernt Schiele, Holger Junker, Paul Lukowicz, and Gerhard Tröster. 2003. Wearable sensing to annotate meeting recordings. Personal and Ubiquitous Computing 7, 5 (2003), 263--274.

Digital Library

[25]

Mika Mäntylä, Bram Adams, Giuseppe Destefanis, Daniel Graziotin, and Marco Ortu. 2016. Mining valence, arousal, and dominance: possibilities for detecting burnout and productivity?. In Proc. of the ACM Conference on Mining Software Repositories. 247--258.

Digital Library

[26]

Moira McGregor and John C. Tang. 2017. More to meetings: Challenges in using speech-based technology to support meetings. In Proc. of the ACM Conference on Computer Supported Cooperative Work. 2208--2220.

[27]

Geoffrey Miller. 2012. The smartphone psychology manifesto. Perspectives on Psychological Science 7, 3 (2012), 221--237.

[28]

Chulhong Min, Akhil Mathur, and Fahim Kawsar. 2018. Exploring audio and kinetic sensing on earable devices. In Proc. of the ACM Workshop on Wearable Systems and Applications. 5--10.

Digital Library

[29]

Shayan Mirjafari et al. 2019. Differentiating higher and lower job performers in the workplace using mobile sensing. Proc. of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 1--24.

Digital Library

[30]

Saif M. Mohammad and Peter D. Turney. 2013. Crowdsourcing a word-emotion association lexicon. Computational Intelligence 29, 3 (2013), 436--465.

[31]

Karin Niemantsverdriet and Thomas Erickson. 2017. Recurring Meetings: An experiential account of repeating meetings in a large organization. Proc. of the ACM on Human-Computer Interaction 1, CSCW (2017), 1--17.

Digital Library

[32]

Costas Panagiotakis and Georgios Tziritas. 2005. A speech/music discriminator based on RMS and zero-crossings. IEEE Trans. on Multimedia 7, 1 (2005), 155--166.

Digital Library

[33]

Sungkyu Park, Marios Constantinides, Luca Maria Aiello, Daniele Quercia, and Paul Van Gent. 2020. WellBeat: A framework for tracking daily well-being using smartwatches. IEEE Internet Computing 24, 5 (2020), 10--17.

[34]

Kestutis Peleckis and Valentina Peleckienė. 2015. Nonverbal communication in business negotiations and business meetings. International Letters of Social and Humanistic Sciences 62 (2015), 62--72.

[35]

Chao Ying Qin, Marios Constantinides, Luca Maria Aiello, and Daniele Quercia. 2020. HeartBees: Visualizing crowd affects. In Proc. of the VIS Arts Program. IEEE, 1--8.

[36]

Alexander Robertson, Luca Maria Aiello, and Daniele Quercia. 2019. The language of dialogue is complex. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13. 428--439.

[37]

Steven G. Rogelberg, Joseph A. Allen, Linda Shanock, Cliff Scott, and Marissa Shuffler. 2010. Employee satisfaction with meetings: A contemporary facet of job satisfaction. Human Resource Management 49, 2 (2010), 149--172.

[38]

Peter Schmitt, Jonas Mandel, and Mickael Guedj. 2015. A comparison of six methods for missing data imputation. Journal of Biometrics & Biostatistics 6, 1 (2015), 1.

[39]

Yolande Strengers. 2015. Meeting in the global workplace: Air travel, telepresence and the body. Mobilities 10, 4 (2015), 592--608.

[40]

Diane Tam, Karon E. MacLean, Joanna McGrenere, and Katherine J. Kuchenbecker. 2013. The design and field observation of a haptic notification system for timing awareness during oral presentations. In Proc. of the ACM Conference on Human Factors in Computing Systems. 1689--1698.

[41]

John Tang et al. 2012. Time travel proxy: Using lightweight video recordings to create asynchronous, interactive meetings. In Proc. of the ACM Conference on Human Factors in Computing Systems. 3111--3120.

[42]

Nicole Torres and Joep Cornelissen. 2019. When you pitch an idea, gestures matter more than words. Harvard Business Review (2019).

[43]

Ke Zhou, Luca Maria Aiello, Sanja Scepanovic, Daniele Quercia, and Sara Konrath. 2021. The language of situational empathy. Proc. of the ACM on Human-Computer Interaction 1, CSCW (2021), 1--19.

Digital Library

Cited By

Constantinides MBogucka EScepanovic SQuercia D(2024)Good Intentions, Risky Inventions: A Method for Assessing the Risks and Benefits of AI in Mobile and Wearable UsesProceedings of the ACM on Human-Computer Interaction10.1145/36765078:MHCI(1-28)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676507
Park GPanda PTankelevitch LRintel S(2024)The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video MeetingsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661507(1638-1657)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661507
Bogucka EConstantinides MDe Miguel Velazquez JScepanovic SQuercia DGvirtz A(2024)The Atlas of AI Incidents in Mobile Computing: Visualizing the Risks and Benefits of AI Gone MobileAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680447(1-6)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680447
Show More Cited By

Index Terms

KAIROS: Talking Heads and Moving Bodies for Successful Meetings
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

The importance of facilitator role behaviors in different face to face group support systems environments
HICSS '95: Proceedings of the 28th Hawaii International Conference on System Sciences

Given the increased demand for group work, it has been argued that strong facilitation skills are critical for successful business interactions, yet many of us view meetings as time-consuming and unproductive exchanges, and few of us have had any formal ...
Designing Authentic Emotions for Non-Human Characters: A Study Evaluating Virtual Affective Behavior
DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

While human emotions have been researched for decades, designing authentic emotional behavior for non-human characters has received less attention. However, virtual behavior not only affects game design, but also allows creating authentic avatars or ...
MixMeetWear: Live Meetings at a Glance
CSCW '16 Companion: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion

We present MixMeetWear, a smartwatch application that allows users to maintain awareness of the audio and visual content of a meeting while completing other tasks. Users of the system can listen to the audio of a meeting and also view, zoom, and pan ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotMobile '21: Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications

February 2021

192 pages

ISBN:9781450383233

DOI:10.1145/3446382

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 February 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

HotMobile '21

Sponsor:

SIGMOBILE

HotMobile '21: The 22nd International Workshop on Mobile Computing Systems and Applications

February 24 - 26, 2021

Virtual, United Kingdom

Acceptance Rates

Overall Acceptance Rate 96 of 345 submissions, 28%

Upcoming Conference

HOTMOBILE '25

Sponsor:
sigmobile

The 26th International Workshop on Mobile Computing Systems and Applications

February 26 - 27, 2025

La Quinta , CA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
338
Total Downloads

Downloads (Last 12 months)63
Downloads (Last 6 weeks)15

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Constantinides MBogucka EScepanovic SQuercia D(2024)Good Intentions, Risky Inventions: A Method for Assessing the Risks and Benefits of AI in Mobile and Wearable UsesProceedings of the ACM on Human-Computer Interaction10.1145/36765078:MHCI(1-28)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676507
Park GPanda PTankelevitch LRintel S(2024)The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video MeetingsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661507(1638-1657)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661507
Bogucka EConstantinides MDe Miguel Velazquez JScepanovic SQuercia DGvirtz A(2024)The Atlas of AI Incidents in Mobile Computing: Visualizing the Risks and Benefits of AI Gone MobileAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680447(1-6)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680447
Hosseinkashi YTankelevitch LPool JCutler RMadan C(2024)Meeting Effectiveness and Inclusiveness: Large-scale Measurement, Identification of Key Features, and Prediction in Real-world Remote MeetingsProceedings of the ACM on Human-Computer Interaction10.1145/36373708:CSCW1(1-39)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637370
Seitz JBenke IHeinzl AMaedche A(2024)The Impact of Video Meeting Systems on Psychological User StatesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103178182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103178
Singh VKar PSohini ARangaiah MChakraborty SMaity M(2023)WiFiTuned: Monitoring Engagement in Online Participation by Harmonizing WiFi and AudioProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614108(670-678)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614108
Meegahapola LDroz WKun Pde Götzen ANutakki CDiwakar SCorrea SSong DXu HBidoglia MGaskell GChagnaa AGanbold AZundui TCaprini CMiorandi DHume AZarza JCernuzzi LBison IBritez MBusso MChenu-Abente RGünel CGiunchiglia FSchelenz LGatica-Perez D(2023)Generalization and Personalization of Mobile Sensing-Based Mood Inference ModelsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694836:4(1-32)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569483
Constantinides MQuercia D(2023)Good Intentions, Bad Inventions: How Employees Judge Pervasive Technologies in the WorkplaceIEEE Pervasive Computing10.1109/MPRV.2022.321740822:1(69-76)Online publication date: 1-Jan-2023
https://doi.org/10.1109/MPRV.2022.3217408
Abramczuk KBohdanowicz ZMuczyński BSkorupska KCnotkowski D(2023)Meet me in VR! Can VR space help remote teams connect: A seven-week study with Horizon WorkroomsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103104179(103104)Online publication date: Nov-2023
https://doi.org/10.1016/j.ijhcs.2023.103104
Zhong SRosset LPapinutto MLalanne DAlavi H(2022)Binaural Audio in Hybrid Meetings: Effects on Speaker Identification, Comprehension, and User ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/35551706:CSCW2(1-24)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555170
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten