article

Multimodal support for social dynamics in co-located meetings

Authors:

Jacques Terken,

Janienke SturmAuthors Info & Claims

Personal and Ubiquitous Computing, Volume 14, Issue 8

Pages 703 - 714

https://doi.org/10.1007/s00779-010-0284-x

Published: 01 December 2010 Publication History

Abstract

In this paper, we present a system that employs perceptual technologies (i.e. technologies that perceive the context through sensors such as cameras and microphone) to provide feedback about people's behaviour in small group meetings. The system measures aspects of behaviour that are relevant to the social dynamics of the meeting, speaking time and gaze behaviour, and provides visual feedback about these aspects to the meeting participants through a peripheral display. We describe the system properties and the perceptual components. Also, we present a study aimed at evaluating the effect of such a system on meeting behaviour. Groups of participants, amounting to 82 participants in all, discussed topics of general interest. Analysis of the data of 58 participants showed that feedback influenced the behaviour of the participants in such a way that it made over-participators speak less and under-participators speak more. Analysis of the micro-patterns of six participants indicated that feedback on gaze behaviour had little effect on the interaction dynamics. We conclude that perceptual technologies can be used to build services that may help people to improve their meeting skills and we consider some ways in which such systems may be deployed in meetings.

References

[1]

Abowd GD, Mynath ED, Rodden T (2002) The human experience. IEEE Pervasive Comput 1:48-57.

[2]

Bakx I, van Turnhout K, Terken J (2003) Facial orientation during multi party interaction with information kiosks. In: Proceedings of interact.

[3]

Basu S, Choudhury T, Clarkson B, Pentland A (2001) Towards measuring human interactions in conversational settings. In: Proceedings of the IEEE international workshop on cues in communication CUES.

[4]

Brdiczka O, Maisonnasse J, Reignier P (2005) Automatic detection of interaction groups. In: Proceedings of the 7th international conference on multimodal interface, Trento, Italy, October 2005, pp 32-36.

[5]

Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Measur 20:37-46.

[6]

DiMicco J, Pandolfo A, Bender W (2004) Influencing group participation with a shared display. In: Proceedings of the 2004 ACM conference on computer supported cooperative work CSCW, pp 614-623.

[7]

DiMicco J, Hollenbach K, Pandolfo A, Bender W (2007) The impact of increased awareness while face-to-face. Human-Computer Interaction, Special Issue on Awareness Systems Design, vol 22, pp 47-96.

[8]

Dourish P, Bly S (1992) Portholes: supporting awareness in a distributed work group. In: Proceedings of the ACM conference on human factors in computer systems CHI'92.

[9]

Doyle M, Straus D (1993) How to make meetings work. The Berkley Publishing Group, New York.

[10]

Erickson T, Halverson C, Kellogg WA, Laff M, Wolf T (2002) Social translucence: designing social infrastructures that make collective activity visible. In: Preece J (ed) Communications of the ACM--special issue on community, vol 45, no 4, pp 40-44.

[11]

Graziola E, Eyck A, Sturm J (2007) Modelling intention to use services supporting human-human communication and collaboration. Internal Report CHIL project. http://chil.server.de/?12532

[12]

Jayagopi DB, Hung H, Yeo C, Gatica-Perez D (2008) Predicting the dominant clique in meetings through fusion of nonverbal cues. In: Proceeding of the 16th ACM international conference on multimedia, ACM, New York, pp 809-812.

[13]

Janis I (1972) Victims of groupthink: a psychological study of foreign-policy decisions and fiascoes. Houghton Mifflin, Boston.

[14]

Kalma AP (1992) Gazing in triads: a powerful signal in floor apportionment. Br J Soc Psychol 31:21-39.

[15]

Kendon A (1967) Some functions of gaze direction in social interaction. Acta Psychol 26:22-63.

[16]

Kipp M (2001) Anvil--a generic annotation tool for multimodal dialogue. In: Proceedings of the 7th European conference on speech communication and technology eurospeech, pp 1367-1370.

[17]

Kraemer K, King J (1988) Computer-based systems for cooperative work and group decision making. ACM Comput Surv 20:115-146.

[18]

Kulyk O, Wang C, Terken J (2006) Real-time feedback based on nonverbal behaviour to enhance social dynamics in small group meetings. In: Joint workshop on multimodal interaction and related machine learning algorithms (MLMI) (Lecture Notes in Computer Science), vol 3869, pp 150-161.

[19]

Lightle JP, Kagel JH, Arkes HR (2009) Information exchange in group decision making: the hidden profile problem reconsidered. Manage Sci 55:568-581.

[20]

Madan A, Caneel R, Pentland A (2004) GroupMedia: distributed multimodal interfaces. In: Proceedings of sixth international conference on multimodal interfaces ICMI04, pp 309-316.

[21]

Matthews T, Rattenbury T, Carter S (2007) Defining, designing, and evaluating peripheral displays: an analysis using Activity Theory. Human-Comput Interact 22:221-261.

[22]

McCowan I, Gatica-Perez D, Bengio S, Moore D, Bourlard H (2004) Towards computer understanding of human interactions. In: Aarts E, Collier R, van Loenen E, de Ruyter B (eds) Ambient intelligence, lecture notes in computer science. Springer, Heidelberg, pp 235-251.

[23]

Pianesi F, Zancanaro M, Falcon V, Not E (2006) Toward supporting group dynamics. In: Proceedings of artificial intelligence applications and innovations, pp 302-311.

[24]

Rienks RJ, Zhang D, Gatica-Perez D, Post W (2006) Detection and application of influence rankings in small group meetings. In: Proceedings of the eighth international conference on multimodal interfaces ICMI'06, pp 257-264.

[25]

Sacks H, Schegloff E, Jefferson G (1974) A simplest systematics for the organisation of turn-taking for conversation. Lang J Linguist Soc Am 50:696-735.

[26]

Schulz-Hardt S, Frey D, Luthgens C, Moscovici S (2000) Biased information search in group decision making. J Pers Soc Psychol 78:655-669.

[27]

Stasser G, Stewart D (1992) Discovery of hidden profiles by decision making groups: solving a problem versus making a judgment. J Pers Soc Psychol 63:426-434.

[28]

Stasser G, Titus W (2003) Hidden profiles: a brief history. Psychol Inq 14:304-313.

[29]

Stiefelhagen R, Zhu J (2002) Head orientation and gaze direction in meetings. In: Proceedings of human factors in computing systems CHI2002, pp 858-859.

[30]

Takemae Y, Otsuka K, Mukawa N (2003) Video cut editing rule based on participants' gaze in multiparty conversation. In: Proceedings of the 11th ACM international conference on multimedia, pp 303-306.

[31]

Terken J, Joris I, de Valk L (2007) Multimodal cues for addressee-hood in triadic communication with a human information retrieval agent. In: ACM international conference on multimodal interaction (ICMI), Nagoya, Japan, 12-14 November 2007.

[32]

Tang JC (1991) Findings from observational studies of collaborative work. Int J Man-Mach Stud 34:143-160.

[33]

Vertegaal R, Slagter R, van der Veer G, Nijholt A (2001) Eye gaze patterns in conversations: there is more to conversational agents than meets the eye. In: Proceedings of human factors in computing systems CHI2001, pp 301-308.

[34]

Waibel A, Stiefelhagen R (2009) Computers in the human interaction loop. Springer, Heidelberg.

[35]

Weisband SP, Schneider SK, Connolly T (1995) Computer-mediated communication and social information: status salience and status awareness. Acad Manag J 38:1124-1151.

Cited By

Praharaj SScheffel MSchmitz MSpecht MDrachsler HWise AMartinez-Maldonado RHilliger I(2022)Towards Collaborative Convergence: Quantifying Collaboration Quality with Automated Co-located Collaboration AnalyticsLAK22: 12th International Learning Analytics and Knowledge Conference10.1145/3506860.3506922(358-369)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3506860.3506922
Niemantsverdriet KEssen HPakanen MEggen B(2019)Designing for Awareness in Interactions with Shared SystemsACM Transactions on Computer-Human Interaction10.1145/333884526:6(1-41)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3338845
Dagan EMárquez Segura EAltarriba Bertran FFlores MMitchell RIsbister KHarrison SBardzell SNeustaedter CTatar D(2019)Design Framework for Social WearablesProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322291(1001-1015)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322291
Show More Cited By

Recommendations

Co-Located Collaborative Visual Analytics around a Tabletop Display

Co-located collaboration can be extremely valuable during complex visual analytics tasks. We present an exploratory study of a system designed to support collaborative visual analysis tasks on a digital tabletop display. Fifteen participant pairs ...
Influencing social dynamics in meetings through a peripheral display
ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

We present a service providing real-time feedback to participants of small group meetings on the social dynamics of the meeting. The service measures and visualizes properties of participants' behaviour that are relevant to the social dynamics of the ...
Exploratory study on concurrent interaction in co-located collaboration
OZCHI '07: Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces

We present an exploratory lab study that provides observations and measures about the usage of interaction devices in co-located cooperative work situations at a tabletop display. We designed our experiment with the aim of providing a context for the ...

Comments

Information & Contributors

Information

Published In

cover image Personal and Ubiquitous Computing

Personal and Ubiquitous Computing Volume 14, Issue 8

December 2010

94 pages

ISSN:1617-4909

Issue’s Table of Contents

Copyright © Copyright © 2010 Springer-Verlag London Limited.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 December 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
166
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Praharaj SScheffel MSchmitz MSpecht MDrachsler HWise AMartinez-Maldonado RHilliger I(2022)Towards Collaborative Convergence: Quantifying Collaboration Quality with Automated Co-located Collaboration AnalyticsLAK22: 12th International Learning Analytics and Knowledge Conference10.1145/3506860.3506922(358-369)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3506860.3506922
Niemantsverdriet KEssen HPakanen MEggen B(2019)Designing for Awareness in Interactions with Shared SystemsACM Transactions on Computer-Human Interaction10.1145/333884526:6(1-41)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3338845
Dagan EMárquez Segura EAltarriba Bertran FFlores MMitchell RIsbister KHarrison SBardzell SNeustaedter CTatar D(2019)Design Framework for Social WearablesProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322291(1001-1015)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322291
Praharaj SScheffel MDrachsler HSpecht M(2019)Group Coach for Co-located CollaborationTransforming Learning with Meaningful Technologies10.1007/978-3-030-29736-7_77(732-736)Online publication date: 16-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29736-7_77
Niemantsverdriet Kvan de Werff Tvan Essen HEggen BMandryk RHancock MPerry MCox A(2018)Share and Share Alike?Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173877(1-14)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173877
Dagan EMárquez Segura EFlores MIsbister KMandryk RHancock MPerry MCox A(2018)'Not Too Much, Not Too Little' Wearables For Group DiscussionsExtended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3188500(1-6)Online publication date: 20-Apr-2018
https://dl.acm.org/doi/10.1145/3170427.3188500
Praharaj SScheffel MDrachsler HSpecht M(2018)Multimodal Analytics for Real-Time Feedback in Co-located Collaboration Lifelong Technology-Enhanced Learning10.1007/978-3-319-98572-5_15(187-201)Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1007/978-3-319-98572-5_15
Niemantsverdriet KErickson T(2017)Recurring MeetingsProceedings of the ACM on Human-Computer Interaction10.1145/31347191:CSCW(1-17)Online publication date: 6-Dec-2017
https://dl.acm.org/doi/10.1145/3134719
Faucett HLee MCarter S(2017)I Should Listen MoreProceedings of the ACM on Human-Computer Interaction10.1145/31346791:CSCW(1-19)Online publication date: 6-Dec-2017
https://dl.acm.org/doi/10.1145/3134679
Shimizu RTakase YNakano YLee STakayama LTruong K(2017)Audio based group conversation support systemProceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers10.1145/3123024.3123079(197-200)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.1145/3123024.3123079
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents