research-article

Improving teamwork using real-time language feedback

Authors:

Yla R. Tausczik,

James W. PennebakerAuthors Info & Claims

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 459 - 468

https://doi.org/10.1145/2470654.2470720

Published: 27 April 2013 Publication History

Abstract

We develop and evaluate a real-time language feedback system that monitors the communication patterns among students in a discussion group and provides real-time instructions to shape the way the group works together. As an initial step, we determine which group processes are related to better outcomes. We then experimentally test the efficacy of providing real-time instructions which target two of these group processes. The feedback system was successfully able to shape the way groups worked together. However, only appropriate feedback given to groups that were not working well together from the start was able to improve group performance.

References

[1]

Anderson, J. R., Corbette, A. T., Koedinger, K. R., and Pelletier, R. Cognitive Tutors: Lessons Learned. Journal of Learning Sciences 4 (1995), 167--207.

[2]

Bales, R. F. Interaction Process Analysis: A method for the study of small groups. The University of Chicago Press, Chicago, 1950.

[3]

Bales, R. F., and Strodtbeck, F. L. Phases in group problem-solving. The Journal of Abnormal and Social Psychology 46 (1951), 485--495.

[4]

Diehl, M., and Stroebe, W. Productivity loss in brainstorming groups: Toward the solution of a riddle. Journal of Personality and Social Psychology 53 (1987), 497--509.

[5]

DiMicco, J. M., Hollenbach, K. J., Pandolfo, A., and Bender, W. The Impact of Increased Awareness While Face-to-Face. Human-Computer Interaction 22 (2007), 47--96.

Digital Library

[6]

Fischer, U., McDonnell, L., and Orasanu, J. Linguistic correlates of team performance: Toward a tool for monitoring team functioning during space missions. Aviation Space and Environmental Medicine 78 (2007), 86--95.

[7]

Gonzales, A. L., Hancock, J. T., and Pennebaker, J. W. Language style matching as a predictor of social dynamics in small groups. Communication Research 31 (2010), 3--19.

[8]

Graesser, A. C., Conley, M. W., and Olney, A. Intelligent tutoring systems. In APA Handbook of Educational Psychology, S. Graham and K. Harris, Eds., vol. 2579. American Psychological Association, Washington, DC, 2012, 451--473.

[9]

Hackman, J. R., and Kaplan, R. E. Interventions into group process: An approach to improving the effectiveness of groups. Decision Sciences 5 (1974), 459--480.

[10]

Hare, A. P. Handbook of Small Group Research. Free Press, New York, 1962.

[11]

Hinsz, V. B., Tindale, R. S., and Vollrath, D. A. The emerging conceptualization of groups as information processors. Psychological Bulletin 121 (1997), 43--64.

[12]

Huffaker, D., Swaab, R., and Diermeier, D. The language of coalition formation in multiparty online negotiations. In In Proceedings of the International Communication Association Conference (Montreal, Canada, 2008), 22--26.

[13]

Ireland, M. E., and Pennebaker, J. W. Language style matching in writing: Synchrony in essays, correspondence, and poetry. Journal of Personality and Social Psychology 99 (2010), 549--571.

[14]

Jonassen, D. H., and Kwon, H. Communication patterns in computer mediated versus face-to-face group problem solving. Educational Technology Research and Development 49 (2001), 35--51.

[15]

Kittur, A., and Kraut, R. E. Harnessing the wisdom of crowds in wikipedia: quality through coordination. In Proc. CSCW 2008, ACM Press (2008), 37--46.

Digital Library

[16]

Leavitt, H. J. Some effects of certain communication patterns on group performance. Journal of Abnormal Psychology 46 (1951), 38--50.

[17]

Lebie, L., Rhoades, J. A., and McGrath, J. E. Interaction process in computer-mediated and face-to-face groups. Computer Supported Cooperative Work 4 (1996), 127--152.

Digital Library

[18]

Leshed, G., Hancock, J. T., Cosley, D., McLeod, P. L., and Gay, G. Feedback for guiding reflection on teamwork practices. In Proc. GROUP 2007, ACM Press (2007), 217--220.

Digital Library

[19]

Leshed, G., Perez, D., Hancock, J. T., Cosley, D., Birnholtz, J., Lee, S., McLeod, P. L., and Gay, G. Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups. Proc. CHI 2009 (2009), 537--546.

Digital Library

[20]

Levine, J. M., and Moreland, R. L. Progress in small group research. Annual Review of Psychology 41 (1990), 585--634.

[21]

McGrath, J. E. Small group research, that once and future field: An interpretation of the past with an eye to the future. Group Dynamics: Theory, Research, and Practice 1 (1997), 7--27.

[22]

Nemeth, C. J., Personnaz, B., Personnaz, M., and Goncalo, J. a. The liberating role of conflict in group creativity: A study in two countries. European Journal of Social Psychology 34 (2004), 365--374.

[23]

Niederhoffer, K. G., and Pennebaker, J. W. Linguistic style matching in social interaction. Journal of Language and Social Psychology 21 (2002), 337--360.

[24]

Nowak, M., Kim, J., Kim, N. W., and Nass, C. Social Visualization and Negotiation: Effects of Feedback Configuration and Status. In Proc. CSCW 2012, ACM Press (2012), 1081--1090.

Digital Library

[25]

Pennebaker, J. W., Gosling, S. D., and Ferrell, J. D. Digital in-class teaching using the TOWER system: A pilot project of two 500-student introductory psychology classes. Tech. rep., Technical Report, Dept. of Psychology, University of Texas at Austin, 2012.

[26]

Sexton, J. B., and Helmreich, R. L. Analyzing cockpit communications: The links between language, performance, and workload. Human Performance in Extreme Environments 5 (2000), 63--68.

[27]

Stasser, G., Taylor, L. A., and Hanna, C. Information sampling in structured and unstructured discussions of three- and six-person groups. Journal of Personality and Social Psychology 57 (1989), 67--78.

[28]

Tausczik, Y. R., and Pennebaker, J. W. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology 29 (2010), 24--54.

[29]

Taylor, P. J., and Thomas, S. Linguistic style matching and negotiation outcome. Negotiation and Conflict Management Research 1 (2008), 263--281.

Cited By

Valencia SHuynh JJiang EWu YWan TZheng ZAdmoni HBigham JPavel A(2024)COMPA: Using Conversation Context to Achieve Common Ground in AACProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642762(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642762
Seo SHan BUnhelkar VAgmon NAn BRicci AYeoh W(2023)Automated Task-Time Interventions to Improve Teamwork using Imitation LearningProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598655(335-344)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3598655
Pellegrino EDellwo V(2023)Speakers are more cooperative and less individual when interacting in larger group sizesFrontiers in Psychology10.3389/fpsyg.2023.114557214Online publication date: 5-Jun-2023
https://doi.org/10.3389/fpsyg.2023.1145572
Show More Cited By

Index Terms

Improving teamwork using real-time language feedback
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Feedback for guiding reflection on teamwork practices
GROUP '07: Proceedings of the 2007 ACM International Conference on Supporting Group Work

Effective communication in project teams is important, but not often taught. We explore how feedback might improve teamwork in a controlled experiment where groups interact through chat rooms. Collaborators who receive high feedback ratings use ...
Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

While most collaboration technologies are concerned with supporting particular tasks such as workflows or meetings, many work groups do not have the teamwork skills essential to effective collaboration. One way to improve teamwork is to provide dynamic ...
An experimental study of collaborative interaction tasks supported by awareness and multimodal feedback
VRCAI '09: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

Awareness and feedback have been identified by many researchers as key concepts to achieve fluent collaboration when performing highly interactive collaborative tasks. However, it is remarkable that few studies address the effect that adding special ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2013

3550 pages

ISBN:9781450318990

DOI:10.1145/2470654

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
1,176
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)7

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Valencia SHuynh JJiang EWu YWan TZheng ZAdmoni HBigham JPavel A(2024)COMPA: Using Conversation Context to Achieve Common Ground in AACProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642762(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642762
Seo SHan BUnhelkar VAgmon NAn BRicci AYeoh W(2023)Automated Task-Time Interventions to Improve Teamwork using Imitation LearningProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598655(335-344)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3598655
Pellegrino EDellwo V(2023)Speakers are more cooperative and less individual when interacting in larger group sizesFrontiers in Psychology10.3389/fpsyg.2023.114557214Online publication date: 5-Jun-2023
https://doi.org/10.3389/fpsyg.2023.1145572
Do HKong HTetali PKarahalios KBailey B(2023)Inform, Explain, or Control: Techniques to Adjust End-User Performance Expectations for a Conversational Agent Facilitating Group Chat DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/36101927:CSCW2(1-26)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610192
Do HKong HTetali PLee JBailey B(2023)To Err is AI: Imperfect Interventions and Repair in a Conversational Agent Facilitating Group Chat DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/35795327:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579532
Lin YLiu YLee C(2023)An Interaction-process-guided Framework for Small-group Performance PredictionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/355876819:2(1-25)Online publication date: 6-Feb-2023
https://dl.acm.org/doi/10.1145/3558768
Ashoori EDávila-Montero SMason A(2023)Analyzing Affect During Virtual Meetings to Improve Quality of Interaction2023 IEEE 13th Annual Computing and Communication Workshop and Conference (CCWC)10.1109/CCWC57344.2023.10099285(0678-0681)Online publication date: 8-Mar-2023
https://doi.org/10.1109/CCWC57344.2023.10099285
Boucher HLierse SMarzano GMarzano G(2022)A Dialogical View on R. Murray Schafer's Theories and Creative Approaches in 21st Century Music EducationSustaining Creativity and the Arts in the Digital Age10.4018/978-1-7998-7840-7.ch011(292-325)Online publication date: 24-Jun-2022
https://doi.org/10.4018/978-1-7998-7840-7.ch011
Klonek FGerpott FHandke L(2022)When Groups of Different Sizes Collide: Effects of Targeted Verbal Aggression on Intragroup FunctioningGroup & Organization Management10.1177/1059601122113442648:4(1203-1244)Online publication date: 31-Oct-2022
https://doi.org/10.1177/10596011221134426
Nguyen MMougenot C(2022)We're Still People And Not Only Emails That We're Sending - Shared Cognition In Distributed Design CollaborationProceedings of the 4th International Electronics Communication Conference10.1145/3560089.3560096(40-46)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.1145/3560089.3560096
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents