Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3430665.3456369acmconferencesArticle/Chapter ViewAbstractPublication PagesiticseConference Proceedingsconference-collections
research-article
Public Access

Using Dialogue Analysis to Predict Women's Stress During Remote Collaborative Learning in Computer Science

Published: 26 June 2021 Publication History

Abstract

The computer science education community strives to improve equity and representation within the field, yet the proportion of women earning CS bachelor's degrees in countries such as the US remains low. In addition to recruitment and retention initiatives that support women, we need to better understand women's experiences within CS. This paper makes a novel contribution toward this effort by examining women's self-reported stress during remote collaborative programming with a peer. Women reported significantly more stress than men, so we analyzed the women's collaborative dialogues and identified the most common dialogue acts and sequences of dialogue acts. We used these dialogue acts to predict women's stress and found six significant patterns of dialogue. Women reported less stress with higher frequencies of offering suggestions, having their partner provide explanations, and having their own rapport-building messages reciprocated by their partner. In contrast, women reported more stress with higher frequencies of their own explanations, having their partner answer their questions, and having their partner send a rapport-building message that they reciprocated. Understanding the nuances of these experiences allows us to make better predictions of when women might be feeling stressed and what we might be able to do to relieve these feelings. Improving women's CS experiences holds the potential to, in turn, improve gender equity within CS.

References

[1]
Annelie Ädel. 2011. Rapport building in student group work. Journal of Pragmatics, Vol. 43, 12 (2011), 2932--2947.
[2]
Michael Baker, Tia G. B. Hansen, Richard Joiner, and David Traum. 1999. The role of grounding in collaborative learning tasks. Collaborative Learning: Cognitive and Computational Approaches, Vol. 31 (1999), 63.
[3]
Mikhail Mikhauilovich Bakhtin. 2010. Speech genres and other late essays .University of Texas Press.
[4]
Andrew Begel and Nachiappan Nagappan. 2008. Pair Programming: What's in It for Me?. In Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (Kaiserslautern, Germany) (ESEM '08). 120--128. https://doi.org/10.1145/1414004.1414026
[5]
Harry Bunt. 2005. A Framework for Dialogue Act Specification. Joint ISO-ACL Workshop on the Representation and Annotation of Semantic Information (2005).
[6]
Herbert H. Clark and Edward F. Schaefer. 1989. Contributing to discourse. Cognitive Science, Vol. 13, 2 (1989), 259--294.
[7]
Jacob Cohen. 2013. Statistical Power Analysis for the Behavioral Sciences .Academic Press.
[8]
Kate Forbes-Riley and Diane J. Litman. 2005. Using Bigrams to Identify Relationships Between Student Certainness States and Tutor Responses in a Spoken Dialogue Corpus. In Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue. 87--96.
[9]
Joey Hadden, Laura Casado, Tyler Sonnemaker, and Taylor Borden. 2020. 21 major companies that have announced employees can work remotely long-term. Business Insider (2020). https://www.businessinsider.com/companies-asking-employees-to-work-from-home-due-to-coronavirus-2020
[10]
Brian Hanks. 2006. Student Attitudes toward Pair Programming. In Proceedings of the 11th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education (Bologna, Italy) (ITICSE '06). 113--117. https://doi.org/10.1145/1140124.1140156
[11]
Douglas M. Hawkins. 2004. The Problem of Overfitting. Journal of Chemical Information and Computer Sciences, Vol. 44, 1 (2004), 1--12. https://doi.org/10.1021/ci0342472 14741005.
[12]
Madeline Hinckle, Arif Rachmatullah, Bradford Mott, Kristy Elizabeth Boyer, James Lester, and Eric Wiebe. 2020. The Relationship of Gender, Experiential, and Psychological Factors to Achievement in Computer Science. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education. 225--231.
[13]
SAS Institute Inc. 2021. JMP® Pro 15. https://www.jmp.com/en_us/software/predictive-analytics-software.html
[14]
Brian Kooiman, Wenling Li, Michael Wesolek, and Heeja Kim. 2015. Validation of the Relatedness Scale of the Intrinsic Motivation Inventory through Factor Analysis. International Journal of Multidisciplinary Research and Modern Education, Vol. 1, 2 (2015), 302--311.
[15]
Nicole C. Krämer, Bilge Karacora, Gale Lucas, Morteza Dehghani, Gina Rüther, and Jonathan Gratch. 2016. Closing the gender gap in STEM with friendly male instructors? On the effects of rapport behavior and gender of a virtual agent in an instructional interaction. Computers & Education, Vol. 99 (2016), 1 -- 13. https://doi.org/10.1016/j.compedu.2016.04.002
[16]
Sandeep Kaur Kuttal, Kevin Gerstner, and Alexandra Bejarano. 2019. Remote Pair Programming in Online CS Education: Investigating through a Gender Lens. In 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 75--85.
[17]
J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, Vol. 33, 1 (1977), 159--174.
[18]
Edward McAuley, Terry Duncan, and Vance V. Tammen. 1989. Psychometric Properties of the Intrinsic Motivation Inventory in a Competitive Sport Setting: A Confirmatory Factor Analysis. Research Quarterly for Exercise and Sport, Vol. 60, 1 (1989), 48--58.
[19]
Ian McChesney. 2016. Three Years of Student Pair Programming: Action Research Insights and Outcomes. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education (Memphis, Tennessee, USA) (SIGCSE '16). 84--89. https://doi.org/10.1145/2839509.2844565
[20]
Charlie McDowell, Brian Hanks, and Linda Werner. 2003. Experimenting with Pair Programming in the Classroom. In Proceedings of the 8th Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE '03). 60--64.
[21]
Charlie McDowell, Linda Werner, Heather Bullock, and Julian Fernald. 2002. The Effects of Pair-Programming on Performance in an Introductory Programming Course. In Proceedings of the 33rd SIGCSE Technical Symposium on Computer Science Education (Cincinnati, Kentucky) (SIGCSE '02). 38--42. https://doi.org/10.1145/563340.563353
[22]
U.S. Department of Education: National Center for Education Statistics. 2019. Higher Education General Information Survey (HEGIS): Degrees in computer and information sciences conferred by postsecondary institutions, by level of degree and sex of student: 1970--71 through 2017--18. https://nces.ed.gov/programs/digest/d19/tables/dt19_325.35.asp Accessed: 01-07--2021.
[23]
Amy Ogan, Samantha Finkelstein, Erin Walker, Ryan Carlson, and Justine Cassell. 2012. Rudeness and Rapport: Insults and Learning Gains in Peer Tutoring. In Intelligent Tutoring Systems, Stefano A. Cerri, William J. Clancey, Giorgos Papadourakis, and Kitty Panourgia (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 11--21.
[24]
Vahab Pournaghshband and Paola Medel. 2020. Promoting Diversity-Inclusive Computer Science Pedagogies: A Multidimensional Perspective. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education. 219--224.
[25]
Sadhana Puntambekar. 2006. Analyzing collaborative interactions: divergence, shared understanding and construction of knowledge. Computers & Education, Vol. 47, 3 (2006), 332 -- 351. https://doi.org/10.1016/j.compedu.2004.10.012
[26]
Peter Robe, Sandeep Kaur Kuttal, Yunfeng Zhang, and Rachel Bellamy. 2020. Can Machine Learning Facilitate Remote Pair Programming? Challenges, Insights & Implications. In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 1--11.
[27]
Fernando J. Rodr'iguez, Kimberly Michelle Price, and Kristy Elizabeth Boyer. 2017. Exploring the Pair Programming Process: Characteristics of Effective Collaboration. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education (Seattle, Washington, USA) (SIGCSE '17). 507--512. https://doi.org/10.1145/3017680.3017748
[28]
Tanmay Sinha and Justine Cassell. 2015. We Click, We Align, We Learn: Impact of Influence and Convergence Processes on Student Learning and Rapport Building. In Proceedings of the 1st Workshop on Modeling INTERPERsonal SynchrONy And InfLuence (Seattle, Washington, USA) (INTERPERSONAL '15). 13--20. https://doi.org/10.1145/2823513.2823516
[29]
Rachel Thomas, Marianne Cooper, Gina Cardazone, Sarah Coury, Kate Urban, Ali Bohrer, Madison Long, Lareina Yee, Alexis Krivkovich, Jess Huang, Sara Prince, and Ankur Kumar. 2020. Women in the Workplace 2020. (2020). https://wiw-report.s3.amazonaws.com/Women_in_the_Workplace_2020.pdf Accessed: 01--12--2021.
[30]
Linda Tickle-Degnen and Robert Rosenthal. 1990. The Nature of Rapport and Its Nonverbal Correlates. Psychological inquiry, Vol. 1, 4 (1990), 285--293.
[31]
Linda L. Werner, Brian Hanks, and Charlie McDowell. 2004. Pair-Programming Helps Female Computer Science Students. Journal on Educational Resources in Computing, Vol. 4, 1 (2004), 4--es. https://doi.org/10.1145/1060071.1060075
[32]
Laurie Williams, Robert R. Kessler, Ward Cunningham, and Ron Jeffries. 2000. Strengthening the case for pair programming. IEEE software, Vol. 17, 4 (2000), 19--25.
[33]
Ursula Wolz, Jacob Palme, Penny Anderson, Zhi Chen, James Dunne, Göran Karlsson, Atika Laribi, Sirkku M"annikkö, Robert Spielvogel, and Henry Walker. 1997. Computer-Mediated Communication in Collaborative Educational Settings (Report of the ITiCSE '97 Working Group on CMC in Collaborative Educational Settings). In The Supplemental Proceedings of the Conference on Integrating Technology into Computer Science Education: Working Group Reports and Supplemental Proceedings (Uppsala, Sweden) (ITiCSE-WGR '97). 51--69.
[34]
UN Women. 2020. COVID-19 and its economic toll on women: The story behind the numbers. UN Women (2020). https://www.unwomen.org/en/news/stories/2020/9/feature-covid-19-economic-impacts-on-women
[35]
Stelios Xinogalos, Maya Satratzemi, Alexander Chatzigeorgiou, and Despina Tsompanoudi. 2017. Student Perceptions on the Benefits and Shortcomings of Distributed Pair Programming Assignments. In 2017 IEEE Global Engineering Education Conference (EDUCON). 1513--1521.
[36]
Kimberly Michelle Ying, Lydia G. Pezzullo, Mohona Ahmed, Kassandra Crompton, Jeremiah Blanchard, and Kristy Elizabeth Boyer. 2019. In Their Own Words: Gender Differences in Student Perceptions of Pair Programming. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE '19). 1053--1059. https://doi.org/10.1145/3287324.3287380
[37]
Kimberly Michelle Ying, Fernando J. Rodríguez, Alexandra Lauren Dibble, and Kristy Elizabeth Boyer. 2020. Understanding Women's Remote Collaborative Programming Experiences: The Relationship between Dialogue Features and Reported Perceptions. Proc. ACM Hum.-Comput. Interact., Vol. 4, CSCW3 (2020), Article 253.
[38]
Nick Z. Zacharis. 2011. Measuring the Effects of Virtual Pair Programming in an Introductory Programming Java Course. IEEE Transactions on Education, Vol. 54, 1 (2011), 168--170.
[39]
Amy L. Zeldin and Frank Pajares. 2000. Against the Odds: Self-Efficacy Beliefs of Women in Mathematical, Scientific, and Technological Careers. Am. Educ. Res. J., Vol. 37, 1 (2000), 215--246. https://doi.org/10.3102/00028312037001215

Cited By

View all
  • (2023)Gender Differences in the Group Dynamics of Smaller CS1 Project Groups2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343369(1-9)Online publication date: 18-Oct-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ITiCSE '21: Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1
June 2021
611 pages
ISBN:9781450382144
DOI:10.1145/3430665
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CS1
  2. CSCL
  3. CSCW
  4. collaboration
  5. gender
  6. women

Qualifiers

  • Research-article

Funding Sources

Conference

ITiCSE 2021
Sponsor:

Acceptance Rates

Overall Acceptance Rate 552 of 1,613 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)50
  • Downloads (Last 6 weeks)5
Reflects downloads up to 15 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Gender Differences in the Group Dynamics of Smaller CS1 Project Groups2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343369(1-9)Online publication date: 18-Oct-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media