Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Understanding the Design Space of AI-Mediated Social Interaction in Online Learning: Challenges and Opportunities

Published: 07 April 2022 Publication History

Abstract

Our online interactions are constantly mediated through Artificial Intelligence (AI), especially our social interactions. AI-mediated social interaction is the AI-facilitated process of building and maintaining social connections between individuals through information inferred from people's online posts. With its impending application across a number of contexts, the challenges and opportunities of AI-mediated social interaction remain underexplored. This paper seeks to understand the design space of AI-mediated social interaction in the context of online learning, where students frequently face social isolation. We deployed an AI agent named SAMI in three class discussion forums to help online learners build social connections. Using SAMI as a probe, we conducted semi-structured interviews with 26 students to understand their difficulties in remote social interactions and their experiences with SAMI. Through the lenses of social translucence and social-technical gap, we illustrate online learners' difficulties in remote social interactions and how SAMI resolved some of the difficulties. We also identify potential ethical and social challenges of SAMI such as user agency and privacy. Based on our findings, we outline the design space of AI-mediated social interaction. We discuss the design tension between AI performance and ethical design and pinpoint two design opportunities for AI-mediated social interaction in designing towards human-AI collaborative social matching and artificial serendipity.

References

[1]
Mark S Ackerman. 2000. The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Human-Computer Interaction, Vol. 15, 2--3 (2000), 179--203.
[2]
Alessandro Acquisti, Laura Brandimarte, and George Loewenstein. 2015. Privacy and human behavior in the age of information. Science, Vol. 347, 6221 (2015), 509--514.
[3]
Rohan Ahuja, Daniyal Khan, Danilo Symonette, Marie desJardins, Simon Stacey, and Don Engel. 2019. A Digital Dashboard for Supporting Online Student Teamwork. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 132--136.
[4]
Tahani Ibrahim Aldosemani, Craig Erschel Shepherd, Ibrahim Gashim, and Tonia Dousay. 2016. Developing third places to foster sense of community in online instruction. British Journal of Educational Technology, Vol. 47, 6 (2016), 1020--1031.
[5]
Steven R Aragon. 2003. Creating social presence in online environments. New directions for adult and continuing education, Vol. 2003, 100 (2003), 57--68.
[6]
J Ben Arbaugh, Martha Cleveland-Innes, Sebastian R Diaz, D Randy Garrison, Philip Ice, Jennifer C Richardson, and Karen P Swan. 2008. Developing a community of inquiry instrument: Testing a measure of the community of inquiry framework using a multi-institutional sample. The internet and higher education, Vol. 11, 3--4 (2008), 133--136.
[7]
Pernille Bjørn and Ojelanki Ngwenyama. 2009. Virtual team collaboration: building shared meaning, resolving breakdowns and creating translucence. Information systems journal, Vol. 19, 3 (2009), 227--253.
[8]
Chloë Brown, Christos Efstratiou, Ilias Leontiadis, Daniele Quercia, and Cecilia Mascolo. 2014. Tracking serendipitous interactions: How individual cultures shape the office. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 1072--1081.
[9]
Jeongmin Byun, Jungkook Park, and Alice Oh. 2020. Cocode: Co-learner Screen Sharing for Social Translucence in Online Programming Courses. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--4.
[10]
Carrie J Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. " Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proceedings of the ACM on Human-computer Interaction, Vol. 3, CSCW (2019), 1--24.
[11]
Kathy Charmaz. 2014. Constructing grounded theory. sage.
[12]
Jilin Chen, Werner Geyer, Casey Dugan, Michael Muller, and Ido Guy. 2009. Make new friends, but keep the old: recommending people on social networking sites. In Proceedings of the SIGCHI conference on human factors in computing systems. 201--210.
[13]
Yu-Shian Chiu, Kuei-Hong Lin, and Jia-Sin Chen. 2011. A social network-based serendipity recommender system. In 2011 International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS). IEEE, 1--5.
[14]
Chia-Fang Chung, Nanna Gorm, Irina A Shklovski, and Sean Munson. 2017. Finding the right fit: understanding health tracking in workplace wellness programs. In Proceedings of the 2017 CHI conference on human factors in computing systems. 4875--4886.
[15]
Andrew Cross, Mydhili Bayyapunedi, Dilip Ravindran, Edward Cutrell, and William Thies. 2014. VidWiki: enabling the crowd to improve the legibility of online educational videos. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 1167--1175.
[16]
Pieter Duysburgh, Shirley A Elprama, and An Jacobs. 2014. Exploring the social-technological gap in telesurgery: collaboration within distributed or teams. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 1537--1548.
[17]
Nathan Eagle and Alex Pentland. 2005. Social serendipity: Mobilizing social software. IEEE Pervasive computing, Vol. 4, 2 (2005), 28--34.
[18]
Upol Ehsan, Q Vera Liao, Michael Muller, Mark O Riedl, and Justin D Weisz. 2021. Expanding explainability: Towards social transparency in ai systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--19.
[19]
Thomas Erickson and Wendy A Kellogg. 2000. Social translucence: an approach to designing systems that support social processes. ACM transactions on computer-human interaction (TOCHI), Vol. 7, 1 (2000), 59--83.
[20]
Casey Fiesler, Cliff Lampe, and Amy S Bruckman. 2016. Reality and perception of copyright terms of service for online content creation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. 1450--1461.
[21]
Asbjørn Følstad, Cecilie Bertinussen Nordheim, and Cato Alexander Bjørkli. 2018. What makes users trust a chatbot for customer service? An exploratory interview study. In International Conference on Internet Science. Springer, 194--208.
[22]
D Randy Garrison and J Ben Arbaugh. 2007. Researching the community of inquiry framework: Review, issues, and future directions. The Internet and higher education, Vol. 10, 3 (2007), 157--172.
[23]
Ali Gheitasy, José Abdelnour-Nocera, and Bonnie Nardi. 2015. Socio-technical gaps in online collaborative consumption (OCC) an example of the etsy community. In Proceedings of the 33rd Annual International Conference on the Design of Communication. 1--9.
[24]
Ashok K Goel and Lalith Polepeddi. 2016. Jill Watson: A virtual teaching assistant for online education. Technical Report. Georgia Institute of Technology.
[25]
Jonathan Grudin. 1994. Groupware and social dynamics: Eight challenges for developers. Commun. ACM, Vol. 37, 1 (1994), 92--105.
[26]
Jeffrey T Hancock, Mor Naaman, and Karen Levy. 2020. AI-mediated communication: definition, research agenda, and ethical considerations. Journal of Computer-Mediated Communication, Vol. 25, 1 (2020), 89--100.
[27]
Jess Hohenstein and Malte Jung. 2020. AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust. Computers in Human Behavior, Vol. 106 (2020), 106190.
[28]
Carol Hostetter and Monique Busch. 2006. Measuring up online: The relationship between social presence and student learning satisfaction. Journal of the Scholarship of Teaching and Learning (2006), 1--12.
[29]
Christopher Irwin and Zane Berge. 2006. Socialization in the online classroom. E-Journal of Instructional Science and Technology, Vol. 9, 1 (2006), n1.
[30]
Carolin Ischen, Theo Araujo, Hilde Voorveld, Guda van Noort, and Edith Smit. 2019. Privacy concerns in chatbot interactions. In International Workshop on Chatbot Research and Design. Springer, 34--48.
[31]
Mizuko Ito. 2013. Hanging out, messing around, and geeking out: Kids living and learning with new media. The MIT Press.
[32]
Maurice Jakesch, Megan French, Xiao Ma, Jeffrey T Hancock, and Mor Naaman. 2019. AI-mediated communication: How the perception that profile text was written by AI affects trustworthiness. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.
[33]
Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-machine collaboration for content regulation: The case of Reddit Automoderator. ACM Transactions on Computer-Human Interaction (TOCHI), Vol. 26, 5 (2019), 1--35.
[34]
Christopher M Johnson. 2001. A survey of current research on online communities of practice. The internet and higher education, Vol. 4, 1 (2001), 45--60.
[35]
David A Joyner, Qiaosi Wang, Suyash Thakare, Shan Jing, Ashok Goel, and Blair MacIntyre. 2020. The Synchronicity Paradox in Online Education. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 15--24.
[36]
Wendy A Kellogg and Thomas Erickson. 2002. Social Translucence, Collective Awareness, and the Emergence of Place. Proceedings of CSCW2002 (2002), 1--6.
[37]
Karel Kreijns, Paul A Kirschner, and Wim Jochems. 2003. Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research. Computers in human behavior, Vol. 19, 3 (2003), 335--353.
[38]
Jorge Larreamendy-Joerns and Gaea Leinhardt. 2006. Going the distance with online education. Review of educational research, Vol. 76, 4 (2006), 567--605.
[39]
Jean Lave, Etienne Wenger, et al. 1991. Situated learning: Legitimate peripheral participation. Cambridge university press.
[40]
Minha Lee, Lily Frank, Femke Beute, Yvonne De Kort, and Wijnand IJsselsteijn. 2017. Bots mind the social-technical gap. In Proceedings of 15th European conference on computer-supported cooperative work-exploratory papers. European Society for Socially Embedded Technologies (EUSSET).
[41]
Yi-Chieh Lee, Naomi Yamashita, and Yun Huang. 2020. Designing a Chatbot as a Mediator for Promoting Deep Self-Disclosure to a Real Mental Health Professional. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--27.
[42]
Q Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--15.
[43]
Julia M Mayer, Starr Roxanne Hiltz, Louise Barkhuus, Kaisa V"a"an"anen, and Quentin Jones. 2016. Supporting opportunities for context-aware social matching: An experience sampling study. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2430--2441.
[44]
Julia M Mayer, Starr Roxanne Hiltz, and Quentin Jones. 2015a. Making social matching context-aware: Design concepts and open challenges. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 545--554.
[45]
Julia M Mayer, Quentin Jones, and Starr Roxanne Hiltz. 2015b. Identifying opportunities for valuable encounters: Toward context-aware social matching systems. ACM Transactions on Information Systems (TOIS), Vol. 34, 1 (2015), 1--32.
[46]
David W McDonald, Stephanie Gokhman, and Mark Zachry. 2012. Building for social translucence: a domain analysis and prototype system. In Proceedings of the ACM 2012 conference on computer supported cooperative work. 637--646.
[47]
Hannah Mieczkowski, Jeffrey T Hancock, Mor Naaman, Malte Jung, and Jess Hohenstein. 2021. AI-Mediated Communication: Language Use and Interpersonal Effects in a Referential Communication Task. Proceedings of the ACM on Human-Computer Interaction, Vol. 5, CSCW1 (2021), 1--14.
[48]
Silvia Milano, Mariarosaria Taddeo, and Luciano Floridi. 2020. Recommender systems and their ethical challenges. AI & SOCIETY, Vol. 35, 4 (2020), 957--967.
[49]
Marti Motoyama and George Varghese. 2009. I seek you: searching and matching individuals in social networks. In Proceedings of the eleventh international workshop on Web information and data management. 67--75.
[50]
Jaya Narain, Tina Quach, Monique Davey, Hae Won Park, Cynthia Breazeal, and Rosalind Picard. 2020. Promoting Wellbeing with Sunny, a Chatbot that Facilitates Positive Messages within Social Groups. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--8.
[51]
Jeff Naruchitparames, Mehmet Hadi Günecs, and Sushil J Louis. 2011. Friend recommendations in social networks using genetic algorithms and network topology. In 2011 IEEE Congress of Evolutionary Computation (CEC). IEEE, 2207--2214.
[52]
Oda Elise Nordberg, Jo Dugstad Wake, Emilie Sektnan Nordby, Eivind Flobak, Tine Nordgreen, Suresh Kumar Mukhiya, and Frode Guribye. 2019. Designing Chatbots for Guiding Online Peer Support Conversations for Adults with ADHD. In International Workshop on Chatbot Research and Design. Springer, 113--126.
[53]
Ekaterina Olshannikova, Thomas Olsson, Jukka Huhtam"aki, Susanna Paasovaara, and Hannu K"arkk"ainen. 2020. From Chance to Serendipity: Knowledge Workers' Experiences of Serendipitous Social Encounters. Advances in Human-Computer Interaction, Vol. 2020 (2020).
[54]
Thomas Olsson, Jukka Huhtam"aki, and Hannu K"arkk"ainen. 2020. Directions for professional social matching systems. Commun. ACM, Vol. 63, 2 (2020), 60--69.
[55]
Lawrence A Palinkas, Sarah M Horwitz, Carla A Green, Jennifer P Wisdom, Naihua Duan, and Kimberly Hoagwood. 2015. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and policy in mental health and mental health services research, Vol. 42, 5 (2015), 533--544.
[56]
Robert D Putnam et al. 2000. Bowling alone: The collapse and revival of American community .Simon and schuster.
[57]
Werner Rammert. 2008. Where the action is. Distributed agency between humans, machines, and programs. transcript.
[58]
Alfred P Rovai. 2001. Building classroom community at a distance: A case study. Educational technology research and development, Vol. 49, 4 (2001), 33.
[59]
Alfred P Rovai. 2002. Development of an instrument to measure classroom community. The Internet and higher education, Vol. 5, 3 (2002), 197--211.
[60]
Koustuv Saha, Ted Grover, Stephen M Mattingly, Vedant Das Swain, Pranshu Gupta, Gonzalo J Martinez, Pablo Robles-Granda, Gloria Mark, Aaron Striegel, and Munmun De Choudhury. 2021. Person-Centered Predictions of Psychological Constructs with Social Media Contextualized by Multimodal Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 5, 1 (2021), 1--32.
[61]
Na Sun, Mary Beth Rosson, and John M Carroll. 2018. Where is community among online learners? Identity, efficacy and personal ties. In Proceedings of the 2018 chi conference on human factors in computing systems. 1--13.
[62]
Na Sun, Xiying Wang, and Mary Beth Rosson. 2019. How Do Distance Learners Connect?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12.
[63]
S Shyam Sundar. 2020. Rise of Machine Agency: A Framework for Studying the Psychology of Human--AI Interaction (HAII). Journal of Computer-Mediated Communication, Vol. 25, 1 (2020), 74--88.
[64]
Agnieszka Matysiak Szostek, Evangelos Karapanos, Berry Eggen, and Mike Holenderski. 2008. Understanding the implications of social translucence for systems supporting communication at work. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. 649--658.
[65]
Hon Jie Teo and Aditya Johri. 2014. Fast, functional, and fitting: expert response dynamics and response quality in an online newcomer help forum. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 332--341.
[66]
Loren Terveen and David W McDonald. 2005. Social matching: A framework and research agenda. ACM transactions on computer-human interaction (TOCHI), Vol. 12, 3 (2005), 401--434.
[67]
Nava Tintarev and Judith Masthoff. 2012. Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction, Vol. 22, 4--5 (2012), 399--439.
[68]
Chun-Hua Tsai and Peter Brusilovsky. 2017. Providing control and transparency in a social recommender system for academic conferences. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. 313--317.
[69]
Qiaosi Wang, Shan Jing, Ida Camacho, David Joyner, and Ashok Goel. 2020 a. Jill Watson SA: Design and Evaluation of a Virtual Agent to Build Communities Among Online Learners. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--8.
[70]
Qiaosi Wang, Shan Jing, David Joyner, Lauren Wilcox, Hong Li, Thomas Plötz, and Betsy Disalvo. 2020 b. Sensing Affect to Empower Students: Learner Perspectives on Affect-Sensitive Technology in Large Educational Contexts. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 63--76.
[71]
Qiaosi Wang, Koustuv Saha, Eric Gregori, David Joyner, and Ashok Goel. 2021. Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--14.
[72]
Dong Whi Yoo and Munmun De Choudhury. 2019. Designing dashboard for campus stakeholders to support college student mental health. In Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare. 61--70.
[73]
Dongwook Yoon, Nicholas Chen, Bernie Randles, Amy Cheatle, Corinna E Löckenhoff, Steven J Jackson, Abigail Sellen, and Francc ois Guimbretière. 2016. RichReview+ Deployment of a Collaborative Multi-modal Annotation System for Instructor Feedback and Peer Discussion. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. 195--205.
[74]
Douglas Zytko and Leanne DeVreugd. 2019. Designing a Social Matching System to Connect Academic Researchers with Local Community Collaborators. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, GROUP (2019), 1--15.
[75]
Douglas Zytko, Victor Regalado, Sukeshini A Grandhi, and Quentin Jones. 2018. Supporting Online Dating Decisions with a Prompted Discussion Interface. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. 353--356.

Cited By

View all
  • (2024)Beyond the ScreenHyperautomation in Business and Society10.4018/979-8-3693-3354-9.ch014(266-285)Online publication date: 28-Jun-2024
  • (2024)WiFi-CSI Difference ParadigmProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596088:2(1-29)Online publication date: 15-May-2024
  • (2024)BreathPro: Monitoring Breathing Mode during Running with EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596078:2(1-25)Online publication date: 15-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 6, Issue CSCW1
CSCW1
April 2022
2511 pages
EISSN:2573-0142
DOI:10.1145/3530837
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 April 2022
Published in PACMHCI Volume 6, Issue CSCW1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AI-mediated communication
  2. AI-mediated social interaction
  3. computer mediated communication
  4. online learning
  5. online social interaction
  6. social translucence
  7. social-technical gap

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)821
  • Downloads (Last 6 weeks)199
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Beyond the ScreenHyperautomation in Business and Society10.4018/979-8-3693-3354-9.ch014(266-285)Online publication date: 28-Jun-2024
  • (2024)WiFi-CSI Difference ParadigmProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596088:2(1-29)Online publication date: 15-May-2024
  • (2024)BreathPro: Monitoring Breathing Mode during Running with EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596078:2(1-25)Online publication date: 15-May-2024
  • (2024)Intelligent Tutors for Adult Learning at Scale: A Narrative ReviewProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664692(289-294)Online publication date: 9-Jul-2024
  • (2024)The AI-DEC: A Card-based Design Method for User-centered AI ExplanationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661576(1010-1028)Online publication date: 1-Jul-2024
  • (2024)Exploring the Design Space of Input Modalities for Working in Mixed Reality on Long-haul FlightsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661560(2267-2285)Online publication date: 1-Jul-2024
  • (2024)ICY Interfaces: Exploration of Ice’s Ephemeral Features for Digital Game User ExperienceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660725(2107-2124)Online publication date: 1-Jul-2024
  • (2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
  • (2024)F2Key: Dynamically Converting Your Face into a Private Key Based on COTS Headphones for Reliable Voice InteractionProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661860(127-140)Online publication date: 3-Jun-2024
  • (2024)EarSlideProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435158:1(1-29)Online publication date: 6-Mar-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media