research-article

Open access

The Impact of Governance Bots on Sense of Virtual Community: Development and Validation of the GOV-BOTs Scale

Authors:

C. Estelle Smith,

Brian C. Keegan,

Anita L. BlanchardAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 6, Issue CSCW2

Article No.: 462, Pages 1 - 30

https://doi.org/10.1145/3555563

Published: 11 November 2022 Publication History

Abstract

Bots are increasingly being used for governance-related purposes in online communities, yet no instrumentation exists for measuring how users assess their beneficial or detrimental impacts. In order to support future human-centered and community-based research, we developed a new scale called GOVernance Bots in Online communiTies (GOV-BOTs) across two rounds of surveys on Reddit (N=820). We applied rigorous psychometric criteria to demonstrate the validity of GOV-BOTs, which contains two subscales: bot governance (4 items) and bot tensions (3 items). Whereas humans have historically expected communities to be composed entirely of humans, the social participation of bots as non-human agents now raises fundamental questions about psychological, philosophical, and ethical implications. Addressing psychological impacts, our data show that perceptions of effective bot governance positively contribute to users' sense of virtual community (SOVC), whereas perceived bot tensions may only impact SOVC if users are more aware of bots. Finally, we show that users tend to experience the greatest SOVC across groups of subreddits, rather than individual subreddits, suggesting that future research should carefully re-consider uses and operationalizations of the term "community."

Supplementary Material

ZIP File (v6cscw2462aux.pdf.zip)

GOV-BOTs Complete Survey Text.

Download
195.76 KB

References

[1]

[n.d.]. Bottiquette. https://www.reddit.com/r/Bottiquette/wiki/bottiquette

[2]

Blake E. Ashforth and Fred Mael. 1989. Social Identity Theory and the Organization. Academy of Management Review 14, 1 (Jan. 1989), 20--39. https://doi.org/10.5465/amr.1989.4278999 Publisher: Academy of Management.

[3]

Kenneth M. Bachrach and Alex J. Zautra. 1985. Coping with a Community Stressor: The Threat of a Hazardous Waste Facility. Journal of Health and Social Behavior 26, 2 (1985), 127--141. https://doi.org/10.2307/2136602 Publisher:

[4]

.

[5]

Jiajun Bao, JunjieWu, Yiming Zhang, Eshwar Chandrasekharan, and David Jurgens. 2021. Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversations. In Proceedings of the Web Conference 2021. Association for Computing Machinery, New York, NY, USA, 1134--1145. https://doi.org/10.1145/3442381.3450122

Digital Library

[6]

Thomas E. Becker. 2005. Potential Problems in the Statistical Control of Variables in Organizational Research: A Qualitative Analysis With Recommendations. Organizational Research Methods 8, 3 (July 2005), 274--289. https: //doi.org/10.1177/1094428105278021 Publisher: SAGE Publications Inc.

[7]

Marit Bentvelzen, Jasmin Niess, Miko?aj P. Wo?niak, and Pawe? W. Wo?niak. 2021. The Development and Validation of the Technology-Supported Reflection Inventory. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Number 366. Association for Computing Machinery, New York, NY, USA, 1--8. http://doi.org/10. 1145/3411764.3445673

Digital Library

[8]

Reuben Binns, Michael Veale, Max Van Kleek, and Nigel Shadbolt. 2017. Like Trainer, Like Bot? Inheritance of Bias in Algorithmic Content Moderation. In Social Informatics (Lecture Notes in Computer Science), Giovanni Luca Ciampaglia, Afra Mashhadi, and Taha Yasseri (Eds.). Springer International Publishing, Cham, 405--415. https: //doi.org/10.1007/978--3--319--67256--4_32

[9]

Anita L. Blanchard. 2007. Developing a Sense of Virtual Community Measure. CyberPsychology & Behavior 10, 6 (Dec. 2007), 827--830. https://doi.org/10.1089/cpb.2007.9946

[10]

Anita L. Blanchard, Leann E. Caudill, and Lisa Slattery Walker. 2020. Developing an entitativity measure and distinguishing it from antecedents and outcomes within online and face-to-face groups. Group Processes & Intergroup Relations 23, 1 (Jan. 2020), 91--108. https://doi.org/10.1177/1368430217743577

[11]

Anita L. Blanchard and M. Lynne Markus. 2004. The experienced "sense" of a virtual community: characteristics and processes. ACM SIGMIS Database: the DATABASE for Advances in Information Systems 35, 1 (Feb. 2004), 64--79. https://doi.org/10.1145/968464.968470

Digital Library

[12]

Anne E Brodsky and Christine M Marx. 2001. Layers of identity: Multiple psychological senses of community within a community setting. Journal of community psychology 29, 2 (2001), 161--178.

[13]

Phillip Brooker. 2019. My unexpectedly militant bots: A case for Programming-as-Social-Science. The Sociological Review 67, 6 (Nov. 2019), 1228--1248. https://doi.org/10.1177/0038026119840988 Publisher: SAGE Publications Ltd.

[14]

Amy Bruckman. 2006. A new perspective on "community" and its implications for computer-mediated communication systems. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). Association for Computing Machinery, New York, NY, USA, 616--621. https://doi.org/10.1145/1125451.1125579

Digital Library

[15]

Fred B Bryant. 2000. Assessing the validity of measurement. Reading and understanding MORE multivariate statistics (2000), 99--146.

[16]

Donald T. Campbell. 1958. Common fate, similarity, and other indices of the status of aggregates of persons as social entities. Behavioral Science 3, 1 (1958), 14--25. https://doi.org/10.1002/bs.3830030103

[17]

Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A Cross-Community Learning-based System to Assist Reddit Moderators. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 174:1--174:30. https://doi.org/10.1145/3359276

Digital Library

[18]

David M. Chavis, James H. Hogge, David W. McMillan, and Abraham Wandersman. 1986. Sense of community through Brunswik's lens: A first look. Journal of Community Psychology 14, 1 (1986), 24--40. https://doi.org/10.1002/1520--6629(198601).0.CO;2-P _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/1520--6629%28198601%2914%3A1%3C24%3A%3AAIDJCOP2290140104% 3E3.0.CO%3B2-P.

[19]

David M. Chavis and J. R. Newbrough. 1986. The meaning of "community" in community psychology. Journal of Community Psychology 14, 4 (1986), 335--340. https://doi.org/10.1002/1520--6629(198610)14:4ace: US Publisher: John Wiley & Sons.

[20]

Florian Daniel, Cinzia Cappiello, and Boualem Benatallah. 2019. Bots Acting Like Humans: Understanding and Preventing Harm. IEEE Internet Computing 23, 2 (March 2019), 40--49. https://doi.org/10.1109/MIC.2019.2893137 Conference Name: IEEE Internet Computing.

Digital Library

[21]

Michael A. DeVito, Jeremy Birnholtz, Jeffery T. Hancock, Megan French, and Sunny Liu. 2018. How People Form Folk Theories of Social Media Feeds and What it Means for How We Study Self-Presentation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1--12. https://doi.org/10.1145/3173574.3173694

Digital Library

[22]

Robert J. Doolittle and Donald Macdonald. 1978. Communication and a sense of community in a metropolitan neighborhood: A factor analytic examination. Communication Quarterly 26, 3 (June 1978), 2--7. https://doi.org/10. 1080/01463377809369297 Publisher: Routledge _eprint: https://doi.org/10.1080/01463377809369297.

[23]

Brianna Dym and Casey Fiesler. 2018. Vulnerable and online: Fandom's case for stronger privacy norms and tools. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. 329--332.

Digital Library

[24]

Motahhare Eslami, Kristen Vaccaro, Min Kyung Lee, Amit Elazari Bar On, Eric Gilbert, and Karrie Karahalios. 2019. User Attitudes towards Algorithmic Opacity and Transparency in Online Reviewing Platforms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300724

Digital Library

[25]

Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2016. The rise of social bots. Commun. ACM 59, 7 (June 2016), 96--104. https://doi.org/10.1145/2818717

Digital Library

[26]

Casey Fiesler and Brianna Dym. 2020. Moving Across Lands: Online Platform Migration in Fandom Communities. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (May 2020), 042:1--042:25. https://doi.org/10.1145/ 3392847

Digital Library

[27]

Casey Fiesler, Jialun Jiang, Joshua McCann, Kyle Frye, and Jed Brubaker. 2018. Reddit Rules! Characterizing an Ecosystem of Governance. Proceedings of the International AAAI Conference on Web and Social Media 12, 1 (June 2018). https://ojs.aaai.org/index.php/ICWSM/article/view/15033 Number: 1.

[28]

Claudia Flores-Saviaga, Brian Keegan, and Saiph Savage. 2018. Mobilizing the Trump Train: Understanding Collective Action in a Political Trolling Community. Proceedings of the International AAAI Conference on Web and Social Media 12, 1 (June 2018). https://ojs.aaai.org/index.php/ICWSM/article/view/15024 Number: 1.

[29]

Susan Folkman, Richard S Lazarus, Christine Dunkel-Schetter, Anita DeLongis, and Rand J Gruen. 1986. Dynamics of a Stressful Encounter: Cognitive Appraisal, Coping, and Encounter Outcomes. Personality and Social Psychology 50, 5 (1986), 12.

[30]

John Fox and Sanford Weisberg. 2019. An R Companion to Applied Regression (3 ed.). Sage Publications. https: //socialsciences.mcmaster.ca/jfox/Books/Companion/

[31]

R. Stuart Geiger. 2014. Bots, bespoke, code and the materiality of software platforms. Information, Communication & Society 17, 3 (March 2014), 342--356. https://doi.org/10.1080/1369118X.2013.873069 Publisher: Routledge _eprint: https://doi.org/10.1080/1369118X.2013.873069.

[32]

R. Stuart Geiger and Aaron Halfaker. 2017. Operationalizing Conflict and Cooperation between Automated Software Agents in Wikipedia: A Replication and Expansion of 'Even Good Bots Fight'. Proceedings of the ACM on Human- Computer Interaction 1, CSCW (Dec. 2017), 49:1--49:33. https://doi.org/10.1145/3134684

Digital Library

[33]

Tarleton Gillespie. 2018. Regulation of and by Platforms. In The SAGE Handbook of Social Media. SAGE Publications Ltd, 55 City Road, 254--278. https://doi.org/10.4135/9781473984066

[34]

Thomas J. Glynn. 1981. Psychological Sense of Community: Measurement and Application. Human Relations 34, 9 (Sept. 1981), 789--818. https://doi.org/10.1177/001872678103400904 Publisher: SAGE Publications Ltd.

[35]

Jonathan Gruber, Eszter Hargittai, Gökçe Karaoglu, and Lisa Brombach. 2021. Algorithm Awareness as an Important Internet Skill: The Case of Voice Assistants. International Journal of Communication 15, 0 (March 2021), 19. https: //ijoc.org/index.php/ijoc/article/view/15941 Number: 0.

[36]

Joseph R. Gusfield. 1975. Community : a critical response. Oxford : Blackwell. https://researchportal.scu.edu.au/ discovery/fulldisplay/alma990001992490402368/61SCU_INST:ResearchRepository

[37]

Aaron Halfaker and R. Stuart Geiger. 2020. ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (Oct. 2020), 148:1--148:37. https: //doi.org/10.1145/3415219

Digital Library

[38]

Qinglai He, Yili Hong, and Raghu Santanam. 2020. Machine-assisted regulation, online participation and human moderation. In International Conference on Information Systems, ICIS 2020 - Making Digital Inclusive: Blending the Local and the Global. Association for Information Systems. https://asu.pure.elsevier.com/en/publications/machineassisted- regulation-online-participation-and-human-modera

[39]

Rick H Hoyle. 2012. Handbook of structural equation modeling. Guilford press.

[40]

Sofia Hurtado, Poushali Ray, and Radu Marculescu. 2019. Bot Detection in Reddit Political Discussion. In Proceedings of the Fourth International Workshop on Social Sensing (SocialSense'19). Association for Computing Machinery, New York, NY, USA, 30--35. https://doi.org/10.1145/3313294.3313386

Digital Library

[41]

Sohyeon Hwang and Jeremy D. Foote. 2021. Why do People Participate in Small Online Communities? Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 1--25. https://doi.org/10.1145/3479606

Digital Library

[42]

Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. "Did You Suspect the Post Would be Removed?": Understanding User Reactions to Content Removals on Reddit. Proceedings of the ACM on Human- Computer Interaction 3, CSCW (Nov. 2019), 192:1--192:33. https://doi.org/10.1145/3359294

Digital Library

[43]

Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. ACM Transactions on Computer-Human Interaction 26, 5 (July 2019), 31:1--31:35. https://doi.org/10.1145/3338243

Digital Library

[44]

Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019. Does Transparency in Moderation Really Matter? User Behavior After Content Removal Explanations on Reddit. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 150:1--150:27. https://doi.org/10.1145/3359252

Digital Library

[45]

Steve Jones. 2015. How I Learned to Stop Worrying and Love the Bots. Social Media Society 1, 1 (April 2015), 2056305115580344. https://doi.org/10.1177/2056305115580344 Publisher: SAGE Publications Ltd.

[46]

Sanjay R. Kairam, Melissa C. Mercado-Crespo, and Steven Sumner. 2022. A Social-Ecological Approach to Modeling Sense of Virtual Community (SOVC) in Livestreaming Communities. CSCW '22: ACM Conference On Computer- Supported Cooperative Work And Social Computing (2022).

[47]

Charles Kiene and Benjamin Mako Hill. 2020. Who Uses Bots? A Statistical Analysis of Bot Usage in Moderation Teams. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3382960

Digital Library

[48]

Charles Kiene, Jialun Aaron Jiang, and Benjamin Mako Hill. 2019. Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 44:1--44:23. https://doi.org/10.1145/3359146

Digital Library

[49]

Sara Kiesler, Robert E. Kraut, and Paul Resnick. 2012. Regulating Behavior in Online Communities. In Building Successful Online Communities: Evidence-Based Social Design. MIT Press.

[50]

Shamika Klassen, Sara Kingsley, Kalyn McCall, JoyWeinberg, and Casey Fiesler. 2021. More than a Modern Day Green Book: Exploring the Online Community of Black Twitter. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--29.

Digital Library

[51]

Eva Knekta, Christopher Runyon, and Sarah Eddy. 2019. One Size Doesn't Fit All: Using Factor Analysis to Gather Validity Evidence When Using Surveys in Your Research. CBE-Life Sciences Education 18, 1 (March 2019), rm1. https://doi.org/10.1187/cbe.18-04-0064 Publisher: American Society for Cell Biology (lse).

[52]

Joon Koh, Young-Gul Kim, and Young-Gul Kim. 2003. Sense of Virtual Community: A Conceptual Framework and Empirical Validation. International Journal of Electronic Commerce 8, 2 (Dec. 2003), 75--94. https://doi.org/10.1080/ 10864415.2003.11044295 Publisher: Routledge _eprint: https://doi.org/10.1080/10864415.2003.11044295.

Digital Library

[53]

Selcuk Korkmaz, Dincer Goksuluk, and Gokmen Zararsiz. 2014. MVN: An R Package for Assessing Multivariate Normality. The R Journal 6, 2 (2014), 151--162. https://journal.r-project.org/archive/2014/RJ-2014-031/index.html

[54]

Richard S. Lazarus and Elizabeth Alfert. 1964. Short-circuiting of threat by experimentally altering cognitive appraisal. The Journal of Abnormal and Social Psychology 69, 2 (1964), 195--205. https://doi.org/10.1037/h0044635

[55]

Carlene R. Lebeuf. 2018. A taxonomy of software bots: towards a deeper understanding of software bot characteristics. Thesis. https://dspace.library.uvic.ca/handle/1828/10004 Accepted: 2018-08--31T18:11:23Z.

[56]

Brian Lickel, David L. Hamilton, and Steven J. Sherman. 2001. Elements of a Lay Theory of Groups: Types of Groups, Relational Styles, and the Perception of Group Entitativity. Personality and Social Psychology Review 5, 2 (May 2001), 129--140. https://doi.org/10.1207/S15327957PSPR0502_4

[57]

Duncan Lock. 2013. A Marvellous & Incomplete Compendium of reddit Automatons & Bots. https://duncanlock.net/ blog/2013/06/19/a-marvellous-incomplete-compendium-of-reddit-automatons-bots/

[58]

Kiel Long, John Vines, Selina Sutton, Phillip Brooker, Tom Feltwell, Ben Kirman, Julie Barnett, and Shaun Lawson. 2017. "Could You Define That in Bot Terms"? Requesting, Creating and Using Bots on Reddit. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 3488--3500. https://doi.org/10.1145/3025453.3025830

Digital Library

[59]

Ming-Cheng Ma and John P. Lalor. 2020. An Empirical Analysis of Human-Bot Interaction on Reddit. In Proceedings of the Sixth Workshop on Noisy User-generated Text (W-NUT 2020). Association for Computational Linguistics, Online, 101--106. https://doi.org/10.18653/v1/2020.wnut-1.14

[60]

Haley MacLeod, Grace Bastin, Leslie S. Liu, Katie Siek, and Kay Connelly. 2017. "Be Grateful You Don'T Have a Real Disease": Understanding Rare Disease Relationships. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1660--1673. https://doi.org/10.1145/3025453.3025796 event-place: Denver, Colorado, USA.

Digital Library

[61]

Fred A. Mael and Lois E. Tetrick. 1992. Identifying Organizational Identification. Educational and Psychological Measurement 52, 4 (Dec. 1992), 813--824. https://doi.org/10.1177/0013164492052004002

[62]

Terri Mannarini and Angela Fedi. 2009. Multiple senses of community: the experience and meaning of community. Journal of Community Psychology 37, 2 (March 2009), 211--227. https://doi.org/10.1002/jcop.20289

[63]

Nathalie Marechal. 2016. When Bots Tweet: Toward a Normative Framework for Bots on Social Networking Sites. (2016), 10.

[64]

Franziska Martini, Paul Samula, Tobias R Keller, and Ulrike Klinger. 2021. Bot, or not? Comparing three methods for detecting social bots in five political discourses. Big Data & Society 8, 2 (July 2021), 20539517211033566. https://doi.org/10.1177/20539517211033566 Publisher: SAGE Publications Ltd.

[65]

Adrienne L. Massanari. 2016. Contested Play: The Culture and Politics of Reddit Bots. In Socialbots and Their Friends. Routledge. Num Pages: 18.

[66]

J. Nathan Matias. 2019. The Civic Labor of Volunteer Moderators Online. Social Media Society 5, 2 (April 2019), 2056305119836778. https://doi.org/10.1177/2056305119836778 Publisher: SAGE Publications Ltd.

[67]

J. Nathan Matias. 2019. Preventing harassment and increasing group participation through social norms in 2,190 online science discussions. Proceedings of the National Academy of Sciences 116, 20 (May 2019), 9785--9789. https: //doi.org/10.1073/pnas.1813486116 Publisher: National Academy of Sciences Section: Social Sciences.

[68]

David W. McMillan and David M. Chavis. 1986. Sense of community: A definition and theory. Journal of Community Psychology 14, 1 (Jan. 1986), 6--23. https://doi.org/10.1002/1520--O;2-I

[69]

Robert R. Morris, Kareem Kouddous, Rohan Kshirsagar, and Stephen M. Schueller. 2018. Towards an Artificially Empathic Conversational Agent for Mental Health Applications: System Design and User Perceptions. Journal of Medical Internet Research 20, 6 (June 2018), e10148. https://doi.org/10.2196/10148 Company: Journal of Medical Internet Research Distributor: Journal of Medical Internet Research Institution: Journal of Medical Internet Research Label: Journal of Medical Internet Research Publisher: JMIR Publications Inc., Toronto, Canada.

[70]

Linda K Muthén and Bengt Muthén. 2017. Mplus user's guide: Statistical analysis with latent variables, user's guide. Muthén & Muthén.

[71]

Adewale Obadimu, Esther Mead, Samer Al-khateeb, and Nitin Agarwal. 2019. A COMPARATIVE ANALYSIS OF FACEBOOK AND TWITTER BOTS.

[72]

Patricia Obst, Sandy G. Smith, and Lucy Zinkiewicz. 2002. An exploration of sense of community, Part 3: Dimensions and predictors of psychological sense of community in geographical communities. Journal of Community Psychology 30, 1 (2002), 119--133. https://doi.org/10.1002/jcop.1054 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/jcop.1054.

[73]

D. D. Perkins and R. B. Taylor. 1996. Ecological assessments of community disorder: their relationship to fear of crime and theoretical implications. American Journal of Community Psychology 24, 1 (Feb. 1996), 63--107. https: //doi.org/10.1007/BF02511883

[74]

Grace M. H. Pretty, Colleen Conroy, Jason Dugay, Karen Fowler, and Diane Williams. 1996. Sense of community and its relevance to adolescents of all ages. Journal of Community Psychology 24, 4 (1996), 365--379. https://doi._eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/%28SICI%291520--6629%28199610%2924%3A4%3C365%3A%3AAIDJCOP6%3E3.0.CO%3B2-T.

[75]

Miretta Prezza and Stefano Costantini. 1998. Sense of community and life satisfaction: investigation in three different territorial contexts. Journal of Community & Applied Social Psychology 8, 3 (1998), 181--194. https://doi.org/10.1002/(SICI)1099--1298(199805/06)8:3_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/%28SICI%291099- 1298%28199805/06%298%3A3%3C181%3A%3AAID-CASP436%3E3.0.CO%3B2--4.

[76]

Nicholas Proferes, Naiyan Jones, Sarah Gilbert, Casey Fiesler, and Michael Zimmer. 2021. Studying Reddit: A Systematic Overview of Disciplines, Approaches, Methods, and Ethics. Social Media Society 7, 2 (April 2021), 20563051211019004. https://doi.org/10.1177/20563051211019004 Publisher: SAGE Publications Ltd.

[77]

John E. Puddifoot. 1995. Dimensions of community identity. Journal of Community & Applied Social Psychology 5, 5 (Dec. 1995), 357--370. https://doi.org/10.1002/casp.2450050507

[78]

Astrid Rosenthal-Von Der Pütten and Nikolai Bock. 2018. Development and Validation of the Self-Efficacy in Human-Robot-Interaction Scale (SE-HRI). ACM Transactions on Human-Robot Interaction 7, 3 (Dec. 2018), 21:1--21:30. https://doi.org/10.1145/3139352

Digital Library

[79]

Qualtrics. 2021. Qualtrics XM. https://www.qualtrics.com/

[80]

Mark Rapley and Grace M. H. Pretty. 1999. Playing procrustes: The interactional production of a ?psychological sense of community". Journal of Community Psychology 27, 6 CO;2-M _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/%28SICI%291520- 6629%28199911%2927%3A6%3C695%3A%3AAID-JCOP5%3E3.0.CO%3B2-M.

[81]

Pew Research. 2016. Reddit news users more likely to be male, young and digital in their news preferences. https://www.pewresearch.org/journalism/2016/02/25/reddit-news-users-more-likely-to-be-male-young-anddigital- in-their-news-preferences/

[82]

William Revelle. 2021. psych: Procedures for Psychological, Psychometric, and Personality Research. https://CRAN.Rproject.org/package=psych 82] Sarah T. Roberts. 2014. Behind the screen: The hidden digital labor of commercial content moderation. Dissertation. University of Illinois at Urbana-Champaign. https://www.ideals.illinois.edu/handle/2142/50401

[83]

Isabel Rodríguez-de Dios, Juan-José Igartua, and Alejandro González-Vázquez. 2016. Development and validation of a digital literacy scale for teenagers. In Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM '16). Association for Computing Machinery, New York, NY, USA, 1067--1072. https://doi.org/10.1145/3012430.3012648

Digital Library

[84]

Yves Rosseel. 2012. lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software 48, 1 (May 2012), 1--36. https://doi.org/10.18637/jss.v048.i02 Number: 1.

[85]

Seymour B. Sarason. 1974. The psychological sense of community: Prospects for a community psychology. Jossey-Bass, Oxford, England. Pages: xii, 290.

[86]

William Sattelberg. 2021. The Demographics of Reddit: Who Uses the Site? https://www.alphr.com/demographicsreddit/

[87]

Nathan Schneider. 2021. Admins, mods, and benevolent dictators for life: The implicit feudalism of online communities. New Media & Society (Jan. 2021), 1461444820986553. https://doi.org/10.1177/1461444820986553 Publisher: SAGE Publications.

[88]

Nathan Schneider, Primavera De Filippi, Seth Frey, Joshua Z. Tan, and Amy X. Zhang. 2021. Modular Politics: Toward a Governance Layer for Online Communities. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 16:1--16:26. https://doi.org/10.1145/3449090

Digital Library

[89]

Chester A Schriesheim and Regina J Eisenbach. 1995. An exploratory and confirmatory factor-analytic investigation of item wording effects on the obtained factor structures of survey questionnaire measures. Journal of Management 21, 6 (1995), 1177--1193.

[90]

Joseph Seering. 2020. Reconsidering Self-Moderation: the Role of Research in Supporting Community-Based Models for Online Content Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (Oct. 2020), 1--28. https://doi.org/10.1145/3415178

Digital Library

[91]

Joseph Seering, Juan Pablo Flores, Saiph Savage, and Jessica Hammer. 2018. The Social Roles of Bots: Evaluating Impact of Bots on Discussions in Online Communities. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 157:1--157:29. https://doi.org/10.1145/3274426

Digital Library

[92]

Joseph Seering, Michal Luria, Connie Ye, Geoff Kaufman, and Jessica Hammer. 2020. It takes a village: integrating an adaptive chatbot into an online gaming community. In Proceedings of the 2020 chi conference on human factors in computing systems. 1--13.

Digital Library

[93]

Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Kai-Cheng Yang, Alessandro Flammini, and Filippo Menczer. 2018. The spread of low-credibility content by social bots. Nature Communications 9, 1 (Nov. 2018), 4787. https://doi.org/10.1038/s41467-018-06930--7 Bandiera_abtest: a Cc_license_type: cc_by Cg_type: Nature Research Journals Number: 1 Primary_atype: Research Publisher: Nature Publishing Group Subject_term: Complex networks;Politics;Society;Technology Subject_term_id: complex-networks;politics;society;technology.

[94]

Prasha Shrestha, Arun Sathanur, Suraj Maharjan, Emily Saldanha, Dustin Arendt, and Svitlana Volkova. 2020. Multiple social platforms reveal actionable signals for software vulnerability awareness: A study of GitHub, Twitter and Reddit. PLOS ONE 15, 3 (March 2020), e0230250. https://doi.org/10.1371/journal.pone.0230250 Publisher: Public Library of Science.

[95]

C Estelle Smith, Avleen Kaur, Katie Z Gach, Loren Terveen, Mary Jo Kreitzer, and Susan O'Conner-Von. 2021. What is Spiritual Support and How Might It Impact the Design of Online Communities? Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1--42.

Digital Library

[96]

C Estelle Smith, Zachary Levonian, Haiwei Ma, Robert Giaquinto, Gemma Lein-Mcdonough, Zixuan Li, Susan O'Conner-Von, and Svetlana Yarosh. 2020. " I Cannot Do All of This Alone" Exploring Instrumental and Prayer Support in Online Health Communities. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 5 (2020), 1--41.

Digital Library

[97]

C. Estelle Smith, Bowen Yu, Anjali Srivastava, Aaron Halfaker, Loren Terveen, and Haiyi Zhu. 2020. Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376783

Digital Library

[98]

Paul E. Spector. 2021. Mastering the Use of Control Variables: the Hierarchical Iterative Control (HIC) Approach. Journal of Business and Psychology 36, 5 (Oct. 2021), 737--750. https://doi.org/10.1007/s10869-020-09709-0

[99]

Chenhao Tan. 2018. Tracing Community Genealogy: How New Communities Emerge from the Old. Proceedings of the International AAAI Conference on Web and Social Media 12, 1 (June 2018). https://ojs.aaai.org/index.php/ICWSM/article/view/15003 Number: 1.

[100]

R Core Team. 2020. R: The R Project for Statistical Computing. https://www.r-project.org/

[101]

Nathan TeBlunthuis and Benjamin Mako Hill. 2022. Identifying Competition and Mutualism between Online Groups. Proceedings of the International AAAI Conference on Web and Social Media 16 (May 2022), 993--1004. https://ojs.aaai.org/index.php/ICWSM/article/view/19352

[102]

Nathan TeBlunthuis, Charles Kiene, Isabella Brown, Laura Alia Levi, Nicole McGinnis, and Benjamin Mako Hill. 2022. No Community Can Do Everything: Why People Participate in Similar Online Communities. arXiv:2201.04271 [cs.SI]

[103]

Vero Vanden Abeele, Lennart E. Nacke, Elisa D. Mekler, and Daniel Johnson. 2016. Design and Preliminary Validation of The Player Experience Inventory. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY Companion '16). Association for Computing Machinery, New York, NY, USA, 335--341. https://doi.org/10.1145/2968120.2987744

Digital Library

[104]

Onur Varol, Emilio Ferrara, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2017. Online Human-Bot Interactions: Detection, Estimation, and Characterization. Proceedings of the International AAAI Conference on Web and Social Media 11, 1 (May 2017), 280--289. https://ojs.aaai.org/index.php/ICWSM/article/view/14871 Number: 1.

[105]

Daniel Votipka, Desiree Abrokwa, and Michelle L. Mazurek. 2020. Building and Validating a Scale for Secure Software Development Self-Efficacy. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--20. http://doi.org/10.1145/3313831.3376754

Digital Library

[106]

Dijana R. Vukovic and Igor M. Dujlovic. 2016. Facebook messenger bots and their application for business. In 2016 24th Telecommunications Forum (TELFOR). 1--4. https://doi.org/10.1109/TELFOR.2016.7818926

[107]

Liuping Wang, Dakuo Wang, Feng Tian, Zhenhui Peng, Xiangmin Fan, Zhan Zhang, Shuai Ma, Mo Yu, Xiaojuan Ma, and Hongan Wang. 2021. CASS: Towards Building a Social-Support Chatbot for Online Health Community. In Proceedings of the CSCW.

Digital Library

[108]

Sai Wang. 2021. Moderating Uncivil User Comments by Humans or Machines? The Effects of Moderation Agent on Perceptions of Bias and Credibility in News Content. Digital Journalism 9, 1 (Jan. 2021), 64--83. https://doi.org/10. 1080/21670811.2020.1851279 Publisher: Routledge _eprint: https://doi.org/10.1080/21670811.2020.1851279.

[109]

T Wei and V Simko. 2021. R package "corrplot": Visualization of a Correlation Matrix. https://github.com/taiyun/corrplot original-date: 2011--12-04T15:15:45Z.

[110]

Joseph Weizenbaum. 1966. ELIZA-a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 1 (Jan. 1966), 36--45. https://doi.org/10.1145/365153.365168

Digital Library

[111]

Stephen G. West, Aaron B. Taylor, and Wei Wu. 2012. Model fit and model selection in structural equation modeling. In Handbook of structural equation modeling. The Guilford Press, New York, NY, US, 209--231.

[112]

David Westerman, Aaron C. Cross, and Peter G. Lindmark. 2019. I Believe in a Thing Called Bot: Perceptions of the Humanness of ?Chatbots". Communication Studies 70, 3 (May 2019), 295--312. https://doi.org/10.1080/10510974.2018. 1557233 Publisher: Routledge _eprint: https://doi.org/10.1080/10510974.2018.1557233.

[113]

Qingwen Xu, Douglas D Perkins, and Julian Chun-Chung Chow. 2010. Sense of community, neighboring, and social capital as predictors of local political participation in China. American journal of community psychology 45, 3 (2010), 259--271.

[114]

Nick Yee, Nicolas Ducheneaut, and Les Nelson. 2012. Online gaming motivations scale: development and validation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2803--2806. http://doi.org/10.1145/2207676.2208681

Digital Library

[115]

Li-Yin Young. 2018. The Effect of Moderator Bots on Abusive Language Use. In Proceedings of the International Conference on Pattern Recognition and Artificial Intelligence (PRAI 2018). Association for Computing Machinery, New York, NY, USA, 133--137. https://doi.org/10.1145/3243250.3243257

Digital Library

[116]

Lei (Nico) Zheng, Christopher M. Albano, Neev M. Vora, Feng Mai, and Jeffrey V. Nickerson. 2019. The Roles Bots Play in Wikipedia. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 215:1--215:20. https://doi.org/10.1145/3359317

Digital Library

[117]

Haiyi Zhu, Jilin Chen, Tara Matthews, Aditya Pal, Hernan Badenes, and Robert E. Kraut. 2014. Selecting an effective niche: an ecological view of the success of online communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). Association for Computing Machinery, New York, NY, USA, 301--310. https://doi.org/10.1145/2556288.2557348

Digital Library

[118]

Haiyi Zhu, Robert E. Kraut, and Aniket Kittur. 2014. The impact of membership overlap on the survival of online communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). Association for Computing Machinery, New York, NY, USA, 281--290. https://doi.org/10.1145/2556288.2557213

Digital Library

[119]

Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. Value-Sensitive Algorithm Design: Method, Case Study, and Lessons. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 194:1--194:23.

Digital Library

Cited By

Seering JKhadka MHaghighi NYang TXi ZBernstein M(2024)Chillbot: Content Moderation in the BackchannelProceedings of the ACM on Human-Computer Interaction10.1145/36869418:CSCW2(1-26)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686941
Kairam SBernstein MBruckman AChancellor SChandrasekharan EDe Choudhury MFiesler CLi HProferes NHorta Ribeiro MSmith CWeld GFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Community-Driven Models for Research on Social PlatformsCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3687141(684-688)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3687141
Berkel NPohl H(2024)Collaborating with Bots and Automation on OpenStreetMapACM Transactions on Computer-Human Interaction10.1145/366532631:3(1-30)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3665326
Show More Cited By

Index Terms

The Impact of Governance Bots on Sense of Virtual Community: Development and Validation of the GOV-BOTs Scale
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

The influences of participation and moderation on the development of a sense of virtual community

Sense of virtual community SOVC is an important indicator of website satisfaction and leads to higher levels of trust online and website use. More than 1,000 online users were surveyed about their activities in web forums, particularly how they view and ...
Community Archetypes: An Empirical Framework for Guiding Research Methodologies to Reflect User Experiences of Sense of Virtual Community on Reddit
CSCW

Humans need a sense of community (SOC), and social media platforms afford opportunities to address this need by providing users with a sense of virtual community (SOVC). This paper explores SOVC on Reddit and is motivated by two goals: (1) providing ...
Who Uses Bots? A Statistical Analysis of Bot Usage in Moderation Teams
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Adopting new technology is challenging for volunteer moderation teams of online communities. Challenges are aggravated when communities increase in size. In a prior qualitative study, Kiene et al. found evidence that moderator teams adapted to challenges ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 6, Issue CSCW2

CSCW

November 2022

8205 pages

EISSN:2573-0142

DOI:10.1145/3571154

Editor:
Jeff Nichols
Google

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2022

Published in PACMHCI Volume 6, Issue CSCW2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
820
Total Downloads

Downloads (Last 12 months)376
Downloads (Last 6 weeks)43

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seering JKhadka MHaghighi NYang TXi ZBernstein M(2024)Chillbot: Content Moderation in the BackchannelProceedings of the ACM on Human-Computer Interaction10.1145/36869418:CSCW2(1-26)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686941
Kairam SBernstein MBruckman AChancellor SChandrasekharan EDe Choudhury MFiesler CLi HProferes NHorta Ribeiro MSmith CWeld GFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Community-Driven Models for Research on Social PlatformsCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3687141(684-688)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3687141
Berkel NPohl H(2024)Collaborating with Bots and Automation on OpenStreetMapACM Transactions on Computer-Human Interaction10.1145/366532631:3(1-30)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3665326
Hwang SKiene COng SShaw A(2024)Adopting Third-party Bots for Managing Online CommunitiesProceedings of the ACM on Human-Computer Interaction10.1145/36537078:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653707
Cai JLin YZhang HCarroll J(2024)Third-Party Developers and Tool Development For Community Management on Live Streaming Platform TwitchProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642787(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642787
Tong HCui QXu WJin DLi MXu TXu LTang Y(2023)Research on the Trust Mechanism of Community Social Enterprises Based on Non-Linear Regression Model2023 International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR)10.1109/ICWAPR58546.2023.10337043(1-6)Online publication date: 9-Jul-2023
https://doi.org/10.1109/ICWAPR58546.2023.10337043

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents