research-article

Managing Disruptive Behavior through Non-Hierarchical Governance: Crowdsourcing in League of Legends and Weibo

Authors:

Shaozeng Zhang,

Bonnie NardiAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 1, Issue CSCW

Article No.: 62, Pages 1 - 17

https://doi.org/10.1145/3134697

Published: 06 December 2017 Publication History

Abstract

Disruptive behaviors such as flaming and vandalism have been part of the Internet since its beginning. Various models of hierarchical governance have been established and managed in different online venues, with both successes and failures. Recently, a new model of non-hierarchical governance has emerged using crowdsourcing technology to allow an online community to manage itself. How do people view and work with non-hierarchical governance? In this paper, we present an interview study with people from two sites: the video game League of Legends and Weibo, a microblogging site in China. We found that people were passionate about participation in crowdsourcing, but at the same time, struggled with the system, and acted beyond their designated role within the system. We derive implications for designing online non-hierarchical governance from our research.

References

[1]

Glenn A. Bowen. 2008. Naturalistic inquiry and the saturation concept: a research note. Qual. Res. 8, 1 (February 2008), 137--152.

[2]

Danah Boyd and Kate Crawford. 2012. Critical Questions for Big Data. Information, Commun. Soc. 15, 5 (June 2012), 662--679.

[3]

Brian Butler, Elisabeth Joyce, and Jacqueline Pike. 2008. Don't look now, but we've created a bureaucracy: the nature and roles of policies and rules in wikipedia. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08, 1101--1110.

Digital Library

[4]

Justin Cheng, Michael Bernstein, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2017. Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussions. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17, 1217--1230.

Digital Library

[5]

Juliet Corbin and Anselm Strauss. 2007. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. SAGE Publications.

[6]

Nicole Crenshaw and Bonnie Nardi. 2016. "It Was More Than Just the Game, It Was the Community": Social Affordances in Online Games. In 49th Hawaii International Conference on System Sciences (HICSS), 3781--3790.

Digital Library

[7]

Nicholas Diakopoulos and Mor Naaman. 2011. Towards quality discourse in online news comments. In Proceedings of the ACM 2011 conference on Computer supported cooperative work - CSCW '11, 133--142.

Digital Library

[8]

Hamid Ekbia and Bonnie Nardi. 2014. Heteromation and its (dis)contents: The invisible division of labor between humans and machines. First Monday 19.

[9]

Andrea Forte and Amy Bruckman. 2008. Scaling Consensus: Increasing Decentralization in Wikipedia Governance. In (HICSS '08), 157--166.

Digital Library

[10]

Andrea Forte, Vanesa Larco, and Amy Bruckman. 2009. Decentralization in Wikipedia Governance. J. Manag. Inf. Syst. 26, 1 (July 2009), 49--72.

Digital Library

[11]

Riot Games. 2012. Tribunal: The First Year. Retrieved from http://na.leagueoflegends.com/board/showthread.php?t=2151902

[12]

R. Stuart Geiger and David Ribes. 2010. The work of sustaining order in wikipedia: the banning of a vandal. In (CSCW '10), 117--126.

Digital Library

[13]

Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The Rise and Decline of an Open Collaboration System: How Wikipedia's Reaction to Popularity Is Causing Its Decline. Am. Behav. Sci. 57, 5 (May 2013), 664--688.

[14]

Aaron Halfaker, Aniket Kittur, and John Riedl. 2011. Don't Bite the Newbies: How Reverts Affect the Quantity and Quality of Wikipedia Work. In (WikiSym '11), 163--172.

Digital Library

[15]

Aaron Halfaker and John Riedl. 2012. Bots and Cyborgs: Wikipedia's Immune System. Computer (Long. Beach. Calif). 45, 3 (March 2012), 79--82.

Digital Library

[16]

Hamid R. Ekbia and Bonnie A. Nardi. 2017. Heteromation, and Other Stories of Computing and Capitalism. MIT Press.

Digital Library

[17]

Chong Han. 2015. Identity construction in weibo communication: Chinese oversea students' experiences in Australia. In Contemporary Chinese Discourse and Social Practice in China, Linda Tsung and Wei Wang (eds.). John Benjamins Publishing Company.

[18]

Mark Handel and James D. Herbsleb. 2002. What is chat doing in the workplace? In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02, 1--10.

Digital Library

[19]

Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 611--620.

Digital Library

[20]

Magnus Johansson, Harko Verhagen, and Yubo Kou. 2015. I Am Being Watched By The Tribunal-Trust and Control in Multiplayer Online Battle Arena Games. In Proceedings of the 10th International Conference on the Foundations of Digital Games.

[21]

Yubo Kou and Xinning Gui. 2014. Playing with strangers: understanding temporary teams in League of Legends. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play - CHI PLAY '14, 161--169.

Digital Library

[22]

Yubo Kou and Xinning Gui. 2017. When Code Governs Community. In 2017 50th Hawaii International Conference on System Sciences.

[23]

Yubo Kou and Xinning Gui. 2017. The Rise and Fall of Moral Labor in an Online Game Community. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17 Companion, 223--226.

Digital Library

[24]

Yubo Kou, Xinning Gui, and Yong Ming Kow. 2016. Ranking Practices and Distinction in League of Legends. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play - CHI PLAY '16, 4--9.

Digital Library

[25]

Yubo Kou and Bonnie Nardi. 2013. Regulating Anti-Social Behavior on the Internet?: The Example of League of Legends. In iConference 2013 Proceedings, 616--622.

[26]

Yubo Kou and Bonnie Nardi. 2014. Governance in League of Legends: A Hybrid System. In Foundations of Digital Games. Retrieved from http://www.fdg2014.org/papers/fdg2014_paper_16.pdf

[27]

Yong Ming Kow and Bonnie Nardi. 2010. Who owns the Mods? First Monday 15, 5 (2010).

[28]

C. Lattemann and S. Stieglitz. 2005. Framework for Governance in Open Source Communities. In Proceedings of the 38th Annual Hawaii International Conference on System Sciences, 1--11.

Digital Library

[29]

Alex Leavitt, Joshua A Clark, and Dennis Wixon. 2016. Uses of Multiple Characters in Online Games and Their Implications for Social Network Methods. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16, 647--661.

Digital Library

[30]

Lawrence Lessig. 2006. Code: And Other Laws of Cyberspace, Version 2.0. Basic Books. Retrieved from http://www.amazon.com/dp/0465039146

Digital Library

[31]

Joe C. Magee and Adam D. Galinsky. 2008. Social Hierarchy: The Self-Reinforcing Nature of Power and Status. Acad. Manag. Ann. 2, 1 (2008), 351--398.

[32]

Jon Marshall. 2006. Negri, Hardt, distributed governance and open source software. PORTAL J. Multidiscip. Int. Stud. 3, 1 (2006).

[33]

David Martin, Benjamin V. Hanrahan, Jacki O'Neill, and Neha Gupta. 2014. Being a Turker. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW '14), 224--235.

Digital Library

[34]

J. Nathan Matias. 2016. The Civic Labor of Online Moderators. In IPP 2016: The Platform Society.

[35]

J. Nathan Matias. 2016. Going Dark: Social Factors in Collective Action Against Platform Operators in the Reddit Blackout. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 1138--1151.

Digital Library

[36]

Chip Morningstar and F. Randall Farmer. 1991. The Lessons of Lucasfilm's Habitat. In Cyberspace: First Steps, Michael Benedikt (ed.). MIT Press, Cambridge, MA, USA, 273--302.

Digital Library

[37]

Bonnie Nardi and Justin Harris. 2006. Strangers and friends: collaborative play in world of warcraft. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work - CSCW '06, 149.

Digital Library

[38]

Siobhán O'Mahony and Fabrizio Ferraro. 2007. The Emergence of Governance in an Open Source Community. Acad. Manag. J. 50, 5 (October 2007), 1079--1106.

[39]

Elinor Ostrom. 1990. Governing the Commons: The Evolution of Institutions for Collective Action. Cambridge University Press. Retrieved from http://www.amazon.com/dp/0521405998

[40]

Elinor Ostrom. 2000. Collective Action and the Evolution of Social Norms. J. Econ. Perspect. 14, 3 (July 2000), 137--158.

[41]

Qianlong. 2013. Sina Weibo processed 15 million user complaints in a year. Sina News. Retrieved from http://news.sina.com.cn/c/2013-07-04/183527578723.shtml

[42]

Niloufar Salehi, Lilly C. Irani, Michael S. Bernstein, Ali Alkhatib, Eva Ogbe, Kristy Milland, and Clickhappier. 2015. We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, 1621--1630.

Digital Library

[43]

Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17, 111--125.

Digital Library

[44]

Tom Senior. 2011. Riot Games hopes tribunal system will clean up League of Legends community. Retrieved from http://www.pcgamer.com/2011/01/14/riot-games-hopes-tribunal-system-will-clean-up-league-of-legends-community/

[45]

M. Six Silberman, Lilly Irani, and Joel Ross. 2010. Ethics and Tactics of Professional Crowdwork. XRDS 17, 2 (December 2010), 39--43.

Digital Library

[46]

Craig Smith. 2016. By the Numbers: 58 Amazing Weibo Statistics (May 2016). DMR. Retrieved from http://expandedramblings.com/index.php/weibo-user-statistics/

[47]

Susan Leigh Star and Anselm Strauss. 1999. Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work. Comput. Support. Coop. Work 8, 1--2 (March 1999), 9--30.

Digital Library

[48]

Tiziana Terranova. 2000. Free Labor: Producing Culture for the Digital Economy. Soc. Text, 63 18, 2 (2000), 33--58.

[49]

Pete Volk. 2016. League of Legends now boasts over 100 million monthly active players worldwide. riftherald.com. Retrieved from http://www.riftherald.com/2016/9/13/12865314/monthly-lol-players-2016-active-worldwide

[50]

Lei Wang. 2015. Study on the Rules of Internet Social Networking Platform: The Theory of the Weibo Community Committee. Technol. Law 4, (2015), 732--756.

[51]

Wenbo Wang, Lu Chen, Krishnaprasad Thirunarayan, and Amit P. Sheth. 2014. Cursing in English on twitter. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14, 415--425.

Digital Library

[52]

Howard T. Welser, Dan Cosley, Gueorgi Kossinets, Austin Lin, Fedor Dokshin, Geri Gay, and Marc Smith. 2011. Finding social roles in Wikipedia. In Proceedings of the 2011 iConference on - iConference '11, 122--129.

Digital Library

[53]

Langdon Winner. 1980. Do Artifacts Have Politics? Mod. Technol. Probl. or Oppor. 109, 1 (1980), 121--136.

[54]

Saskia Witteborn and Qian Huang. 2015. Diaosi {Underdog Talk} as a Way of Relating in Contemporary China. In The Handbook of Communication in Cross-Cultural Perspective. 142--152.

[55]

Yue Hu, Jichang Zhao, Junjie Wu, and Xiuguo Bao. 2015. On exploring ambivalent expression in Weibo. In 2015 12th International Conference on Service Systems and Service Management (ICSSSM), 1--6.

[56]

Andrej Zwitter. 2014. Big Data ethics. Big Data Soc. 1, 2 (2014).

Cited By

Andrade Martins Morais EAraújo de Lima EVicente Graciano-Neto V(2024)Governança de Sistemas-de-Sistemas: Um Mapeamento Sistemático da LiteraturaiSys - Brazilian Journal of Information Systems10.5753/isys.2024.379817:1Online publication date: 27-Dec-2024
https://doi.org/10.5753/isys.2024.3798
Frommel JMandryk R(2024)Toxicity in Online Games: The Prevalence and Efficacy of Coping StrategiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642523(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642523
Jhaver SRathi HSaha K(2024)Bystanders of Online Moderation: Examining the Effects of Witnessing Post-Removal ExplanationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642204(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642204
Show More Cited By

Index Terms

Managing Disruptive Behavior through Non-Hierarchical Governance: Crowdsourcing in League of Legends and Weibo
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Flag and Flaggability in Automated Moderation: The Case of Reporting Toxic Behavior in an Online Game Community
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Online platforms rely upon users or automated tools to flag toxic behaviors, the very first step in online moderation. While much recent research has examined online moderation, the role of flag remains poorly understood. This question becomes even more ...
Prosocial behavior in an online game community: an ethnographic study
FDG '17: Proceedings of the 12th International Conference on the Foundations of Digital Games

We report an ethnographic study of prosocial behavior inconnection to League of Legends, one of the most popular games in the world. In this game community, the game developer, Riot Games, implemented a system that allowed players to volunteer their ...
The Rise and Fall of Moral Labor in an Online Game Community
CSCW '17 Companion: Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

In this study we use moral labor to denote a particular form of work primarily driven by moral sense -- people believe it is right to do so and such work is utilized to improve commercial product. We examine moral labor in League of Legends, a popular ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 1, Issue CSCW

November 2017

2095 pages

EISSN:2573-0142

DOI:10.1145/3171581

Editors:
Clifford Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Snap Inc.
,
Wolfgang Stuerzlinger
Simon Fraser University

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2017

Published in PACMHCI Volume 1, Issue CSCW

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
614
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)14

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Andrade Martins Morais EAraújo de Lima EVicente Graciano-Neto V(2024)Governança de Sistemas-de-Sistemas: Um Mapeamento Sistemático da LiteraturaiSys - Brazilian Journal of Information Systems10.5753/isys.2024.379817:1Online publication date: 27-Dec-2024
https://doi.org/10.5753/isys.2024.3798
Frommel JMandryk R(2024)Toxicity in Online Games: The Prevalence and Efficacy of Coping StrategiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642523(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642523
Jhaver SRathi HSaha K(2024)Bystanders of Online Moderation: Examining the Effects of Witnessing Post-Removal ExplanationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642204(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642204
Laato SKordyaka BHamari J(2024)Traumatizing or Just Annoying? Unveiling the Spectrum of Gamer Toxicity in the StarCraft II CommunityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642137(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642137
Schrör SMüller FSchädlich F(2023)Überwachen und Strafen im Online-Gaming?Politiken des (digitalen) Spiels10.14361/9783839467909-017(279-290)Online publication date: 2-Oct-2023
https://doi.org/10.14361/9783839467909-017
Ma RLi YKou Y(2023)Transparency, Fairness, and Coping: How Players Experience Moderation in Multiplayer Online GamesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581097(1-21)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581097
Boldi ARapp A(2023)“Is It Legit, To You?”. An Exploration of Players’ Perceptions of Cheating in a Multiplayer Video Game: Making Sense of UncertaintyInternational Journal of Human–Computer Interaction10.1080/10447318.2023.220427640:15(4021-4041)Online publication date: 28-Apr-2023
https://doi.org/10.1080/10447318.2023.2204276
Pan CYakhmi SIyer TStrasnick EZhang ABernstein M(2022)Comparing the Perceived Legitimacy of Content Moderation Processes: Contractors, Algorithms, Expert Panels, and Digital JuriesProceedings of the ACM on Human-Computer Interaction10.1145/35129296:CSCW1(1-31)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512929
Gordon MLam MPark JPatel KHancock JHashimoto TBernstein M(2022)Jury Learning: Integrating Dissenting Voices into Machine Learning ModelsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502004(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502004
Kou Y(2021)Punishment and Its Discontents: An Analysis of Permanent Ban in an Online Game CommunityProceedings of the ACM on Human-Computer Interaction10.1145/34760755:CSCW2(1-21)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476075
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents