research-article

Hate Raids on Twitch: Understanding Real-Time Human-Bot Coordinated Attacks in Live Streaming Communities

Authors:

Sagnik Chowdhury,

Donghee Yvette WohnAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue CSCW2

Article No.: 342, Pages 1 - 28

https://doi.org/10.1145/3610191

Published: 04 October 2023 Publication History

Abstract

Online harassment and content moderation have been well-documented in online communities. However, new contexts and systems always bring new ways of harassment and need new moderation mechanisms. This study focuses on hate raids, a form of group attack in real-time in live streaming communities. Through a qualitative analysis of hate raids discussion in the Twitch subreddit (r/Twitch), we found that (1) hate raids as a human-bot coordinated group attack leverages the live stream system to attack marginalized streamers and other potential groups with(out) breaking the rules, (2) marginalized streamers suffer compound harms with insufficient support from the platform, (3) moderation strategies are overwhelmingly technical, but streamers still struggle to balance moderation and participation considering their marginalization status and needs. We use affordances as a lens to explain how hate raids happens in live streaming systems and propose moderation-by-design as a lens when developing new features or systems to mitigate the potential abuse of such designs.

References

[1]

[n.d.]. Defining ?Online Abuse": A Glossary of Terms. https://onlineharassmentfieldmanual.pen.org/defining-online-harassment-a-glossary-of-terms/

[2]

2021. H2 2021 Transparency Report. https://safety.twitch.tv/s/article/H2--2021-Transparency-Report?language=en_US

[3]

Zahra Ashktorab and Jessica Vitak. 2016. Designing Cyberbullying Mitigation and Prevention Solutions through Participatory Design With Teenagers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 3895--3905. https://doi.org/10.1145/2858036.2858548

Digital Library

[4]

Connor Bennett. 2021. What is ?A Day off Twitch'? Why streamers are striking to protest. https://www.dexerto.com/entertainment/what-is-a-day-off-twitch-why-streamers-are-striking-to-protest-1643209/

[5]

Lindsay Blackwell, Jill Dimond, Sarita Schoenebeck, and Cliff Lampe. 2017. Classification and its consequences for online harassment: Design insights from HeartMob. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (11 2017). https://doi.org/10.1145/3134659

Digital Library

[6]

Lindsay Blackwell, Nicole Ellison, Natasha Elliott-Deflo, and Raz Schwartz. 2019. Harassment in Social Virtual Reality: Challenges for Platform Governance. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (11 2019), 1--25. https://doi.org/10.1145/3359202

Digital Library

[7]

Danah Michele Boyd. 2008. Taken out of context: American teen sociality in networked publics. Ph.D. Dissertation. University of California, Berkeley. https://www.proquest.com/openview/9cc930ef134daf46c17434d2992e8251/1?pq-origsite=gscholar&cbl=18750

[8]

Andrea Braithwaite. 2014. ?Seriously, get out': Feminists on the forums and the War(craft) on women. New Media & Society 16, 5 (8 2014), 703--718. https://doi.org/10.1177/1461444813489503

[9]

Anna Brown. 2020. LGB online daters have positive experiences overall but face harassment. https://www.pewresearch.org/fact-tank/2020/04/09/lesbian-gay-and-bisexual-online-daters-report-positive-experiences-but-also-harassment/

[10]

Jie Cai and Donghee Y. Wohn. 2019. Categorizing Live Streaming Moderation Tools: An Analysis of Twitch. International Journal of Interactive Communication Systems and Technologies 9, 2 (7 2019), 36--50. https://doi.org/10.4018/IJICST.2019070103

[11]

Jie Cai and Donghee Yvette Wohn. 2021. After Violation But Before Sanction: Understanding Volunteer Moderators' Profiling Processes Toward Violators in Live Streaming Communities. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--25. https://doi.org/10.1145/3479554

Digital Library

[12]

Jie Cai and Donghee Yvette Wohn. 2022. Coordination and Collaboration: How do Volunteer Moderators Work as a Team in Live Streaming Communities?. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--14. https://doi.org/10.1145/3491102.3517628

Digital Library

[13]

Jie Cai, Donghee Y. Wohn, and Mashael Almoqbel. 2021. Moderation Visibility: Mapping the Strategies of Volunteer Moderators in Live Streaming Micro Communities. In Proceedings of ACM International Conference on Interactive Media Experiences. 61--72. https://doi.org/10.1145/3452918.3458796

Digital Library

[14]

Jie Cai and Donghee Yvette Wohn. 2023. Understanding Moderators' Conflict and Conflict Management Strategies with Streamers in Live Streaming Communities; Understanding Moderators' Conflict and Conflict Management Strategies with Streamers in Live Streaming Communities. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). ACM, Hamburg, Germany, 1--12. https://doi.org/10.1145/3544548.3580982

Digital Library

[15]

Stevie Chancellor, Jessica Annette Pater, Trustin Clear, Eric Gilbert, and Munmun De Choudhury. 2016. #thyghgapp: Instagram Content Moderation and Lexical Variation in Pro-Eating Disorder Communities. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work and Social Computing. 1201--1213. https://doi.org/10.1145/2818048.2819963

Digital Library

[16]

Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A Cross-Community Learning-based System to Assist Reddit Moderators. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--30. https://doi.org/10.1145/3359276

Digital Library

[17]

Eshwar Chandrasekharan, Mattia Samory, Anirudh Srinivasan, and Eric Gilbert. 2017. The bag of communities: Identifying abusive behavior online with preexisting internet data. Conference on Human Factors in Computing Systems - Proceedings 2017-May (5 2017), 3175--3187. https://doi.org/10.1145/3025453.3026018

Digital Library

[18]

Despoina Chatzakou, Nicolas Kourtellis, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, and Athena Vakali. 2017. Hate is not Binary: Studying Abusive Behavior of \#GamerGate on Twitter. In Proceedings of the 28th ACM Conference on Hypertext and Social Media. ACM, New York, NY, USA, 65--74. https://doi.org/10.1145/3078714.3078721

Digital Library

[19]

Despoina Chatzakou, Nicolas Kourtellis, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, and Athena Vakali. 2017. Measuring \#GamerGate: A Tale of Hate, Sexism, and Bullying. In Proceedings of the 26th International Conference on World Wide Web Companion. ACM Press, New York, New York, USA, 1285--1290. https://doi.org/10.1145/3041021.3053890

Digital Library

[20]

Mia Consalvo. 2012. Confronting Toxic Gamer Culture: A Challenge for Feminist Game Studies Scholars. Journal of Gender, New Media, and Technology 1 (11 2012), 1--11. https://doi.org/10.7264/N33X84KH

[21]

Amanda C.e Cote. 2017. "I Can Defend Myself": Women's Strategies for Coping with Harassment while Gaming Online. Games and Culture 12, 2 (2017), 136--155. https://doi.org/10.1177/1555412015587603

[22]

Anubrata Das, Brandon Dang, and Matthew Lease. 2020. Fast, Accurate, and Healthier: Interactive Blurring Helps Moderators Reduce Exposure to Harmful Content. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 8, 1 (2020), 33--42. https://ojs.aaai.org/index.php/HCOMP/article/view/7461

[23]

Bryan Dosono and Bryan Semaan. 2019. Moderation Practices as Emotional Labor in Sustaining Online Communities. In Proceedings of the ACM Conference on Human Factors in Computing Systems. 1--13. https://doi.org/10.1145/3290605.3300372

Digital Library

[24]

Ian Drosos and Philip J Guo. 2022. The Design Space of Livestreaming Equipment Setups: Tradeoffs, Challenges, and Opportunities. In Designing Interactive Systems Conference. ACM, New York, NY, USA, 835--848. https://doi.org/10.1145/3532106.3533489

Digital Library

[25]

Jennifer Fereday and Eimear Muir-Cochrane. 2006. Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development. International Journal of Qualitative Methods 5, 1 (3 2006), 80--92. https://doi.org/10.1177/160940690600500107

[26]

Michelle Ferrier and Nisha Garud-Patkar. 2018. TrollBusters: Fighting Online Harassment of Women Journalists. In Mediating Misogyny. Springer International Publishing, Cham, 311--332. https://doi.org/10.1007/978--3--319--72917--6{_}16

[27]

Jessica L. Feuston, Alex S. Taylor, and Anne Marie Piper. 2020. Conformity of Eating Disorders through Content Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (5 2020), 1--28. https://doi.org/10.1145/3392845

Digital Library

[28]

Colin Ford, Dan Gardner, Leah Elaine Horgan, Calvin Liu, a. m. Tsaasan, Bonnie Nardi, and Jordan Rickman. 2017. Chat Speed OP PogChamp: Practices of Coherence in Massive Twitch Chat. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 858--871. https://doi.org/10.1145/3027063.3052765

Digital Library

[29]

Jesse Fox and Wai Yen Tang. 2017. Women's experiences with general and sexual harassment in online video games: Rumination, organizational responsiveness, withdrawal, and coping strategies. New Media and Society 19, 8 (3 2017), 1290--1307. https://doi.org/10.1177/1461444816635778

[30]

Eric J. Friedman* and Paul Resnick. 2001. The Social Cost of Cheap Pseudonyms. Journal of Economics Management Strategy 10, 2 (6 2001), 173--199. https://doi.org/10.1111/j.1430--9134.2001.00173.x

[31]

Tarleton Gillespie. 2020. Content moderation, AI, and the question of scale. Big Data & Society 7, 2 (7 2020), 1--5. https://doi.org/10.1177/2053951720943234

[32]

Tarleton Gillespie, Patricia Aufderheide, Elinor Carmi, Ysabel Gerrard, Robert Gorwa, Ariadna Matamoros-Fernández, Sarah T. Roberts, Aram Sinnreich, and Sarah Myers West. 2020. Expanding the debate about content moderation: Scholarly research agendas for the coming policy debates. Internet Policy Review 9, 4 (2020), 1--29. https://doi.org/10.14763/2020.4.1512

[33]

Nitesh Goyal, Ian D. Kivlichan, Rachel Rosen, and Lucy Vasserman. 2022. Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (11 2022), 1--28. https://doi.org/10.1145/3555088

Digital Library

[34]

Nitesh Goyal, Leslie Park, and Lucy Vasserman. 2022. ?You have to prove the threat is real": Understanding the needs of Female Journalists and Activists to Document and Report Online Harassment. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--17. https://doi.org/10.1145/3491102.3517517

Digital Library

[35]

Nathan Grayson. 2022. How Twitch took down the Buffalo shooter's stream faster than Facebook. https://www.washingtonpost.com/video-games/2022/05/20/twitch-buffalo-shooter-facebook-nypd-interview/

[36]

James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology 17, 1 (2015), 68. https://digitalcommons.law.yale.edu/yjolt/vol17/iss1/2

[37]

Oliver L. Haimson, Justin Buss, Zu Weinger, Denny L. Starks, Dykee Gorrell, and Briar Sweetbriar Baron. 2020. Trans Time: Safety, Privacy, and ContentWarnings on a Transgender-Specific Social Media Site. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (10 2020). https://doi.org/10.1145/3415195

Digital Library

[38]

Oliver L. Haimson, Daniel Delmonaco, Peipei Nie, and Andrea Wegner. 2021. Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--35. https://doi.org/10.1145/3479610

Digital Library

[39]

William A. Hamilton, Oliver Garretson, and Andruid Kerne. 2014. Streaming on twitch: Fostering participatory communities of play within live mixed media. In Conference on Human Factors in Computing Systems - Proceedings. ACM, New York, NY, USA, 1315--1324. https://doi.org/10.1145/2556288.2557048

Digital Library

[40]

U. Hedestig and V. Kaptelinin. 2003. Facilitator's invisible expertise and supra-situational activities in a telelearning environment. In Proceedings of the 36th Annual Hawaii International Conference on System Sciences. IEEE, 10. https://doi.org/10.1109/HICSS.2003.1173637

[41]

Graeme Horsman. 2018. A forensic examination of the technical and legal challenges surrounding the investigation of child abuse on live streaming platforms: A case study on Periscope. Journal of Information Security and Applications 42 (10 2018), 107--117. https://doi.org/10.1016/j.jisa.2018.07.009

[42]

Ian Hutchby. 2001. Technologies, texts and affordances. Sociology 35, 2 (5 2001), 441--456. https://doi.org/10.1017/S0038038501000219

[43]

Abdul Rehman Javed, Waqas Ahmed, Mamoun Alazab, Zunera Jalil, Kashif Kifayat, and Thippa Reddy Gadekallu. 2022. A Comprehensive Survey on Computer Forensics: State-of-the-Art, Tools, Techniques, Challenges, and Future Directions. IEEE Access 10 (2022), 11065--11089. https://doi.org/10.1109/ACCESS.2022.3142508

[44]

Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. ?Did you suspect the post would be removed?": Understanding user reactions to content removals on reddit. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (11 2019), 1--33. https://doi.org/10.1145/3359294

Digital Library

[45]

Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-machine collaboration for content regulation: The case of reddit automoderator. ACM Transactions on Computer-Human Interaction 26, 5 (2019), 35. https://doi.org/10.1145/3338243

Digital Library

[46]

Shagun Jhaver, Christian Boylston, DIyi Yang, and Amy Bruckman. 2021. Evaluating the Effectiveness of Deplatforming as a Moderation Strategy on Twitter. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--30. https://doi.org/10.1145/3479525

Digital Library

[47]

Shagun Jhaver, Quan Ze Chen, Detlef Knauss, and Amy X. Zhang. 2022. Designing Word Filter Tools for Creator-led Comment Moderation. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--21. https://doi.org/10.1145/3491102.3517505

Digital Library

[48]

Jialun Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation challenges in voice-based online communities on discord. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (11 2019). https://doi.org/10.1145/3359157

Digital Library

[49]

Jialun Aaron Jiang, Peipei Nie, Jed R Brubaker, and Casey Fiesler. 2022. A Trade-off-centered Framework of Content Moderation; A Trade-off-centered Framework of Content Moderation. ACM Trans. Comput.-Hum. Interact. (2022), 1--34. https://doi.org/10.1145/3534929

Digital Library

[50]

Chris Jones, Lone Dirckinck-Holmfeld, and Berner Lindström. 2006. A relational, indirect, meso-level approach to CSCL design in the next decade. International Journal of Computer-Supported Collaborative Learning 1, 1 (3 2006), 35--56. https://doi.org/10.1007/s11412-006--6841--7

[51]

Joann Keyton and Kathy Menzie. 2007. Sexually Harassing Messages: Decoding Workplace Conversation. Communication Studies 58, 1 (2 2007), 87--103. https://doi.org/10.1080/10510970601168756

[52]

Soomin Kim, Changhoon Oh, Won Ik Cho, Donghoon Shin, Bongwon Suh, and Joonhwan Lee. 2021. Trkic G00gle: Why and How Users Game Translation Algorithms. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--24. https://doi.org/10.1145/3476085

Digital Library

[53]

Yubo Kou. 2021. Punishment and Its Discontents: An Analysis of Permanent Ban in an Online Game Community. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--21. https://doi.org/10.1145/3476075

Digital Library

[54]

Srijan Kumar, William L. Hamilton, Jure Leskovec, and Dan Jurafsky. 2018. Community Interaction and Conflict on the Web. In Proceedings of the 2018 World Wide Web Conference on World Wide Web. ACM Press, New York, New York, USA, 933--943. https://doi.org/10.1145/3178876.3186141

Digital Library

[55]

Jeffrey H. Kuznekoff and Lindsey M. Rose. 2013. Communication in multiplayer gaming: Examining player responses to gender cues. New Media and Society 15, 4 (9 2013), 541--556. https://doi.org/10.1177/1461444812458271

[56]

Vivian Lai, Samuel Carton, Rajat Bhatnagar, Q. Vera Liao, Yunfeng Zhang, and Chenhao Tan. 2022. Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--18. https://doi.org/10.1145/3491102.3501999

Digital Library

[57]

Charlotte Lambert, Ananya Rajagopal, and Eshwar Chandrasekharan. 2022. Conversational Resilience: Quantifying and Predicting Conversational Outcomes Following Adverse Events. Proceedings of the International AAAI Conference on Web and Social Media 16, 1 (2022), 548--559. https://ojs.aaai.org/index.php/ICWSM/article/view/19314

[58]

Cliff Lampe and Paul Resnick. 2004. Slash(dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Proceedings of the ACM Conference on Human Factors in Computing Systems. 543--550. https://doi.org/10.1145/985692.985761

Digital Library

[59]

Alexander Lee. 2022. ?Don't let it bother you, just continue streaming': Confessions of a Twitch streamer who received ?hate raids'. https://digiday.com/marketing/dont-let-it-bother-you-just-continue-streaming-confessions-of-a-twitch-streamer-and-victim-of-online-hate-raids/

[60]

Pascal Lessel, Alexander Vielhauer, and Antonio Krüger. 2017. Expanding video game live-streams with enhanced communication channels: A case study. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery, 1571--1576. https://doi.org/10.1145/3025453.3025708

Digital Library

[61]

Hanlin Li, Brent Hecht, and Stevie Chancellor. 2022. Measuring the Monetary Value of Online Volunteer Work. In Proceedings of the International AAAI Conference on Web and Social Media. 596--606. https://ojs.aaai.org/index.php/ICWSM/article/view/19318

[62]

Hanlin Li, Nicholas Vincent, Janice Tsai, Jofish Kaye, and Brent Hecht. 2019. How Do People Change Their Technology Use in Protest? Proceedings of the ACM on Human-Computer Interaction 3, CSCW (11 2019), 1--22. https://doi.org/10.1145/3359189

Digital Library

[63]

Lingyuan Li, Kelsea Schulenberg, Guo Freeman, and Dane Acena. 2023. "We Cried on Each Other's Shoulders": How LGBTQ Individuals Experience Social Support in Social Virtual Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), Vol. 16. ACM, 1--16. https://doi.org/10.1145/3544548.3581530

Digital Library

[64]

Na Li, Jie Cai, and Donghee Yvette Wohn. 2023. Ignoring As a Moderation Strategy for Volunteer Moderators on Twitch. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, Vol. 1. ACM, New York, NY, USA, 1--7. https://doi.org/10.1145/3544549.3585704

Digital Library

[65]

Megan Lindsay, Jaime M. Booth, Jill T. Messing, and Jonel Thaller. 2016. Experiences of Online Harassment Among Emerging Adults. Journal of Interpersonal Violence 31, 19 (11 2016), 3174--3195. https://doi.org/10.1177/0886260515584344

[66]

Jeremy Lopez and Guo Freeman. 2022. To Tag or Not To Tag: The Interplay of the Twitch Tag System and LGBTQIA Visibility in Live Streaming. Proceedings of the 55th Hawaii International Conference on System Sciences (1 2022). https://doi.org/10.24251/HICSS.2022.413

[67]

Mufan Luo, Tiffany W. Hsu, Joon Sung Park, and Jeffrey T. Hancock. 2020. Emotional Amplification During Live-Streaming: Evidence from Comments During and After News Events. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (5 2020), 1--19. https://doi.org/10.1145/3392853

Digital Library

[68]

Renkai Ma and Yubo Kou. 2021. "How advertiser-friendly is my video?": YouTuber's Socioeconomic Interactions with Algorithmic Content Moderation. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--25. https://doi.org/10.1145/3479573

Digital Library

[69]

Enrico Mariconti, Guillermo Suarez-Tangil, Jeremy Blackburn, Emiliano De Cristofaro, Nicolas Kourtellis, Ilias Leontiadis, Jordi Luque Serrano, and Gianluca Stringhini. 2019. ?You Know What to Do": Proactive Detection of YouTube Videos Targeted by Coordinated Hate Attacks. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (11 2019), 1--21. https://doi.org/10.1145/3359309

Digital Library

[70]

Adrienne Massanari. 2017. #Gamergate and The Fappening: How Reddit's algorithm, governance, and culture support toxic technocultures. New Media and Society 19, 3 (2017), 329--346. https://doi.org/10.1177/1461444815608807

[71]

Binny Mathew, Punyajoy Saha, Hardik Tharad, Subham Rajgaria, Prajwal Singhania, Suman Kalyan Maity, Pawan Goyal, and Animesh Mukherjee. 2019. Thou shalt not hate: Countering online hate speech. In Proceedings of the 13th International Conference on Web and Social Media, ICWSM 2019. 369--380. https://doi.org/10.13140/RG.2.2.31128.85765

[72]

Brian McInnis, Leah Ajmani, Lu Sun, Yiwen Hou, Ziwen Zeng, and Steven P. Dow. 2021. Reporting the Community Beat: Practices for Moderating Online Discussion at a News Website. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--25. https://doi.org/10.1145/3476074

Digital Library

[73]

Lavinia McLean and Mark D. Griffiths. 2019. Female Gamers' Experience of Online Harassment and Social Support in Online Gaming: A Qualitative Study. International Journal of Mental Health and Addiction 17, 4 (8 2019), 970--994. https://doi.org/10.1007/S11469-018--9962-0/FIGURES/1

[74]

Joanne Meredith. 2017. Analysing technological affordances of online interactions using conversation analysis. Journal of Pragmatics 115 (7 2017), 42--55. https://doi.org/10.1016/j.pragma.2017.03.001

[75]

Fernando Miró-Llinares and Asier Moneva. 2019. What about cyberspace (and cybercrime alongside it)? A reply to Farrell and Birks ?Did cybercrime cause the crime drop?". Crime Science 8, 1 (12 2019), 12. https://doi.org/10.1186/s40163-019-0107-y

[76]

Kimberly J Mitchell, David Finkelhor, Lisa M Jones, and Janis Wolak. 2010. Use of social networking sites in online sex crimes against minors: an examination of national incidence and means of utilization. The Journal of adolescent health : official publication of the Society for Adolescent Medicine 47, 2 (8 2010), 183--90. https://doi.org/10.1016/j.jadohealth.2010.01.007

[77]

Ed Nightingale. 2022. Twitch streamers positive about new raid feature in response to harassment. https://www.eurogamer.net/twitch-streamers-positive-about-new-raid-feature-in-response-to-harassment

[78]

Shirin Nilizadeh, François Labrèche, Alireza Sedighian, Ali Zand, José Fernandez, Christopher Kruegel, Gianluca Stringhini, and Giovanni Vigna. 2017. POISED: Spotting twitter spam off the beaten paths. In Proceedings of the ACM Conference on Computer and Communications Security. ACM, New York, NY, USA, 1159--1174. https://doi.org/10.1145/3133956.3134055

Digital Library

[79]

Donald A. Norman. 1988. The Psychology of Everyday Things. Basic Books, New York. https://psycnet.apa.org/record/1988--97561-000

[80]

Xinru Page, Andrew Capener, Spring Cullen, Tao Wang, Monica Garfield, and Pamela J. Wisniewski. 2022. Perceiving Affordances Differently: The Unintended Consequences When Young Autistic Adults Engage with Social Media. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--21. https://doi.org/10.1145/3491102.3517596

Digital Library

[81]

Joon Sung Park, Lindsay Popowski, Carrie J Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In The 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22). 1--18. https://doi.org/10.1145/3526113.3545616

Digital Library

[82]

Ash Parrish. 2021. How to stop a hate raid. https://www.theverge.com/22633874/how-to-stop-a-hate-raid-twitch-safety-tools

[83]

Ash Parrish. 2021. Twitch sues two alleged ?hate raiders'. https://www.theverge.com/2021/9/10/22666953/twitch-sues-alleged-hate-raiders-harassment-streamers

[84]

Ethel Quayle. 2016. Researching online child sexual exploitation and abuse: Are there links between online and offline vulnerabilities? Technical Report. The University of Edinburgh, UK. 1--48 pages. www.globalkidsonline.net/sexual-

[85]

Sarah Riddick and Rich Shivener. 2022. Affective Spamming on Twitch: Rhetorics of an Emote-Only Audience in a Presidential Inauguration Livestream. Computers and Composition 64 (6 2022), 102711. https://doi.org/10.1016/j.compcom.2022.102711

[86]

D Robey, C Anderson, B Raymond Journal of the Association for, and undefined 2013. 2013. Information technology, materiality, and organizational change: A professional odyssey. aisel.aisnet.org 14, 7 (2013), 379--398. https://aisel.aisnet.org/jais/vol14/iss7/1/

[87]

Morgan Klaus Scheuerman, Stacy M. Branham, and Foad Hamidi. 2018. Safe spaces and safe places: Unpacking technology-mediated experiences of safety and harm with transgender people. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (11 2018), 1--27. https://doi.org/10.1145/3274424

Digital Library

[88]

Morgan Klaus Scheuerman, Jialun Aaron Jiang, Casey Fiesler, and Jed R. Brubaker. 2021. A Framework of Severity for Harmful Content Online. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (10 2021), 1--33. https://doi.org/10.1145/3479512

Digital Library

[89]

Sarita Schoenebeck and Lindsay Blackwell. 2021. Reimagining Social Media Governance: Harm, Accountability, and Repair. SSRN Electronic Journal (7 2021). https://doi.org/10.2139/ssrn.3895779

[90]

Kelsea Schulenberg, Lingyuan Li, Guo Freeman, Samaneh Zamanifard, and Nathan J Mcneese. 2023. Towards Leveraging AI-based Moderation to Address Emergent Harassment in Social Virtual Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), Vol. 1. ACM, 1--17. https://doi.org/10.1145/3544548.3581090

Digital Library

[91]

Joseph Seering. 2020. Reconsidering Community Self-Moderation: The Role of Research in Supporting Community-Based Models for Online Content Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (10 2020). https://doi.org/10.1145/3415178

Digital Library

[92]

Joseph Seering, Tianmi Fang, Luca Damasco, Mianhong Cherie Chen, Likang Sun, and Geoff Kaufman. 2019. Designing User Interface Elements to Improve the Quality and Civility of Discourse in Online Commenting Behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300836

Digital Library

[93]

Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 111--125. https://doi.org/10.1145/2998181.2998277

Digital Library

[94]

Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society 21, 7 (7 2019), 1417--1443. https://doi.org/10.1177/1461444818821316

[95]

Jeff T Sheng and Sanjay R Kairam. 2020. From Virtual Strangers to IRL Friends: Relationship Development in Livestreaming Communities on Twitch. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 34. https://doi.org/10.1145/3415165

Digital Library

[96]

Miriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl, and Matthew Lease. 2021. The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving Support. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery, 1--14. https://doi.org/10.1145/3411764.3445092

Digital Library

[97]

Gianluca Stringhini, Pierre Mourlanne, Gregoire Jacob, Manuel Egele, Christopher Kruegel, and Giovanni Vigna. 2015. Evilcohort: Detecting communities of malicious accounts on online services., 563--578 pages. https://www.usenix.org/conference/usenixsecurity15/technical-sessions/presentation/stringhini

[98]

Keith Stuart. 2014. Zoe Quinn: 'All Gamergate has done is ruin people's lives'. https://www.theguardian.com/technology/2014/dec/03/zoe-quinn-gamergate-interview

[99]

Sharifa Sultana, Mitrasree Deb, Ananya Bhattacharjee, Shaid Hasan, S.M.Raihanul Alam, Trishna Chakraborty, Prianka Roy, Samira Fairuz Ahmed, Aparna Moitra, M. Ashraful Amin, A.K.M. Najmul Islam, and Syed Ishtiaque Ahmed. 2021. ?Unmochon': A Tool to Combat Online Sexual Harassment over Facebook Messenger. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--18. https://doi.org/10.1145/3411764.3445154

Digital Library

[100]

Hibby Thach, Samuel Mayworm, Daniel Delmonaco, and Oliver Haimson. 2022. (In)visible moderation: A digital ethnography of marginalized users and content moderation on Twitch and Reddit. New Media & Society (7 2022), 1--22. https://doi.org/10.1177/14614448221109804

[101]

Jirassaya Uttarapong, Jie Cai, and Donghee Yvette Wohn. 2021. Harassment Experiences of Women and LGBTQ Live Streamers and How They Handled Negativity. In ACM International Conference on Interactive Media Experiences. ACM, New York, NY, USA, 7--19. https://doi.org/10.1145/3452918.3458794

Digital Library

[102]

Jessica Vitak, Kalyani Chadha, Linda Steiner, and Zahra Ashktorab. 2017. Identifying women's experiences with and strategies for mitigating negative effects of online harassment. In Proceedings of the ACM Conference on Computer Supported Cooperative Work. 1231--1245. https://doi.org/10.1145/2998181.2998337

Digital Library

[103]

Ashley Marie Walker and Michael A. DeVito. 2020. "'More gay' fits in better": Intracommunity Power Dynamics and Harms in Online LGBTQ Spaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--15. https://doi.org/10.1145/3313831.3376497

Digital Library

[104]

Donghee Yvette Wohn. 2019. Volunteer Moderators in Twitch Micro Communities. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300390

Digital Library

[105]

Donghee Yvette Wohn, Casey Fiesler, Libby Hemphill, Munmun De Choudhury, and J. Nathan Matias. 2017. How to handle online risks? Discussing content curation and moderation in social media. Conference on Human Factors in Computing Systems - Proceedings Part F127655 (5 2017), 1271--1276. https://doi.org/10.1145/3027063.3051141

Digital Library

[106]

Donghee Yvette Wohn and Guo Freeman. 2020. Audience Management Practices of Live Streamers on Twitch. IMX 2020 - Proceedings of the 2020 ACM International Conference on Interactive Media Experiences (6 2020), 106--116. https://doi.org/10.1145/3391614.3393653

Digital Library

[107]

Samuel C Woolley. 2022. Digital Propaganda: The Power of Influencers. Journal of Democracy 33, 3 (2022), 115--129. https://muse.jhu.edu/article/860232

[108]

Austin P. Wright, Omar Shaikh, Haekyu Park, Will Epperson, Muhammed Ahmed, Stephane Pinel, Duen Horng (polo) Chau, and Diyi Yang. 2021. Recast: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (4 2021). https://doi.org/10.1145/3449280

Digital Library

[109]

Mu Xia, Yun Huang, Wenjing Duan, and Andrew B. Whinston. 2009. Ballot box communication in online communities. Commun. ACM 52, 9 (9 2009), 138--142. https://doi.org/10.1145/1562164.1562199

Digital Library

[110]

Savvas Zannettou, Mai Elsherief, Elizabeth Belding, Shirin Nilizadeh, and Gianluca Stringhini. 2020. Measuring and Characterizing Hate Speech on News Websites. In 12th ACM Conference on Web Science. ACM, New York, NY, USA, 125--134. https://doi.org/10.1145/3394231.3397902

Digital Library

[111]

Yingfan Zhou and Rosta Farzan. 2021. Designing to Stop Live Streaming Cyberbullying. In Proceedings of the 10th International Conference on Communities & Technologies - Wicked Problems in the Age of Tech. ACM, New York, NY USA, 138--150. https://doi.org/10.1145/3461564.3461574

Digital Library

[112]

Ethan Zuckerman. 2021. Why study media ecosystems? Information Communication and Society 24, 10 (2021), 1495--1513. https://doi.org/10.1080/1369118X.2021.1942513

Cited By

Cai JLin YZhang HCarroll J(2024)Third-Party Developers and Tool Development For Community Management on Live Streaming Platform TwitchProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642787(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642787
Lyu YCai JCallis ACotter KCarroll J(2024)"I Got Flagged for Supposed Bullying, Even Though It Was in Response to Someone Harassing Me About My Disability.": A Study of Blind TikTokers’ Content Moderation ExperiencesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642148(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642148
Merayo NCotelo RCarratalá-Sáez RAndújar F(2024)Applying machine learning to assess emotional reactions to video game content streamed on Spanish Twitch channelsComputer Speech & Language10.1016/j.csl.2024.10165188(101651)Online publication date: Nov-2024
https://doi.org/10.1016/j.csl.2024.101651
Show More Cited By

Index Terms

Hate Raids on Twitch: Understanding Real-Time Human-Bot Coordinated Attacks in Live Streaming Communities
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Hate Raids on Twitch: Echoes of the Past, New Modalities, and Implications for Platform Governance
CSCW

In the summer of 2021, users on the livestreaming platform Twitch were targeted by a wave of "hate raids," a form of attack that overwhelms a streamer's chatroom with hateful messages, often through the use of bots and automation. Using a mixed-methods ...
Understanding Moderators’ Conflict and Conflict Management Strategies with Streamers in Live Streaming Communities
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

As each micro community centered around the streamer attempts to set its own guidelines in live streaming communities, it is common for volunteer moderators (mods) and the streamer to disagree on how to handle various situations. In this study, we ...
Volunteer Moderators in Twitch Micro Communities: How They Get Involved, the Roles They Play, and the Emotional Labor They Experience
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

The ability to engage in real-time text conversations is an important feature on live streaming platforms. The moderation of this text content relies heavily on the work of unpaid volunteers. This study reports on interviews with 20 people who moderate ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue CSCW2

CSCW

October 2023

4055 pages

EISSN:2573-0142

DOI:10.1145/3626953

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2023

Published in PACMHCI Volume 7, Issue CSCW2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
215
Total Downloads

Downloads (Last 12 months)215
Downloads (Last 6 weeks)20

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cai JLin YZhang HCarroll J(2024)Third-Party Developers and Tool Development For Community Management on Live Streaming Platform TwitchProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642787(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642787
Lyu YCai JCallis ACotter KCarroll J(2024)"I Got Flagged for Supposed Bullying, Even Though It Was in Response to Someone Harassing Me About My Disability.": A Study of Blind TikTokers’ Content Moderation ExperiencesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642148(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642148
Merayo NCotelo RCarratalá-Sáez RAndújar F(2024)Applying machine learning to assess emotional reactions to video game content streamed on Spanish Twitch channelsComputer Speech & Language10.1016/j.csl.2024.10165188(101651)Online publication date: Nov-2024
https://doi.org/10.1016/j.csl.2024.101651
Chen QCai JJacucci G(2024)“People are Way too Obsessed with Rank”: Trust System in Social Virtual RealityComputer Supported Cooperative Work (CSCW)10.1007/s10606-024-09498-7Online publication date: 4-May-2024
https://doi.org/10.1007/s10606-024-09498-7

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents