Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Investigating Influential Users' Responses to Permanent Suspension on Social Media

Published: 26 April 2024 Publication History

Abstract

Social media platforms use permanent suspension as a measure of last resort to intervene with users who spread harmful or misleading content. However, permanent suspension does not signify the end of a user's online presence, but rather on that specific platform. This issue is particularly salient for influential users with large audiences, as they have the potential to cause substantial shifts in the overall social media information landscape when suspended. Our work employs a mixed methods approach to study the context around, and behavioral patterns after, permanent suspension. We find that migration is a common step after suspension, and characterize a number of behavioral strategies and patterns that occur after influential users are suspended. By focusing on consequences of suspension across more holistically, we have identified numerous opportunities for design and future research to mitigate the potential negative effects of permanent suspensions on the broader social media information landscape.

References

[1]
Alberto Abadie and Javier Gardeazabal. 2003. The economic costs of conflict: A case study of the Basque Country. American economic review 93, 1 (2003), 113--132.
[2]
Brain Adam. 2021. Setback for Gettr:Can no longer import Twitter Content. Retrieved July 12, 2022 from https://voonze.com/setback-for-gettr-can-no-longer-import-twitter-content/
[3]
Kayode Sakariyah Adewole, Nor Badrul Anuar, Amirrudin Kamsin, Kasturi Dewi Varathan, and Syed Abdul Razak. 2017. Malicious accounts: Dark of the social networks. Journal of Network and Computer Applications 79 (2017), 41--67.
[4]
Davey Alba. 2022. Twitter Permanently Suspends Marjorie Taylor Greene's Account. Retrieved July 12, 2022 from https://www.nytimes.com/2022/01/02/technology/marjorie-taylor-greene-twitter.html
[5]
Shiza Ali, Mohammad Hammas Saeed, Esraa Aldreabi, Jeremy Blackburn, Emiliano De Cristofaro, Savvas Zannettou, and Gianluca Stringhini. 2021. Understanding the effect of deplatforming on social networks. In 13th ACM Web Science Conference 2021. 187--195.
[6]
Virginia Allen. 2021. New Social Media Platform Gettr Says No to Cancel Culture, Yes to Free Speech. Retrieved July 12, 2022 from https://www.dailysignal.com/2021/07/09/new-social-media-platform-gettr-says-no-to-cancel-culture-yes- to-free-speech/
[7]
Marvin Ammori. 2014. THE" NEW"" NEW YORK TIMES": FREE SPEECH LAWYERING IN THE AGE OF GOOGLE AND TWITTER. Harvard Law Review 127, 8 (2014), 2259--2295.
[8]
Athanasios Andreou, Márcio Silva, Fabrício Benevenuto, Oana Goga, Patrick Loiseau, and Alan Mislove. 2019. Measuring the Facebook advertising ecosystem. In NDSS 2019-Proceedings of the Network and Distributed System Security Symposium. 1--15.
[9]
Carolina Are. 2021. The Shadowban Cycle: an autoethnography of pole dancing, nudity and censorship on Instagram. Feminist Media Studies (2021), 1--18.
[10]
Enrique Armijo. 2021. Reasonableness as Censorship: Section 230 Reform, Content Moderation, and the First Amendment. Fla. L. Rev. 73 (2021), 1199.
[11]
Joseph B Bayer, Penny Triu, and Nicole B Ellison. 2020. Social media elements, ecologies, and effects. Annual review of psychology (2020).
[12]
Reuben Binns, Michael Veale, Max Van Kleek, and Nigel Shadbolt. 2017. Like trainer, like bot? Inheritance of bias in algorithmic content moderation. In International conference on social informatics. Springer, 405--415.
[13]
Danielle Blunt, Ariel Wolf, Emily Coombes, and Shanelle Mullin. 2020. Posting into the void: Studying the impact of shadowbanning on sex workers and activists. Retrieved September 6 (2020), 2021.
[14]
Pablo J Boczkowski, Mora Matassi, and Eugenia Mitchelstein. 2018. How young users deal with multiple platforms: The role of meaning-making in social media repertoires. Journal of computer-mediated communication 23, 5 (2018), 245--259.
[15]
Leticia Bode and Emily K Vraga. 2015. In related news, that was wrong: The correction of misinformation through related stories functionality in social media. Journal of Communication 65, 4 (2015), 619--638.
[16]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.
[17]
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877--1901.
[18]
Pete Burnap and Matthew L Williams. 2015. Cyber hate speech on twitter: An application of machine classification and statistical modeling for policy and decision making. Policy & internet 7, 2 (2015), 223--242.
[19]
Eshwar Chandrasekharan, Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2022. Quarantined! examining the effects of a community-wide moderation intervention on reddit. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4 (2022), 1--26.
[20]
Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You can't stay here: The efficacy of reddit's 2015 ban examined through hate speech. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), 1--22.
[21]
Jonathan Chang and Cristian Danescu-Niculescu-Mizil. 2019. Trajectories of blocked community members: Redemp- tion, recidivism and departure. In The world wide web conference. 184--195.
[22]
Danielle Keats Citron. 2014. Hate crimes in cyberspace. Harvard University Press.
[23]
Danielle Keats Citron and Benjamin Wittes. 2017. The internet will not break: Denying bad samaritans sec. 230 immunity. Fordham L. Rev. 86 (2017), 401.
[24]
Danielle Keats Citron and Benjamin Wittes. 2018. The Problem Isn't Just Backpage: Revising Section 230 Immunity. (2018).
[25]
Jane Coaston. 2018. YouTube, Facebook, and Apple's ban on Alex Jones, explained. Retrieved August 6, 2018 from https://www.vox.com/2018/8/6/17655658/alex-jones-facebook-youtube-conspiracy-theories
[26]
Ben Collins and Brandy Zadrozny. 2021. Twitter bans Michael Flynn, Sidney Powell in QAnon account purge. Retrieved July 12, 2022 from https://www.nbcnews.com/tech/tech-news/twitter-bans-michael-flynn-sidney-powell-qanon- account- purge- n1253550
[27]
Marie L Conte. 2022. The Inside Story of Politics for All, Twitter's Infamous UK News Account. Retrieved July 12, 2022 from https://www.vice.com/en/article/jgmjex/what-happened-to-politics-for-all
[28]
Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society 18, 3 (2016), 410--428.
[29]
Colleen Cronin. 2021. Fake news accounts claim Taliban executed CNN journalist. Retrieved July 12, 2022 from https://www.dailydot.com/debug/fake-news-accounts-tweet-death-fake-journalist-afghanistan/
[30]
Tim Cushing. 2019. Court Says Section 230 Shields Twitter From Revenge Porn Bro's Stupid Lawsuit. Retrieved July 12, 2022 from https://www.techdirt.com/2019/06/13/court-says-section-230-shields-twitter-revenge-porn-bros-stupid- lawsuit/
[31]
Julia R DeCook. 2022. r/WatchRedditDie and the politics of Reddit's bans and quarantines. Internet Histories 6, 1--2 (2022), 206--222.
[32]
MichaelADeVito,JeremyBirnholtz,andJefferyTHancock.2017.Platforms,people,andperception:Usingaffordances to understand self-presentation on social media. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. 740--754.
[33]
Michael A DeVito, Ashley Marie Walker, and Jeremy Birnholtz. 2018. 'Too Gay for Facebook' Presenting LGBTQ Identity Throughout the Personal Social Media Ecosystem. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--23.
[34]
Judith S Donath. 2002. Identity and deception in the virtual community. In Communities in cyberspace. Routledge, 37--68.
[35]
Rónán Duffy. 2020. Twitter permanently suspends Gemma O'Doherty's account over 'repeated violations'. Retrieved July 12, 2022 from https://www.thejournal.ie/gemma-odoherty-twitter-5165384-Jul2020/
[36]
Emory James Edwards and Tom Boellstorff. 2021. Migration, non-use, and the ?Tumblrpocalypse': Towards a unified theory of digital exodus. Media, Culture & Society 43, 3 (2021), 582--592.
[37]
Oliver Effron. 2020. David Duke has been banned from Twitter. Retrieved July 12, 2022 from https://www.cnn.com/ 2020/07/31/tech/david-duke-twitter-ban/index.html
[38]
Greg Evans. 2021. This Twitter account documents all the madness you're missing on Parler. Retrieved July 12, 2022 from https://www.indy100.com/science-tech/parler-twitter-account-trump-right-wing-b1784844
[39]
Gabriel Fair and Ryan Wesslen. 2019. Shouting into the void: A database of the alternative social media platform gab. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13. 608--610.
[40]
Emilio Ferrara. 2023. Should chatgpt be biased? challenges and risks of bias in large language models. arXiv preprint arXiv:2304.03738 (2023).
[41]
Jenna Fisher. 2021. Twitter Suspends Senate Candidate Shiva Ayyadurai's Account. Retrieved July 12, 2022 from https://patch.com/massachusetts/cambridge/twitter-suspends-senate-candidate-shiva-ayyadurais-account
[42]
Christine Geeng, Savanna Yee, and Franziska Roesner. 2020. Fake news on Facebook and Twitter: Investigating how people (don't) investigate. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1--14.
[43]
R Stuart Geiger. 2016. Bot-based collective blocklists in Twitter: the counterpublic moderation of harassment in a networked public space. Information, Communication & Society 19, 6 (2016), 787--803.
[44]
Samuel Gibbs and Martin Belam. 2017. Twitter suspends Britain First leaders as it enforces new anti-abuse rules. Retrieved July 12, 2022 from https://www.theguardian.com/technology/2017/dec/18/twitter-enforcing-anti-abuse- rules-clean-up-act-abuse-hate-symbols-sexual-advances-violent-groups
[45]
Lex Gill, Dennis Redeker, and Urs Gasser. 2015. Towards digital constitutionalism? Mapping attempts to craft an internet bill of rights. Mapping Attempts to Craft an Internet Bill of Rights (November 9, 2015). Berkman Center Research Publication 2015--15 (2015).
[46]
Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press.
[47]
João Gonçalves, Ina Weber, Gina M Masullo, Marisa Torres da Silva, and Joep Hofhuis. 2021. Common sense or censorship: How algorithmic moderators and message type influence perceptions of online content deletion. new media & society (2021), 14614448211032310.
[48]
JazminGoodwin.2021.Gab:Everythingyouneedtoknowaboutthefast-growing,controversialsocialnetwork. Retrieved July 12, 2022 from https://www.cnn.com/2021/01/17/tech/what-is-gab explainer/index.html
[49]
James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. 17 (2015), 42.
[50]
Tommi Gröndahl, Luca Pajola, Mika Juuti, Mauro Conti, and N Asokan. 2018. All you need is" love" evading hate speech detection. In Proceedings of the 11th ACM workshop on artificial intelligence and security. 2--12.
[51]
Richard Hanania. 2019. It Isn't Your Imagination: Twitter Treats Conservatives More Harshly Than Liberals. Retrieved June 24, 2022 from https://quillette.com/2019/02/12/it-isnt-your-imagination-twitter-treats-conservatives-more-harshly-than-liberals/l
[52]
Amy A Hasinoff and Nathan Schneider. 2022. From Scalability to Subsidiarity in Addressing Online Harm. Social Media Society 8, 3 (2022), 20563051221126041.
[53]
HinduPost. 2020. Twitter targeting TrueIndology for sharing inconvenient truths? Retrieved July 14, 2022 from https://hindupost.in/media/twitter-hounds-true-indology-for-sharing-inconvenient-truths/
[54]
Matthew P Hooker. 2019. Censorship, Free Speech & Facebook: Applying the First Amendment to Social Media Platforms via the Public Function Exception. Wash. JL Tech. & Arts 15 (2019), 36.
[55]
Manoel Horta Ribeiro, Shagun Jhaver, Savvas Zannettou, Jeremy Blackburn, Gianluca Stringhini, Emiliano De Cristo- faro, and Robert West. 2021. Do platform migrations compromise content moderation? evidence from r/the_donald and r/incels. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--24.
[56]
Twitter Inc. 2021. Permanent suspension of @realDonaldTrump. Retrieved January 8, 2021 from https://blog.twitter. com/en_us/topics/company/2020/suspension
[57]
Mike Isaac. 2023. Reddit Wants to Get Paid for Helping to Teach Big A.I. Systems. Retrieved July 10, 2023 from https://www.nytimes.com/2023/04/18/technology/reddit-ai-openai-google.html
[58]
Shagun Jhaver. 2020. Identifying opportunities to improve content moderation. Ph. D. Dissertation. Georgia Institute of Technology.
[59]
Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. " Did you suspect the post would be removed?" Understanding user reactions to content removals on Reddit. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1--33.
[60]
ShagunJhaver,ChristianBoylston,DiyiYang,andAmyBruckman.2021.Evaluatingtheeffectivenessofdeplatforming as a moderation strategy on Twitter. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--30.
[61]
Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019. Does transparency in moderation really matter? User behavior after content removal explanations on reddit. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--27.
[62]
Dustin Jones. 2021. Twitter Bans Account Linked To Iran's Supreme Leader. Retrieved July 12, 2022 from https: //www.npr.org/2021/01/22/959736537/twitter-bans-account-linked-to-irans-supreme-leader
[63]
Ben Kaiser, Jerry Wei, Eli Lucherini, Kevin Lee, J Nathan Matias, and Jonathan Mayer. 2021. Adapting security warnings to counter online disinformation. In 30th USENIX Security Symposium (USENIX Security 21). 1163--1180.
[64]
Sowmya Karunakaran and Rashmi Ramakrishan. 2019. Testing stylistic interventions to reduce emotional impact of content moderation workers. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7. 50--58.
[65]
Ayushman Kaul. 2020. Telegram - a free speech Russian platform is a haven for far-Right terror groups. Retrieved July 12, 2022 from https://theprint.in/opinion/telegram-a-free-speech-russian-platform-is-a-haven-for-far-right-terror- groups/407357/
[66]
David A Kaye. 2019. Speech police: The global struggle to govern the Internet. Columbia Global Reports.
[67]
Sam Kestenbaum. 2017. 'Antifa's Most Prominent Jew' Booted From Twitter. Retrieved July 12, 2022 from https: //forward.com/fast-forward/374276/antifas-most-prominent-jew-booted-from-twitter/
[68]
SaraKiesler,RobertKraut,PaulResnick,andAniketKittur.2012.Regulatingbehaviorinonlinecommunities.Building successful online communities: Evidence-based social design 1 (2012), 4--2.
[69]
Kate Klonick. 2017. The new governors: The people, rules, and processes governing online speech. Harv. L. Rev. 131 (2017), 1598.
[70]
Yubo Kou. 2021. Punishment and Its Discontents: An Analysis of Permanent Ban in an Online Game Community. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--21.
[71]
Zaira Lakhpatwala. 2021. Why won't Twitter ban Khamenei when it permanently suspended Trump? Retrieved July 12, 2022 from https://www.arabnews.com/node/1829296/media
[72]
Cliff Lampe, Paul Zube, Jusil Lee, Chul Hyun Park, and Erik Johnston. 2014. Crowdsourcing civility: A natural experiment examining the effects of distributed moderation in online forums. Government Information Quarterly 31, 2 (2014), 317--326.
[73]
Allen Yilun Lin, Kate Kuehl, Johannes Schöning, and Brent Hecht. 2017. Understanding" Death by GPS" A Systematic Study of Catastrophic Incidents Associated with Personal Navigation Technologies. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1154--1166.
[74]
Siân E Lindley, Catherine C Marshall, Richard Banks, Abigail Sellen, and Tim Regan. 2013. Rethinking the web as a personal archive. In Proceedings of the 22nd international conference on World Wide Web. 749--760.
[75]
Julia Manchester. 2018. Self-described feminist banned from Twitter says platform is setting 'dangerous' precedent. Retrieved July 12, 2022 from https://thehill.com/hilltv/rising/420033-self-described-feminist-banned-from-twitter- says- platform- is- setting- a/
[76]
Sarah Marsh. 2019. Twitter blocks accounts of Raul Castro and Cuban state-run media. Retrieved July 12, 2022 from https://www.reuters.com/article/us-cuba-twitter/twitter-blocks-accounts-of-raul-castro-and-cuban-state-run-media- idUSKCN1VX2AH
[77]
J Nathan Matias. 2019. The civic labor of volunteer moderators online. Social Media Society 5, 2 (2019), 2056305119836778.
[78]
J Nathan Matias. 2019. Preventing harassment and increasing group participation through social norms in 2,190 online science discussions. Proceedings of the National Academy of Sciences 116, 20 (2019), 9785--9789.
[79]
Emma Mayer. 2021. Gettr CEO Says Twitter Blocking Tweet Imports, Suggests That Makes It a Publisher. Retrieved July 12, 2022 from https://www.newsweek.com/gettr-ceo-says-twitter-blocking-tweet-imports-suggests-that-makes-it- publisher- 1608577
[80]
Bill McCarthy. 2020. Who is Robert Malone? Joe Rogan's guest was a vaccine scientist, became an anti-vaccine darling. Retrieved July 12, 2022 from https://www.politifact.com/article/2022/jan/06/who-robert-malone-joe-rogans-guest- was- vaccine- sci/
[81]
Paul Mena. 2020. Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook. Policy & internet 12, 2 (2020), 165--183.
[82]
Mainack Mondal, Leandro Araújo Silva, and Fabrício Benevenuto. 2017. A measurement study of hate speech in social media. In Proceedings of the 28th ACM conference on hypertext and social media. 85--94.
[83]
Patricia L Moravec, Antino Kim, and Alan R Dennis. 2020. Appealing to sense and sensibility: System 1 and system 2 interventions for fake news on social media. Information Systems Research 31, 3 (2020), 987--1006.
[84]
Jason Murdock. 2020. Twitter Suspends Account of Chinese Virologist Who Claimed Coronavirus Was Made in a Lab. Retrieved July 12, 2022 from https://www.newsweek.com/twitter-suspends-dr-li-meng-yan-wuhan-lab-coronavirus- covid19- 1532193
[85]
Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society 20, 11 (2018), 4366--4383.
[86]
Peter Nagy and Gina Neff. 2015. Imagined affordance: Reconstructing a keyword for communication theory. Social Media Society 1, 2 (2015), 2056305115603385.
[87]
Edward Newell, David Jurgens, Haji Mohammad Saleem, Hardik Vala, Jad Sassine, Caitrin Armstrong, and Derek Ruths. 2016. User migration in online social networks: A case study on reddit during a period of community unrest. In Tenth International AAAI Conference on Web and Social Media.
[88]
Chikashi Nobata, Joel Tetreault, Achint Thomas, Yashar Mehdad, and Yi Chang. 2016. Abusive language detection in online user content. In Proceedings of the 25th international conference on world wide web. 145--153.
[89]
Fayika Farhat Nova, Michael Ann DeVito, Pratyasha Saha, Kazi Shohanur Rashid, Shashwata Roy Turzo, Sadia Afrin, and Shion Guha. 2021. " Facebook Promotes More Harassment" Social Media Ecosystem, Skill and Marginalized Hijra Identity in Bangladesh. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1--35.
[90]
Stanford Internet Observatory. 2001. gogettr. Retrieved May 15, 2005 from https://github.com/stanfordio/gogettr/
[91]
Abby Ohlheiser and Ian Shapira. 2018. Gab, the white supremacist sanctuary linked to the Pittsburgh suspect, goes offline(fornow). RetrievedJuly12,2022fromhttps://www.washingtonpost.com/technology/2018/10/28/how-gab-became-white-supremacist-sanctuary-before-it-was-linked-pittsburgh-suspect/
[92]
GordonPennycook,AdamBear,EvanTCollins,andDavidGRand.2020.Theimpliedtrutheffect:Attachingwarnings to a subset of fake news headlines increases perceived accuracy of headlines without warnings. Management Science 66, 11 (2020), 4944--4957.
[93]
Gordon Pennycook, Tyrone D Cannon, and David G Rand. 2018. Prior exposure increases perceived accuracy of fake news. Journal of experimental psychology: general 147, 12 (2018), 1865.
[94]
Billy Perrigo. 2023. Exclusive: OpenAI Used Kenyan Workers on Less Than $2 Per Hour to Make ChatGPT Less Toxic. Retrieved July 10, 2023 from https://time.com/6247678/openai-chatgpt-kenya-workers/
[95]
Ewan Plamer. 2022. Marjorie Taylor Greene Gets Gab, Gettr Boost After Twitter Ban-Way Down Overall. Retrieved July 12, 2022 from https://www.newsweek.com/marjorie-taylor-greene-twitter-ban-gab-gettr-boost-1667988
[96]
Andrew Quinn. 2020. Twitter ban former TUV election candidate David Vance over tweet sent to Manchester United strikerMarcusRashford. RetrievedJuly14,2022fromhttps://www.newsletter.co.uk/news/politics/twitter-ban-former-tuv-election-candidate-david-vance-over-tweet-sent-to-manchester-united-striker-marcus-rashford-2967257
[97]
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018. Improving language understanding by generative pre-training. (2018).
[98]
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
[99]
Kevin Rawlinson. 2018. Tommy Robinson permanently banned by Twitter. Retrieved July 12, 2022 from https://www.theguardian.com/technology/2018/mar/28/tommy-robinson-permanently-banned-twitter- violating- rules- hateful- conduct
[100]
Adi Robertson. 2018. TFormer revenge porn mogul Craig Brittain sues Twitter in absurdist censorship complaint. Retrieved July 12, 2022 from https://www.theverge.com/2018/6/7/17437608/craig-brittain-revenge-porn-senate-candidate- twitter- censorship- antitrust- lawsuit
[101]
Richard Rogers. 2020. Deplatforming: Following extreme Internet celebrities to Telegram and alternative social media. European Journal of Communication 35, 3 (2020), 213--229.
[102]
Aja Romano. 2017. Twitter suspended, then restored, the account of former KKK grand wizard David Duke. Retrieved July 12, 2022 from https://www.vox.com/culture/2017/3/7/14831800/david-duke-twitter-ban-restored
[103]
Mac Ryan and Montgomery Blake. 2018. Twitter Suspended Proud Boys' And Founder Gavin McInnes' Accounts Ahead OfThe'UniteTheRight'Rally. RetrievedJune28,2022fromhttps://www.buzzfeednews.com/article/ryanmac/twitter- suspends-proud-boys-and-founder-gavin-mcinnes
[104]
Haji Mohammad Saleem and Derek Ruths. 2018. The aftermath of disbanding an online hateful community. arXiv preprint arXiv:1804.07354 (2018).
[105]
Emily Saltz, Claire R Leibowicz, and Claire Wardle. 2021. Encounters with visual misinformation and labels across platforms: An interview and diary study to inform ecosystem approaches to misinformation interventions. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1--6.
[106]
Joseph Seering. 2020. Reconsidering Community Self-Moderation: the Role of Research in Supporting Community- Based Models for Online Content Moderation. Proc. ACM Hum.-Comput. Interact 3 (2020).
[107]
JosephSeering,TianmiFang,LucaDamasco,Mianhong'Cherie'Chen,LikangSun,andGeoffKaufman.2019.Designing user interface elements to improve the quality and civility of discourse in online commenting behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.
[108]
Joseph Seering, Michal Luria, Connie Ye, Geoff Kaufman, and Jessica Hammer. 2020. It takes a village: integrating an adaptive chatbot into an online gaming community. In Proceedings of the 2020 chi conference on human factors in computing systems. 1--13.
[109]
Haeseung Seo, Aiping Xiong, and Dongwon Lee. 2019. Trust it or not: Effects of machine-learning warnings in helping individuals mitigate misinformation. In Proceedings of the 10th ACM Conference on Web Science. 265--274.
[110]
Ahmad Shehabat, Teodor Mitew, and Yahia Alzoubi. 2017. Encrypted jihad: Investigating the role of Telegram App in lone wolf attacks in the West. Journal of strategic security 10, 3 (2017), 27--53.
[111]
Spencer Silva. 2021. Racist troll Owen Benjamin is evading bans from major social media platforms to continue spreading hateandbigotry. RetrievedJuly12,2022fromhttps://www.mediamatters.org/facebook/racist-troll-owen-benjamin- evading-bans-major-social-media-platforms-continue-spreading
[112]
Seth Simons. 2021. Twitter Permanently Suspends Anthony Cumia. Retrieved July 12, 2022 from https://www. pastemagazine.com/comedy/anthony-cumia/twitter-permanently-suspends-anthony-cumia/
[113]
Mohit Singhal, Chen Ling, Nihal Kumarswamy, Gianluca Stringhini, and Shirin Nilizadeh. 2022. SoK: content moderation in social media, from guidelines to enforcement, and research to practice. arXiv preprint arXiv:2206.14855 (2022).
[114]
Tim Squirrell. 2019. Platform dialectics: The relationships between volunteer moderators and end users on reddit. New Media & Society 21, 9 (2019), 1910--1927.
[115]
AngelicaStabile.2022.Dr.RobertMaloneonJoeRoganinterviewcensorship,Twitterban:'Youcan'tsuppressinformation'. Retrieved July 12, 2022 from https://www.foxnews.com/media/dr-robert-malone-joe-rogan-covid-ingraham-twitter- ban-youtube-censorship
[116]
Christine Stapleton. 2019. This far-right provocateur is banned from social media, but she's still running for Con- gress. Retrieved July 12, 2022 from https://www.palmbeachpost.com/story/news/local/2019/10/08/this-far-right- provocateur-is-banned-from-social-media-but-shes-still-running-for-congress/2545693007/
[117]
Kate Starbird, Ahmer Arif, and Tom Wilson. 2019. Disinformation as collaborative work: Surfacing the participatory nature of strategic information operations. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--26.
[118]
Chris Stokel-Walker. 2023. Twitters $42,000-per-Month API Prices Out Nearly Everyone. Retrieved July 15, 2023 from https://www.wired.com/story/twitter-data-api-prices-out-nearly-everyone/
[119]
Jo Ellen Stryker, Ricardo J Wray, Robert C Hornik, and Itzik Yanovitzky. 2006. Validation of database search terms for content analysis: The case of cancer news coverage. Journalism & Mass Communication Quarterly 83, 2 (2006), 413--430.
[120]
Nicolas Suzor, Tess Van Geelen, and Sarah Myers West. 2018. Evaluating the legitimacy of platform governance: A review of research and a shared research agenda. International Communication Gazette 80, 4 (2018), 385--400.
[121]
Edson C Tandoc Jr, Chen Lou, and Velyn Lee Hui Min. 2019. Platform-swinging in a poly-social-media context: How and why users navigate multiple social media platforms. Journal of Computer-Mediated Communication 24, 1 (2019), 21--35.
[122]
Jacob Thebault-Spieker, Sukrit Venkatagiri, Naomi Mine, and Kurt Luther. 2023. Diverse Perspectives Can Mitigate Political Bias in Crowdsourced Content Moderation. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 1280--1291.
[123]
Kurt Thomas, Chris Grier, Dawn Song, and Vern Paxson. 2011. Suspended accounts in retrospect: an analysis of twitter spam. In Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference. 243--258.
[124]
Twitter. 2022. Notices on Twitter and what they mean. Retrieved June 24, 2022 from https://help.twitter.com/en/rulesand-policies/notices-on-twitter
[125]
Twitter. 2022. Rules and policies. Retrieved June 24, 2022 from https://help.twitter.com/en/rules-and-policies#general
[126]
Kristen Vaccaro, Ziang Xiao, Kevin Hamilton, and Karrie Karahalios. 2021. Contestability for content moderation. Proceedings of the ACM on human-computer interaction 5, CSCW2 (2021), 1--28.
[127]
Reed Van Schenck. 2023. Deplatforming ?the people": media populism, racial capitalism, and the regulation of online reactionary networks. Media, Culture & Society (2023), 01634437231169909.
[128]
Daniel Victor. 2016. Microsoft Created a Twitter Bot to Learn From Users. It Quickly Became a Racist Jerk. Retrieved July 15, 2023 from https://www.nytimes.com/2016/03/25/technology/microsoft-created-a-twitter-bot-to-learn-fromusers-it-quickly-became-a-racist-jerk.html
[129]
Pablo Villalobos, Jaime Sevilla, Lennart Heim, Tamay Besiroglu, Marius Hobbhahn, and Anson Ho. 2022. Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning. arXiv preprint arXiv:2211.04325 (2022).
[130]
Jessica Vitak, Kalyani Chadha, Linda Steiner, and Zahra Ashktorab. 2017. Identifying women's experiences with and strategies for mitigating negative effects of online harassment. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. 1231--1245.
[131]
Jim Waterson. 2022. TechScape: Inside the rise and fall of Politics For All. Retrieved July 14, 2022 from https: //www.theguardian.com/technology/2022/jan/12/techscape-politics-for-all-twitter
[132]
Brian E Weeks, Alberto Ardèvol-Abreu, and Homero Gil de Zúñiga. 2017. Online influence? Social media use, opinion leadership, and political persuasion. International journal of public opinion research 29, 2 (2017), 214--239.
[133]
Miranda Wei, Madison Stamos, Sophie Veys, Nathan Reitinger, Justin Goodman, Margot Herman, Dorota Filipczuk, Ben Weinshel, Michelle L Mazurek, and Blase Ur. 2020. What Twitter knows: Characterizing ad targeting practices, user perceptions, and ad explanations through users' own Twitter data. In 29th USENIX Security Symposium (USENIX Security 20). 145--162.
[134]
Mark White. 2021. Anjem Choudary: Islamist hate preacher banned from Twitter. Retrieved July 12, 2022 from https://news.sky.com/story/anjem-choudary-islamist-hate-preacher-banned-from-twitter-12367411
[135]
Donghee Yvette Wohn. 2019. Volunteer moderators in twitch micro communities: How they get involved, the roles they play, and the emotional labor they experience. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1--13.
[136]
Shaomei Wu, Jake M Hofman, Winter A Mason, and Duncan J Watts. 2011. Who says what to whom on twitter. In Proceedings of the 20th international conference on World wide web. 705--714.
[137]
Sijia Xiao, Shagun Jhaver, and Niloufar Salehi. 2022. Addressing harm in online gaming communities--the opportunities and challenges for a restorative justice approach. arXiv preprint arXiv:2211.01524 (2022).
[138]
Brandy Zadrozny. 2018. Right-wing platforms provide refuge to digital outcasts - and Alex Jones. Retrieved July 14, 2022 from https://www.nbcnews.com/tech/tech-news/right-wing-platforms-provide-refuge-digital-outcasts-alexjones-n899161
[139]
Savvas Zannettou, Barry Bradlyn, Emiliano De Cristofaro, Haewoon Kwak, Michael Sirivianos, Gianluca Stringini, and Jeremy Blackburn. 2018. In Companion Proceedings of the The Web Conference 2018. 1007--1014.
[140]
Xuan Zhao, Cliff Lampe, and Nicole B Ellison. 2016. The social media ecology: User perceptions, strategies and challenges. In Proceedings of the 2016 CHI conference on human factors in computing systems. 89--100.

Index Terms

  1. Investigating Influential Users' Responses to Permanent Suspension on Social Media

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue CSCW1
    CSCW
    April 2024
    6294 pages
    EISSN:2573-0142
    DOI:10.1145/3661497
    Issue’s Table of Contents
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 April 2024
    Published in PACMHCI Volume 8, Issue CSCW1

    Check for updates

    Author Tags

    1. moderation
    2. permanent suspension
    3. social media ecology
    4. social networks

    Qualifiers

    • Research-article

    Funding Sources

    • Wisconsin Alumni Research Foundation

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 246
      Total Downloads
    • Downloads (Last 12 months)246
    • Downloads (Last 6 weeks)79
    Reflects downloads up to 01 Nov 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media