"Dialing it Back:" Shadowbanning, Invisible Digital Labor, and how Marginalized Content Creators Attempt to Mitigate the Impacts of Opaque Platform Governance
Authors: 
Sena A. Kojah, Ben Zefeng Zhang, Carolina Are, Daniel Delmonaco, 
Oliver L. HaimsonAuthors Info & Claims
Sena A. Kojah, Ben Zefeng Zhang, Carolina Are, Daniel Delmonaco, Oliver L. HaimsonAuthors Info & ClaimsArticle No.: GROUP12, Pages 1 - 22
Abstract
Content creators with marginalized identities are disproportionately affected by shadowbanning on social media platforms, which impacts their economic prospects online. Through a diary study and interviews with eight marginalized content creators who are women, pole dancers, plus size, and/or LGBTQIA+, this paper examines how content creators with marginalized identities experience shadowbanning. We highlight the labor and economic inequalities of shadowbanning, and the resulting invisible online labor that marginalized creators often must perform. We identify three types of invisible labor that marginalized content creators engage in to mitigate shadowbanning and sustain their online presence: mental and emotional labor, misdirected labor, and community labor. We conclude that even though marginalized content creators engaged in cross-platform collaborative labor and personal mental/emotional labor to mitigate the impacts of shadowbanning, it was insufficient to prevent uncertainty and economic precarity created by algorithmic opacity and ambiguity.
References
[1]
Mike Ananny. 2018. Networked press freedom: Creating infrastructures for a public right to hear. MIT press.
[2]
Carolina Are and Pam Briggs. 2023. The emotional and financial impact of de-platforming on creators at the margins. Social media+ society 9, 1 (2023), 20563051231155103.
[3]
C. Are and P. Briggs. 2023. The Emotional and Financial Impact of De-Platforming on Creators at the Margins. Social Media + Society 9, 1 (2023). https://doi.org/10.1177/20563051231155103
[4]
Sarah Banet-Weiser. 2018. Empowered: Popular feminism and popular misogyny. Duke University Press.
[5]
E. B. Bigelow. 1878. The Relations of Labor and Capital. The Atlantic (October 1 1878). https://www.theatlantic.com/magazine/archive/1878/10/the-relations-of-labor-and capital/521106/
[6]
Sophie Bishop. 2019. Managing visibility on YouTube through algorithmic gossip. New media & society 21, 11--12(2019), 2589--2606.
[7]
D. Blunt, E. Coombes, S. Mullin, and A. Wolf. 2020. Posting Into the Void. Hacking/Hustling. https://hackinghustling.org/posting-into-the-void-content-moderation/
[8]
D. Blunt and Z. Stardust. 2021. Automating Whorephobia: Sex, Technology and the Violence of Deplatforming. Porn Studies 8, 4 (2021), 350--366.
[9]
D. Blunt and A. Wolf. 2020. Erased: The impact of FOSTA-SESTA and the removal of Backpage on sex workers. Antitraffickingreview.org 14 (2020), 117--121.
[10]
Oversight Board. 2023. Gender identity and nudity. Decisions. https://oversightboard.com/decision/BUN-IH313ZHJ/
[11]
N. Bolger, A. Davis, and E. Rafaeli. 2003. Diary methods: capturing life as it is lived. Annual Review of Psychology 54 (2003), 579--616. https://doi.org/10.1146/annurev.psych.54.101601.145030
[12]
Carolyn Bronstein. 2021. Deplatforming sexual speech in the age of FOSTA/SESTA. Porn Studies 8, 4 (2021), 367--380. https://doi.org/10.1080/23268743.2021.1993972
[13]
Scott Carter and Jennifer Mankoff. 2005. When participants do the capturing: The role of media in diary studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 899--908.
[14]
S. Cole. 2018. Where Did the Concept of 'Shadow Banning' Come From? Vice. https://www.vice.com/en/article/a3q744/where-did-shadow-banning-come-from-trump-republicans-shadowbanned
[15]
Juliet M Corbin and Anselm Strauss. 1990. Grounded theory research: Procedures, canons, and evaluative criteria. Qualitative sociology 13, 1 (1990), 3--21.
[16]
K. Cotter. 2021. 'Shadowbanning is not a thing': black box gaslighting and the power to independently know and credibly critique algorithms. Information, Communication Society 26, 6 (2021), 1226--1243. https://doi.org/10.1080/1369118X.2021.1994624
[17]
Mary Crain, Walter Poster, and Michael Cherry. 2016. Invisible labor: Hidden work in the contemporary world. University of California Press, Berkeley.
[18]
Samantha Dalal, Ngan Chiem, Nikoo Karbassi, Yuhan Liu, and Andrés Monroy-Hernández. 2023. Understanding Human Intervention in the Platform Economy: A case study of an indie food delivery service. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1--16.
[19]
A. K. Daniels. 1987. Invisible work. Social Problems 34, 5 (1987), 403--415. https://doi.org/10.2307/800538
[20]
Arlene Kaplan Daniels. 1987. Invisible work. Social problems 34, 5 (1987), 403--415.
[21]
Liz Dean, Brendan Churchill, and Leah Ruppanner. 2022. The mental load: building a deeper theoretical understanding of how cognitive and emotional labor over load women and mothers. Community, work & family 25, 1 (2022), 13--29.
[22]
Michael A. DeVito. 2021. Adaptive Folk Theorization as a Path to Algorithmic Literacy on Changing Platforms. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--38. https://doi.org/10.1145/3476080
[23]
Sandra MA Dijkstra-Kersten, Karolien EM Biesheuvel-Leliefeld, Johannes C van der Wouden, Brenda WJH Penninx,and Harm WJ van Marwijk. 2015. Associations of financial strain and income with depressive and anxiety disorders. J Epidemiol Community Health 69, 7 (2015), 660--665.
[24]
Brooke Erin Duffy. 2020. Algorithmic precarity in cultural work. Communication and the Public 5, 3--4 (2020), 103--107.
[25]
Brooke Erin Duffy and Colten Meisner. 2022. Platform governance at the margins: Social media creators' experiences with algorithmic (in) visibility. Media, Culture & Society 45, 2 (2022), 285--304.
[26]
Brooke Erin Duffy, Annika Pinch, Shruti Sannon, and Megan Sawey. 2021. The nested precarities of creative labor on social media. Social media+ society 7, 2 (2021), 20563051211021368.
[27]
Gwyn Easterbrook-Smith. 2023. OnlyFans as gig-economy work: A nexus of precarity and stigma. Porn studies 10, 3 (2023), 252--267.
[28]
Motahhare Eslami, Karrie Karahalios, Christian Sandvig, Kristen Vaccaro, Aimee Rickman, Kevin Hamilton, and Alex Kirlik. 2016. First I "like" it, then I hide it: Folk Theories of Social Feeds. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2858036.2858494
[29]
Lisa Fiksenbaum, Zdravko Marjanovic, and Esther Greenglass. 2017. Financial threat and individuals' willingness to change financial behavior. Review of Behavioral Finance 9, 2 (2017), 128--147.
[30]
Anonymized for Review. 2021. Anonymized title. (2021).
[31]
Anonymized for Review. 2022. Anonymized title. (2022).
[32]
Sarah E Fox, Vera Khovanskaya, Clara Crivellaro, Niloufar Salehi, Lynn Dombrowski, Chinmay Kulkarni, Lilly Irani, and Jodi Forlizzi. 2020. Worker-centered design: Expanding HCI methods for supporting labor. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1--8.
[33]
Florencia García-Rapp. 2017. Popularity markers on YouTube's attention economy: the case of Bubzbeauty. Celebrity Studies 8, 2 (2017), 228--245.
[34]
Tom Gerken. 2022. How to check if your Instagram posts are being hidden. BBC News (2022). https://www.bbc.co.uk/news/technology-63907699
[35]
Emily Gilbert. 2023. Beyond the usual suspects: Invisible labor(ers) in futures of work. Geography Compass 17 (2023),e12675, 1--12. https://doi.org/10.1111/gec3.12675
[36]
T. Gillespie. 2022. Do Not Recommend? Reduction as a Form of Content Moderation. Social Media + Society 8, 3 (2022),20563051221117550. https://doi.org/10.1177/20563051221117552
[37]
Z. Glatt. 2022. 'We're all told not to put our eggs in one basket': Uncertainty, precarity and cross-platform labor in the online video influencer industry. International Journal of Communication 16 (2022), 1--19. https://ijoc.org/index.php/ijoc/article/view/15761
[38]
Mary L Gray, Siddharth Suri, Syed Shoaib Ali, and Deepti Kulkarni. 2016. The crowd is a collaborative network. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing. 134--147.
[39]
Joan Greenbaum. 1996. Back to labor: returning to labor process discussions in the study of work. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (Boston, Massachusetts, USA) (CSCW '96). Association for Computing Machinery, New York, NY, USA, 229--237. https://doi.org/10.1145/240080.240259
[40]
Cheng Guo. 2020. Identity and user behavior in online communities. In Companion Proceedings of the 2020 ACM International Conference on Supporting Group Work. 35--38.
[41]
Oliver L. Haimson, Daniel Delmonaco, Peipei Nie, and Andrea Wegner. 2021. Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 466 (oct 2021), 35 pages. https: //doi.org/10.1145/3479610
[42]
Oliver L. Haimson, David Delmonaco, Peng Nie, and Arman Wegner. 2021. Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--35. https://doi.org/10.1145/3479610
[43]
K. Hill. 2021. Algorithmic insecurity, schedule non standardness, and gig worker wellbeing. (2021). https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3773164 Population Association of America Poster Presentation. Working Paper.
[44]
Cynthia Huff. 1989. " That Profoundly Female, and Feminist Genre": The Diary as Feminist Practice. Women's Studies Quarterly 17, 3/4 (1989), 6--14.
[45]
Lilly C Irani and M Six Silberman. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems. 611--620.
[46]
Karin AM Janssens, Elisabeth H Bos, Judith GM Rosmalen, Marieke C Wichers, and Harriëtte Riese. 2018. A qualitative approach to guide choices for designing a diary study. BMC medical research methodology 18 (2018), 1--12.
[47]
Mohammad Hossein Jarrahi and Will Sutherland. 2019. Algorithmic management and algorithmic competencies: Understanding and appropriating algorithms in gig work. In Information in Contemporary Society: 14th International Conference, iConference 2019, Washington, DC, USA, March 31--April 3, 2019, Proceedings 14. Springer, 578--589.
[48]
Mohammad Hossein Jarrahi, Will Sutherland, Sarah Beth Nelson, and Steve Sawyer. 2020. Platformic management, boundary resources for gig work, and worker autonomy. Computer supported cooperative work (CSCW) 29 (2020),153--189.
[49]
Kylie Jarrett. 2022. Digital labor. John Wiley & Sons.
[50]
Trinady Joslin. 2020. Black Creators Protest TikTok's Algorithm with# imblackmovement. Daily Dot (2020).
[51]
Vera Khovanskaya. 2023. The Cyberunion 20 Years Later. Interactions 30, 2 (feb 2023), 48--51. https://doi.org/10.1145/3583079
[52]
Kalle Kusk and Claus Bossen. 2022. Working with wolt: an ethnographic study of lenient algorithmic management on a food delivery platform. Proceedings of the ACM on Human-Computer Interaction 6, GROUP (2022), 1--22.
[53]
Airi Lampinen, Moira McGregor, Rob Comber, and Barry Brown. 2018. Member-Owned Alternatives: Exploring Participatory Forms of Organising with Cooperatives. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--19.
[54]
Maurizio Lazzarato. 2006. The Concepts of Life and the Living in the Societies of Control. Deleuze and the Social (2006), 171--190.
[55]
P. Leerssen. 2023. An end to shadow banning? Transparency rights in the Digital Services Act between content moderation and curation. Computer Law & Security Review 48 (2023). https://doi.org/10.1016/j.clsr.2023.105790
[56]
M. Leybold and M. Nadegger. 2023. Overcoming communicative separation for stigma reconstruction: How pole dancers fight content moderation on Instagram. Organization 0, 0 (2023). https://doi.org/10.1177/13505084221145635
[57]
Renkai Ma and Yubo Kou. 2021. " How advertiser-friendly is my video?": YouTuber's Socioeconomic Interactions with Algorithmic Content Moderation. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--25.
[58]
G. Mauro and H. Schellman. 2023. 'There is no standard': investigation finds AI algorithms objectify women's bodies. The Guardian (2023). https://www.theguardian.com/technology/2023/feb/08/biased-ai-algorithms-racy-women-bodies
[59]
Isabel Munoz, Michael Dunn, Steve Sawyer, and Emily Michaels. 2022. Platform-mediated Markets, Online Freelance Workers and Deconstructed Identities. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1--24.
[60]
Susanna Paasonen. 2021. Dependent, distracted, bored: Affective formations in networked media. MIT Press.
[61]
Julian Posada. 2022. Embedded reproduction in platform data work. Information, Communication & Society 25, 6 (2022), 816--834.
[62]
Bernhard Rieder, Erik Borra, Òscar Coromina, and Ariadna Matamoros-Fernández. 2023. Making a living in the creator economy: A large-scale study of linking on YouTube. Social Media+ Society 9, 2 (2023), 20563051231180628.
[63]
Laura Savolainen. 2022. The shadow banning controversy: perceived governance and algorithmic folklore. Media, culture & society 44, 6 (2022), 1091--1109.
[64]
Catherine Scott and Megan Medaugh. 2017. Axial Coding. https://doi.org/10.1002/9781118901731.iecrm0012
[65]
Ellen Simpson, Andrew Hamann, and Bryan Semaan. 2022. How to tame" your" algorithm: LGBTQ+ users' domestication of TikTok. Proceedings of the ACM on Human-computer Interaction 6, GROUP (2022), 1--27.
[66]
Franchesca Spektor, Sarah E Fox, Ezra Awumey, Ben Begleiter, Chinmay Kulkarni, Betsy Stringam, Christine A Riordan, Hye Jin Rho, Hunter Akridge, and Jodi Forlizzi. 2023. Charting the Automation of Hospitality: An Interdisciplinary Literature Review Examining the Evolution of Frontline Service work in the Face of Algorithmic Management. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1--20.
[67]
L. Stack. 2018. What Is a 'Shadow Ban,' and Is Twitter Doing It to Republican Accounts? The New York Times (July 26 2018). https://www.nytimes.com/2018/07/26/us/politics/twitter-shadowbanning.html
[68]
Will Sutherland, Mohammad Hossein Jarrahi, Michael Dunn, and Sarah Beth Nelson. 2020. Work precarity and gig literacies in online freelancing. Work, Employment and Society 34, 3 (2020), 457--475.
[69]
Karoliina Talvitie-Lamberg, Vilma Lehtinen, and Sanna Valtonen. 2022. Tactics of invisibility: How people in vulnerable positions make datafied everyday life livable. new media & society (2022), 14614448221136077.
[70]
Joice Tang, McKane Andrus, Samuel So, Udayan Tandon, Andrés Monroy-Hernández, Vera Khovanskaya, Sean A. Munson, Mark Zachry, and Sucheta Ghoshal. 2023. Back to "Back to Labor": Revisiting Political Economies of Computer-Supported Cooperative Work. In Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing (Minneapolis, MN, USA) (CSCW '23 Companion). Association for Computing Machinery, New York, NY, USA, 522--526. https://doi.org/10.1145/3584931.3611285
[71]
Arianna Tassinari and Vincenzo Maccarrone. 2020. Riders on the storm: Workplace solidarity among gig economy couriers in Italy and the UK. Work, employment and society 34, 1 (2020), 35--54.
[72]
Tiziana Terranova. 2012. Free labor. In Digital Labor. Routledge, 33--57.
[73]
Katrin Tiidenberg. 2021. Sex, power and platform governance. Porn Studies 8, 4 (2021), 381--393.
[74]
Anna Lowenhaupt Tsing. 2015. The mushroom at the end of the world: On the possibility of life in capitalist ruins. Princeton University Press.
[75]
C. Vark. 2021. Sex, Money, & Politics: Big Tech Made FOSTA-SESTA Global for Sex Workers. American University Business Law Review (2021). https://aublr.org/2021/10/sex-money-politics-big-tech-made-fosta-sesta-global-for-sex-workers/#_ftn22
[76]
Katie Waddington. 2013. Using qualitative diary research to understand emotion at work. In A Day in the Life of a Happy Worker, Arnold B. Bakker and Kevin Daniels (Eds.). Psychology Press, Hove, 132--149.
[77]
Mark E Whiting, Dilrukshi Gamage, Snehalkumar (Neil) S Gaikwad, Aaron Gilbee, Shirish Goyal, Alipta Ballav, Dinesh Majeti, Nalin Chhibber, Angela Richmond-Fuller, Freddie Vargus, et al. 2017. Crowd guilds: Worker-led reputation and feedback on crowdsourcing platforms. In Proceedings of the 2017 acm conference on computer supported cooperative work and social computing. 1902--1913.
[78]
Alex J Wood, Mark Graham, Vili Lehdonvirta, and Isis Hjorth. 2019. Networked but commodified: The (dis) embedded-ness of digital labour in the gig economy. Sociology 53, 5 (2019), 931--950.
[79]
Qian Yang, Richmond Y Wong, Thomas Gilbert, Margaret D Hagan, Steven Jackson, Sabine Junginger, and John Zimmerman. 2023. Designing Technology and Policy Simultaneously: Towards A Research Agenda and New Practice. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1--6.
[80]
Brita Ytre-Arne, Trine Syvertsen, Hallvard Moe, and Faltin Karlsen. 2020. Temporal ambivalences in smartphone use: Conflicting flows, conflicting responsibilities. new media & society 22, 9 (2020), 1715--1732.
[81]
Zizheng Yu, Emiliano Treré, and Tiziano Bonini. 2022. The emergence of algorithmic solidarity: unveiling mutual aid practices and resistance among Chinese delivery workers. Media International Australia 183, 1 (2022), 107--123.
Index Terms
- "Dialing it Back:" Shadowbanning, Invisible Digital Labor, and how Marginalized Content Creators Attempt to Mitigate the Impacts of Opaque Platform Governance
Recommendations
Quantifying the Invisible Labor in Crowd Work
CSCW2Crowdsourcing markets provide workers with a centralized place to find paid work. What may not be obvious at first glance is that, in addition to the work they do for pay, crowd workers also have to shoulder a variety of unpaid invisible labor in these ...
Understanding the impacts of user- and marketer- generated content on free digital content consumption
AbstractThe literature has shown that user-generated content (UGC) and marketer-generated content (MGC) simultaneously influence consumers' decision-making process. Yet it is unclear how UGC and MGC jointly affect the overall market reaction, ...
Highlights- The incremental view count of a free fitness video is affected by both user-generated content (UGC) and marketer-generated content (MGC).
Beyond Initial Removal: Lasting Impacts of Discriminatory Content Moderation to Marginalized Creators on Instagram
CSCWRecent work has demonstrated how content moderation practices on social media may unfairly affect marginalized individuals, for example by censoring women's bodies and misidentifying reclaimed terms as hate speech. This study documents and explores the ...
Comments
Information & Contributors
Information
Published In
January 2025
938 pages
Copyright © 2025 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 January 2025
Published in PACMHCI Volume 9, Issue 1
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 45Total Downloads
- Downloads (Last 12 months)45
- Downloads (Last 6 weeks)45
Reflects downloads up to 18 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in