research-article

Open access

Contestability For Content Moderation

Authors:

Kristen Vaccaro,

Kevin Hamilton, and

Karrie KarahaliosAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 5, Issue CSCW2

Article No.: 318, Pages 1 - 28

https://doi.org/10.1145/3476059

Published: 18 October 2021 Publication History

Abstract

Content moderation systems for social media have had numerous issues of bias, in terms of race, gender, and ability among many others. One proposal for addressing such issues in automated decision making is by designing for contestability, whereby users can shape and influence how decisions are made. In this study, we conduct a series of participatory design workshops with participants from communities that have experienced problems with social media content moderation in the past. Together with participants, we explore the idea of designing for contestability in content moderation and find that users' designs suggest three fruitful, practical avenues: adding representation, improving communication, and designing with compassion. We conclude with design recommendations drawn from participants' proposals, and reflect on the challenges that remain.

Supplementary Material

ZIP File (v5cscw318aux.zip)

Download
27.74 MB

References

[1]

Wajeeha Ahmad and Ilaria Liccardi. 2020. Addressing Anonymous Abuses: Measuring the Effects of Technical Mechanisms on Reported User Behaviors. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.

Digital Library

[2]

Leigh Alexander. 2016. Facebook's censorship of Aboriginal bodies raises troubling ideas of “decency”. The Guardian (March 2016). https://www.theguardian.com/technology/2016/mar/23/facebook-censorship-topless-aboriginal-women

[3]

Marco Almada. 2019. Human Intervention In Automated Decision-Making: Toward The Construction Of Contestable Systems. In Proc. International Conference on Artificial Intelligence and Law. 2--11.

Digital Library

[4]

Mike Ananny and Kate Crawford. 2018. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society (2018).

[5]

Julia Angwin and Hannes Grassegger. 2017. Facebook's Secret Censorship Rules Protect White Men From Hate Speech But Not Black Children. https://www.propublica.org/article/facebook-hate-speech-censorship-internal-documents-algorithms. ProPublica.

[6]

Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proc. CHI.

Digital Library

[7]

Sam Biddle, Paulo Victor Ribeiro, and Tatiana Dias. 2020. TikTok Told Moderators: Suppress Posts by the "Ugly" and Poor. https://theintercept.com/2020/03/16/tiktok-app-moderators-users-discrimination

[8]

Danielle Blunt, Ariel Wolf, Emily Coombes, and Shanelle Mullin. 2020. Posting Into the Void: Studying the Impact of Shadowbanning on Sex Workers and Activists. https://hackinghustling.org/posting-into-the-void-content-moderation/

[9]

Ariel Bogle. 2019. Aussie sex workers were kicked off American websites so they built their own. https://www.abc.net.au/news/science/2019-06--22/fosta-sesta-laws-impact-australian-sex-workers-one-year-later/11229724

[10]

Elena Botella. 2019. TikTok Admits It Suppressed Videos by Disabled, Queer, and Fat Creators. Slate (2019).

[11]

Zach-Amaury Boufoy-Bastick and Lenandlar Singh. 2007. The Socio-Technical Indicator Model: Socially-Sensitive CMC Technology, with an Implementation of Representative Moderation. International Journal of Computer, Information, and Systems Science, and Engineering, Vol. 1 (2007), 1.

[12]

Richard E Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development .sage.

[13]

Tone Bratteteig and Guri Verne. 2018. Does AI Make PD Obsolete? Exploring Challenges From Artificial Intelligence To Participatory Design. In Proc. Participatory Design Conference.

[14]

Anna Brown, Alexandra Chouldechova, Emily Putnam-Hornstein, Andrew Tobin, and Rhema Vaithianathan. 2019. Toward Algorithmic Accountability In Public Services: A Qualitative Study Of Affected Community Perspectives On Algorithmic Decision-Making In Child Welfare Services. In Proc. CHI.

Digital Library

[15]

Jenna Burrell, Zoe Kahn, Anne Jonas, and Daniel Griffin. 2019. When Users Control the Algorithms: Values Expressed in Practices on Twitter. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--20.

Digital Library

[16]

Online Censorship. [n.d.]. OFFLINE-ONLINE: data visuals exploring how content moderation practices impact marginalized communities. https://onlinecensorship.org/content/infographics.

[17]

@cfiesler (Casey Fiesler). 2020. “OK I'm going to weigh in on the tagging/content moderation conversation happening right now”. https://twitter.com/cfiesler/status/1273300997801041920

[18]

Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A Cross-Community Learning-Based System to Assist Reddit Moderators. Proc. ACM Hum.-Comput. Interact. CSCW (2019). https://doi.org/10.1145/3359276

Digital Library

[19]

Qijin Cheng and Elad Yom-Tov. 2019. Do search engine helpline notices aid in preventing suicide? Analysis of archival data. Journal of medical internet research, Vol. 21, 3 (2019).

[20]

Alexander Cheves. 2018. The Dangerous Trend of LGBTQ Censorship on the Internet. Out Magazine (2018). http://www.out.com/out-exclusives/2018/12/06/dangerous-trend-lgbtq-censorship-internet

[21]

Keith Coleman. 2021. Introducing Birdwatch, a community-based approach to misinformation. Twitter Blog (2021).

[22]

Roger Coleman and Cherie Lebbon. 1999. Inclusive design. Helen Hamlyn Research Centre, Royal College of Art (1999).

[23]

Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society, Vol. 18, 3 (2016), 410--428.

[24]

Nigel Cross. 1982. Designerly ways of knowing. Design studies, Vol. 3, 4 (1982).

[25]

Michael A DeVito, Darren Gergle, and Jeremy Birnholtz. 2017. Algorithms Ruin Everything: #RIPTwitter, Folk Theories, and Resistance to Algorithmic Change in Social Media. In Proc. CHI. https://doi.org/10.1145/3025453.3025659

Digital Library

[26]

Nicholas Diakopoulos and Michael Koliska. 2017. Algorithmic Transparency in the News Media. Digital Journalism (2017). https://doi.org/10.1080/21670811.2016.1208053

[27]

Carl DiSalvo, Jonathan Lukens, Thomas Lodato, Tom Jenkins, and Tanyoung Kim. 2014. Making Public Things: How HCI Design Can Express Matters of Concern. In Proc. CHI.

Digital Library

[28]

Evelyn Douek. 2021. The Facebook Oversight Board's First Decisions: Ambitious, and Perhaps Impractical. Lawfare Blog (2021).

[29]

Maximiliano Duron. 2019. Instagram Holds Closed-Door Roundtable with Artists on Art and Nudity. (2019). https://www.artnews.com/art-news/news/instagram-censorship-roundtable-13431/

[30]

Elizabeth Dwoskin, Jeanne Whalen, and Regine Cabato. 2019. Content moderators at YouTube, Facebook and Twitter see the worst of the web and suffer silently. https://www.washingtonpost.com/technology/2019/07/25/social-media-companies-are-outsourcing-their-dirty-work-philippines-generation-workers-is-paying-price

[31]

Victoria Elliott. 2018. Thinking About the Coding Process in Qualitative Data Analysis. The Qualitative Report (2018).

[32]

Jenny Fan and Amy X Zhang. 2020. Digital Juries: A Civics-Oriented Approach to Platform Governance. In Proc. CHI.

Digital Library

[33]

Jessica L Feuston, Alex S Taylor, and Anne Marie Piper. 2020. Conformity of Eating Disorders through Content Moderation. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--28.

Digital Library

[34]

Juniper Fitzgerald and Jessie Sage. 2019. Shadowbans: Secret Policies Depriving Sex Workers of Income and Community. https://titsandsass.com/shadowbans-secret-policies-depriving-sex-workers-of-income-and-community/

[35]

Eivind Flobak, Jo D Wake, Joakim Vindenes, Smiti Kahlon, Tine Nordgreen, and Frode Guribye. 2019. Participatory Design of VR Scenarios for Exposure Therapy. In Proc. CHI.

Digital Library

[36]

Christine Floyd, Wolf-Michael Mehl, Fanny-Michaela Resin, Gerhard Schmidt, and Gregor Wolf. 1989. Out Of Scandinavia: Alternative Approaches To Software Design And System Development. Human-Computer Interaction, Vol. 4, 4 (1989), 253--350.

Digital Library

[37]

Chris Fox. 2020. TikTok admits restricting some LGBT hashtags. BBC News (September 2020). https://www.bbc.com/news/technology-54102575

[38]

Sarah Fox, Mariam Asad, Katherine Lo, Jill P Dimond, Lynn S Dombrowski, and Shaowen Bardzell. 2016. Exploring Social Justice, Design, and HCI. In Proc. CHI Extended Abstracts.

Digital Library

[39]

Andrea Gasparini. 2015. Perspective and use of empathy in design thinking. In Proc. ACHI.

[40]

Cally Gatehouse, Matthew Wood, Jo Briggs, James Pickles, and Shaun Lawson. 2018. Troubling vulnerability: Designing with LGBT young people's ambivalence towards hate crime reporting. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.

Digital Library

[41]

Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.

[42]

G Anthony Gorry. 1973. Computer-Assisted Clinical Decision Making. Methods of Information in Medicine, Vol. 12, 1 (1973), 45.

[43]

Peter Leo Gorski, Yasemin Acar, Luigi Lo Iacono, and Sascha Fahl. 2020. Listen to Developers! A Participatory Design Study on Security Warnings for Cryptographic APIs. In Proc. CHI.

Digital Library

[44]

Mary L Gray. 2009. Out in the country: Youth, media, and queer visibility in rural America .NYU Press.

[45]

Rebecca Greenfield. 2012. Pinterest Has an Anorexia Problem Now. The Atlantic (March 2012). https://www.theatlantic.com/technology/archive/2012/03/pinterest-has-anorexia-problem-now-too/330315/

[46]

Jessica Guynn. 2017. Facebook apologizes to black activist who was censored for calling out racism. USA Today (August 2017). https://www.usatoday.com/story/tech/2017/08/03/facebook-ijeoma-oluo-hate-speech/537682001/

[47]

Oliver L Haimson, Avery Dame-Griff, Elias Capello, and Zahari Richter. 2019. Tumblr was a trans technology: the meaning, importance, history, and future of trans technologies. Feminist Media Studies (2019), 1--17.

[48]

Oliver L Haimson, Dykee Gorrell, Denny L Starks, and Zu Weinger. 2020. Designing trans technology: Defining challenges and envisioning community-centered solutions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.

Digital Library

[49]

Oliver L Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing" authentic" identity online: Facebook, real names, and non-normative identities. First Monday (2016).

[50]

Jean Hardy and Stefani Vargas. 2019. Participatory design and the future of rural LGBTQ communities. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion. 195--199.

Digital Library

[51]

Christina Harrington, Sheena Erete, and Anne Marie Piper. 2019. Deconstructing community-based collaborative design: Towards more equitable participatory design engagements. Proc. CSCW (2019).

Digital Library

[52]

Jaz Hee-jeong Choi, Laura Forlano, and Denisa Kera. 2020. Situated Automation: Algorithmic Creatures in Participatory Design. In Proc. Participatory Design Conference.

[53]

Ann Heylighen and Andy Dong. 2019. To empathise or not to empathise? Empathy and its limits in design. Design Studies (2019).

[54]

Tad Hirsch, Kritzia Merced, Shrikanth Narayanan, Zac E Imel, and David C Atkins. 2017. Designing Contestability: Interaction Design, Machine Learning, And Mental Health. In Proc. DIS. 95--99.

Digital Library

[55]

Vivian Ho. 2018. Tumblr's adult content ban dismays some users: 'It was a safe space'. https://www.theguardian.com/technology/2018/dec/03/tumblr-adult-content-ban-lgbt-community-gender?__s=abutgqgfq3qtwvi5gq42

[56]

Amanda Holpuch. 2015. Facebook still suspending Native Americans over `real name' policy. The Guardian (February 2015). https://www.theguardian.com/technology/2015/feb/16/facebook-real-name-policy-suspends-native-americans

[57]

Tracy Jan and Elizabeth Dwoskin. 2017. A white man called her kids the n-word. Facebook stopped her from sharing it. https://www.washingtonpost.com/business/economy/for-facebook-erasing-hate-speech-proves-a-daunting-challenge/2017/07/31/922d9bc6--6e3b-11e7--9c15--177740635e83_story.html The Washington Post.

[58]

Chantal Jandard. 2015. The “What Should I Design” Generator. http://www.whatshouldidesign.com/

[59]

Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2018. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proceedings of the ACM on Human-Computer Interaction, Vol. 2 (2018).

[60]

Michael Katell, Meg Young, Dharma Dailey, Bernease Herman, Vivian Guetler, Aaron Tam, Corinne Bintz, Daniella Raz, and PM Krafft. 2020. Toward Situated Interventions For Algorithmic Equity: Lessons From The Field. In Proc. FAT*.

Digital Library

[61]

Janet Kelly. 2019. Towards ethical principles for participatory design practice. CoDesign, Vol. 15, 4 (2019), 329--344.

[62]

Os Keyes, Josephine Hoy, and Margaret Drouhard. 2019. Human-Computer Insurrection: Notes on an Anarchist HCI. In Proc. CHI.

Digital Library

[63]

Sunyoung Kim, Muyang Li, Jennifer Senick, and Gediminas Mainelis. 2020. Designing To Engage Children In Monitoring Indoor Air Quality: A Participatory Approach. In Proc. Interaction Design and Children. 323--334.

Digital Library

[64]

Kate Klonick. 2017. The new governors: The people, rules, and processes governing online speech. Harvard Law Review, Vol. 131 (2017), 1598.

[65]

Daniel N Kluttz and Deirdre K Mulligan. 2019. Automated Decision Support Technologies And The Legal Profession. Berkeley Tech. Law Journal, Vol. 34 (2019), 853.

[66]

Jason Koebler and Joseph Cox. 2018. The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (August 2018). https://www.vice.com/en_us/article/xwk9zd/how-facebook-content-moderation-works

[67]

Dev Raj Lamichhane and Janet C Read. 2020. Play It My Way: Participatory Mobile Game Design with Children in Rural Nepal. In International Conference on Human-Computer Interaction. Springer, 325--336.

[68]

Kyle Langvardt. 2017. Regulating Online Content Moderation. Georgetown Law Journal, Vol. 106 (2017), 1353.

[69]

Iris Latour. 2020. The guide to mastering online brainstorming: 20 Brainstorming Techniques That Work. https://miro.com/guides/online-brainstorming/techniques-methods#20-crazy-eights

[70]

Min Kyung Lee and Su Baykal. 2017. Algorithmic Mediation in Group Decisions: Fairness Perceptions of Algorithmically Mediated vs. Discussion-Based Social Division. In Proc. CSCW. ACM. https://doi.org/10.1145/2998181.2998230

Digital Library

[71]

Min Kyung Lee, Anuraag Jain, Hea Jin Cha, Shashank Ojha, and Daniel Kusbit. 2019 a. Procedural justice in algorithmic fairness: Leveraging transparency and outcome control for fair algorithmic mediation. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--26.

Digital Library

[72]

Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019 b. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35.

[73]

Kimberly Leonard. 2015. Is Social Media Making Self-Harm Worse for Teens? US News (May 2015). https://www.usnews.com/news/articles/2015/05/29/is-social-media-making-self-harm-worse-for-teens

[74]

Sam Levin. 2017. As Facebook blocks the names of trans users and drag queens, this burlesque performer is fighting back. The Guardian (June 2017). https://www.theguardian.com/world/2017/jun/29/facebook-real-name-trans-drag-queen-dottie-lux

[75]

Karyne Levy. 2014. Facebook Apologizes For 'Real Name' Policy That Forced Drag Queens To Change Their Profiles. Business Insider (2014). https://www.businessinsider.com/facebook-apologizes-for-real-name-policy-2014--10

[76]

Q Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: informing design practices for explainable AI user experiences. In Proc. CHI.

Digital Library

[77]

Shannon Liao. 2019. After the porn ban, Tumblr users have ditched the platform as promised. The Verge. https://www.theverge.com/2019/3/14/18266013/tumblr-porn-ban-lost-users-down-traffic.

[78]

Dottie Lux and Little Miss Hot Mess. 2017. Facebook's Hate Speech Policies Censor Marginalized Users. Wired (August 2017). https://www.wired.com/story/facebooks-hate-speech-policies-censor-marginalized-users/

[79]

Amber Madison. 2015. When Social-Media Companies Censor Sex Education. https://www.theatlantic.com/health/archive/2015/03/when-social-media-censors-sex-education/385576/. The Atlantic.

[80]

Aaron Mak. 2018. Facebook content moderation rules: How company decides what to remove. https://slate.com/technology/2018/04/facebook-content-moderation-rules-how-company-decides-what-to-remove.html. Slate.

[81]

Ariadna Matamoros-Fernandez. 2017. Platformed racism: The mediation and circulation of an Australian race-based controversy on Twitter, Facebook and YouTube. Information, Communication & Society, Vol. 20, 6 (2017), 930--946.

[82]

J Matias, Amy Johnson, Whitney Erin Boesel, Brian Keegan, Jaclyn Friedman, and Charlie DeTar. 2015. Reporting, reviewing, and responding to harassment on Twitter. Available at SSRN 2602018 (2015).

[83]

Louise Matsakis and Paris Martineau. 2020. Coronavirus Disrupts Social Media's First Line of Defense. Wired. https://www.wired.com/story/coronavirus-social-media-automated-content-moderation/.

[84]

Michael J Muller and Allison Druin. 2012. Participatory Design: The Third Space In Human-Computer Interaction. In Human Computer Interaction Handbook. CRC Press, 1125--1153.

[85]

Deirdre K Mulligan, Daniel Kluttz, and Nitin Kohli. 2019. Shaping Our Tools: Contestability as a Means to Promote Responsible Algorithmic Decision Making in the Professions. Available at SSRN 3311894 (2019).

[86]

Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, Vol. 20, 11 (2018), 4366--4383.

[87]

David G Novick and Stephen Sutton. 1997. What is Mixed-Initiative Interaction. In Proc. AAAI Spring Symposium, Vol. 2. 12.

[88]

Frank A Pasquale. 2011. Restoring transparency to automated authority. Journal on Telecommunications and High Technology Law, (2011).

[89]

Delia Paunescu. 2019. Inside Instagram's nudity ban. (2019). https://www.vox.com/recode/2019/10/27/20932915/instagram-free-the-nipple-photo-facebook-nudity-ban-art-reset-podcast

[90]

Abby Phillip. 2015. Online 'authenticity' and how Facebook's 'real name' policy hurts Native Americans. The Washington Post (February 2015). https://www.washingtonpost.com/news/morning-mix/wp/2015/02/10/online-authenticity-and-how-facebooks-real-name-policy-hurts-native-americans/

[91]

Alisha Pradhan, Ben Jelen, Katie A Siek, Joel Chan, and Amanda Lazar. 2020. Understanding Older Adults' Participation in Design Workshops. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--15.

Digital Library

[92]

Ondvr ej Procházka. 2019. Making Sense of Facebook's Content Moderation: A Posthumanist Perspective on Communicative Competence and Internet Memes. Signs and Society, Vol. 7, 3 (2019), 362--397.

[93]

Adam Przeworski, Susan Carol Stokes Stokes, Susan C Stokes, and Bernard Manin. 1999. Democracy, accountability, and representation. Vol. 2. Cambridge University Press.

[94]

Anniek Bao Qian Tong and Flynn Murphy. 2020. Young Shopkeeper's Suicide After WeChat Ban Highlights App's Influence Over 1.2 Billion Lives. Caixin Global (August 2020). https://www.caixinglobal.com/2020-08--28/young-shopkeepers-suicide-after-wechat-ban-highlights-apps-influence-over-12-billion-lives-101598510.html

[95]

Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations as mechanisms for supporting algorithmic transparency. In Proc. CHI. ACM.

Digital Library

[96]

Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. Why should i trust you?: Explaining the predictions of any classifier. In Proc. KDD. ACM.

Digital Library

[97]

Jane Ritchie, Jane Lewis, Carol McNaughton Nicholls, Rachel Ormston, et al. 2013. Qualitative research practice: A guide for social science students and researchers. Sage.

[98]

Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work. In The Intersectional Internet: Race, Sex, Class and Culture Online, S. U. Noble and B. Tynes (Eds.). Peter Lang Publishing.

[99]

Sarah T Roberts. 2018. Digital detritus: `Error' and the logic of opacity in social media content moderation. First Monday, Vol. 23, 3 (2018).

[100]

Adi Robertson. 2019. TikTok prevented disabled users? videos from showing up in feeds. The Verge (2019). https://www.theverge.com/2019/12/2/20991843/tiktok-bytedance-platform-disabled-autism-lgbt-fat-user-algorithm-reach-limit

[101]

Aja Romano. 2018. Tumblr is banning adult content. It's about so much more than porn. Vox (2018).

[102]

Elizabeth B-N Sanders and Pieter Jan Stappers. 2012. Convivial Toolbox: Generative Research for the Front End of Design. BIS Publishers.

[103]

Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society (2019).

[104]

Claire Selvin. 2019. Betty Tompkins Ousted from Instagram for Posting Classic Painting of Penetration. https://www.artnews.com/art-news/news/betty-tompkins-expelled-from-instagram-12463/

[105]

Limor Shifman. 2014. Memes in digital culture. MIT press.

Digital Library

[106]

Edward Hance Shortliffe and Bruce G Buchanan. 1985. Rule-based Expert Systems: the MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley Publishing Company.

[107]

Ellen Silver. 2018. Hard Questions: Who Reviews Objectionable Content on Facebook? And Is the Company Doing Enough to Support Them? https://newsroom.fb.com/news/2018/07/hard-questions-content-reviewers/

[108]

Jesper Simonsen and Toni Robertson. 2012. Routledge International Handbook Of Participatory Design .Routledge.

[109]

Olivia Solon. 2017a. Facebook is hiring moderators. But is the job too gruesome to handle? https://www.theguardian.com/technology/2017/may/04/facebook-content-moderators-ptsd-psychological-dangers

[110]

Olivia Solon. 2017b. Underpaid and overburdened: the life of a Facebook moderator. The Guardian (May 2017). https://www.theguardian.com/news/2017/may/25/facebook-moderator-underpaid-overburdened-extreme-content

[111]

Olivia Solon. 2020. Facebook ignored racial bias research, employees say. NBC News (2020). https://www.nbcnews.com/tech/tech-news/facebook-management-ignored-internal-research-showing-racial-bias-current-former-n1234746

[112]

Kaitlyn Tiffany. 2017. Twitter criticized for suspending popular LGBTQ academic @meakoopa. The Verge (June 2017). https://www.theverge.com/2017/6/13/15794296/twitter-suspended-meakoopa-anthony-oliveira-controversy

[113]

Kaitlyn Tiffany. 2019. Tumblr's First Year Without Porn. The Atlantic (2019).

[114]

Alexandra To, Hillary Carey, Geoff Kaufman, and Jessica Hammer. 2021. Reducing Uncertainty and Offering Comfort: Designing Technology for Coping with Interpersonal Racism. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.

Digital Library

[115]

Kristen Vaccaro, Karrie Karahalios, Deirdre Mulligan, Daniel Kluttz, and Tad Hirsch. 2019. Contestability in Algorithmic Decision Making. In Proc. CSCW Workshops. ACM.

[116]

Kristen Vaccaro, Christian Sandvig, and Karrie Karahalios. 2020. “At the End of the Day Facebook Does What It Wants”: How Users Experience Contesting Algorithmic Content Moderation. In Proc. CSCW. ACM.

[117]

Maja Van der Velden, C Mörtberg, J Van den Hoven, PE Vermaas, and I Van de Poel. 2014. Participatory design and design for values. Development, Vol. 11, 3 (2014), 215--236.

[118]

Richmond Y. Wong, Deirdre K. Mulligan, Ellen Van Wyk, James Pierce, and John Chuang. 2017. Eliciting Values Reflections by Engaging Privacy Futures Using Design Workbooks. Proc. ACM HCI CSCW (2017). https://doi.org/10.1145/3134746

Digital Library

[119]

Allison Woodruff. 2019. 10 things you should know about algorithmic fairness. interactions, Vol. 26, 4 (2019), 47--51.

[120]

Peter Wright and John McCarthy. 2008. Empathy and experience in HCI. In Proc. CHI.

Digital Library

Cited By

Zhou EGuo SHong ZJensen CXiao YZhang DLiang JPei Q(2024)VeriDKG: A Verifiable SPARQL Query Engine for Decentralized Knowledge GraphsProceedings of the VLDB Endowment10.14778/3636218.363624217:4(912-925)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.14778/3636218.3636242
Baumer ETaylor ABrubaker JMcGee M(2024)Algorithmic SubjectivitiesACM Transactions on Computer-Human Interaction10.1145/3660344Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3660344
Ma RZhang ZGui XKou Y(2024)Labeling in the Dark: Exploring Content Creators’ and Consumers’ Experiences with Content Classification for Child Safety on YouTubeProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661565(1518-1532)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661565
Show More Cited By

Index Terms

Contestability For Content Moderation
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Social media
  2. Human computer interaction (HCI)

Recommendations

A Trade-off-centered Framework of Content Moderation
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it ...
Read More
Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas
CSCW2

Social media sites use content moderation to attempt to cultivate safe spaces with accurate information for their users. However, content moderation decisions may not be applied equally for all types of users, and may lead to disproportionate censorship ...
Read More
Content Moderation and the Formation of Online Communities: A Theoretical Framework
WWW '24: Proceedings of the ACM on Web Conference 2024

We study the impact of content moderation policies in online communities. In our theoretical model, a platform chooses a content moderation policy and individuals choose whether or not to participate in the community according to the fraction of user ...
Read More

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue CSCW2

CSCW2

October 2021

5376 pages

EISSN:2573-0142

DOI:10.1145/3493286

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 October 2021

Published in PACMHCI Volume 5, Issue CSCW2

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
3,970
Total Downloads

Downloads (Last 12 months)2,970
Downloads (Last 6 weeks)203

Other Metrics

View Author Metrics

Citations

Cited By

Zhou EGuo SHong ZJensen CXiao YZhang DLiang JPei Q(2024)VeriDKG: A Verifiable SPARQL Query Engine for Decentralized Knowledge GraphsProceedings of the VLDB Endowment10.14778/3636218.363624217:4(912-925)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.14778/3636218.3636242
Baumer ETaylor ABrubaker JMcGee M(2024)Algorithmic SubjectivitiesACM Transactions on Computer-Human Interaction10.1145/3660344Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3660344
Ma RZhang ZGui XKou Y(2024)Labeling in the Dark: Exploring Content Creators’ and Consumers’ Experiences with Content Classification for Child Safety on YouTubeProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661565(1518-1532)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661565
Rifat MAsha AJadon SYan XGuha SAhmed S(2024)Combating Islamophobia: Compromise, Community, and Harmony in Mitigating Harmful Online ContentACM Transactions on Social Computing10.1145/36415107:1(1-32)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3641510
Gao ZThebault-Spieker J(2024)Investigating Influential Users' Responses to Permanent Suspension on Social MediaProceedings of the ACM on Human-Computer Interaction10.1145/36373568:CSCW1(1-41)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637356
Pyle CZhang BHaimson OAndalibi N(2024)"I'm Constantly in This Dilemma": How Migrant Technology Professionals Perceive Social Media Recommendation AlgorithmsProceedings of the ACM on Human-Computer Interaction10.1145/36373428:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637342
Atreja SIm JResnick PHemphill L(2024)AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User AppealsProceedings of the ACM on Human-Computer Interaction10.1145/36372968:CSCW1(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637296
Mayworm SAlbert KHaimson O(2024)Misgendered During Moderation: How Transgender Bodies Make Visible Cisnormative Content Moderation Policies and Enforcement in a Meta Oversight Board CaseProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658907(301-312)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658907
Degachi CMehrotra SYurrita MNiforatos ETielman M(2024)Practising Appropriate Trust in Human-Centred AI DesignExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650825(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650825
Xue XLi XJia BDu JFu X(2024)Who Should Hold Control? Rethinking Empowerment in Home Automation among Cohabitants through the Lens of Co-DesignProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642866(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642866
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents