research-article

Conformity of Eating Disorders through Content Moderation

Authors:

Jessica L. Feuston,

Alex S. Taylor,

Anne Marie PiperAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 4, Issue CSCW1

Article No.: 40, Pages 1 - 28

https://doi.org/10.1145/3392845

Published: 29 May 2020 Publication History

Abstract

For individuals with mental illness, social media platforms are considered spaces for sharing and connection. However, not all expressions of mental illness are treated equally on these platforms. Different aggregates of human and technical control are used to report and ban content, accounts, and communities. Through two years of digital ethnography, including online observation and interviews, with people with eating disorders, we examine the experience of content moderation. We use a constructivist grounded theory approach to analysis that shows how practices of moderation across different platforms have particular consequences for members of marginalized groups, who are pressured to conform and compelled to resist. Above all, we argue that platform moderation is enmeshed with wider processes of conformity to specific versions of mental illness. Practices of moderation reassert certain bodies and experiences as 'normal' and valued, while rejecting others. At the same time, navigating and resisting these normative pressures further inscribes the marginal status of certain individuals. We discuss changes to the ways that platforms handle content related to eating disorders by drawing on the concept of multiplicity to inform design.

References

[1]

Nazanin Andalibi. 2019. What Happens After Disclosing Stigmatized Experiences on Identified Social Media: Individual, Dyadic, and Social/Network Outcomes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 137.

Digital Library

[2]

Nazanin Andalibi and Andrea Forte. 2018. Announcing pregnancy loss on Facebook: A decision-making framework for stigmatized disclosures on identified social network sites. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--14.

Digital Library

[3]

Nazanin Andalibi, Pinar Ozturk, and Andrea Forte. 2017. Sensitive Self-disclosures, Responses, and Social Support on Instagram: The Case of #Depression. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1485--1500. https://doi.org/10.1145/2998181.2998243

Digital Library

[4]

Monica Anderson, Skye Toor, Lee Rainie, and Aaron Smith. 2018. Activism in the Social Media Age. Pew Research Center (11 July 2018). https://www.pewinternet.org/2018/07/11/activism-in-the-social-media-age/

[5]

Natalya N Bazarova, Yoon Hyung Choi, Victoria Schwanda Sosik, Dan Cosley, and Janis Whitlock. 2015. Social sharing of emotions on Facebook: Channel differences, satisfaction, and replies. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. ACM, 154--164.

Digital Library

[6]

Rena Bivens. 2017. The gender binary will not be deprogrammed: Ten years of coding gender on Facebook. New Media & Society, Vol. 19, 6 (2017), 880--898.

[7]

Rena Bivens and Oliver L Haimson. 2016. Baking gender into social media design: How platforms shape categories for users and advertisers. Social Media+Society, Vol. 2, 4 (2016), 2056305116672486.

[8]

Lindsay Blackwell, Jill Dimond, Sarita Schoenebeck, and Cliff Lampe. 2017. Classification and Its Consequences for Online Harassment: Design Insights from HeartMob. Proc. ACM Hum.-Comput. Interact., Vol. 1, CSCW (Dec. 2017), 24:1--24:19. https://doi.org/10.1145/3134659

Digital Library

[9]

Leah Boepple and J Kevin Thompson. 2016. A content analytic comparison of fitspiration and thinspiration websites. International Journal of Eating Disorders, Vol. 49, 1 (2016), 98--101.

[10]

Dina L. G. Borzekowski, Summer Schenk, Jenny L. Wilson, and Rebecka Peebles. 2010. e-Ana and e-Mia: A Content Analysis of Pro-Eating Disorder Web Sites. American Journal of Public Health, Vol. 100, 8 (Aug. 2010), 1526--1534. https://doi.org/10.2105/AJPH.2009.172700

[11]

Leanne Bowler, Eleanor Mattern, Wei Jeng, Jung Sun Oh, and Daqing He. 2013. I know what you are going through: answers to informational questions about eating disorders in Yahoo! Answers: a qualitative study. In Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries. American Society for Information Science, 6.

[12]

Leanne Bowler, Jung Sun Oh, Daqing He, Eleanor Mattern, and Wei Jeng. 2012. Eating disorder questions in Yahoo! Answers: Information, conversation, or reflection? Proceedings of the American Society for Information Science and Technology, Vol. 49, 1 (2012), 1--11.

[13]

Danah Boyd. 2010. Social network sites as networked publics: Affordances, dynamics, and implications. In A networked self. Routledge, 47--66.

[14]

Danah Boyd. 2014. It's complicated: The social lives of networked teens .Yale University Press.

Digital Library

[15]

Rosi Braidotti. 2000. Teratologies. In Deleuze and Feminist Theory, Ian Buchanan and Claire Colebrook (Eds.). Edinburgh University Press, Edinburgh, 156--172. https://edinburghuniversitypress.com/book-deleuze-and-feminist-theory.html

[16]

Amy Bruckman. 2006. Teaching students to study online communities ethically. Journal of Information Ethics, Vol. 15, 2 (2006), 82.

[17]

Eleanor R. Burgess, Kathryn E. Ringland, Jennifer Nicholas, Ashley A. Knapp, Jordan Eschler, David C. Mohr, and Madhu C. Reddy. 2019. “I think people are powerful”: The sociality of individuals managing depression. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov 2019), 41:1--41:29. https://doi.org/10.1145/3359143

Digital Library

[18]

Judith Butler. 1993. Bodies That Matter: On the Discursive Limits of `Sex' .Routledge, New York.

[19]

Kellie E Carlyle, Jeanine PD Guidry, Kofoworola Williams, Ariella Tabaac, and Paul B Perrin. 2018. Suicide conversations on Instagram: contagion or caring? Journal of Communication in Healthcare, Vol. 11, 1 (2018), 12--18.

[20]

Patricia A Cavazos-Rehg, Melissa J Krauss, Shaina J Costello, Nina Kaiser, Elizabeth S Cahn, Ellen E Fitzsimmons-Craft, and Denise E Wilfley. 2019. “I just want to be skinny.”: A content analysis of tweets expressing eating disorder symptoms. PloS one, Vol. 14, 1 (2019), e0207506.

[21]

Stevie Chancellor, Andrea Hu, and Munmun De Choudhury. 2018. Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 666:1--666:14. https://doi.org/10.1145/3173574.3174240

Digital Library

[22]

Stevie Chancellor, Yannis Kalantidis, Jessica A. Pater, Munmun De Choudhury, and David A. Shamma. 2017. Multimodal Classification of Moderated Online Pro-Eating Disorder Content. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3213--3226. https://doi.org/10.1145/3025453.3025985

Digital Library

[23]

Stevie Chancellor, Zhiyuan (Jerry) Lin, and Munmun De Choudhury. 2016a. "This Post Will Just Get Taken Down": Characterizing Removed Pro-Eating Disorder Social Media Content. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1157--1162. https://doi.org/10.1145/2858036.2858248

Digital Library

[24]

Stevie Chancellor, Tanushree Mitra, and Munmun De Choudhury. 2016b. Recovery Amid Pro-Anorexia: Analysis of Recovery in Social Media. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2111--2123. https://doi.org/10.1145/2858036.2858246

Digital Library

[25]

Stevie Chancellor, Jessica Annette Pater, Trustin Clear, Eric Gilbert, and Munmun De Choudhury. 2016c. #Thyghgapp: Instagram Content Moderation and Lexical Variation in Pro-Eating Disorder Communities. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1201--1213. https://doi.org/10.1145/2818048.2819963

Digital Library

[26]

Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You can't stay here: The efficacy of reddit's 2015 ban examined through hate speech. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 31.

Digital Library

[27]

Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert. 2018. The Internet's Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 32:1--32:25. https://doi.org/10.1145/3274301

Digital Library

[28]

Jonathan P Chang and Cristian Danescu-Niculescu-Mizil. 2019. Trouble on the Horizon: Forecasting the Derailment of Online Conversations as they Develop. arXiv preprint arXiv:1909.01362 (2019).

[29]

Pamara F Chang and Natalya N Bazarova. 2016. Managing stigma: Disclosure-response communication patterns in pro-anorexic websites. Health Communication, Vol. 31, 2 (2016), 217--229.

[30]

Kathy Charmaz. 2014. Constructing Grounded Theory. SAGE.

[31]

Robert B Cialdini and Noah J Goldstein. 2004. Social influence: Compliance and conformity. Annu. Rev. Psychol., Vol. 55 (2004), 591--621.

[32]

Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society, Vol. 18, 3 (March 2016), 410--428. https://doi.org/10.1177/1461444814543163

[33]

Sky Croeser. 2016. Thinking Beyond `Free Speech' in Responding to Online Harassment. Ada: a journal of new media, gender, and culture, Vol. 10 (2016), online--online.

[34]

Munmun De Choudhury. 2015. Anorexia on Tumblr: A Characterization Study. In Proceedings of the 5th International Conference on Digital Health 2015 (DH '15). ACM, New York, NY, USA, 43--50. https://doi.org/10.1145/2750511.2750515

Digital Library

[35]

Tisha Dejmanee. 2013. Bodies of technology : performative flesh, pleasure and subversion in cyberspace. Gender Questions, Vol. 1, 1 (Jan. 2013), 3--17. https://journals.co.za/content/genderq/1/1/EJC167619

[36]

Michael A. DeVito, Ashley Marie Walker, and Jeremy Birnholtz. 2018. `Too Gay for Facebook': Presenting LGBTQ

[37]

Identity Throughout the Personal Social Media Ecosystem. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 44:1--44:23. https://doi.org/10.1145/3274313

Digital Library

[38]

Jill P Dimond, Michaelanne Dye, Daphne LaRose, and Amy S Bruckman. 2013. Hollaback!: the role of storytelling online in a social movement organization. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 477--490.

Digital Library

[39]

Bryan Dosono and Bryan Semaan. 2019. Moderation Practices as Emotional Labor in Sustaining Online Communities: The Case of AAPI Identity Work on Reddit. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 142.

Digital Library

[40]

Paul Dourish. 2006. Implications for design. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 541--550.

Digital Library

[41]

Maeve Duggan. 2017. Online harassment 2017. (2017).

[42]

Brianna Dym, Jed R Brubaker, Casey Fiesler, and Bryan Semaan. 2019. "Coming Out Okay": Community Narratives for LGBTQ Identity Recovery Work. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov. 2019), 29. https://doi.org/10.1145/3359256

Digital Library

[43]

Elizabeth V Eikey. 2016. Privacy and weight loss apps: a first look at how women with eating disorders use social features. In Proceedings of the 19th International Conference on Supporting Group Work. 413--415.

Digital Library

[44]

Elizabeth V Eikey and Kayla M Booth. 2017. Recovery and maintenance: how women with eating disorders use Instagram. iConference 2017 Proceedings (2017).

[45]

Elizabeth V Eikey and Madhu C Reddy. 2017. ?It's Definitely Been a Journey": A Qualitative Study on How Women with Eating Disorders Use Weight Loss Apps. In Proceedings of the 2017 CHI conference on human factors in computing systems. 642--654.

Digital Library

[46]

Elizabeth Victoria Eikey, Madhu C Reddy, Kayla M Booth, Lynette Kvasny, Johnna L Blair, Victor Li, and Erika S Poole. 2017. Desire to be underweight: Exploratory study on a weight loss app community and user perceptions of the impact on disordered eating behaviors. JMIR mHealth and uHealth, Vol. 5, 10 (2017), e150.

[47]

Jessica L. Feuston and Anne Marie Piper. 2018. Beyond the Coded Gaze: Analyzing Expression of Mental Health and Illness on Instagram. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 51:1--51:21. https://doi.org/10.1145/3274320

Digital Library

[48]

Jessica L. Feuston and Anne Marie Piper. 2019. Everyday Experiences: Small Stories and Mental Illness on Instagram. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 265:1--265:14. https://doi.org/10.1145/3290605.3300495 event-place: Glasgow, Scotland Uk.

Digital Library

[49]

Casey Fiesler, Michaelanne Dye, Jessica L Feuston, Chaya Hiruncharoenvate, Clayton J Hutto, Shannon Morrison, Parisa Khanipour Roshan, Umashanthi Pavalanathan, Amy S Bruckman, Munmun De Choudhury, et al. 2017. What (or who) is public?: Privacy settings and social media content sharing. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 567--580.

Digital Library

[50]

Casey Fiesler, Jialun "Aaron" Jiang, Joshua McCann, Kyle Frye, and Jed R. Brubaker. 2018. Reddit Rules! Characterizing an Ecosystem of Governance. In Twelfth International AAAI Conference on Web and Social Media. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17898

[51]

Casey Fiesler and Nicholas Proferes. 2018. “Participant” perceptions of Twitter research ethics. Social Media+Society, Vol. 4, 1 (2018), 2056305118763366.

[52]

Rachel A Fleming-May and Laura E Miller. 2010. I'm scared to look but I'm dying to know: information seeking and sharing on Pro-Ana weblogs. In Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem-Volume 47. American Society for Information Science, 61.

[53]

Michel Foucault. 2003. Madness and civilization .Routledge.

[54]

Michel Foucault. 2012. Discipline and punish: The birth of the prison .Vintage.

[55]

Arthur W. Frank. [n. d.]. The Wounded Storyteller. https://www.press.uchicago.edu/ucp/books/book/chicago/W/bo14674212.html

[56]

Mary Anne Franks. [n. d.]. The Free Speech Black Hole: Can The Internet Escape the Gravitational Pull of the First Amendment? Knight First Amendment Institute at Columbia University ([n. d.]). https://knightcolumbia.org/content/the-free-speech-black-hole-can-the-internet-escape-the-gravitational-pull-of-the-first-amendment

[57]

Christian Fuchs. 2013. Internet and Surveillance: The Challenges of Web 2.0 and Social Media. Routledge.

[58]

Ysabel Gerrard. 2018. Beyond the hashtag: Circumventing content moderation on social media. New Media & Society, Vol. 20, 12 (2018), 4492--4511.

[59]

Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media. Yale University Press.

[60]

Debbie Ging and Sarah Garvey. 2018. `Written in these scars are the stories I can't explain': A content analysis of pro-ana and thinspiration image sharing on Instagram. New Media & Society, Vol. 20, 3 (2018), 1181--1200.

[61]

Eric Goldman. 2010. Unregulating Online Harassment. Denver University Law Review Online, Vol. 57 (2010), 59.

[62]

Mary L Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass .Eamon Dolan Books, New York.

[63]

James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology (2015), 42--109. https://heinonline.org/HOL/P?h=hein.journals/yjolt17&i=42

[64]

Oliver L Haimson, Jed R Brubaker, Lynn Dombrowski, and Gillian R Hayes. 2015a. Disclosure, stress, and support during gender transition on Facebook. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1176--1190.

Digital Library

[65]

Oliver L Haimson, Jed R Brubaker, Lynn Dombrowski, and Gillian R Hayes. 2016. Digital footprints and changing networks during online identity transitions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2895--2907.

Digital Library

[66]

Oliver L Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing" authentic" identity online: Facebook, real names, and non-normative identities. First Monday, Vol. 21, 6 (2016).

[67]

Oliver L Haimson, Kathryn E Ringland, and Gillian R Hayes. 2015b. Marginalized populations and research ethics online. In CSCW Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World (CSCW Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World), Vol. 5.

[68]

Max Halupka. 2014. Clicktivism: A systematic heuristic. Policy & Internet, Vol. 6, 2 (2014), 115--132.

[69]

Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M Branham. 2018. Gender recognition or gender reductionism?: The social implications of embedded gender recognition systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 8.

Digital Library

[70]

Donna J Haraway. 2013. When species meet. Vol. 3. U of Minnesota Press.

[71]

Libby Hemphill and Andrew J Roback. 2014. Tweet acts: how constituents lobby congress via Twitter. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 1200--1210.

Digital Library

[72]

Dorothy Howard and Lilly Irani. 2019. Ways of Knowing When Research Subjects Care. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 97.

Digital Library

[73]

Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 611--620.

[74]

Grace YoungJoo Jeon, Nicole B Ellison, Bernie Hogan, and Christine Greenhow. 2016. First-generation students and college: The role of Facebook networks as information sources. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 887--899.

[75]

Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019 a. “Did You Suspect the Post Would be Removed?”: Understanding User Reactions to Content Removals on Reddit. ACM Trans. Comput.-Hum. Interact., Vol. 3, CSCW (Nov. 2019), 33. https://doi.org/10.1145/3359294

Digital Library

[76]

Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019 b. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact., Vol. 26, 5 (July 2019), 31:1--31:35. https://doi.org/10.1145/3338243

Digital Library

[77]

Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019 c. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. ACM Trans. Comput.-Hum. Interact., Vol. 3, CSCW (Nov. 2019), 27. https://doi.org/10.1145/3359252

Digital Library

[78]

Shagun Jhaver, Sucheta Ghoshal, Amy Bruckman, and Eric Gilbert. 2018. Online Harassment and Content Moderation: The Case of Blocklists. ACM Trans. Comput.-Hum. Interact., Vol. 2, CSCW (March 2018), 12:1--12:33. https://doi.org/10.1145/3185593

Digital Library

[79]

Jialun “Aaron” Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation Challenges in Voice-based Online Communities on Discord. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov. 2019), 23.

[80]

Adrienne S Juarascio, Amber Shoaib, and C Alix Timko. 2010. Pro-eating disorder communities on social networking sites: a content analysis. Eating disorders, Vol. 18, 5 (2010), 393--407.

[81]

Anna Keski-Rahkonen and Federica Tozzi. 2005. The process of recovery in eating disorder sufferers' own words: An Internet-based study. International Journal of Eating Disorders, Vol. 37, S1 (2005), S80--S86.

[82]

Charles Kiene, Jialun “Aaron” Jiang, and Benjamin Mako Hill. 2019. Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (Nov. 2019), 23.

[83]

Arthur Kleinman. 1989. The Illness Narratives: Suffering, Healing, And The Human Condition reprint edition ed.). Basic Books, New York.

[84]

Priya Kumar and Sarita Schoenebeck. 2015. The modern day baby book: Enacting good mothering and stewarding privacy on Facebook. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1302--1312.

Digital Library

[85]

Lakesha Lafayett. 2017. The Problematic Whitewashing of Eating Disorder Recovery. https://www.nationaleatingdisorders.org/blog/problematic-whitewashing-eating-disorder-recovery

[86]

Cliff Lampe and Paul Resnick. 2004. Slash(Dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 543--550. https://doi.org/10.1145/985692.985761 event-place: Vienna, Austria.

Digital Library

[87]

Cliff A.C. Lampe, Erik Johnston, and Paul Resnick. 2007. Follow the Reader: Filtering Comments on Slashdot. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1253--1262. https://doi.org/10.1145/1240624.1240815 event-place: San Jose, California, USA.

Digital Library

[88]

landoflobsters. 2019. Changes to Our Policy Against Bullying and Harassment. Reddit (30 September 2019). https://www.reddit.com/r/announcements/comments/dbf9nj/changes_to_our_policy_against_bullying_and/

[89]

Yu-Hao Lee and Gary Hsieh. 2013. Does slacktivism hurt activism?: the effects of moral balancing and consistency in online activism. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 811--820.

Digital Library

[90]

Brenda A LeFrancc ois, Robert Menzies, and Geoffrey Reaume. 2013. Mad matters: A critical reader in Canadian mad studies .Canadian Scholars' Press.

[91]

A Lenhart, M Ybarra, K Zickuhr, and M Price-Feeney. 2016. Online Harassment, Digital Abuse, and Cyberstalking in America. Data & Society Research Institute. Center for Innovative Public Health Research. Retrieved from: https://datasociety. net/pubs/oh/Online_Harassment_2016. pdf (2016).

[92]

Philip LeVine and Ron Scollon. 2004. Multimodal Discourse Analysis as the Confluence of Discourse and Technology. In Discourse and technology: Multimodal discourse analysis, Philip LeVine and Ron Scollon (Eds.). Georgetown University Press, 1--6.

[93]

Stephen P Lewis and Alexis E Arbuthnott. 2012. Searching for thinspiration: the nature of internet searches for pro-eating disorder websites. Cyberpsychology, Behavior, and Social Networking, Vol. 15, 4 (2012), 200--204.

[94]

Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI conference on human factors in computing systems. 557--566.

Digital Library

[95]

Jessa Lingel. 2019. The gentrification of the internet. http://culturedigitally.org/2019/03/the-gentrification-of-the-internet/

[96]

Deanna Linville, Tiffany Brown, Katrina Sturm, and Tori McDougal. 2012. Eating disorders and social support: perspectives of recovered individuals. Eating Disorders, Vol. 20, 3 (2012), 216--231.

[97]

Fannie Liu, Denae Ford, Chris Parnin, and Laura Dabbish. 2017. Selfies as social movements: Influences on participation and perceived impact on stereotypes. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 72.

Digital Library

[98]

James D. Livingston and Jennifer E. Boyd. 2010. Correlates and consequences of internalized stigma for people living with mental illness: A systematic review and meta-analysis. Social Science & Medicine, Vol. 71, 12 (Dec. 2010), 2150--2161. https://doi.org/10.1016/j.socscimed.2010.09.030

[99]

Helen Malson. 1999. Womæn under erasure: Anorexic bodies in postmodern context. Journal of community & applied social psychology, Vol. 9, 2 (1999), 137--153.

[100]

Ben Marder, Adam Joinson, Avi Shankar, and David Houghton. 2016. The extended `chilling' effect of Facebook: The cold reality of ubiquitous social networking. Computers in Human Behavior, Vol. 60 (2016), 582--592.

Digital Library

[101]

Aiden McGillicuddy, Jean-Gregoire Bernard, and Jocelyn Cranefield. 2016. Controlling Bad Behavior in Online Communities: An Examination of Moderation Work. ICIS 2016 Proceedings (Dec. 2016). https://aisel.aisnet.org/icis2016/SocialMedia/Presentations/23

[102]

Bharat Mehra, Cecelia Merkel, and Ann Peterson Bishop. 2004. The internet for empowerment of minority and marginalized users. New media & society, Vol. 6, 6 (2004), 781--802.

[103]

Kaitlynn Mendes, Jessica Ringrose, and Jessalynn Keller. 2018. #MeToo and the promise and pitfalls of challenging rape culture through digital feminist activism. European Journal of Women's Studies, Vol. 25, 2 (May 2018), 236--246. https://doi.org/10.1177/1350506818765318

[104]

Annemarie Mol. 2002. The body multiple: Ontology in medical practice .Duke University Press.

[105]

Dhiraj Murthy. 2008. Digital ethnography: An examination of the use of new technologies for social research. Sociology, Vol. 42, 5 (2008), 837--855.

[106]

Dhiraj Murthy. 2011. Emergent digital ethnographic methods for social research. Handbook of emergent technologies in social research (2011), 158--179.

[107]

Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, Vol. 20, 11 (Nov. 2018), 4366--4383. https://doi.org/10.1177/1461444818773059

[108]

Jung Sun Oh, Daqing He, Wei Jeng, Eleanor Mattern, and Leanne Bowler. 2013. Linguistic characteristics of eating disorder questions on Yahoo! Answers-content, style, and emotion. In Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries. American Society for Information Science, 87.

[109]

Kathleen O'Leary, Arpita Bhattacharya, Sean A Munson, Jacob O Wobbrock, and Wanda Pratt. 2017. Design opportunities for mental health peer support technologies. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1470--1484.

Digital Library

[110]

Alexandra Olteanu, Sarah Vieweg, and Carlos Castillo. 2015. What to expect when the unexpected happens: Social media communications across crises. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. ACM, 994--1009.

Digital Library

[111]

Onlinecensorship.org. 2019. Offline-Online. https://onlinecensorship.org/content/infographics Retrieved September 20, 2019.

[112]

John E Pachankis. 2007. The psychological implications of concealing a stigma: A cognitive-affective-behavioral model. Psychological bulletin, Vol. 133, 2 (2007), 328.

[113]

Jessica A. Pater, Oliver L. Haimson, Nazanin Andalibi, and Elizabeth D. Mynatt. 2016a. “Hunger Hurts but Starving Works”: Characterizing the Presentation of Eating Disorders Online. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1185--1200. https://doi.org/10.1145/2818048.2820030

Digital Library

[114]

Jessica A. Pater, Moon K. Kim, Elizabeth D. Mynatt, and Casey Fiesler. 2016b. Characterizations of Online Harassment: Comparing Policies Across Social Media Platforms. In Proceedings of the 19th International Conference on Supporting Group Work (GROUP '16). ACM, New York, NY, USA, 369--374. https://doi.org/10.1145/2957276.2957297 event-place: Sanibel Island, Florida, USA.

Digital Library

[115]

Jessica A. Pater, Lauren E. Reining, Andrew D. Miller, Tammy Toscos, and Elizabeth D. Mynatt. 2019. "Notjustgirls": Exploring Male-related Eating Disordered Content Across Social Media Platforms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 651:1--651:13. https://doi.org/10.1145/3290605.3300881 event-place: Glasgow, Scotland Uk.

Digital Library

[116]

Jon Penney. 2017. Internet surveillance, regulation, and chilling effects online: A comparative case study. Internet Policy Review (2017).

[117]

Shruti Phadke, Jonathan Lloyd, James Hawdon, Mattia Samory, and Tanushree Mitra. 2018. Framing Hate with Hate Frames: Designing the Codebook. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 201--204.

Digital Library

[118]

Sarah Pink, Heather A. Horst, John Postill, Larissa Hjorth, Tania Lewis, and Jo Tacchi. 2016. Digital ethnography: Principles and Practice .SAGE.

[119]

Radha Iyengar Plumb. 2019. An Independent Report on How We Measure Content Moderation. Facebook Newsroom (23 May 2019). https://newsroom.fb.com/news/2019/05/dtag-report/

[120]

Rebecca Puhl and Young Suh. 2015. Stigma and eating and weight disorders. Current psychiatry reports, Vol. 17, 3 (2015), 10.

[121]

Bryce J Renninger. 2015. “Where I can be myself... where I can speak my mind”: Networked counterpublics in a polymedia environment. New Media & Society, Vol. 17, 9 (2015), 1513--1529.

[122]

Sarah Roberts. 2016. Digital Refuse: Canadian Garbage, Commercial Content Moderation and the Global Circulation of Social Media's Waste. Wi: Journal of Mobile Media (Jan. 2016). https://ir.lib.uwo.ca/commpub/14

[123]

Sarah T Roberts. 2019. Behind the Screen: Content Moderation in the Shadows of Social Media .Yale University Press.

[124]

James P Roehrig and Carmen P McLean. 2010. A comparison of stigma toward eating disorders versus depression. International Journal of Eating Disorders, Vol. 43, 7 (2010), 671--674.

[125]

Nicolas Rüsch, Matthias C. Angermeyer, and Patrick W. Corrigan. 2005. Mental illness stigma: Concepts, consequences, and initiatives to reduce stigma. European Psychiatry, Vol. 20, 8 (Dec. 2005), 529--539. https://doi.org/10.1016/j.eurpsy.2005.04.004

[126]

Shruti Sannon, Elizabeth L. Murnane, Natalya N. Bazarova, and Geri Gay. 2019. "I Was Really, Really Nervous Posting It": Communicating About Invisible Chronic Illnesses Across Social Media Platforms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 353:1--353:13. https://doi.org/10.1145/3290605.3300583 event-place: Glasgow, Scotland Uk.

Digital Library

[127]

Morgan Klaus Scheuerman, Stacy M. Branham, and Foad Hamidi. 2018. Safe Spaces and Safe Places: Unpacking Technology-Mediated Experiences of Safety and Harm with Transgender People. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 155:1--155:27. https://doi.org/10.1145/3274424

Digital Library

[128]

Lynne Schrum. 1995. Framing the debate: Ethical research in the information age. Qualitative Inquiry, Vol. 1, 3 (1995), 311--326.

[129]

Andrew Scull. 2015. Madness in Civilization: A Cultural History of Insanity, from the Bible to Freud, from the Madhouse to Modern Medicine .Princeton University Press. 432 pages.

[130]

Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 111--125. https://doi.org/10.1145/2998181.2998277 event-place: Portland, Oregon, USA.

Digital Library

[131]

Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society, Vol. 21, 7 (July 2019), 1417--1443. https://doi.org/10.1177/1461444818821316

[132]

Leslie Regan Shade. 2003. Weborexics: The ethical issues surrounding pro-ana websites. (2003).

[133]

Heather Anne Swanson. 2018. Landscapes, by comparison. In The World Multiple: The Quotidian Politics of Knowing and Generating Entangled Worlds, Kei'ichi Omura, Grant Otsuki, Shiho Satsuka, and Atsuro Morita (Eds.). Routledge, Chapter 7.

[134]

Marika Tiggemann and Mia Zaccardo. 2018. `Strong is the new skinny': A content analysis of #fitspiration images on Instagram. Journal of health psychology, Vol. 23, 8 (2018), 1003--1011.

[135]

Walter Vandereycken and Ina Van Humbeeck. 2008. Denial and concealment of eating disorders: a retrospective survey. European Eating Disorders Review, Vol. 16, 2 (2008), 109--114. https://doi.org/10.1002/erv.857

[136]

Aditya Vashistha, Abhinav Garg, Richard Anderson, and Agha Ali Raza. 2019. Threats, Abuses, Flirting, and Blackmail: Gender Inequity in Social Media Voice Forums. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 72.

Digital Library

[137]

Jessica Vitak, Kalyani Chadha, Linda Steiner, and Zahra Ashktorab. 2017. Identifying Women's Experiences With and Strategies for Mitigating Negative Effects of Online Harassment. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1231--1245.

Digital Library

[138]

Tao Wang, Markus Brede, Antonella Ianni, and Emmanouil Mentzakis. 2017. Detecting and characterizing eating-disorder communities on social media. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. ACM, 91--100.

Digital Library

[139]

Donghee Yvette Wohn. 2019. Volunteer Moderators in Twitch Micro Communities: How They Get Involved, the Roles They Play, and the Emotional Labor They Experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 160.

Digital Library

[140]

David Wood. 2003. Foucault and panopticism revisited. Surveillance & Society, Vol. 1, 3 (2003), 234--239.

[141]

Diyi Yang, Zheng Yao, Joseph Seering, and Robert Kraut. 2019. The Channel Matters: Self-disclosure, Reciprocity and Social Support in Online Cancer Support Groups. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 31:1--31:15. https://doi.org/10.1145/3290605.3300261 event-place: Glasgow, Scotland Uk.

Digital Library

Cited By

Freeman GZytko DRazi ALampe CCandello HJakobi TAal K(2025)New Opportunities, Risks, and Harm of Generative AI for Fostering Safe Online CommunitiesThe 2025 ACM International Conference on Supporting Group Work10.1145/3688828.3700747(2-5)Online publication date: 12-Jan-2025
https://dl.acm.org/doi/10.1145/3688828.3700747
Marshall PBooth MCoole MFothergill LGlossop ZHaines JHarding AJohnston RJones SLodge CMachin KMeacock RNielson KPuddephatt JRakic TRayson PRobinson HRycroft-Malone JShryane NSwithenbank ZWise SLobban F(2024)Understanding the Impacts of Online Mental Health Peer Support Forums: Realist SynthesisJMIR Mental Health10.2196/5575011(e55750)Online publication date: 9-May-2024
https://doi.org/10.2196/55750
Lookingbill VLe K(2024)“There’s Always a Way to Get Around the Guidelines”: Nonsuicidal Self-Injury and Content Moderation on TikTokSocial Media + Society10.1177/2056305124125437110:2Online publication date: 17-May-2024
https://doi.org/10.1177/20563051241254371
Show More Cited By

Index Terms

Conformity of Eating Disorders through Content Moderation
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas
CSCW2

Social media sites use content moderation to attempt to cultivate safe spaces with accurate information for their users. However, content moderation decisions may not be applied equally for all types of users, and may lead to disproportionate censorship ...
"Do You Ladies Relate?": Experiences of Gender Diverse People in Online Eating Disorder Communities
CSCW

The study of eating disorders online has a long tradition within CSCW and HCI scholarship. Research within this body of work highlights the types of content people with eating disorders post as well as the ways in which individuals use online spaces for ...
A Trade-off-centered Framework of Content Moderation
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 4, Issue CSCW1

CSCW

May 2020

1285 pages

EISSN:2573-0142

DOI:10.1145/3403424

Editors:
Cliff Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Microsoft Research
,
Wolfgang Stuerzlinger
Simon Fraser University, Canada

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 May 2020

Published in PACMHCI Volume 4, Issue CSCW1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

60
Total Citations
View Citations
1,362
Total Downloads

Downloads (Last 12 months)244
Downloads (Last 6 weeks)26

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Freeman GZytko DRazi ALampe CCandello HJakobi TAal K(2025)New Opportunities, Risks, and Harm of Generative AI for Fostering Safe Online CommunitiesThe 2025 ACM International Conference on Supporting Group Work10.1145/3688828.3700747(2-5)Online publication date: 12-Jan-2025
https://dl.acm.org/doi/10.1145/3688828.3700747
Marshall PBooth MCoole MFothergill LGlossop ZHaines JHarding AJohnston RJones SLodge CMachin KMeacock RNielson KPuddephatt JRakic TRayson PRobinson HRycroft-Malone JShryane NSwithenbank ZWise SLobban F(2024)Understanding the Impacts of Online Mental Health Peer Support Forums: Realist SynthesisJMIR Mental Health10.2196/5575011(e55750)Online publication date: 9-May-2024
https://doi.org/10.2196/55750
Lookingbill VLe K(2024)“There’s Always a Way to Get Around the Guidelines”: Nonsuicidal Self-Injury and Content Moderation on TikTokSocial Media + Society10.1177/2056305124125437110:2Online publication date: 17-May-2024
https://doi.org/10.1177/20563051241254371
Nova FPfafman RLogan Delaney CPater J(2024)Unveiling the "Toxic" World of #Meanspo: Understanding Users' Emerging Online Eating Disorder Practices in X/TwitterProceedings of the ACM on Human-Computer Interaction10.1145/36870618:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687061
Seering JKhadka MHaghighi NYang TXi ZBernstein M(2024)Chillbot: Content Moderation in the BackchannelProceedings of the ACM on Human-Computer Interaction10.1145/36869418:CSCW2(1-26)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686941
Rifat MDas DPoddar AJannat MSoden RSemaan BAhmed S(2024)The Politics of Fear and the Experience of Bangladeshi Religious Minority Communities Using Social Media PlatformsProceedings of the ACM on Human-Computer Interaction10.1145/36869268:CSCW2(1-32)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686926
Ma RZhang ZGui XKou Y(2024)Labeling in the Dark: Exploring Content Creators’ and Consumers’ Experiences with Content Classification for Child Safety on YouTubeProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661565(1518-1532)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661565
Guluzade LSas C(2024)Functionality and User Review Analysis of Mobile Apps for Mindfulness Eating and Eating DisordersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661521(1350-1371)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661521
Delmonaco DMayworm SThach HGuberman JAugusta AHaimson O(2024)"What are you doing, TikTok?" : How Marginalized Social Media Users Perceive, Theorize, and "Prove" ShadowbanningProceedings of the ACM on Human-Computer Interaction10.1145/36374318:CSCW1(1-39)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637431
Mayworm SLi SThach HDelmonaco DPaneda CWegner AHaimson O(2024)The Online Identity Help Center: Designing and Developing a Content Moderation Policy Resource for Marginalized Social Media UsersProceedings of the ACM on Human-Computer Interaction10.1145/36374068:CSCW1(1-30)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637406
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents