Just Accepted
Recommender System-Induced Eating Disorder Relapse: Harmful Content and the Challenges of Responsible Recommendation
Accepted on 11 June 2024
Abstract
As users’ social media feeds have become increasingly driven by algorithmically recommended content, there is a need to understand the impact these recommendations have on users. People in recovery from eating disorders (ED) may try to avoid content that features severely underweight bodies or that encourages disordered eating. However, if recommender systems show them this type of content anyway, it may impact their recovery or even lead to relapse. In this study, we take a two-pronged approach to understanding the intersection of recommender systems, eating disorder content, and users in recovery. We performed a content analysis of tweets about recommended eating disorder content and conducted a small-scale study on Pinterest to show that eating disorder content is recommended in response to interaction with posts about eating disorder recovery. We discuss the implications for responsible recommendation and harm prevention.
References
[1]
Mark Alfano, Amir Ebrahimi Fard, J Adam Carter, Peter Clutton, and Colin Klein. 2021. Technologically scaffolded atypical cognition: The case of YouTube’s recommender system. Synthese 199 (2021), 835–858.
[2]
Jon Arcelus, Alex J Mitchell, Jackie Wales, and Søren Nielsen. 2011. Mortality rates in patients with anorexia nervosa and other eating disorders: a meta-analysis of 36 studies. Archives of general psychiatry 68, 7 (2011), 724–731.
[3]
Fabrizio Bert, Maria Rosaria Gualano, Elisa Camussi, and Roberta Siliquini. 2016. Risks and threats of social media websites: twitter and the proana movement. Cyberpsychology, Behavior, and Social Networking 19, 4 (2016), 233–238.
[4]
Maximilian Boeker and Aleksandra Urman. 2022. An empirical investigation of personalization factors on TikTok. In Proceedings of the ACM web conference 2022. 2298–2309.
[5]
Patricia A Cavazos-Rehg, Ellen E Fitzsimmons-Craft, Melissa J Krauss, Nnenna Anako, Christine Xu, Erin Kasson, Shaina J Costello, and Denise E Wilfley. 2020. Examining the self-reported advantages and disadvantages of socially networking about body image and eating disorders. International Journal of Eating Disorders 53, 6 (2020), 852–863.
[6]
Patricia A Cavazos-Rehg, Melissa J Krauss, Shaina J Costello, Nina Kaiser, Elizabeth S Cahn, Ellen E Fitzsimmons-Craft, and Denise E Wilfley. 2019. “I just want to be skinny.”: A content analysis of tweets expressing eating disorder symptoms. PloS one 14, 1 (2019), e0207506.
[7]
Eric B Chesley, JD Alberts, JD Klein, and REb Kreipe. 2003. Pro or con? Anorexia nervosa and the Internet. Journal of Adolescent Health 32, 2 (2003), 123–124.
[8]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems. 191–198.
[9]
Kathleen Custers and Jan Van den Bulck. 2009. Viewership of pro-anorexia websites in seventh, ninth and eleventh graders. European Eating Disorders Review: The Professional Journal of the Eating Disorders Association 17, 3 (2009), 214–219.
[10]
Munmun De Choudhury. 2015. Anorexia on tumblr: A characterization study. In Proceedings of the 5th international conference on digital health 2015. 43–50.
[11]
EJ Dickson. 2020. Why Is TikTok Advertising Dangerous Fasting Diets to Teenage Girls? Rolling Stone (July 2020).
[12]
Jasmine Fardouly and Lenny R Vartanian. 2016. Social media and body image concerns: Current research and future directions. Current opinion in psychology 9 (2016), 1–5.
[13]
Miriam Fernandez and Alejandro Bellogín. 2020. Recommender systems and misinformation: the problem or the solution? (2020), 40–50.
[14]
Manfred Maximilian Fichter and Norbert Quadflieg. 2016. Mortality in eating disorders-results of a large prospective clinical longitudinal study. International Journal of Eating Disorders 49, 4 (2016), 391–401.
[15]
Debra L Franko, Aparna Keshaviah, Kamryn T Eddy, Meera Krishna, Martha C Davis, Pamela K Keel, and David B Herzog. 2013. A longitudinal investigation of mortality in anorexia nervosa and bulimia nervosa. American Journal of Psychiatry 170, 8 (2013), 917–925.
[16]
Richard J Freeman, Barbara Beach, Ron Davis, and Leslie Solyom. 1986. The prediction of relapse in bulimia nervosa. In Anorexia nervosa and bulimic disorders. Elsevier, 349–353.
[17]
Jannath Ghaznavi and Laramie D Taylor. 2015. Bones, body parts, and sex appeal: An analysis of# thinspiration images on popular social media. Body image 14 (2015), 54–61.
[18]
Martin Guha. 2014. Diagnostic and statistical manual of mental disorders: DSM-5. Emerald Group Publishing Limited.
[19]
Taha Hassan. 2019. Trust and trustworthiness in social recommender systems. In Companion proceedings of the 2019 world wide web conference. 529–532.
[20]
Muqaddas Jan, Sanobia Soomro, and Nawaz Ahmad. 2017. Impact of social media on self-esteem. European Scientific Journal 13, 23 (2017), 329–341.
[21]
C Jankowski. 2012. Associations between disordered eating, menstrual dysfunction, and musculoskeletal injury among high school athletes. Yearbook of Sports Medicine 394 (2012), 395.
[22]
Adrienne S Juarascio, Amber Shoaib, and C Alix Timko. 2010. Pro-eating disorder communities on social networking sites: a content analysis. Eating disorders 18, 5 (2010), 393–407.
[23]
Pamela K Keel, David J Dorer, Debra L Franko, Safia C Jackson, and David B Herzog. 2005. Postremission predictors of relapse in women with eating disorders. American Journal of Psychiatry 162, 12 (2005), 2263–2268.
[24]
Betul Keles, Niall McCrae, and Annmarie Grealish. 2020. A systematic review: the influence of social media on depression, anxiety and psychological distress in adolescents. International Journal of Adolescence and Youth 25, 1 (2020), 79–93.
[25]
Anna Keski-Rahkonen, Hans W Hoek, Ezra S Susser, Milla S Linna, Elina Sihvola, Anu Raevuori, Cynthia M Bulik, Jaakko Kaprio, and Aila Rissanen. 2007. Epidemiology and course of anorexia nervosa in the community. American Journal of Psychiatry 164, 8 (2007), 1259–1265.
[26]
Helvi Kyngäs. 2020. Inductive content analysis. The application of content analysis in nursing science research (2020), 13–21.
[27]
David C Liu, Stephanie Rogers, Raymond Shiau, Dmitry Kislyuk, Kevin C Ma, Zhigang Zhong, Jenny Liu, and Yushi Jing. 2017. Related pins at pinterest: The evolution of a real-world recommender system. In Proceedings of the 26th international conference on world wide web companion. 583–592.
[28]
Dimitar Nikolov, Mounia Lalmas, Alessandro Flammini, and Filippo Menczer. 2019. Quantifying biases in online information exposure. Journal of the Association for Information Science and Technology 70, 3 (2019), 218–229.
[29]
Mark L Norris, Katherine M Boydell, Leora Pinhas, and Debra K Katzman. 2006. Ana and the Internet: A review of pro-anorexia websites. International Journal of Eating Disorders 39, 6 (2006), 443–447.
[30]
Alyssa N Saiphoo and Zahra Vahedi. 2019. A meta-analytic review of the relationship between social media use and body image disturbance. Computers in human behavior 101 (2019), 259–275.
[31]
Margaret Sala, Ani Keshishian, Sarah Song, Rivka Moskowitz, Cynthia M Bulik, Corey R Roos, and Cheri A Levinson. 2023. Predictors of relapse in eating disorders: A meta-analysis. Journal of Psychiatric Research (2023).
[32]
Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Kai-Cheng Yang, Alessandro Flammini, and Filippo Menczer. 2018. The spread of low-credibility content by social bots. Nature communications 9, 1 (2018), 1–9.
[33]
Shaina J Sowles, Monique McLeary, Allison Optican, Elizabeth Cahn, Melissa J Krauss, Ellen E Fitzsimmons-Craft, Denise E Wilfley, and Patricia A Cavazos-Rehg. 2018. A content analysis of an online pro-eating disorder community on Reddit. Body image 24 (2018), 137–144.
[34]
Shabbir Syed-Abdul, Luis Fernandez-Luque, Wen-Shan Jian, Yu-Chuan Li, Steven Crain, Min-Huei Hsu, Yao-Chin Wang, Dorjsuren Khandregzen, Enkhzaya Chuluunbaatar, Phung Anh Nguyen, et al. 2013. Misleading health-related information promoted through video-based social media: anorexia on YouTube. Journal of medical Internet research 15, 2 (2013), e2237.
[35]
Melina A Throuvala, Mark D Griffiths, Mike Rennoldson, and Daria J Kuss. 2021. Perceived challenges and online harms from social media use on a severity continuum: a qualitative psychological stakeholder perspective. International journal of environmental research and public health 18, 6 (2021), 3227.
[36]
Laura Vandenbosch, Jasmine Fardouly, and Marika Tiggemann. 2022. Social media and body image: Recent trends and future directions. Current opinion in psychology 45 (2022), 101289.
[37]
Xue Xia, Neng Gu, Dhruvil Deven Badani, and Andrew Zhai. 2022. How Pinterest Leverages Realtime User Actions in Recommendation to Boost Homefeed Engagement Volume. Pinterest Engineering Blog (November 4 2022). https://medium.com/pinterest-engineering/how-pinterest-leverages-realtime-user-actions-in-recommendation-to-boost-homefeed-engagement-volume-165ae2e8cde8
[38]
Elad Yom-Tov, Luis Fernandez-Luque, Ingmar Weber, Steven P Crain, et al. 2012. Pro-anorexia and pro-recovery photo sharing: a tale of two warring tribes. Journal of medical Internet research 14, 6 (2012), e2239.
Index Terms
- Recommender System-Induced Eating Disorder Relapse: Harmful Content and the Challenges of Responsible Recommendation
Recommendations
New Recommendation Techniques for Multicriteria Rating Systems
Traditional single-rating recommender systems have been successful in a number of personalization applications, but the research area of multicriteria recommender systems has been largely untouched. Taking full advantage of multicriteria ratings in ...
A Scalable, Accurate Hybrid Recommender System
WKDD '10: Proceedings of the 2010 Third International Conference on Knowledge Discovery and Data MiningRecommender systems apply machine learning techniques for filtering unseen information and can predict whether a user would like a given resource. There are three main types of recommender systems: collaborative filtering, content-based filtering, and ...
A Clustering Approach for Personalizing Diversity in Collaborative Recommender Systems
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and PersonalizationMuch of the focus of recommender systems research has been on the accurate prediction of users' ratings for unseen items. Recent work has suggested that objectives such as diversity and novelty in recommendations are also important factors in the ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 Copyright held by the owner/author(s).
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Online AM: 05 July 2024
Accepted: 11 June 2024
Revised: 19 May 2024
Received: 29 June 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 66Total Downloads
- Downloads (Last 12 months)66
- Downloads (Last 6 weeks)66
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in