Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3614419.3644003acmconferencesArticle/Chapter ViewAbstractPublication PageswebsciConference Proceedingsconference-collections
research-article
Open access

Analysing the Effect of Recommendation Algorithms on the Spread of Misinformation

Published: 21 May 2024 Publication History

Abstract

Recommendation algorithms (RAs) have been pointed out as one of the major culprits of misinformation spreading in the digital sphere.1 However, it is still unclear how these algorithms propagate misinformation, e.g., which particular recommendation approaches are more prone to suggest misinforming items, or which internal parameters of the algorithms could be influencing more on their misinformation propagation capacity. Motivated by this fact, in this work, we present an analysis of the effect of some of the most popular recommendation algorithms on the spread of misinformation on Twitter (X). A set of guidelines on how to adapt these algorithms is provided based on such analysis and a comprehensive review of the research literature.

Supplemental Material

MP4 File - PaperSession-3_Misinformation & Moderation_einezln_Donnerstag_240605_MiriamFernandez
Analysing the Effect of Recommendation Algorithms on the Spread of Misinformation

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin. 2015. Context-Aware Recommender Systems. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, 191–226.
[2]
Esma Aïmeur, Sabrine Amri, and Gilles Brassard. 2023. Fake news, disinformation and misinformation in social media: a review. Social Network Analysis and Mining 13, 1 (2023), 30.
[3]
Fabio Aiolli. 2013. Efficient top-n recommendation for very large scale binary rated datasets. In Proceedings of RecSys. ACM, 273–280.
[4]
Hunt Allcott, Matthew Gentzkow, and Chuan Yu. 2019. Trends in the diffusion of misinformation on social media. Research & Politics 6, 2 (2019), 2053168019848554.
[5]
Xavier Amatriain and Justin Basilico. 2015. Recommender Systems in Industry: A Netflix Case Study. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, 385–419.
[6]
Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130–1132.
[7]
Alejandro Bellogín, Pablo Castells, and Iván Cantador. 2017. Statistical biases in Information Retrieval metrics for recommender systems. Information Retrieval Journal 20, 6 (2017), 606–634.
[8]
Chris Blex and Taha Yasseri. 2020. Positive algorithmic bias cannot stop fragmentation in homophilic networks. The Journal of Mathematical Sociology (2020), 1–18.
[9]
Leticia Bode and Emily K Vraga. 2015. In related news, that was wrong: The correction of misinformation through related stories functionality in social media. Journal of Communication 65, 4 (2015), 619–638.
[10]
Rocío Cañamares and Pablo Castells. 2018. Should I Follow the Crowd?: A Probabilistic Analysis of the Effectiveness of Popularity in Recommender Systems. In Proceedings of SIGIR. ACM, 415–424.
[11]
Pablo Castells, Neil J. Hurley, and Saul Vargas. 2015. Novelty and Diversity in Recommender Systems. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, 881–918.
[12]
Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In Proceedings of the 20th WWW. ACM, 675–684.
[13]
Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2013. Predicting information credibility in time-sensitive social media. Internet Research 23, 5 (2013), 560–588.
[14]
Jilin Chen, Gary Hsieh, Jalal U Mahmud, and Jeffrey Nichols. 2014. Understanding individuals’ personal values from social media word use. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 405–414.
[15]
Xinran Chen and Sei-Ching Joanna Sin. 2013. ‘Misinformation? What of it?’ Motivations and individual differences in misinformation sharing on social media. Proceedings of the ASIS&T 50, 1 (2013), 1–4.
[16]
Giovanni Luca Ciampaglia, Azadeh Nematzadeh, Filippo Menczer, and Alessandro Flammini. 2018. How algorithmic popularity bias hinders or promotes quality. Scientific Reports 8, 1 (2018), 1–7.
[17]
Gabriel de Souza Pereira Moreira, Dietmar Jannach, and Adilson Marques da Cunha. 2019. On the Importance of News Content Representation in Hybrid Neural Session-based Recommender Systems. In Proceedings of INRA(CEUR Workshop Proceedings, Vol. 2554). 18–23.
[18]
Michela Del Vicario, Alessandro Bessi, Fabiana Zollo, Fabio Petroni, Antonio Scala, Guido Caldarelli, H Eugene Stanley, and Walter Quattrociocchi. 2016. The spreading of misinformation online. Proceedings of the National Academy of Sciences 113, 3 (2016), 554–559.
[19]
Mehdi Elahi, Dietmar Jannach, Lars Skjærven, Erik Knudsen, Helle Sjøvaag, Kristian Tolonen, Øyvind Holmstad, Igor Pipkin, Eivind Throndsen, Agnes Stenbom, 2022. Towards responsible media recommendation. AI and Ethics (2022), 1–12.
[20]
Motahareh Eslamimehdiabadi, Aimee Rickman, Kristen Vaccaro, Christian Sandvig, Kevin Hamilton, and Karrie Karahalios. 2015. " I always assumed that I wasn’t really that close to [her]": Reasoning about invisible algorithms in the news feed. Proceedings of the 33rd CHI (2015).
[21]
Miriam Fernandez and Harith Alani. 2018. Online misinformation: Challenges and future directions. In Companion Proceedings of The Web Conference 2018. 595–602.
[22]
Miriam Fernandez and Alejandro Bellogín. 2020. Recommender Systems and Misinformation: The Problem or the Solution?. In Proceedings of the OHARS Workshop, co-located with RecSys 2020.
[23]
Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2016. The rise of social bots. Commun. ACM 59, 7 (2016), 96–104.
[24]
Leon Festinger. 1957. A theory of cognitive dissonance. Vol. 2. Stanford Univ. Press.
[25]
R Kelly Garrett, Erik C Nisbet, and Emily K Lynch. 2013. Undermining the corrective effects of media-based political fact checking? The role of contextual cues and naïve theory. Journal of Communication 63, 4 (2013), 617–637.
[26]
Andrew Guess, Jonathan Nagler, and Joshua Tucker. 2019. Less than you think: Prevalence and predictors of fake news dissemination on Facebook. Science Advances 5, 1 (2019).
[27]
Asela Gunawardana and Guy Shani. 2015. Evaluating Recommender Systems. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, 265–308.
[28]
Aditi Gupta, Ponnurangam Kumaraguru, Carlos Castillo, and Patrick Meier. 2014. Tweetcred: Real-time credibility assessment of content on twitter. In Proceedings of the SocInfo. Springer, 228–243.
[29]
Lars Kai Hansen, Adam Arvidsson, Finn Årup Nielsen, Elanor Colleoni, and Michael Etter. 2011. Good friends, bad news-affect and virality in twitter. In Future information technology. Springer, 34–43.
[30]
F. Maxwell Harper and Joseph A. Konstan. 2016. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst 5, 4 (2016), 19:1–19:19.
[31]
Taha Hassan. 2019. Trust and trustworthiness in social recommender systems. In Companion Proceedings of The 2019 World Wide Web Conference. 529–532.
[32]
Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative Filtering for Implicit Feedback Datasets. In Proceedings of ICDM. IEEE Computer Society, 263–272.
[33]
Marianne E Jaeger, Susan Anthony, and Ralph L Rosnow. 1980. Who hears what from whom and with what effect: A study of rumor. Personality and Social Psychology Bulletin 6, 3 (1980), 473–478.
[34]
Dietmar Jannach, Lukas Lerche, Iman Kamehkhosh, and Michael Jugovac. 2015. What recommenders recommend: an analysis of recommendation biases and possible countermeasures. User Modeling and User-Adapted Interaction 25, 5 (2015), 427–491.
[35]
Jennifer Jerit and Yangzi Zhao. 2020. Political Misinformation. Annual Review of Political Science 23, 1 (2020), 77–94. https://doi.org/10.1146/annurev-polisci-050718-032814
[36]
Mozhgan Karimi, Dietmar Jannach, and Michael Jugovac. 2018. News recommender systems - Survey and roads ahead. Information Processing Management 54, 6 (2018), 1203–1227.
[37]
Natascha A Karlova and Karen E Fisher. 2013. A social diffusion model of misinformation and disinformation for understanding human information behaviour. (2013).
[38]
Daniel Kluver and Joseph A. Konstan. 2014. Evaluating recommender behavior for new users. In Eighth ACM Conference on Recommender Systems, RecSys ’14, Foster City, Silicon Valley, CA, USA - October 06 - 10, 2014, Alfred Kobsa, Michelle X. Zhou, Martin Ester, and Yehuda Koren (Eds.). ACM, 121–128. https://doi.org/10.1145/2645710.2645742
[39]
Yehuda Koren and Robert M. Bell. 2015. Advances in Collaborative Filtering. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, 77–118.
[40]
David MJ Lazer, Matthew A Baum, Yochai Benkler, Adam J Berinsky, Kelly M Greenhill, Filippo Menczer, Miriam J Metzger, Brendan Nyhan, Gordon Pennycook, David Rothschild, 2018. The science of fake news. Science 359, 6380 (2018), 1094–1096.
[41]
Kyumin Lee, Prithivi Tamilarasan, and James Caverlee. 2013. Crowdturfers, Campaigns, and Social Media: Tracking and Revealing Crowdsourced Manipulation of Social Media. In Proceedings of the 7th ICWSM.
[42]
Joseph McGlynn, Maxim Baryshevtsev, and Zane A Dayton. 2020. Misinformation more likely to use non-specific authority references: Twitter analysis of two COVID-19 myths. Harvard Kennedy School Misinformation Review 1, 3 (2020).
[43]
Shahan Ali Memon and Kathleen M Carley. 2020. Characterizing covid-19 misinformation communities using a novel twitter dataset. arXiv preprint arXiv:2008.00791 (2020).
[44]
Martino Mensio and Harith Alani. 2019. MisinfoMe: Who’s Interacting with Misinformation? (2019).
[45]
Silvia Milano, Mariarosaria Taddeo, and Luciano Floridi. 2020. Recommender systems and their ethical challenges. AI & SOCIETY (2020), 1–11.
[46]
Scott Monteith, Tasha Glenn, John R. Geddes, Peter C. Whybrow, Eric Achtyes, and Michael Bauer. 2024. Artificial intelligence and increasing misinformation. The British Journal of Psychiatry 224, 2 (2024), 33–35. https://doi.org/10.1192/bjp.2023.136
[47]
Xiaoli Nan, Yuan Wang, and Kathryn Thier. 2022. Why people believe health misinformation and who are at risk? A systematic review of individual differences in susceptibility to health misinformation. Social Science & Medicine (2022), 115398.
[48]
Dimitar Nikolov, Diego FM Oliveira, Alessandro Flammini, and Filippo Menczer. 2015. Measuring online social bubbles. PeerJ computer science 1 (2015), e38.
[49]
Xia Ning, Christian Desrosiers, and George Karypis. 2015. A Comprehensive Survey of Neighborhood-Based Recommendation Methods. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, 37–76.
[50]
Brendan Nyhan and Jason Reifler. 2010. When corrections fail: The persistence of political misperceptions. Political Behavior 32, 2 (2010), 303–330.
[51]
John O’Donovan and Barry Smyth. 2005. Trust in recommender systems. In Proceedings of IUI. 167–174.
[52]
Eli Pariser. 2011. The filter bubble: What the Internet is hiding from you. Penguin UK.
[53]
Royal Pathak, Francesca Spezzano, and Maria Soledad Pera. 2023. Understanding the contribution of recommendation algorithms on misinformation recommendation and misinformation dissemination on social networks. ACM Transactions on the Web 17, 4 (2023), 1–26.
[54]
Lara SG Piccolo, Alisson Puska, Roberto Pereira, and Tracie Farrell. 2020. Pathway to a Human-Values Based Approach to Tackle Misinformation Online. In Proceedings of the 22nd HCI. Springer, 510–522.
[55]
Vahed Qazvinian, Emily Rosengren, Dragomir R Radev, and Qiaozhu Mei. 2011. Rumor has it: Identifying misinformation in microblogs. In Proceedings of the EMNLP. Association for Computational Linguistics, 1589–1599.
[56]
Xiaoyan Qiu, Diego FM Oliveira, Alireza Sahami Shirazi, Alessandro Flammini, and Filippo Menczer. 2017. Limited individual attention and online virality of low-quality information. Nature Human Behaviour 1, 7 (2017), 0132.
[57]
Daniele Quercia, Michal Kosinski, David Stillwell, and Jon Crowcroft. 2011. Our twitter profiles, our selves: Predicting personality with twitter. In 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing. IEEE, 180–185.
[58]
Jon Roozenbeek, Claudia R. Schneider, Sarah Dryhurst, John Kerr, Alexandra L. J. Freeman, Gabriel Recchia, Anne Marthe van der Bles, and Sander van der Linden. 2020. Susceptibility to misinformation about COVID-19 around the world. (2020).
[59]
Dorsaf Sallami, Rim Ben Salem, and Esma Aïmeur. 2023. Trust-based Recommender System for Fake News Mitigation. In Adjunct Proceedings of UMAP. 104–109.
[60]
Oguz Semerci, Alois Gruson, Catherinee Edwards, Ben Lacker, Clay Gibson, and Vladan Radosavljevic. 2019. Homepage personalization at Spotify. In Proceedings of the 13th ACM Conference on Recommender Systems, Toine Bogers, Alan Said, Peter Brusilovsky, and Domonkos Tikk (Eds.). ACM, 527.
[61]
Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Kai-Cheng Yang, Alessandro Flammini, and Filippo Menczer. 2018. The spread of low-credibility content by social bots. Nature communications 9, 1 (2018), 1–9.
[62]
Kai Shu, Deepak Mahudeswaran, Suhang Wang, Dongwon Lee, and Huan Liu. 2020. FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media. Big Data 8, 3 (2020), 171–188.
[63]
Emily Taylor, Lisa-Maria Neudert, Stacie Hoffmann, and Philip N Howard. 2020. Follow the Money: How the Online Advertising Ecosystem Funds COVID-19 Junk News and Disinformation.
[64]
Antonela Tommasel and Ira Assent. 2023. Recommendation fairness and where to find it: An empirical study on fairness of user recommender systems. In IEEE International Conference on Big Data, BigData 2023, Sorrento, Italy, December 15-18, 2023, Jingrui He, Themis Palpanas, Xiaohua Hu, Alfredo Cuzzocrea, Dejing Dou, Dominik Slezak, Wei Wang, Aleksandra Gruca, Jerry Chun-Wei Lin, and Rakesh Agrawal (Eds.). IEEE, 4195–4204. https://doi.org/10.1109/BIGDATA59044.2023.10386616
[65]
Antonela Tommasel and Filippo Menczer. 2022. Do Recommender Systems Make Social Media More Susceptible to Misinformation Spreaders?. In Proceedings of RecSys. 550–555.
[66]
Antonela Tommasel, Juan Manuel Rodriguez, and Daniela Godoy. 2021. I Want to Break Free! Recommending Friends from Outside the Echo Chamber. In Proceedings of RecSys. 23–33.
[67]
Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science 359, 6380 (2018), 1146–1151.
[68]
Emily K Vraga and Leticia Bode. 2020. Correction as a Solution for Health Misinformation on Social Media.
[69]
Claudia Wagner, Silvia Mitter, Christian Körner, and Markus Strohmaier. 2012. When social bots attack: Modeling susceptibility of users in online social networks. In Proceedings of the WWW’12 Workshop on ’Making Sense of Microposts’, Vol. 2. 1951–1959.
[70]
Shoujin Wang, Xiaofei Xu, Xiuzhen Zhang, Yan Wang, and Wenzhuo Song. 2022. Veracity-aware and event-driven personalized news recommendation for fake news mitigation. In Proceedings of the ACM Web Conference. 3673–3684.
[71]
Claire Wardle and Hossein Derakhshan. 2017. Information disorder: Toward an interdisciplinary framework for research and policy making. Council of Europe Report 27 (2017).
[72]
Liang Wu, Fred Morstatter, Kathleen M. Carley, and Huan Liu. 2019. Misinformation in Social Media: Definition, Manipulation, and Detection. SIGKDD Explor. 21, 2 (2019), 80–90.
[73]
Canwen Xu and Julian J. McAuley. 2023. A Survey on Dynamic Neural Networks for Natural Language Processing. In Findings of the ACL, Andreas Vlachos and Isabelle Augenstein (Eds.). Association for Computational Linguistics, 2325–2336.
[74]
Danni Xu, Shaojing Fan, and Mohan S. Kankanhalli. 2023. Combating Misinformation in the Era of Generative AI Models. In Proceedings of the 31st ACM International Conference on Multimedia, MM 2023, Ottawa, ON, Canada, 29 October 2023- 3 November 2023, Abdulmotaleb El-Saddik, Tao Mei, Rita Cucchiara, Marco Bertini, Diana Patricia Tobon Vallejo, Pradeep K. Atrey, and M. Shamim Hossain (Eds.). ACM, 9291–9298. https://doi.org/10.1145/3581783.3612704
[75]
Fattane Zarrinkalam, Mohsen Kahani, and Ebrahim Bagheri. 2018. Mining user interests over active topics on social networks. Inf. Process. Manag. 54, 2 (2018), 339–357.
[76]
Amy X Zhang, Aditya Ranganathan, Sarah Emlen Metz, Scott Appling, Connie Moon Sehat, Norman Gilmore, Nick B Adams, Emmanuel Vincent, Jennifer Lee, Martin Robbins, 2018. A structured response to misinformation: Defining and annotating credibility indicators in news articles. In Companion Proceedings of The Web Conference 2018. 603–612.
[77]
Xichen Zhang and Ali A. Ghorbani. 2020. An overview of online fake news: Characterization, detection, and discussion. Inf. Process. Manag. 57, 2 (2020), 102025.
[78]
Fan Zhou, Ruiyang Yin, Kunpeng Zhang, Goce Trajcevski, Ting Zhong, and Jin Wu. 2019. Adversarial Point-of-Interest Recommendation. In Proceedings of WWW. ACM, 3462–34618.
[79]
Bi Zhu, Chuansheng Chen, Elizabeth F Loftus, Chongde Lin, and Qinghua. He. 2010. Individual differences in false memory from misinformation: Personality characteristics and their interactions with cognitive abilities. Personality and Individual Differences 48, 8 (2010), 889–894.

Cited By

View all
  • (2024)Analyzing the Interplay between Diversity of News Recommendations and Misinformation Spread in Social MediaAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664870(80-85)Online publication date: 27-Jun-2024
  • (2024)Advancing Misinformation Awareness in Recommender Systems for Social Media Information IntegrityProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680259(5471-5474)Online publication date: 21-Oct-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WEBSCI '24: Proceedings of the 16th ACM Web Science Conference
May 2024
395 pages
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2024

Check for updates

Author Tags

  1. misinformation
  2. recommender systems
  3. social networks

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Data Availability

PaperSession-3_Misinformation & Moderation_einezln_Donnerstag_240605_MiriamFernandez: Analysing the Effect of Recommendation Algorithms on the Spread of Misinformation https://dl.acm.org/doi/10.1145/3614419.3644003#PaperSession-3_Misinformation & Moderation_einezln_Donnerstag_240605_MiriamFernandez.mp4

Funding Sources

  • Spanish Ministry of Science and Innovation
  • European Union

Conference

Websci '24
Sponsor:
Websci '24: 16th ACM Web Science Conference
May 21 - 24, 2024
Stuttgart, Germany

Acceptance Rates

Overall Acceptance Rate 245 of 933 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)669
  • Downloads (Last 6 weeks)165
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Analyzing the Interplay between Diversity of News Recommendations and Misinformation Spread in Social MediaAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664870(80-85)Online publication date: 27-Jun-2024
  • (2024)Advancing Misinformation Awareness in Recommender Systems for Social Media Information IntegrityProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680259(5471-5474)Online publication date: 21-Oct-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media