Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

More Accounts, Fewer Links: How Algorithmic Curation Impacts Media Exposure in Twitter Timelines

Published: 22 April 2021 Publication History
  • Get Citation Alerts
  • Abstract

    Algorithmic timeline curation is now an integral part of Twitter's platform, affecting information exposure for more than 150 million daily active users. Despite its large-scale and high-stakes impact, especially during a public health emergency such as the COVID-19 pandemic, the exact effects of Twitter's curation algorithm generally remain unknown. In this work, we present a sock-puppet audit that aims to characterize the effects of algorithmic curation on source diversity and topic diversity in Twitter timelines. We created eight sock puppet accounts to emulate representative real-world users, selected through a large-scale network analysis. Then, for one month during early 2020, we collected the puppets' timelines twice per day. Broadly, our results show that algorithmic curation increases source diversity in terms of both Twitter accounts and external domains, even though it drastically decreases the number of external links in the timeline. In terms of topic diversity, algorithmic curation had a mixed effect, slightly amplifying a cluster of politically-focused tweets while squelching clusters of tweets focused on COVID-19 fatalities and health information. Finally, we present some evidence that the timeline algorithm may exacerbate partisan differences in exposure to different sources and topics. The paper concludes by discussing broader implications in the context of algorithmic gatekeeping.

    Supplementary Material

    ZIP File (v5cscw078aux.zip)
    Graphs for each individual puppet that correspond to the aggregate average graphs in the paper.

    References

    [1]
    Ashish Agarwal, Kartik Hosanagar, and Michael D. Smith. 2011. Location, location, location: An analysis of profitability of position in online advertising markets. Journal of Marketing Research, Vol. 48, 6 (dec 2011), 1057--1073. https://doi.org/10.1509/jmr.08.0468
    [2]
    American Press Institute. 2020. What is the purpose of journalism? https://www.americanpressinstitute.org/journalism-essentials/what-is-journalism/purpose-journalism/
    [3]
    Anne Marie Apanovitch, Danielle McCarthy, and Peter Salovey. 2003. Using message framing to motivate HIV testing among low-income, ethnic minority women. Health Psychology, Vol. 22, 1 (2003), 60--67. https://doi.org/10.1037/0278--6133.22.1.60
    [4]
    Adam Badawy, Kristina Lerman, and Emilio Ferrara. 2019. Who falls for online political manipulation?. In The Web Conference 2019 - Companion of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc, New York, New York, USA, 162--168. https://doi.org/10.1145/3308560.3316494
    [5]
    Ricardo Baeza-Yates. 2018. Bias on the web. Commun. ACM, Vol. 61, 6 (2018), 54--61. https://doi.org/10.1145/3209581
    [6]
    Ben H Bagdikian. 1983. The media monopoly. Boston.
    [7]
    Eytan Bakshy, Winter A. Mason, Jake M. Hofman, and Duncan J. Watts. 2011. Everyone's an influencer: Quantifying influence on twitter. In Proceedings of the 4th ACM International Conference on Web Search and Data Mining, WSDM 2011. 65--74. https://doi.org/10.1145/1935826.1935845
    [8]
    Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science, Vol. 348, 6239 (jun 2015), 1130--1132. https://doi.org/10.1126/science.aaa1160
    [9]
    Jack Bandy and Nicholas Diakopoulos. 2020. Auditing News Curation Systems: A Case Study Examining Algorithmic and Editorial Logic in Apple News. International conference on web and social media (ICWSM) (2020).
    [10]
    Anja Bechmann and Kristoffer L. Nielbo. 2018. Are We Exposed to the Same "News" in the News Feed?: An empirical analysis of filter bubbles as information similarity for Danish Facebook users. Digital Journalism, Vol. 6, 8 (2018), 990--1002. https://doi.org/10.1080/21670811.2018.1510741
    [11]
    Marianne Bertrand and Sendhil Mullainathan. 2003. Are Emily and Greg More Employable than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination. (2003). https://doi.org/10.2139/ssrn.422902
    [12]
    Vincent D Blondel, Jean Loup Guillaume, Renaud Lambiotte, and Etienne Lefebvre. 2008. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, Vol. 2008, 10 (oct 2008), P10008. https://doi.org/10.1088/1742-5468/2008/10/P10008
    [13]
    Engin Bozdag and Jeroen van den Hoven. 2015. Breaking the filter bubble: democracy and design. Ethics and Information Technology, Vol. 17, 4 (2015), 249--265. https://doi.org/10.1007/s10676-015-9380-y
    [14]
    Petter Bae Brandtzæg. 2010. Towards a unified Media-User Typology (MUT): A meta-analysis and review of the research literature on media-user typologies. Computers in Human Behavior, Vol. 26, 5 (sep 2010), 940--956. https://doi.org/10.1016/j.chb.2010.02.008
    [15]
    Axel Bruns. 2019 a. After the ?APIcalypse': social media platforms and their fight against critical scholarly research. Information Communication and Society, Vol. 22, 11 (2019), 1544--1566. https://doi.org/10.1080/1369118X.2019.1637447
    [16]
    Axel Bruns. 2019 b. Are Filter Bubbles Real? John Wiley & Sons.
    [17]
    Ceren Budak, Sharad Goel, and Justin M. Rao. 2016. Fair and balanced? Quantifying media bias through crowdsourced content analysis . Public Opinion Quarterly, Vol. 80, Specialissue1 (2016), 250--271. https://doi.org/10.1093/poq/nfw007
    [18]
    Meeyoung Cha, Hamed Haddadi, Fabrí cio Benevenuto, and Krishna P Gummadi. 2010. Measuring User Influence in Twitter: The Million Follower Fallacy. In ICWSM.
    [19]
    Samantha Cole. 2020. How to Take Your Twitter Feed Back From the Algorithm . https://www.vice.com/en_us/article/7kz9ez/go-into-2020-by-taking-your-twitter-feed-back-from-the-algorithms
    [20]
    Cé dric Courtois, Laura Slechten, and Lennert Coenen. 2018. Challenging Google Search filter bubbles in social and political information: Disconforming evidence from a digital methods case study. Telematics and Informatics, Vol. 35, 7 (oct 2018), 2006--2015. https://doi.org/10.1016/j.tele.2018.07.004
    [21]
    Dharma Dailey and Kate Starbird. 2014. Journalists as Crowdsourcerers: Responding to Crisis by Reporting with a Crowd . Computer Supported Cooperative Work: CSCW: An International Journal, Vol. 23, 4--6 (2014), 445--481. https://doi.org/10.1007/s10606-014-9208-z
    [22]
    Clayton Allen Davis, Onur Varol, Emilio Ferrara, Alessandro Flammini, and Filippo Menczer. 2016. BotOrNot. In Proceedings of the 25th International Conference Companion on World Wide Web - WWW '16 Companion. Association for Computing Machinery (ACM), New York, New York, USA, 273--274. https://doi.org/10.1145/2872518.2889302
    [23]
    Thorsten Joachims Dept, Computer Science, Laura Granka Google Inc, Helene Hembrooke Dept, Information Science, Filip Radlinski Dept, and Geri G A Y Dept. 2007. Evaluating the Accuracy of Implicit Feedback from Clicks and Query Reformulations in Web Search. ACM Transactions on Information Systems, Vol. 25, 2 (2007). https://dl.acm.org/doi/abs/10.1145/1229179.1229181
    [24]
    Michael A. DeVito. 2017. From Editors to Algorithms: A values-based approach to understanding story selection in the Facebook news feed. Digital Journalism, Vol. 5, 6 (jul 2017), 753--773. https://doi.org/10.1080/21670811.2016.1178592
    [25]
    Michael A. DeVito, Darren Gergle, and Jeremy Birnholtz. 2017. "Algorithms ruin everything". In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3025453.3025659
    [26]
    Nicholas Diakopoulos. 2019. Automating the News: How Algorithms Are Rewriting the Media. Harvard University Press.
    [27]
    Stuart Dredge. 2014. Yes, Twitter is putting tweets in your timeline from people you don't follow. https://www.theguardian.com/technology/2014/oct/17/twitter-tweets-timeline-dont-follow
    [28]
    Robert Entman. 1993. Framing - Toward Clarification of a Fractured Paradigm. Journal of Communication, Vol. 43, 4 (1993), 51--58. https://doi.org/10.1111/j.1460--2466.1993.tb01304.x
    [29]
    Motahhare Eslami, Amirhossein Aleyasen, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. FeedVis: A Path for Exploring News Feed Curation Algorithms. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing - CSCW'15 Companion. 65--68. https://doi.org/10.1145/2685553.2702690
    [30]
    Sean Fischer, Kokil Jaidka, and Yphtach Lelkes. 2020. Auditing local news presence on Google News . Nature Human Behaviour (sep 2020). https://doi.org/10.1038/s41562-020-00954-0
    [31]
    Richard Fletcher and Rasmus Kleis Nielsen. 2018. Are people incidentally exposed to news on social media? A comparative analysis . New Media and Society, Vol. 20, 7 (2018), 2450--2468. https://doi.org/10.1177/1461444817724170
    [32]
    Agence France-Presse. 2020. Twitter shares surge on millions new users. https://tribune.net.ph/index.php/2020/02/07/twitter-shares-surge-on-millions-new-users/
    [33]
    S Michael Gaddis. 2017. An Introduction to Audit Studies in the Social Sciences. Technical Report. www.auditstudies.com
    [34]
    Mary A. Gerend and Jon K. Maner. 2011. Fear, Anger, Fruits, and Veggies: Interactive Effects of Emotion and Message Framing on Health Behavior. Health Psychology, Vol. 30, 4 (jul 2011), 420--423. https://doi.org/10.1037/a0021981
    [35]
    Laura A. Granka, Thorsten Joachims, and Geri Gay. 2004. Eye-tracking analysis of user behavior in WWW search. In Proceedings of Sheffield SIGIR - Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, New York, New York, USA, 478--479. https://doi.org/10.1145/1008992.1009079
    [36]
    Nir Grinberg, Kenneth Joseph, Lisa Friedland, Briony Swire-Thompson, and David Lazer. 2019 a. Political science: Fake news on Twitter during the 2016 U.S. presidential election. Science, Vol. 363, 6425 (2019), 374--378. https://doi.org/10.1126/science.aau2706
    [37]
    Nir Grinberg, Kenneth Joseph, Lisa Friedland, Briony Swire-Thompson, and David Lazer. 2019 b. Supplementary Materials for Fake news on Twitter during the 2016 U.S. presidential election. Science, Vol. 363, 6425 (2019), 374--378. https://doi.org/10.1126/science.aau2706
    [38]
    Mario Haim, Andreas Graefe, and Hans Bernd Brosius. 2018. Burst of the Filter Bubble: Effects of personalization on the diversity of Google News. Digital Journalism, Vol. 6, 3 (2018), 330--343. https://doi.org/10.1080/21670811.2017.1338145
    [39]
    Anikó Hannák, Piotr Sapieżyński, Arash Molavi Khaki, David Lazer, Alan Mislove, and Christo Wilson. 2013. Measuring Personalization of Web Search. In Proceedings of the 22nd international conference on World Wide Web. ACM, 527--538. https://doi.org/10.1145/2488388.2488435
    [40]
    Natali Helberger. 2019. On the Democratic Role of News Recommenders. Digital Journalism, Vol. 7, 8 (sep 2019), 993--1012. https://doi.org/10.1080/21670811.2019.1623700
    [41]
    Natali Helberger, Kari Karppinen, and Lucia D'Acunto. 2018. Exposure diversity as a design principle for recommender systems. Information Communication and Society, Vol. 21, 2 (2018), 191--207. https://doi.org/10.1080/1369118X.2016.1271900
    [42]
    Alfred Hermida. 2010. Twittering the news: The emergence of ambient journalism. Journalism Practice, Vol. 4, 3 (2010), 297--308. https://doi.org/10.1080/17512781003640703
    [43]
    Matthew Hindman. 2011. Less of the same: The lack of local news on the Internet. Prepared for the FCC (2011).
    [44]
    Liangjie Hong and Brian D Davison. 2010. Empirical study of topic modeling in Twitter. In SOMA 2010 - Proceedings of the 1st Workshop on Social Media Analytics. 80--88. https://doi.org/10.1145/1964858.1964870
    [45]
    Desheng Hu, Ronald E Robertson, Shan Jiang, and Christo Wilson. 2019. Auditing the partisanship of Google search snippets. In The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. 693--704. https://doi.org/10.1145/3308558.3313654
    [46]
    Qiang Jipeng, Qian Zhenyu, Li Yun, Yuan Yunhao, and Wu Xindong. 2019. Short Text Topic Modeling Techniques, Applications, and Performance: A Survey. (apr 2019). arxiv: 1904.07695 http://arxiv.org/abs/1904.07695
    [47]
    Mark Jurkowitz and Amy Mitchell. 2020. A fifth of Democrats, Republicans get news only from outlets with like-minded audiences. https://www.journalism.org/2020/03/04/about-one-fifth-of-democrats-and-republicans-get-political-news-in-a-kind-of-media-bubble/
    [48]
    Mark Jurkowitz, Amy Mitchell, Elisa Shearer, and Mason Walker. 2020. U.S. Media Polarization and the 2020 Election: A Nation Devided. Technical Report. 67 pages. https://www.journalism.org/2020/01/24/americans-are-divided-by-party-in-the-sources-they-turn-to-for-political-news/
    [49]
    Marius Kaminskas and Derek Bridge. 2016. Diversity, Serendipity, Novelty, and Coverage. ACM Transactions on Interactive Intelligent Systems, Vol. 7, 1 (2016), 1--42. https://doi.org/10.1145/2926720
    [50]
    Jacob Kastrenakes. 2020. Twitter says AI tweet recommendations helped it add millions of users. https://www.theverge.com/2020/2/6/21125431/twitter-q4--2019-earnings-daily-user-growth-machine-learning
    [51]
    Nicolas Koumchatzky and Anton Andryeyev. 2017. Using Deep Learning at Scale in Twitter's Timelines. https://blog.twitter.com/engineering/en_us/topics/insights/2017/using-deep-learning-at-scale-in-twitters-timelines.html
    [52]
    Juhi Kulshrestha, Motahhare Eslami, Johnnatan Messias, Muhammad Bilal Zafar, Saptarshi Ghosh, Krishna P. Gummadi, and Karrie Karahalios. 2019. Search bias quantification: investigating political bias in social media and web search. Information Retrieval Journal, Vol. 22, 1--2 (apr 2019), 188--227. https://doi.org/10.1007/s10791-018-9341-2
    [53]
    Haewoon Kwak, Changhyun Lee, Hosung Park, and Sue Moon. 2010. What is Twitter, a Social Network or a News Media?. In Proceedings of the 19th international conference on World wide web. ACM, 591--600. http://bit.ly
    [54]
    David Lazer. 2020. Studying human attention on the Internet., 21--22 pages. https://doi.org/10.1073/pnas.1919348117
    [55]
    Huyen Le, Raven Maragh, Brian Ekdale, Andrew High, Timothy Havens, and Zubair Shafiq. 2019. Measuring Political Personalization of Google News Search. Association for Computing Machinery (ACM), 2957--2963. https://doi.org/10.1145/3308558.3313682
    [56]
    Jayeon Lee and Weiai Xu. 2018. The more attacks, the more retweets: Trump's and Clinton's agenda setting on Twitter. Public Relations Review, Vol. 44, 2 (jun 2018), 201--213. https://doi.org/10.1016/j.pubrev.2017.10.002
    [57]
    Nicholas Lé onard and Cibele Montez Halasz. 2018. Twitter meets TensorFlow. https://blog.twitter.com/engineering/en_us/topics/insights/2018/twittertensorflow.html
    [58]
    Chenliang Li, Haoran Wang, Zhiqian Zhang, Aixin Sun, and Zongyang Ma. 2016. Topic modeling for short texts with auxiliary word embeddings. In SIGIR 2016 - Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, Inc, New York, New York, USA, 165--174. https://doi.org/10.1145/2911451.2911499
    [59]
    Feng Lu, Anca Dumitrache, and David Graus. 2020. Beyond Optimizing for Clicks: Incorporating Editorial Values in News Recommendation. In UMAP. https://doi.org/10.1145/3340631.3394864 arxiv: 2004.09980
    [60]
    Ingrid Lunden. 2020. Twitter Q1: sales up 3% to $808M as it swings to a loss on COVID-19, mDAUS hit record 166M. https://techcrunch.com/2020/04/30/twitter-q1-sales-up-3-to-808m-as-it-swigs-to-a-loss-on-covid-19-mdaus-hit-record-166m/
    [61]
    Momin M. Malik and Jü rgen Pfeffer. 2016. A Macroscopic Analysis of News Content in Twitter. Digital Journalism, Vol. 4, 8 (nov 2016), 955--979. https://doi.org/10.1080/21670811.2015.1133249
    [62]
    Katerina Eva Matsa and Elisa Shearer. 2018. News Use Across Social Media Platforms | Pew Research Center. Technical Report. http://www.journalism.org/2018/09/10/news-use-across-social-media-platforms-2018/
    [63]
    Rishabh Mehrotra, Scott Sanner, Wray Buntine, and Lexing Xie. 2013. Improving LDA topic models for microblogs via tweet pooling and automatic labeling. In SIGIR 2013 - Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, New York, USA, 889--892. https://doi.org/10.1145/2484028.2484166
    [64]
    Danaë Metaxa, Joon Sung Park, James A Landay, and Jeff Hancock. 2019. Search media and elections: A longitudinal investigation of political search results in the 2018 U.S. Elections. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019). https://doi.org/10.1145/3359231
    [65]
    Amy Mitchell and J Baxter Oliphant. 2020. Americans Immersed in COVID-19 News; Most Think Media Are Doing Fairly Well Covering It. Technical Report. 1-4 pages. https://www.journalism.org/2020/03/18/americans-immersed-in-covid-19-news-most-think-media-are-doing-fairly-well-covering-it/
    [66]
    Tanushree Mitra and Eric Gilbert. 2015. CREDBANK: A large-scale social media corpus with associated credibility annotations. In Proceedings of the 9th International Conference on Web and Social Media, ICWSM 2015. 258--267. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM15/paper/viewPaper/10582
    [67]
    Judith Mö ller, Damian Trilling, Natali Helberger, and Bram van Es. 2018. Do not blame it on the algorithm: an empirical assessment of multiple recommender systems and their impact on content diversity. Information Communication and Society, Vol. 21, 7 (2018), 959--977. https://doi.org/10.1080/1369118X.2018.1444076
    [68]
    Philip M. Napoli. 2011. Exposure Diversity Reconsidered. Journal of Information Policy, Vol. 1, 4 (2011), 246--259. https://doi.org/10.5325/jinfopoli.1.2011.0246
    [69]
    Philip M. Napoli. 2015a. Social media and the public interest: Governance of news platforms in the realm of individual and algorithmic gatekeepers. Telecommunications Policy, Vol. 39, 9 (2015), 751--760. https://doi.org/10.1016/j.telpol.2014.12.003
    [70]
    Philip M. Napoli. 2015b. Social Media and the Public Interest: The Rise of Algorithmic News and the Future of the Marketplace of Ideas. Telecommunications Policy (2015).
    [71]
    Efrat Nechushtai and Seth C. Lewis. 2019. What kind of news gatekeepers do we want machines to be? Filter bubbles, fragmentation, and the normative dimensions of algorithmic recommendations. Computers in Human Behavior, Vol. 90 (jan 2019), 298--307. https://doi.org/10.1016/j.chb.2018.07.043
    [72]
    Claudia Orellana-Rodriguez and Mark T. Keane. 2018. Attention to news and its dissemination on Twitter: A survey. https://doi.org/10.1016/j.cosrev.2018.07.001
    [73]
    Eli Pariser. 2011. The filter bubble: how the new personalized Web is changing what we read and how we think. Penguin. https://doi.org/10.5860/CHOICE.50-0926
    [74]
    Marco Pennacchiotti and Ana-Maria Popescu. 2011. A Machine Learning Approach to Twitter User Classification. In Fifth international AAAI conference on weblogs and social media (ICWSM).
    [75]
    Chelsea Peterson-Salahuddin and Nicholas Diakopoulos. 2020. Negotiated autonomy: The role of social media algorithms in editorial decision making. Media and Communication, Vol. 8, 3 (jul 2020), 27--38. https://doi.org/10.17645/mac.v8i3.3001
    [76]
    Paul Resnick, R. Kelly Garrett, Travis Kriplean, Sean A Munson, and Natalie Jomini Stroud. 2013. Bursting Your (Filter) Bubble: Strategies for Promoting Diverse Exposure. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW (2013), 95--100.
    [77]
    Ronald E Robertson, Shan Jiang, Kenneth Joseph, Lisa Friedland, David Lazer, and Christo Wilson. 2018. Auditing partisan audience bias within Google search. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 22. https://doi.org/10.1145/3274417
    [78]
    Peter Salovey and Pamela Williams-Piehota. 2004. Field Experiments in Social Psychology: Message Framing and the Promotion of Health Protective Behaviors. In American Behavioral Scientist, Vol. 47. SAGE Publications, 488--505. https://doi.org/10.1177/0002764203259293
    [79]
    Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In Data and discrimination: converting critical concerns into productive inquiry. 1--23.
    [80]
    Michael. Schudson. 1995. The Power of News. Harvard University Press. 269 pages.
    [81]
    Limor Shifman. 2013. Memes in a digital world: Reconciling with a conceptual troublemaker. Journal of Computer-Mediated Communication, Vol. 18, 3 (2013), 362--377. https://doi.org/10.1111/jcc4.12013
    [82]
    Sprout Social. 2020. How the Twitter Algorithm Works in 2020. https://sproutsocial.com/insights/twitter-algorithm/
    [83]
    Kate Starbird. 2017. Examining the Alternative Media Ecosystem through the Production of Alternative Narratives of Mass Shooting Events on Twitter. ICWSM (2017).
    [84]
    Leo G. Stewart, Ahmer Arif, A. Conrad Nied, Emma S. Spiro, and Kate Starbird. 2017. Drawing the lines of contention: Networked frame contests within #BlackLivesMatter discourse. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (nov 2017), 1--23. https://doi.org/10.1145/3134920
    [85]
    Natalie Jomini Stroud. 2010. Polarization and partisan selective exposure. Journal of Communication, Vol. 60, 3 (aug 2010), 556--576. https://doi.org/10.1111/j.1460--2466.2010.01497.x
    [86]
    Didi Surian, Dat Quoc Nguyen, Georgina Kennedy, Mark Johnson, Enrico Coiera, and Adam G. Dunn. 2016. Characterizing twitter discussions about HPV vaccines using topic modeling and community detection. Journal of Medical Internet Research, Vol. 18, 8 (aug 2016), e232. https://doi.org/10.2196/jmir.6045
    [87]
    Daniel Trielli and Nicholas Diakopoulos. 2019. Search as News Curator: The Role of Google in Shaping Attention to News Information. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM.
    [88]
    Daniel Trielli and Nicholas Diakopoulos. 2020. Partisan search behavior and Google results in the 2018 U.S. midterm elections. Information, Communication & Society (may 2020), 1--17. https://doi.org/10.1080/1369118X.2020.1764605
    [89]
    Twitter. 2020 a. About your Twitter timeline. https://help.twitter.com/en/using-twitter/twitter-timeline
    [90]
    Twitter. 2020 b. Twitter moments: Guidelines and principles. https://help.twitter.com/en/rules-and-policies/twitter-moments-guidelines-and-principles https://about.twitter.com/company/moments-guidelines
    [91]
    Sebastián Valenzuela, Soledad Puente, and Pablo M. Flores. 2017. Comparing Disaster News on Twitter and Television: an Intermedia Agenda Setting Perspective. Journal of Broadcasting and Electronic Media, Vol. 61, 4 (2017), 615--637. https://doi.org/10.1080/08838151.2017.1344673
    [92]
    Nicholas Vincent, Isaac Johnson, Patrick Sheehan, and Brent Hecht. 2019. Measuring the Importance of User-Generated Content to Search Engines. In Proceedings of the International AAAI Conference on Web and Social Media (ICWSM).
    [93]
    Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science, Vol. 359, 6380 (mar 2018), 1146--1151. https://doi.org/10.1126/science.aap9559
    [94]
    David H. Weaver and Lars Willnat. 2016. Changes in U.S. Journalism: How do journalists think about social media? Journalism Practice, Vol. 10, 7 (oct 2016), 844--855. https://doi.org/10.1080/17512786.2016.1171162
    [95]
    James G Webster and Harsh Taneja. 2018. Building and interpreting audience networks: A response to mukerjee, majo-vazquez & gonzalez-bailon., E11--E14 pages. https://doi.org/10.1093/joc/jqy024
    [96]
    John Wihbey, Kenneth Joseph, and David Lazer. 2019. The social silos of journalism? Twitter, news media and partisan segregation. New Media and Society, Vol. 21, 4 (2019), 815--835. https://doi.org/10.1177/1461444818807133
    [97]
    Stefan Wojcik and Adam Hughes. 2019. Sizing Up Twitter Users. Pew Research Center (2019), 1--23.
    [98]
    Shaomei Wu, Jake M. Hofman, Winter A. Mason, and Duncan J. Watts. 2011. Who says what to whom on twitter. In Proceedings of the 20th International Conference on World Wide Web, WWW 2011. 705--714. https://doi.org/10.1145/1963405.1963504
    [99]
    Yan Yan and Wanjiang Zhang. 2020. Gossip at one's fingertips: Predictors of celebrity news on Twitter. Journalism, Vol. 21, 5 (may 2020). https://doi.org/10.1177/1464884918791349
    [100]
    Kai-Cheng Yang, Onur Varol, Pik-Mai Hui, and Filippo Menczer. 2020. Scalable and Generalizable Social Bot Detection through Data Selection. In Association for the Advancement of Artificial Intelligence (AAAI).
    [101]
    Jianhua Yin and Jianyong Wang. 2014. A Dirichlet multinomial mixture model-based approach for short text clustering. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery, New York, New York, USA, 233--242. https://doi.org/10.1145/2623330.2623715
    [102]
    Wayne Xin Zhao, Jing Jiang, Jianshu Weng, Jing He, Ee Peng Lim, Hongfei Yan, and Xiaoming Li. 2011. Comparing twitter and traditional media using topic models. In European conference on information retrieval. Springer. https://doi.org/10.1007/978-3-642-20161-5_34

    Cited By

    View all
    • (2024)Political Influencers and Their Social Media Audiences during the 2021 Arizona AuditSocius: Sociological Research for a Dynamic World10.1177/2378023124125968010Online publication date: 17-Jun-2024
    • (2024)Building Human Values into Recommender Systems: An Interdisciplinary SynthesisACM Transactions on Recommender Systems10.1145/36322972:3(1-57)Online publication date: 5-Jun-2024
    • (2024)Stemming the Tide of Problematic Information in Online Environments: Assessing Interventions and Identifying Opportunities for InterruptionCompanion Publication of the 16th ACM Web Science Conference10.1145/3630744.3658615(37-41)Online publication date: 21-May-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW1
    CSCW
    April 2021
    5016 pages
    EISSN:2573-0142
    DOI:10.1145/3460939
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 April 2021
    Published in PACMHCI Volume 5, Issue CSCW1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. algorithm auditing
    2. content ranking
    3. social media
    4. twitter

    Qualifiers

    • Research-article

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)451
    • Downloads (Last 6 weeks)58

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Political Influencers and Their Social Media Audiences during the 2021 Arizona AuditSocius: Sociological Research for a Dynamic World10.1177/2378023124125968010Online publication date: 17-Jun-2024
    • (2024)Building Human Values into Recommender Systems: An Interdisciplinary SynthesisACM Transactions on Recommender Systems10.1145/36322972:3(1-57)Online publication date: 5-Jun-2024
    • (2024)Stemming the Tide of Problematic Information in Online Environments: Assessing Interventions and Identifying Opportunities for InterruptionCompanion Publication of the 16th ACM Web Science Conference10.1145/3630744.3658615(37-41)Online publication date: 21-May-2024
    • (2024)8–10% of algorithmic recommendations are ‘bad’, but… an exploratory risk-utility meta-analysis and its regulatory implicationsInternational Journal of Information Management: The Journal for Information Professionals10.1016/j.ijinfomgt.2023.10274375:COnline publication date: 25-Jun-2024
    • (2024)Aligning agent-based testing (ABT) with the experimental research paradigm: a literature review and best practicesJournal of Computational Social Science10.1007/s42001-024-00283-6Online publication date: 16-May-2024
    • (2024)Skewed perspectives: examining the influence of engagement maximization on content diversity in social media feedsJournal of Computational Social Science10.1007/s42001-024-00255-w7:1(721-739)Online publication date: 20-Mar-2024
    • (2024)Algorithmic Amplification of Politics and Engagement Maximization on Social MediaComplex Networks & Their Applications XII10.1007/978-3-031-53503-1_11(131-142)Online publication date: 29-Feb-2024
    • (2024) What's in your PIE ? Understanding the contents of personalized information environments with PIEGraph Journal of the Association for Information Science and Technology10.1002/asi.24869Online publication date: 12-Jan-2024
    • (2023)Did COVID-19 Blur Partisan Boundaries? A Comparison of Partisan Affinity and Source Heterophily in Online Alternative News-Sharing Networks Before and During the COVID-19 PandemicSocial Media + Society10.1177/205630512311929639:3Online publication date: 26-Aug-2023
    • (2023)Evaluating Content Exposure Bias in Social NetworksProceedings of the 2023 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining10.1145/3625007.3627724(379-383)Online publication date: 6-Nov-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media