Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Bubbles bursting: : Investigating and measuring the personalisation of social media searches

Published: 01 August 2023 Publication History

Highlights

This study presents an open, extensible, and reproducible framework for investigating the implicit factors that affect personalisation in social media searches, which are not explicitly stated or visible to users, and measuring the extent of personalisation in the search results affected by these factors.
The results of a comprehensive set of experiments on Twitter carried out in this study suggest that the hypothesised factors of followees, cookies, and carry-over effect have limited impact on personalisation, with the exception of polarised topics, where the experiment revealed a notable one-sided bias in the search results.
The article presents a range of mitigation strategies to address the negative consequences of personalisation in social media search results, in line with existing research works. These include promoting greater transparency of algorithmic personlisation mechanisms for social media search results, empowering users to control the personalisation settings of their search results, encouraging healthy online search behaviours such as deliberately seeking diverse perspectives and regularly clearing internet cookies and social media search histories, and advocating for policymakers to develop policies to promote algorithmic awareness and protect user data privacy.

Abstract

Social media platforms implement personalisation algorithms to provide users with a tailored selection of posts under the assumption of a better experience. However, prior studies examining social media timelines revealed that, due to personalisation algorithms, social media users are more likely to encounter attitude-consistent content that reinforces their existing beliefs than information that contradicts them, creating filter bubbles and ultimately hampering their ability to make good decisions. To burst the bubbles, this paper proposes a framework for investigating and measuring the factors that affect personalisation in social media search mechanisms by controlling external noises that can mask the results and be misinterpreted as personalisation. Upon conducting a comprehensive set of experiments with Twitter as our study social media platform, we observed that users’ followees, cookies, and carry-over effect play a role in shaping personalised search results. While the extent of their influence is relatively limited, they can still lead to the introduction of biases, consequently affecting users’ opinions and judgements. In addition, the experiments also shed light on the fact that searches on polarised issues can lead to unwarranted one-sided inclinations in the results. Lastly, we argue in favour of alleviating the multifaceted societal and ethical consequences of algorithmic personalisation through encouraging users to develop healthy social media use habits and by urging social media platforms as well as policymakers to actively work towards fostering a more diverse and reliable online information ecosystem.

References

[1]
U. Reviglio, C. Agosti, Thinking outside the black-box: The case for “algorithmic sovereignty in social media, 6, Social Media+ Society, 2020, pp. 1–12.
[2]
E. Bozdag, Bias in algorithmic filtering and personalization, Ethics Inform. Technol. 15 (3) (2013) 209–227.
[3]
N. Bartley, A. Abeliuk, E. Ferrara, K. Lerman, Auditing algorithmic bias on twitter, in: 13th ACM Web Science Conference 2021, 2021, pp. 65–73.
[4]
K. Ansgar, V.E. Perez, W. Helena, P. Menisha, C. Sofia, J. Marina, M. Derek, Editorial responsibilities arising from personalization algorithms, ORBIT J. 1 (1) (2017) 1–12.
[5]
N. Perra, L.E. Rocha, Modelling opinion dynamics in the age of algorithmic personalisation, Sci. Rep. 9 (1) (2019) 1–11.
[6]
F. Zuiderveen Borgesius, D. Trilling, J. Möller, B. Bodó, C.H. De Vreese, N. Helberger, Should we worry about filter bubbles?, Internet Policy Review, J. Internet Regul. 5 (1) (2016) 1–16.
[7]
A. Bruns, Are filter bubbles real?, Polity Press, Cambridge, 2019.
[8]
G. Figà Talamanca, S. Arfini, Through the newsfeed glass: Rethinking filter bubbles and echo chambers, Philos. Technol. 35(1) (2022) 1–34.
[9]
E. Pariser, The filter bubble: What the Internet is hiding from you, Penguin Press, 2011.
[10]
S.S. Rehani, Social media personalization algorithms and the emergence of filter bubbles, iSChannel 15 (1) (2020) 20–24.
[11]
D.J. Ali, E. Eriyanto, Political polarization and selective exposure of social media users in indonesia, Jurnal Ilmu Sosial Dan Ilmu Politik 24 (3) (2021) 268–283.
[12]
S. Miller, P. Menard, D. Bourrie, S. Sittig, Integrating truth bias and elaboration likelihood to understand how political polarisation impacts disinformation engagement on social media, Inform. Syst. J. (2022) 1–38.
[13]
H. Holone, The filter bubble and its effect on online personal health information, Croat. Med. J. 57 (3) (2016) 298–301.
[14]
S.C. Rhodes, Filter bubbles, echo chambers, and fake news: how social media conditions individuals to be less critical of political misinformation, Polit. Commun. 39 (1) (2022) 1–22.
[15]
P. Garg, S.N. Singh, Multilayer perceptron optimization approaches for detecting spam on social media based on recursive feature elimination, in: B. Unhelker, H.M. Pandey, G. Raj (Eds.), Applications of Artificial Intelligence and Machine Learning, Springer Nature Singapore, Singapore, 2022, pp. 501–510.
[16]
J. Sun, J. Song, Y. Jiang, Y. Liu, J. Li, Prick the filter bubble: A novel cross domain recommendation model with adaptive diversity regularization, Electronic Markets 32 (1) (2022) 101–121.
[17]
N. Thurman, S. Schifferes, The future of personalization at news websites, Journal. Stud. 13 (5–6) (2012) 775–790.
[18]
A. Hannak, P. Sapiezynski, A. Molavi Kakhki, B. Krishnamurthy, D. Lazer, A. Mislove, C. Wilson, Measuring Personalization of Web Search, in: Proceedings of the 22nd International Conference on World Wide Web, WWW ’13, Association for Computing Machinery, New York, NY, USA, 2013, pp. 527–538. URL:
[19]
C. Kliman-Silver, A. Hannak, D. Lazer, C. Wilson, A. Mislove, Location, Location, Location: The Impact of Geolocation on Web Search Personalization, in: Proceedings of the 2015 Internet Measurement Conference, IMC ’15, Association for Computing Machinery, New York, NY, USA, 2015, pp. 121–127.
[20]
V. Cozza, V.T. Hoang, M. Petrocchi, A. Spognardi, Experimental measures of news personalization in Google News, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (2016) 93–104
[21]
E. Bakshy, S. Messing, L.A. Adamic, Exposure to ideologically diverse news and opinion on facebook, Science 348 (6239) (2015) 1130–1132.
[22]
C. Yang, B.P. Nunes, J.C. d. Santos, S.W.M. Siqueira, X. Xu, The biaschecker: How biased are social media searches?, in: Proceedings of the 2021 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM ’21, Association for Computing Machinery, New York, NY, USA, 2022, p. 305–308. URL:
[23]
J.C. dos Santos, S.W.M. Siqueira, B. Pereira Nunes, P.P. Balestrassi, F.R.S. Pereira, Is there personalization in twitter search? a study on polarized opinions about the brazilian welfare reform, in: 12th ACM Conference on Web Science, WebSci ’20, Association for Computing Machinery, New York, NY, USA, 2020, pp. 267–276,.
[24]
S. Nagulendra, J. Vassileva, Understanding and controlling the filter bubble through interactive visualization: a user study, in: Proceedings of the 25th ACM conference on Hypertext and social media, HT ’14, Association for Computing Machinery, New York, NY, USA, 2014, pp. 107–115. URL:
[25]
O. Shcherbakova, S. Nikiforchuk, Social media and filter bubbles, Sci. J. Polonia Univ. 54 (5) (2022) 81–88,.
[26]
R. Levy, Social media, news consumption, and polarization: Evidence from a field experiment, Am. Econ. Rev. 111 (3) (2021) 831–870.
[27]
J.J. Van Bavel, S. Rathje, E. Harris, C. Robertson, A. Sternisko, How social media shapes polarization, Trends Cognit. Sci. 25 (11) (2021) 913–916.
[28]
R. Gramigna, Inside facebook’s semiosphere. how social media influence digital hate and fuel cyber-polarization, Soc. Semiot. 32 (5) (2022) 606–633,.
[29]
J.P. Baptista, A. Gradim, “brave new world of fake news: How it works, Javnost-the public 28 (4) (2021) 426–443.
[30]
N.K. Agarwal, F. Alsaeedi, Creation, dissemination and mitigation: toward a disinformation behavior framework and model, Aslib J. Inform. Manage. 73 (5) (2021) 639–658.
[31]
C.H. Au, K.K. Ho, D.K. Chiu, The role of online misinformation and fake news in ideological polarization: barriers, catalysts, and implications, Inform. Syst. Front. (2021) 1–24.
[32]
J.A. Piazza, Fake news: The effects of social media disinformation on domestic terrorism, Dynamics of Asymmetric Conflict 15 (1) (2022) 55–77.
[33]
T. Lee, The global rise of “fake news and the threat to democratic elections in the usa, Public Administration and Policy 22 (1) (2019) 15–24.
[34]
D. Acemoglu, A. Ozdaglar, J. Siderius, A model of online misinformation, NBER Working Paper (2022) 1–42
[35]
A.K. Kar, S.N. Tripathi, N. Malik, S. Gupta, U. Sivarajah, How does misinformation and capricious opinions impact the supply chain-a study on the impacts during the pandemic, Ann. Oper. Res. (2022) 1–22.
[36]
E.J. Rader, Awareness of behavioral tracking and information privacy concern in facebook and google., in: SOUPS, Vol. 14, 2014, pp. 51–67.
[37]
A. Koene, E. Perez, C.J. Carter, R. Statache, S. Adolphs, C. O’Malley, T. Rodden, D. McAuley, Privacy concerns arising from internet service personalization filters, Acm Sigcas Computers and Society 45 (3) (2016) 167–171.
[38]
J. Golbeck, User privacy concerns with common data used in recommender systems, in: Social Informatics: 8th International Conference, SocInfo 2016, Bellevue, WA, USA, November 11–14, 2016, Proceedings, Part I 8, Springer, 2016, pp. 468–480.
[39]
A.-R. Jung, The influence of perceived ad relevance on social media advertising: An empirical examination of a mediating role of privacy concern, Comput. Human Behav. 70 (2017) 303–309.
[40]
S. Gambs, Privacy and ethical challenges in big data, in: Foundations and Practice of Security: 11th International Symposium, FPS 2018, Montreal, QC, Canada, November 13–15, 2018, Revised Selected Papers 11, Springer, 2019, pp. 17–26.
[41]
A. Kozyreva, P. Lorenz-Spreen, R. Hertwig, S. Lewandowsky, S.M. Herzog, Public attitudes towards algorithmic personalization and use of personal data online: Evidence from germany, great britain, and the united states, Human. Soc. Sci. Commun. 8 (1) (2021) 1–11.
[42]
E. Perez Vallejos, L. Dowthwaite, H. Creswich, V. Portillo, A. Koene, M. Jirotka, A. McCarthy, D. McAuley, The impact of algorithmic decision-making processes on young people’s well-being, Health Inform. J. 27 (1) (2021) 1–21.
[43]
D. Nikolov, D.F. Oliveira, A. Flammini, F. Menczer, Measuring online social bubbles, PeerJ Comput. Sci. 1 (2015) 1–14.
[44]
E. Hargreaves, C. Agosti, D. Menasché, G. Neglia, A. Reiffers-Masson, E. Altman, Biases in the Facebook News Feed: A Case Study on the Italian Elections, IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) 2018 (2018) 806–812,.
[45]
F. Huszár, S.I. Ktena, C. O’Brien, L. Belli, A. Schlaikjer, M. Hardt, Algorithmic amplification of politics on twitter, Proceedings of the National Academy of Sciences 119 (1) (2022) e2025334119.
[46]
J. Kulshrestha, M. Eslami, J. Messias, M.B. Zafar, S. Ghosh, K.P. Gummadi, K. Karahalios, Search bias quantification: investigating political bias in social media and web search, Inform. Retrieval J.1–2, SI 22 (2019) 188–227,.
[47]
R.E. Robertson, D. Lazer, C. Wilson, Auditing the personalization and composition of politically-related search engine results pages, in: Proceedings of the 2018 World Wide Web Conference, 2018, pp. 955–965.
[48]
C. Sandvig, K. Hamilton, K. Karahalios, C. Langbort, Auditing algorithms: Research methods for detecting discrimination on internet platforms, Data and discrimination: converting critical concerns into productive inquiry 22 (2014) (2014) 4349–4357.
[49]
J. Bandy, Problematic machine behavior: A systematic literature review of algorithm audits, Proceedings of the acm on human-computer interaction 5 (CSCW1) (2021) 1–34.
[50]
J. Bandy, N. Diakopoulos, More accounts, fewer links: How algorithmic curation impacts media exposure in twitter timelines, Proceedings of the ACM on Human-Computer Interaction 5 (CSCW1) (2021) 1–28.
[51]
R. Kohavi, R. Longbotham, D. Sommerfield, R.M. Henne, Controlled experiments on the web: survey and practical guide, Data Mining Knowl. Discovery 18 (2009) 140–181.
[52]
R. Kohavi, A. Deng, B. Frasca, R. Longbotham, T. Walker, Y. Xu, Trustworthy online controlled experiments: Five puzzling outcomes explained, in: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, 2012, pp. 786–794.
[53]
R. Kohavi, D. Tang, Y. Xu, Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing, Cambridge University Press, 2020, pp. 200–208. 10.1017/9781108653985.025 Ch. The A/A Test,.
[54]
E.T. Peterson, Web analytics demystified: a marketer’s guide to understanding how your web site affects your business, Bookrenter, 2004.
[55]
S. Salehi, J.T. Du, H. Ashman, Examining Personalization in Academic Web Search, in: Proceedings of the 26th ACM Conference on Hypertext & Social Media, HT ’15, Association for Computing Machinery, New York, NY, USA, 2015, pp. 103–111. URL:
[56]
H. Le, R. Maragh, B. Ekdale, A. High, T. Havens, Z. Shafiq, Measuring Political Personalization of Google News Search, in: The World Wide Web Conference, WWW ’19, Association for Computing Machinery, New York, NY, USA, 2019, pp. 2957–2963. doi: 10.1145/3308558.3313682.
[57]
B. Pan, H. Hembrooke, T. Joachims, L. Lorigo, G. Gay, L. Granka, In google we trust: Users’ decisions on rank, position, and relevance, J. Comput.-Mediated Commun. 12 (3) (2007) 801–823.
[58]
P. Jaccard, Distribution de la flore alpine dans le bassin des dranses et dans quelques régions voisines, Bulletin de la Societe Vaudoise des Sciences Naturelles 37 (1901) 241–272,.
[59]
V.I. Levenshtein, Binary codes capable of correcting deletions, insertions and reversals, Soviet Physics Doklady 10 (1966) 707–710.
[60]
M.G. Kendall, A new measure of rank correlation, Biometrika 30 (1–2) (1938) 81–93,. arXiv:https://academic.oup.com/biomet/article-pdf/30/1-2/81/423380/30-1-2-81.pdf.
[61]
K. Wang, Y. Zeng, F. Meng, L. Yang Feiyu, Comparison between calculation methods for semantic text similarity based on siamese networks, in: 2021 4th International Conference on Data Science and Information Technology, DSIT 2021, Association for Computing Machinery, New York, NY, USA, 2021, pp. 389–395. doi: 10.1145/3478905.3478981.
[62]
Y. Yang, D. Cer, A. Ahmad, M. Guo, J. Law, N. Constant, G.H. Abrego, S. Yuan, C. Tar, Y.-H. Sung, B. Strope, R. Kurzweil, Multilingual universal sentence encoder for semantic retrieval (2019). arXiv:1907.04307.
[63]
F. Feng, Y. Yang, D. Cer, N. Arivazhagan, W. Wang, Language-agnostic bert sentence embedding (2020). arXiv:2007.01852.
[64]
J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, Bert: Pre-training of deep bidirectional transformers for language understanding (2019). arXiv:1810.04805.
[65]
F. Rahutomo, T. Kitasuka, M. Aritsugi, Semantic cosine similarity, in: The 7th international student conference on advanced science and technology ICAST, Vol. 4, 2012, pp. 1–2.
[66]
S.M. Kosslyn, Graph Design for the Eye and Mind, Oxford University Press, 2006, Ch. Choosing a Graph Format, pp. 29–74.
[67]
M. Mani, S. Fei, Effective big data visualization, in: Proceedings of the 21st International Database Engineering & Applications Symposium, 2017, pp. 298–303.
[68]
J. In, S. Lee, Statistical data presentation, Korean J. Anesthesiol. 70 (3) (2017) 267–276.
[69]
J.M. Chambers, W.S. Cleveland, B. Kleiner, P.A. Tukey, Graphical Methods for Data Analysis, 1st Edition, Chapman and Hall/CRC, 2017, Ch. Portraying the Distribution of a Set of Data, pp. 9–46.
[70]
S.E. Asch, Forming impressions of personality., The, J. Abnorm. Soc. Psychol. 41 (3) (1946) 258–290.
[71]
R.M. Hogarth, H.J. Einhorn, Order effects in belief updating: The belief-adjustment model, Cognit. Psychol. 24 (1) (1992) 1–55.
[72]
J. Marquardson, M. Grimes, Supporting better decisions: How order effects influence decision support system alignment, Interact. Comput. 30 (6) (2018) 469–479.
[73]
R. Epstein, R.E. Robertson, The search engine manipulation effect (seme) and its possible impact on the outcomes of elections, Proceedings of the National Academy of Sciences 112 (33) (2015) E4512–E4521.
[74]
A. Novin, E. Meyers, Making sense of conflicting science information: Exploring bias in the search engine result page, in: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, CHIIR ’17, Association for Computing Machinery, New York, NY, USA, 2017, p. 175–184. URL:
[75]
E. Ulusoy, D. Carnahan, D.E. Bergan, R.C. Barry, S. Ma, S. Ahn, J. McGraw, Flooding the zone: How exposure to implausible statements shapes subsequent belief judgments, Int. J. Public Opin. Res. 33 (4) (2021) 856–872,.
[76]
E. Bozdag, J. Van Den Hoven, Breaking the filter bubble: democracy and design, Ethics Inform. Technol. 17 (4) (2015) 249–265.
[77]
J. Swart, Experiencing algorithms: How young people understand, feel about, and engage with algorithmic news selection on social media, Social Media+ Society 7 (2) (2021) 1–11.
[78]
European Parliament and Council of the European Union, EU General Data Protection Regulation (GDPR), Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), Official Journal of the European Union, L 119/1 (2016). URL: https://commission.europa.eu/law/law-topic/data-protection_en.
[79]
Presidency of the Republic, Brazilian General Data Protection Law (LGPD), Law n 13.709, Secretaria-Geral (2018). URL: http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2018/lei/L13709compilado.htm.
[80]
Parliament of United Kingdom, Data Protection Act 2018 (DPA), Government UK (2018). URL: https://www.gov.uk/government/collections/data-protection-act-2018.
[81]
Office of the Privacy Commissioner, The Personal Information Protection and Electronic Documents Act (PIPEDA), S.C. 2000, c. 5 (2000). URL: https://www.priv.gc.ca/en/privacy-topics/privacy-laws-in-canada/the-personal-information-protection-and-electronic-documents-act-pipeda/.
[82]
Office of the Australian Information Commissioner, Australian Privacy Principles (APPs), Office of the Australian Information Commissioner (2014). URL: https://www.oaic.gov.au/privacy/australian-privacy-principles.
[83]
R. Buyle, R. Taelman, K. Mostaert, G. Joris, E. Mannens, R. Verborgh, T. Berners-Lee, Streamlining governmental processes by putting citizens in control of their personal data, in: Electronic Governance and Open Society: Challenges in Eurasia: 6th International Conference, EGOSE 2019, St. Petersburg, Russia, November 13–14, 2019, Proceedings 6, Springer, 2020, pp. 346–359.
[84]
C. Aguilera-Carnerero, A.H. Azeez, ‘islamonausea, not islamophobia’: The many faces of cyber hate speech, J. Arab & Muslim Media Res. 9 (1) (2016) 21–40.
[85]
M. Li, Z. Luo, The ‘bad women drivers’ myth: The overrepresentation of female drivers and gender bias in china’s media, Inform., Commun. Soc. 23 (5) (2020) 776–793.
[86]
T.T. Nguyen, D. Huang, E.K. Michaels, M.M. Glymour, A.M. Allen, Q.C. Nguyen, Evaluating associations between area-level twitter-expressed negative racial sentiment, hate crimes, and residents’ racial prejudice in the united states, SSM-population Health 13 (2021),.
[87]
H. Cho, W. Li, J. Cannon, R. Lopez, C. Song, Testing three explanations for stigmatization of people of asian descent during covid-19: maladaptive coping, biased media use, or racial prejudice?, Ethnicity Health 26 (1) (2021) 94–109.
[88]
M.I. Rashid, M.M. Iqbal, M. Tanvir, Islamophobia: Causes and countermeasures, Asian J. Comparat. Politics (2023) 20578911231156277.
[89]
A.K. Kar, Y.K. Dwivedi, Theory building with big data-driven research–moving away from the “what towards the “why, Int. J. Inf. Manage. 54 (2020),.
[90]
R. Aswani, A.K. Kar, P.V. Ilavarasan, Experience: managing misinformation in social media–insights for policymakers from twitter analytics, J. Data Inform. Qual. (JDIQ) 12 (1) (2019) 1–18,.
[91]
F. Sharevski, A. Huff, P. Jachim, E. Pieroni, (mis) perceptions and engagement on twitter: Covid-19 vaccine rumors on efficacy and mass immunization effort, Int. J. Inform. Manage. Data Insights 2 (1) (2022).
[92]
W. Ansar, S. Goswami, Combating the menace: A survey on characterization and detection of fake news from a data science perspective, Int. J. Inform. Manage. Data Insights 1 (2) (2021).
[93]
A.K. Kar, R. Aswani, How to differentiate propagators of information and misinformation–insights from social media analytics based on bio-inspired computing, J. Inform. Optimiz. Sci. 42 (6) (2021) 1307–1335,.
[94]
L. Schelenz, A. Segal, K. Gal, Best practices for transparency in machinegenerated personalization, in: Adjunct Publication of the 28th ACMConference on User Modeling, Adaptation and Personalization, UMAP’20 Adjunct, Association for Computing Machinery, New York, NY,USA, 2020, p. 23–28.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Telematics and Informatics
Telematics and Informatics  Volume 82, Issue C
Aug 2023
162 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 August 2023

Author Tags

  1. Social media
  2. Search mechanism
  3. Personalisation algorithms
  4. Filter bubble

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 02 Sep 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media