Cited By
View all- Yang PColavizza G(2024)Polarization and reliability of news sources in WikipediaOnline Information Review10.1108/OIR-02-2023-008448:5(908-925)Online publication date: 18-Jan-2024
A Comparative Study of Reference Reliability in Multiple Language Editions of Wikipedia
Authors: 
Aitolkyn Baigutanova, 
Diego Saez-Trumper, Miriam Redi, Meeyoung Cha, Pablo AragónAuthors Info & Claims
Aitolkyn Baigutanova, Diego Saez-Trumper, Miriam Redi, Meeyoung Cha, Pablo AragónAuthors Info & ClaimsPages 3743 - 3747
Abstract
Information presented in Wikipedia articles must be attributable to reliable published sources in the form of references. This study examines over 5 million Wikipedia articles to assess the reliability of references in multiple language editions. We quantify the cross-lingual patterns of the perennial sources list, a collection of reliability labels for web domains identified and collaboratively agreed upon by Wikipedia editors. We discover that some sources (or web domains) deemed untrustworthy in one language (i.e., English) continue to appear in articles in other languages. This trend is especially evident with sources tailored for smaller communities. Furthermore, non-authoritative sources found in the English version of a page tend to persist in other language versions of that page. We finally present a case study on the Chinese, Russian, and Swedish Wikipedias to demonstrate a discrepancy in reference reliability across cultures. Our finding highlights future challenges in coordinating global knowledge on source reliability.
References
[1]
Pablo Aragón and Diego Sáez-Trumper. 2021. A preliminary approach to knowledge integrity risk assessment in Wikipedia projects. arXiv preprint arXiv:2106.15940 (2021).
[2]
Aitolkyn Baigutanova, Jaehyeon Myung, Diego Saez-Trumper, Ai-Jou Chou, Miriam Redi, Changwook Jung, and Meeyoung Cha. 2023. Longitudinal Assessment of Reference Quality on Wikipedia. In Proceedings of the ACM Web Conference 2023 (Austin, TX, USA) (WWW '23). Association for Computing Machinery, New York, NY, USA, 2831--2839. https://doi.org/10.1145/3543507.3583218
[3]
Brent Jaron Hecht. 2013. The mining and application of diverse cultural perspectives in user-generated content. Ph.,D. Dissertation. Northwestern University.
[4]
Sohyeon Hwang and Aaron Shaw. 2022. Rules and Rule-Making in the Five Largest Wikipedias. Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16, 1 (May 2022), 347--357. https://doi.org/10.1609/icwsm.v16i1.19297
[5]
Włodzimierz Lewoniewski, Krzysztof Wke cel, and Witold Abramowicz. 2017. Analysis of References Across Wikipedia Languages. In Information and Software Technologies, Robertas Damavs evivc ius and Vilma Mikavs yt.e (Eds.). Springer International Publishing, Cham, 561--573.
[6]
Włodzimierz Lewoniewski, Krzysztof Wke cel, and Witold Abramowicz. 2023. Companies in Multilingual Wikipedia: Articles Quality and Important Sources of Information. In Information Technology for Management: Approaches to Improving Business and Society, Ewa Ziemba, Witold Chmielarz, and Jarosław Wka tróbski (Eds.). Springer Nature Switzerland, Cham, 48--67.
[7]
Hause Lin, Jana Lasser, Stephan Lewandowsky, Rocky Cole, Andrew Gully, David Rand, and Gordon Pennycook. 2022. High level of agreement across different news domain quality ratings. (2022).
[8]
Sverrir Steinsson. 2023. Rule Ambiguity, Institutional Clashes, and Population Loss: How Wikipedia Became the Last Good Place on the Internet. American Political Science Review (2023), 1--17.
[9]
Rodolfo Vieira Valentim, Giovanni Comarela, Souneil Park, and Diego Sáez-Trumper. 2021. Tracking knowledge propagation across wikipedia languages. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 15. 1046--1052.
[10]
English Wikipedia. 2023 a. List of Wikipedias Retrieved May 26, 2023 from
[11]
English Wikipedia. 2023 b. Reliable sources Noticeboard. https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Noticeboard Retrieved May 26, 2023 from
[12]
English Wikipedia. 2023 c. Verifiability Policy. https://en.wikipedia.org/wiki/Wikipedia:Verifiability Retrieved May 26, 2023 from
[13]
English Wikipedia. 2023 d. Wikipedia: Reliable source, Perennial Source. https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources Retrieved May 26, 2023 from
[14]
Puyu Yang and Giovanni Colavizza. 2022a. A Map of Science in Wikipedia. In Companion Proceedings of the Web Conference 2022. 1289--1300.
[15]
Puyu Yang and Giovanni Colavizza. 2022b. Polarization and reliability of news sources in Wikipedia. arXiv preprint arXiv:2210.16065 (2022).
[16]
Xiang Zheng, Jiajing Chen, Erjia Yan, and Chaoqun Ni. 2023. Gender and country biases in Wikipedia citations to scholarly publications. Journal of the Association for Information Science and Technology, Vol. 74, 2 (2023), 219--233.
Index Terms
- A Comparative Study of Reference Reliability in Multiple Language Editions of Wikipedia
Recommendations
Learning multilingual named entity recognition from Wikipedia
We automatically create enormous, free and multilingual silver-standard training annotations for named entity recognition (ner) by exploiting the text and structure of Wikipedia. Most ner systems rely on statistical models of annotated data to identify ...
#Wikipedia on Twitter: analyzing tweets about Wikipedia
OpenSym '15: Proceedings of the 11th International Symposium on Open CollaborationWikipedia has long become a standard source of information on the web and as such is widely referenced on the web and in social media. This paper analyzes the usage of Wikipedia on Twitter by looking into languages used on both platforms, content ...
Vandals and Hoaxes on the Web
CyberSafety'16: Proceedings of the First International Workshop on Computational Methods for CyberSafetyWeb is a space for all, where everybody can read, publish and share information. This has had tremendous positive impact on the lives of billions of people. Wikipedia, being the largest encyclopedia and free, is a major source of information for many. ...
Comments
Information & Contributors
Information
Published In
October 2023
5508 pages
ISBN:9798400701245
DOI:10.1145/3583780
- General Chairs:
- Ingo Frommholz,
- Frank Hopfgartner,
- Mark Lee,
- Michael Oakes,
- Program Chairs:
- Mounia Lalmas,
- Min Zhang,
- Rodrygo Santos
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 21 October 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
- Institute for Basic Science
- National Research Foundation of Korea (NRF) grant
Conference
CIKM '23: The 32nd ACM International Conference on Information and Knowledge Management
October 21 - 25, 2023
Birmingham, United Kingdom
Acceptance Rates
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 139Total Downloads
- Downloads (Last 12 months)139
- Downloads (Last 6 weeks)10
Reflects downloads up to 11 Aug 2024
Other Metrics
Citations
Cited By
View all- Yang PColavizza G(2024)Polarization and reliability of news sources in WikipediaOnline Information Review10.1108/OIR-02-2023-008448:5(908-925)Online publication date: 18-Jan-2024
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in