research-article

A comparative study of academic and Wikipedia ranking

Authors:

Xin Shuai,

Zhuoren Jiang,

Xiaozhong Liu,

Johan BollenAuthors Info & Claims

JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries

Pages 25 - 28

https://doi.org/10.1145/2467696.2467746

Published: 22 July 2013 Publication History

Get Access

Abstract

In addition to its broad popularity Wikipedia is also widely used for scholarly purposes. Many Wikipedia pages pertain to academic papers, scholars and topics providing a rich ecology for scholarly uses. Scholarly references and mentions on Wikipedia may thus shape the "societal impact" of a certain scholarly communication item, but it is not clear whether they shape actual "academic impact". In this paper we compare the impact of papers, scholars, and topics according to two different measures, namely scholarly citations and Wikipedia mentions. Our results show that academic and Wikipedia impact are positively correlated. Papers, authors, and topics that are mentioned on Wikipedia have higher academic impact than those are not mentioned. Our findings validate the hypothesis that Wikipedia can help assess the impact of scholarly publications and underpin relevance indicators for scholarly retrieval or recommendation systems.

References

[1]

P. Evans and M. Krauthammer. Exploring the use of social media to measure journal article impact. AMIA Symposium, 2011(January):374--81, 2011.

Google Scholar

[2]

E. Garfield and R. K. Merton. Citation indexing-its theory and application in science, technology, and humanities. garfield.library.upenn.edu, Jan. 1979.

Google Scholar

[3]

A. Kittur, E. H. Chi, and B. Suh. What's in wikipedia?: mapping topics and conflict using socially annotated category structure. CHI '09, pages 1509--1512, New York, NY, USA, 2009. ACM.

Digital Library

Google Scholar

[4]

J. Priem and B. H. Hemminger. Scientometrics 2.0: New metrics of scholarly impact on the social web. First Monday; Volume 15, Number 7 - 5 July 2010, 2010.

Google Scholar

[5]

J. Priem, H. A. Piwowar, and B. M. Hemminger. Altmetrics in the wild: Using social media to explore scholarly impact. ArXiv e-prints, Mar. 2012.

Google Scholar

[6]

X. Shuai, A. Pepe, and J. Bollen. How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations. PloS ONE, 11(7), 2012.

Google Scholar

[7]

C. Spearman. The proof and measurement of association between two things. The American journal of psychology, 100(3--4):441--471, 1987.

Google Scholar

[8]

F. Årup Nielsen. Scientific citations in wikipedia. First Monday, 12(8), 2007.

Google Scholar

Cited By

View all

Yang PColavizza G(2024)Polarization and reliability of news sources in WikipediaOnline Information Review10.1108/OIR-02-2023-008448:5(908-925)Online publication date: 18-Jan-2024
https://doi.org/10.1108/OIR-02-2023-0084
Schmidt MKircheis WSimons APotthast MStein B(2023)A diachronic perspective on citation latency in Wikipedia articles on CRISPR/Cas-9: an exploratory case studyScientometrics10.1007/s11192-023-04703-8128:6(3649-3673)Online publication date: 14-May-2023
https://doi.org/10.1007/s11192-023-04703-8
Zagorova OUlloa RWeller KFlöck F(2022)“I updated the <ref>”: The evolution of references in the English Wikipedia and the implications for altmetricsQuantitative Science Studies10.1162/qss_a_001713:1(147-173)Online publication date: 12-Apr-2022
https://doi.org/10.1162/qss_a_00171
Show More Cited By

Index Terms

A comparative study of academic and Wikipedia ranking
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
2. Information systems
  1. Information systems applications
    1. Digital libraries and archives

Recommendations

Methodological issues in measuring citations in Wikipedia: a case study in Library and Information Science

Wikipedia citations have been suggested as a metric that partially captures the impact of research, providing an indication of the transfer of scholarly output to a wider audience beyond the academic community. In this article, we explore the coverage ...
Journal self-citation study for semiconductor literature: synchronous and diachronous approach
Special issue: Informetrics

The present study investigates the self-citations of the most productive semiconductor journals by synchronous (self-citing rate) and diachronous (self-cited rate) approaches. Journal's productivity of 100 most productive semiconductor journals was ...
Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations
Abstract
New sources of citation data have recently become available, such as Microsoft Academic, Dimensions, and the OpenCitations Index of CrossRef open DOI-to-DOI citations (COCI). Although these have been compared to the Web of Science Core Collection (...

Comments

Information & Contributors

Information

Published In

JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries

July 2013

480 pages

ISBN:9781450320771

DOI:10.1145/2467696

General Chairs:
J. Stephen Downie
University of Illinois at Urbana-Champaign, USA
,
Robert H. McDonald
Indiana University Bloomington, USA
,
Program Chairs:
Timothy W. Cole
University of Illinois at Urbana-Champaign, USA
,
Robert Sanderson
Los Alamos National Laboratory, USA
,
Frank Shipman
Texas A&M University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

JCDL '13

Sponsor:

JCDL '13: 13th ACM/IEEE-CS Joint Conference on Digital Libraries

July 22 - 26, 2013

Indiana, Indianapolis, USA

Acceptance Rates

JCDL '13 Paper Acceptance Rate 28 of 95 submissions, 29%;

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
298
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yang PColavizza G(2024)Polarization and reliability of news sources in WikipediaOnline Information Review10.1108/OIR-02-2023-008448:5(908-925)Online publication date: 18-Jan-2024
https://doi.org/10.1108/OIR-02-2023-0084
Schmidt MKircheis WSimons APotthast MStein B(2023)A diachronic perspective on citation latency in Wikipedia articles on CRISPR/Cas-9: an exploratory case studyScientometrics10.1007/s11192-023-04703-8128:6(3649-3673)Online publication date: 14-May-2023
https://doi.org/10.1007/s11192-023-04703-8
Zagorova OUlloa RWeller KFlöck F(2022)“I updated the <ref>”: The evolution of references in the English Wikipedia and the implications for altmetricsQuantitative Science Studies10.1162/qss_a_001713:1(147-173)Online publication date: 12-Apr-2022
https://doi.org/10.1162/qss_a_00171
Houtti MJohnson ICepeda JKhandelwal SBhatnagar ATerveen L(2022)"We Need a Woman in Music": Exploring Wikipedia's Values on Article PriorityProceedings of the ACM on Human-Computer Interaction10.1145/35551566:CSCW2(1-28)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555156
Przybyla PBorkowski PKaczynski K(2022)Countering Disinformation by Finding Reliable Sources: a Citation-Based Approach2022 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN55064.2022.9891941(1-8)Online publication date: 18-Jul-2022
https://doi.org/10.1109/IJCNN55064.2022.9891941
Zheng XChen JYan ENi C(2022)Gender and country biases in Wikipedia citations to scholarly publicationsJournal of the Association for Information Science and Technology10.1002/asi.2472374:2(219-233)Online publication date: 5-Nov-2022
https://doi.org/10.1002/asi.24723
Singh HWest RColavizza G(2021)Wikipedia citations: A comprehensive data set of citations with identifiers extracted from English WikipediaQuantitative Science Studies10.1162/qss_a_001052:1(1-19)Online publication date: 8-Apr-2021
https://doi.org/10.1162/qss_a_00105
Azeroual OLewoniewski W(2020)How to Inspect and Measure Data Quality about Scientific Publications: Use Case of Wikipedia and CRIS DatabasesAlgorithms10.3390/a1305010713:5(107)Online publication date: 26-Apr-2020
https://doi.org/10.3390/a13050107
Ortega J(2018)The life cycle of altmetric impact: A longitudinal study of six metrics from PlumXJournal of Informetrics10.1016/j.joi.2018.06.00112:3(579-589)Online publication date: Aug-2018
https://doi.org/10.1016/j.joi.2018.06.001
Sugimoto CWork SLarivière VHaustein S(2017)Scholarly use of social media and altmetricsJournal of the Association for Information Science and Technology10.1002/asi.2383368:9(2037-2062)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1002/asi.23833
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Methodological issues in measuring citations in Wikipedia: a case study in Library and Information Science

Journal self-citation study for semiconductor literature: synchronous and diachronous approach

Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations