Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3383583.3398528acmconferencesArticle/Chapter ViewAbstractPublication PagesjcdlConference Proceedingsconference-collections
research-article
Public Access

Gatekeeper: Analyzing G-Indexes and Improving Service Quantification

Published: 01 August 2020 Publication History

Abstract

While it has been extensively studied on how to model and measure a scholar's research impact (e.g., citation analysis), there have been very few studies that systematically collect and quantify a scholar's service impact to scientific communities. To address this lack of studies, we have developed a prototype digital library, named as g, that crawls, extracts, and quantifies scholars' service impacts based on their roles as "gatekeepers" in Computer Science conferences. Continuing this effort, in this work, we further theoretically analyze and improve the understanding on the expected behavior of three quantification measures (i.e., G-indexes) being used in g. In addition, we demonstrate that the stretched-exponential model fits significantly better than three other heavy-tail models (i.e., power-law, log-normal, and parabolic-fractal) in capturing scholars' service impacts via three quantification measures. Finally, using the analyzed quantification measures, we present leading scholars and conferences with respect to their service impacts. Our prototype is available at: https://gatekeeper.ist.psu.edu.

References

[1]
Emery Berger. 2020. CSRankings: Computer Science Rankings. http://csrankings.org/.
[2]
Imed Bouchrika. 2019. Guide2Research: Top Computer Science Conferences. http://www.guide2research.com/topconf/
[3]
Leo Egghe. 2006. Theory and Practise of the G-index. Scientometrics (2006).
[4]
Ergin Elmacioglu and Dongwon Lee. 2009. Oracle, Where Shall I Submit My Papers? Commun. ACM (2009).
[5]
Jenny Rose Finkel, Trond Grenager, and Christopher Manning. 2005. Incorporating Non-Local Information into Information Extraction Systems by Gibbs Sampling. In ACL.
[6]
Robert Geist, Madhu Chetuparambil, Stephen Hedetniemi, and A. Joe Turner. 1996. Computing Research Programs in the U.S. Commun. ACM (1996).
[7]
J. E. Hirsch. 2005. An Index to Quantify an Individual's Scientific Research Output. PNAS (2005).
[8]
H Jeong, Z Néda, and A. L Barabási. 2003. Measuring Preferential Attachment in Evolving Networks. Europhysics Letters (2003).
[9]
Leonid Keselman. 2019. Venue Analytics: A Simple Alternative to Citation-Based Metrics. In JCDL.
[10]
Spyke Krepshaw and Dongwon Lee. 2019. Gatekeeper: Quantifying the Impacts of Service to the Scientific Community. In TPDL.
[11]
J. Laherrère and D. Sornette. 1998. Stretched exponential distributions in nature and economy: "fat tails" with characteristic scales. The European Physical Journal (1998).
[12]
Michael Ley. 2002. The DBLP Computer Science Bibliography: Evolution, Research Issues, Perspectives. In SPIRE.
[13]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research (2011).
[14]
Derek De Solla Price. 1976. A General Theory of Bibliometric and other Cumulative Advantage Processes. Journal of the American Society for Information Science (1976).
[15]
S. Redner. 1998. How Popular is Your Paper? An Empirical Study of the Citation Distribution. The European Physical Journal B: Condensed Matter and Complex Systems (1998).
[16]
Boris Schauerte. 2008. Microsoft Academic: Conference Field Ratings. http://www.conferenceranks.com/visualization/msar2014.html
[17]
Jerome Spanier and Keith B. Oldham. 1987. An Atlas of Functions.
[18]
C. Spearman. 1904. The Proof and Measurement of Association between Two Things. The American Journal of Psychology (1904).
[19]
Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, and Zhong Su. 2008. ArnetMiner: Extraction and Mining of Academic Social Networks. In KDD.
[20]
C. Tsallis and M F de Albuquerque. 2000. Are Citations of Scientific Papers a Case of Nonextensivity? The European Physical Journal B - Condensed Matter and Complex Systems (2000).
[21]
Su Yan and Dongwon Lee. 2007. Toward Alternative Measures for Ranking Venues: A Case of Database Research Community. In JCDL.
[22]
Tong Zhange. 2004. Solving Large Scale Linear Prediction Problems Using Stochastic Gradient Descent Algorithms. In ICML.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
JCDL '20: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020
August 2020
611 pages
ISBN:9781450375856
DOI:10.1145/3383583
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2020

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

  • NSF

Conference

JCDL '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 152
    Total Downloads
  • Downloads (Last 12 months)79
  • Downloads (Last 6 weeks)15
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media