research-article

Free access

Measuring the Impact of Topic Drift in Scholarly Networks

Authors:

Min SongAuthors Info & Claims

WWW '18: Companion Proceedings of the The Web Conference 2018

Pages 373 - 378

https://doi.org/10.1145/3184558.3186358

Published: 23 April 2018 Publication History

All formats PDF

Abstract

With the increase in collaboration among researchers of various disciplines, changing the research topic or working on multiple topics is not an unusual behavior. Several comprehensive efforts have been made for predicting, quantifying, and studying the researcher's impact. The question, that how the change in the field of interest over time or working in more than one topics can influence the scientific impact, remains unanswered. In this research, we study the effect of topic drift on the scientific impact of an author. We apply Author Conference Topic (ACT) model to extract topic distribution of individual authors who are working on multiple topics to compare and analyze with authors who work on a single topic. We analyze the productivity of the authors on the basis of publication count, citation count and h-index. We find that authors who stick to one topic, produce a higher impact and gain more attention. To further strengthen our results we gather the h-index of top-ranked authors working on one topic and top-ranked authors working on multiple topics and examine whether there are similar trends in their progress. The results show an evidence of significant impact of topic drift on career choices of researchers.

References

[1]

H. Ankarali, O. Pasin, and S. Ankarali, "A New Index for Evaluating Academic Performance: Hos-index," Int. J. Comput. Sci. Issues IJCSI, vol. 14, no. 3, p. 78, 2017.

[2]

J. G. Foster, A. Rzhetsky, and J. A. Evans, "Tradition and innovation in scientists' research strategies," Am. Sociol. Rev., vol. 80, no. 5, pp. 875--908, 2015.

[3]

T. Amjad, A. Daud, D. Che, and A. Akram, "MuICE: Mutual Influence and Citation Exclusivity Author Rank," Inf. Process. Manag., 2015.

[4]

D. Bouyssou and T. Marchant, "Ranking authors using fractional counting of citations: An axiomatic approach," J. Informetr., vol. 10, no. 1, pp. 183--199, 2016.

[5]

T. Amjad, Y. Ding, A. Daud, J. Xu, and V. Malic, "Topic-based heterogeneous rank," Scientometrics, vol. 104, no. 1, pp. 313--334, 2015.

Digital Library

[6]

T. Amjad and A. Daud, "Indexing of authors according to their domain of expertise," Malays. J. Libr. Inf. Sci., vol. 22, no. 1, pp. 69--82, 2017.

[7]

D. Peiris and R. Weerasinghe, "Citation network-based framework for ranking academic Publications and venues," in Advances in ICT for Emerging Regions (ICTer), 2015 Fifteenth International Conference on, 2015, pp. 146--151.

[8]

X. Liu, J. Bollen, M. L. Nelson, and H. Van de Sompel, "Co-authorship networks in the digital library research community," Inf. Process. Manag., vol. 41, no. 6, pp. 1462--1480, 2005.

Digital Library

[9]

E. Yan and Y. Ding, "Discovering author impact: A PageRank perspective," Inf. Process. Manag., vol. 47, no. 1, pp. 125--134, 2011.

Digital Library

[10]

D. Fiala, F. Rousselot, and K. Jezek, "PageRank for bibliographic networks," Scientometrics, vol. 76, no. 1, pp. 135--158, 2008.

[11]

E. Yan and Y. Ding, "Scholarly network similarities: How bibliographic coupling networks, citation networks, cocitation networks, topical networks, coauthorship networks, and coword networks relate to each other," J. Assoc. Inf. Sci. Technol., vol. 63, no. 7, pp. 1313--1326, 2012.

Digital Library

[12]

E. Yan, Y. Ding, and C. R. Sugimoto, "P-Rank: An indicator measuring prestige in heterogeneous scholarly networks," J. Am. Soc. Inf. Sci. Technol., vol. 62, no. 3, pp. 467--477, 2011.

Digital Library

[13]

Z. Yang, L. Hong, and B. D. Davison, "Topic-driven multi-type citation network analysis," in Adaptivity, Personalization and Fusion of Heterogeneous Information, 2010, pp. 24--31.

Digital Library

[14]

T. Amjad, A. Daud, A. Akram, and F. Muhammed, "Impact of mutual influence while ranking authors in a co-authorship network," Kuwait J. Sci., vol. 43, no. 3, 2016.

[15]

X.-L. Li, C. S. Foo, K. L. Tew, and S.-K. Ng, "Searching for rising stars in bibliography networks," in Database Systems for Advanced Applications, 2009, pp. 288--292.

Digital Library

[16]

A. Daud et al., "Finding Rising Stars in Co-Author Networks via Weighted Mutual Influence," in Proceedings of the 26th International Conference on World Wide Web Companion, 2017, pp. 33--41.

Digital Library

[17]

T. Amjad et al., "Standing on the shoulders of giants," J. Informetr., vol. 11, no. 1, pp. 307--323, 2017.

[18]

L. Li, X. Wang, Q. Zhang, P. Lei, M. Ma, and X. Chen, "A quick and effective method for ranking authors in academic social network," in Multimedia and Ubiquitous Engineering, Springer, 2014, pp. 179--185.

[19]

D. Fiala and G. Tutoky, "PageRank-based prediction of award-winning researchers and the impact of citations," J. Informetr., vol. 11, no. 4, pp. 1044--1068, 2017.

[20]

T. Amjad, A. Daud, and N. R. Aljohani, "Ranking authors in academic social networks: a survey," Libr. Hi Tech, vol. 36, no. 1, pp. 97--128, 2018.

[21]

D. Fiala, "Time-aware PageRank for bibliographic networks," J. Informetr., vol. 6, no. 3, pp. 370--388, 2012.

[22]

M. Franceschet and G. Colavizza, "TimeRank: A dynamic approach to rate scholars using citations," J. Informetr., vol. 11, no. 4, pp. 1128--1141, 2017.

[23]

Y. Wang, Y. Tong, and M. Zeng, "Ranking Scientific Articles by Exploiting Citations, Authors, Journals, and Time Information.," 2013.

[24]

X. Kong, J. Zhou, J. Zhang, W. Wang, and F. Xia, "TAPRank: A Time-Aware Author Ranking Method in Heterogeneous Networks," in Smart City/SocialCom/SustainCom (SmartCity), 2015 IEEE International Conference on, 2015, pp. 242--246.

[25]

A. Daud, J. Li, L. Zhou, and F. Muhammad, "Temporal expert finding through generalized time topic modeling," Knowl.-Based Syst., vol. 23, no. 6, pp. 615--625, 2010.

Digital Library

[26]

Z. Yang, J. Tang, J. Zhang, J. Li, and B. Gao, "Topic-level random walk through probabilistic model," in Advances in Data and Web Management, Springer, 2009, pp. 162--173.

Digital Library

[27]

T. A. Olowookere, B. O. Eke, and L. U. Oghenekaro, "A Topic Modelling-Based Framework for Mining Digital Library's Text Documents," 2015.

[28]

B. Chen, S. Tsutsui, Y. Ding, and F. Ma, "Understanding the topic evolution in a scientific domain: An exploratory study for the field of information retrieval," J. Informetr., vol. 11, no. 4, pp. 1175--1189, 2017.

[29]

M. Kim, I. Baek, and M. Song, "Topic diffusion analysis of a weighted citation network in biomedical literature," J. Assoc. Inf. Sci. Technol.

[30]

T. Jia, D. Wang, and B. K. Szymanski, "Quantifying patterns of research-interest evolution," Nat. Hum. Behav., vol. 1, p. 78, 2017.

[31]

J. Tang, R. Jin, and J. Zhang, "A topic modeling approach and its integration into the random walk framework for academic search," 2008, pp. 1055--1060.

Digital Library

[32]

J. Tang, J. Zhang, L. Yao, J. Li, L. Zhang, and Z. Su, "Arnetminer: extraction and mining of academic social networks," 2008, pp. 990--998.

Digital Library

Cited By

Daud AGhaffar SAmjad T(2024)Citation Count Is Not Enough: Citation’s Context-Based Scientific Impact EvaluationIEEE Transactions on Computational Social Systems10.1109/TCSS.2022.319350811:4(4567-4573)Online publication date: Aug-2024
https://doi.org/10.1109/TCSS.2022.3193508
Yu CWang CZhang TBu YXu J(2024)Analyzing research diversity of scholars based on multi-dimensional calculation of knowledge entitiesScientometrics10.1007/s11192-023-04821-3129:11(7329-7358)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1007/s11192-023-04821-3
Amjad T(2021)Domain-Specific Scientific Impact and its Prediction2021 International Conference on Artificial Intelligence (ICAI)10.1109/ICAI52203.2021.9445203(16-21)Online publication date: 5-Apr-2021
https://doi.org/10.1109/ICAI52203.2021.9445203
Show More Cited By

Index Terms

Measuring the Impact of Topic Drift in Scholarly Networks
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing design and evaluation methods
      1. Social network analysis
2. Information systems
  1. Information retrieval
    1. Document representation
      1. Document topic models
    2. Retrieval models and ranking
      1. Top-k retrieval in databases

Recommendations

Evaluating scientific impact of publications: combining citation polarity and purpose
Abstract
Citation counts are commonly used to evaluate the scientific impact of a publication on the general premise that more citations probably mean more endorsements. However, two questionable assumptions underpin this idea: a) that all authors ...
Will This Paper Increase Your h-index?: Scientific Impact Prediction
WSDM '15: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining

Scientific impact plays a central role in the evaluation of the output of scholars, departments, and institutions. A widely used measure of scientific impact is citations, with a growing body of literature focused on predicting the number of citations ...
Scholarly impact assessment: a survey of citation weighting solutions

Scholarly impact assessment has always been a hot issue. It has played an important role in evaluating researchers, scientific papers, scientific teams, and institutions within science of science. Scholarly impact assessment is also used to address ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WWW '18: Companion Proceedings of the The Web Conference 2018

April 2018

2023 pages

ISBN:9781450356404

General Chairs:
Pierre-Antoine Champin
Université Claude Bernard Lyon 1, France
,
Fabien Gandon
Inria, Université Côte d'Azur, CNRS, I3S, France
,
Lionel Médini
Université Claude Bernard Lyon 1, CNRS, LIRIS, France
,
Program Chairs:
Mounia Lalmas
Spotify, UK
,
Panagiotis G. Ipeirotis
New York University, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IW3C2: International World Wide Web Conference Committee

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

International World Wide Web Conferences Steering Committee

Republic and Canton of Geneva, Switzerland

Publication History

Published: 23 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Research Foundation of Korea
Ministry of Education of the Republic of Korea

Conference

WWW '18

Sponsor:

IW3C2

WWW '18: The Web Conference 2018

April 23 - 27, 2018

Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
558
Total Downloads

Downloads (Last 12 months)129
Downloads (Last 6 weeks)21

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Daud AGhaffar SAmjad T(2024)Citation Count Is Not Enough: Citation’s Context-Based Scientific Impact EvaluationIEEE Transactions on Computational Social Systems10.1109/TCSS.2022.319350811:4(4567-4573)Online publication date: Aug-2024
https://doi.org/10.1109/TCSS.2022.3193508
Yu CWang CZhang TBu YXu J(2024)Analyzing research diversity of scholars based on multi-dimensional calculation of knowledge entitiesScientometrics10.1007/s11192-023-04821-3129:11(7329-7358)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1007/s11192-023-04821-3
Amjad T(2021)Domain-Specific Scientific Impact and its Prediction2021 International Conference on Artificial Intelligence (ICAI)10.1109/ICAI52203.2021.9445203(16-21)Online publication date: 5-Apr-2021
https://doi.org/10.1109/ICAI52203.2021.9445203
Daud AAbbas FAmjad TAlshdadi AAlowibdi J(2021)Finding rising stars through hot topics detectionFuture Generation Computer Systems10.1016/j.future.2020.10.013115(798-813)Online publication date: Feb-2021
https://doi.org/10.1016/j.future.2020.10.013
Ma YJi ZSong L(2020)A Two-Layer Network Model Reveals the Adhesion Scientist Career Stage and Research Topic in ChinaIEEE Access10.1109/ACCESS.2020.29803048(52726-52737)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2980304
Ma YSong LJi ZWang QYu Q(2020)Scholar’s career switch adhesive with research topics: An evidence from ChinaPhysica A: Statistical Mechanics and its Applications10.1016/j.physa.2020.124959557(124959)Online publication date: Nov-2020
https://doi.org/10.1016/j.physa.2020.124959
Purwitasari DFatichah CSumpeno SSteglich CPurnomo M(2020)Identifying collaboration dynamics of bipartite author-topic networks with the influences of interest changesScientometrics10.1007/s11192-019-03342-2122:3(1407-1443)Online publication date: 1-Mar-2020
https://dl.acm.org/doi/10.1007/s11192-019-03342-2
Purwitasari DFatichah CSooai ASumpeno SPurnomo M(2019)Productivity-based Features from Article Metadata for Fuzzy Rules to Classify Academic Expert2019 IEEE 10th International Conference on Awareness Science and Technology (iCAST)10.1109/ICAwST.2019.8923316(1-6)Online publication date: Oct-2019
https://doi.org/10.1109/ICAwST.2019.8923316

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten