Abstract
Several indexes have been proposed to evaluate the scientific research productivity. These indexes are useful for several management decisions, such as career development and distribution of financial capital to scientific researches. In the last two decades, several works have proposed indexes to measure how productive and relevant the work of a researcher is. Some of these indexes aim to be applicable to evaluate an individual researcher and/or groups of researchers, applying the same formula for both situations. However, in some cases, this application is not straightforward. In this work, we studied the main indexes used to evaluate productivity of scientific researchers, discuss their aspects and organize them according to their characteristics, by pointing up the variables that are used to compose each index. We also analyzed works that applied the h-index for a group of researchers, highlighting the different ways adopted for this application. Furthermore, we discussed the opportunities to expand these metrics in a fairer way to evaluate quantitative and qualitative aspects for groups of researchers. After a literature review of these indexes, we conclude that the h-index can be used in many ways to evaluate groups of scientific researchers. Hence, there are other challenges and opportunities in the proposal of indexes to evaluate these groups, such as performing experiments for smaller groups, evaluating social aspects and defining better ways for selecting articles to evaluate the research productivity of groups.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102, 16569–16572 (2005). https://doi.org/10.1073/pnas.0507655102
Egghe, L.: Theory and practise of the g-index. Scientometrics 69, 131–152 (2006). https://doi.org/10.1007/s11192-006-0144-7
Zhang, C.-T.: The e-Index, complementing the h-index for excess citations. PLoS One 4, (2009). https://doi.org/10.1371/journal.pone.0005429
Joshi, M.A.: Bibliometric indicators for evaluating the quality of scientific publications. J. Contemp. Dent. Pract. 15, 258–262 (2014). https://doi.org/10.5005/jp-journals-10024-1525
Kosmulski, M.: A new Hirsch-type index saves time and works equally well as the original h-index. ISSI Newslett. 2(3), 4–6 (2006)
Flatt, J., Blasimme, A., Vayena, E.: Improving the measurement of scientific success by reporting a self-citation index. Publications 5, 20 (2017). https://doi.org/10.3390/publications5030020
Hirsch, J.E.: An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship. Scientometrics 85, 741–754 (2010). https://doi.org/10.1007/s11192-010-0193-9
Valles, M., Injante, R., Hernández, E., Riascos, J., Galvez, M., Velasco, J.: An altmetric alternative for measuring the impact of university institutional repositories’ grey literature. In: Mugnaini, R. (ed.) DIONE 2020. LNICST, vol. 319, pp. 222–234. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50072-6_17
Torres-Salinas, D., Robinson-Garcia, N., Jiménez-Contreras, E.: Can we use altmetrics at the institutional level? A case study analysing the coverage by research areas of four Spanish universities, p. 8 (2016)
Rousseau, R., Yang, L., Yue, T.: A discussion of Prathap’s h2-index for institutional evaluation with an application in the field of HIV infection and therapy. J. Informetr. 4, 175–184 (2010). https://doi.org/10.1016/j.joi.2009.11.007
Mitra, P.: Hirsch-type indices for ranking institutions scientific research output. Curr. Sci. 91, 1439 (2006)
Jacsó, P.: The h-index for countries in web of science and scopus. Online Inf. Rev. 33, 831–837 (2009). https://doi.org/10.1108/14684520910985756
Rad, A.E., Brinjikji, W., Cloft, H.J., Kallmes, D.F.: The h-index in academic radiology. Acad. Radiol. 17, 817–821 (2010). https://doi.org/10.1016/j.acra.2010.03.011
Khan, N., Thompson, C.J., Choudhri, A.F., et al.: Part I: the application of the h-index to groups of individuals and departments in academic neurosurgery. World Neurosurg. 80, 759–765.e3 (2013). https://doi.org/10.1016/j.wneu.2013.07.010
Schubert, A.: Successive h-indices. Scientometrics 70, 201–205 (2007). https://doi.org/10.1007/s11192-007-0112-x
Agarwal, A., Durairajanayagam, D., Tatagari, S., et al.: Bibliometrics: tracking research impact by selecting the appropriate metrics. Asian J. Androl. 18, 296 (2016). https://doi.org/10.4103/1008-682X.171582
Gasparyan, A.Y., Yessirkepov, M., Duisenova, A., et al.: Researcher and author impact metrics: variety, value, and context. J. Korean Med. Sci. 33, (2018). https://doi.org/10.3346/jkms.2018.33.e139
Jin, B., Liang, L., Rousseau, R., Egghe, L.: The R- and AR-indices: complementing the h-index. Chin. Sci. Bull. 52, 855–863 (2007). https://doi.org/10.1007/s11434-007-0145-9
Altmann, J., Abbasi, A., Hwang, J.: Evaluating the productivity of researchers and their communities: the RP-index and the CP-index, p. 15 (2009)
Schreiber, M.: A case study of the modified Hirsch index h m accounting for multiple coauthors. J. Am. Soc. Inf. Sci. Technol. 60, 1274–1282 (2009). https://doi.org/10.1002/asi.21057
Kozak, M., Bornmann, L.: A new family of cumulative indexes for measuring scientific performance. PLoS ONE 7, (2012). https://doi.org/10.1371/journal.pone.0047679
Pan, R.K., Fortunato, S.: Author Impact Factor: tracking the dynamics of individual scientific impact. Sci. Rep. 4, 4880 (2015). https://doi.org/10.1038/srep04880
Senanayake, U., Piraveenan, M., Zomaya, A.: The pagerank-index: going beyond citation counts in quantifying scientific impact of researchers. PLoS ONE 10, (2015). https://doi.org/10.1371/journal.pone.0134794
Hirsch, J.E.: hα: an index to quantify an individual’s scientific leadership. Scientometrics 118, 673–686 (2019). https://doi.org/10.1007/s11192-018-2994-1
Ye, F.Y., Rousseau, R.: Probing the h-core: an investigation of the tail–core ratio for rank distributions. Scientometrics 84, 431–439 (2010). https://doi.org/10.1007/s11192-009-0099-6
van Raan, A.F.J.: Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups. Scientometrics 67, 491–502 (2006). https://doi.org/10.1556/Scient.67.2006.3.10
Egghe, L.: Theory and practise of the g-index. Scientometrics 69, 131–152 (2006). https://doi.org/10.1007/s11192-006-0144-7
Affonso, F., Dias, T.M.R., de Oliveira Santiago, M.: A strategy for co-authorship recommendation: analysis using scientific data repositories. In: Mugnaini, R. (ed.) DIONE 2020. LNICST, vol. 319, pp. 167–178. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50072-6_13
Fernandes, D., David, N., Cortinhal, M.J.: A distributed tool for online identification of communities in co-authorship networks at a university. In: Mugnaini, R. (ed.) DIONE 2020. LNICST, vol. 319, pp. 179–189. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50072-6_14
Marcelino, L.V., Pinto, A.L., Marques, C.A.: Intellectual authorities and hubs of green chemistry. In: Mugnaini, R. (ed.) DIONE 2020. LNICST, vol. 319, pp. 190–209. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50072-6_15
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Santos, A.A.d., Dutra, M.L. (2021). Indexes for Evaluating Research Groups: Challenges and Opportunities. In: Bisset Álvarez, E. (eds) Data and Information in Online Environments. DIONE 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 378. Springer, Cham. https://doi.org/10.1007/978-3-030-77417-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-77417-2_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77416-5
Online ISBN: 978-3-030-77417-2
eBook Packages: Computer ScienceComputer Science (R0)