Abstract
The great importance international rankings have achieved in the research policy arena warns against many threats consequence of the flaws and shortcomings these tools present. One of them has to do with the inability to accurately represent national university systems as their original purpose is only to rank world-class universities. Another one has to do with the lack of representativeness of universities’ disciplinary profiles as they usually provide a unique table. Although some rankings offer a great coverage and others offer league tables by fields, no international ranking does both. In order to surpass such limitation from a research policy viewpoint, this paper analyzes the possibility of using national rankings in order to complement international rankings. For this, we analyze the Spanish university system as a study case presenting the I-UGR Rankings for Spanish universities by fields and subfields. Then, we compare their results with those obtained by the Shanghai Ranking, the QS Ranking, the Leiden Ranking and the NTU Ranking, as they all have basic common grounds which allow such comparison. We conclude that it is advisable to use national rankings in order to complement international rankings, however we observe that this must be done with certain caution as they differ on the methodology employed as well as on the construction of the fields.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abramo, G., Cicero, T., & D’Angelo, C. A. (2011). The Dangers of performance -based research funding in non-competitive higher education systems. Scientometrics, 87(3), 641–654.
Aguillo, I., Bar-Ilan, J., Levene, M., & Ortega, J. L. (2010). Comparing university rankings. Scientometrics, 85(1), 243–256.
Bornmann, L., Mutz, R., & Daniel, H.-D. (2013). Multilevel-statistical reformulation of citation-based university rankings: The Leiden ranking 2011/2012. Journal of the American Society for Information Science and Technology, 64(8), 1649–1658.
Cabezas-Clavijo, Á., Robinson-García, N., Escabias, M., & Jiménez-Contreras, E. (2013). Reviewers’ ratings and bibliometric indicators: Hand in hand when assessing over research proposals? PLoS ONE, 8(6), e68258.
Collini, S. (2011). What are universities for?. London, UK: Penguin Books.
Delgado López-Cózar, E. (2012). Cómo se cocinan los rankings universitarios. Dendra médica. Revista de Humanidades, 11(1), 43–58.
Docampo, D. (2011). On the use of the Shanghai ranking to assess the research performance of university systems. Scientometrics, 86(1), 77–92.
García, J. A., Rodríguez-Sánchez, R., Fdez-Valdivia, J., Robinson-García, N., & Torres-Salinas, D. (2012). Mapping institutions according to their journal publication profile: Spanish universities as a case study. Journal of the American Society for Information Science and Technology, 63(11), 2328–2340.
Hazelkorn, E. (2011). Rankings and the reshaping of higher education: The battle for world-class excellence. Houndmills, UK: Palgrave MacMillan.
Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences USA, 102(46), 16569–16572.
Leydesdorff, L., & Rafols, I. (2009). A global map of science based on the ISI subject categories. Journal of the American Society for Information Science and Technology, 63(11), 2239–2253.
Liu, N. C., & Cheng, Y. (2005). The academic ranking of world universities. Higher Education in Europe, 30(2), 127–136.
Marginson, S., & van der Wende, M. (2007). To rank or to be ranked: The impact of global rankings in higher education. Journal of Studies in International Education, 11(3–4), 306–329.
Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer.
Moed, H. F., Moya-Anegón, F., López-Illescas, C., & Visser, M. (2011). Is concentration of university research associated with better research performance? Journal of Informetrics, 5(4), 649–658.
Orduña-Malea, E. (2012). Propuesta de un modelo de análisis redinformétrico multinivel para el estudio sistémico de las universidades [Doctoral Thesis]. Valencia, Spain: Universidad Politécnica de Valencia.
Rafols, I., Ciarli, T., van Zwanenberg, P. & Stirling, A. (2012). Towards indicators ‘opening up’ science and technology policy. In E. Archaumbault & V. Larivière (eds.), Proceedings of 17th International Conference on Science and Technology Indicators, 675–682.
Shin, J. C., & Toutkoushian, R. K. (2011). The past, present, and future of university rankings. In J. C. Shin, R. K. Toutkoushian, & U. Teichler (Eds.), University rankings: Theoretical basis, methodology and impacts on global higher education (pp. 1–18). Dordrecht, Netherlands: Springer.
Torres-Salinas, D., Delgado López-Cózar, E., Moreno-Torres, J. G., & Herrera, F. (2011a). Rankings ISI de las universidades españolas según campos científicos: descripción y resultados. ElProfesional de la Información, 20(1), 111–118.
Torres-Salinas, D., Moreno-Torres, J. G., Delgado López-Cózar, E., & Herrera, F. (2011b). A methodology for institution-field ranking based on a bidimensional analysis: The IFQ2A index. Scientometrics, 88(3), 771–786.
Torres-Salinas, D., Moreno-Torres, J. G., Robinson-García, N., Delgado López-Cózar, E., & Herrera, F. (2011c). Rankings ISI de las Universidades Españolas según Campos y Disciplinas Científicas (2ª ed. 2011). El Profesional de la Información, 20(6), 701–709.
Toutkoushian, R. K., & Webber, K. (2011). Measuring the research performance of postsecondary institutions. In J. C. Shin, R. K. Toutkoushian, & U. Teichler (Eds.), University ranking: Theoretical basis, methodology and impacts on global higher education (pp. 123–144). Dordrecht, Netherlands: Springer.
Usher, A., & Savino, M. (2007). A global survey of university rankings and league tables. Higher Education in Europe, 32(1), 5–15.
Van Raan, A. F. J. (2005). Fatal attraction: conceptual and methodological problems in the ranking of universities in the global scientific communication system. Scientometrics, 62(1), 133–143.
Visser, M. S., Calero-Medina, C. M. &Moed, H. F. (2007). Beyond Rankings: The Role of Large Research Universities in the Global Scientific Communication System. In D. Torres-Salinas & H.F. Moed, Proceedings of 11th Conference of the International Society for Scientometrics and Informetrics (pp. 761–765). Madrid, Spain: CINDOC-CSIC.
Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E. C. M., Tijssen, R. J., van Eck, N. J., et al. (2012). The Leiden ranking 2011/2012: Data collection, indicators and interpretation. Journal of the American Society for Information Science and Technology, 63(12), 2419–2432.
Acknowledgments
Thanks are due to the two anonymous referees for their helpful comments. Nicolás Robinson-García is currently supported by a FPU Grant from the Ministerio de Educación y Ciencia of the Spanish Government.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Robinson-García, N., Torres-Salinas, D., Delgado López-Cózar, E. et al. An insight into the importance of national university rankings in an international context: the case of the I-UGR rankings of Spanish universities. Scientometrics 101, 1309–1324 (2014). https://doi.org/10.1007/s11192-014-1263-1
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-014-1263-1