13 Research Paper
13 Research Paper
13 Research Paper
10.16920/jeet/2024/v38i1/24181
Abstract : The National Institutional Ranking score. Consequently, Institutes must focus on
Framework (NIRF), evaluates universities and enhancing these parameters to enhance their total
institutions based on key parameters such as score and position in the NIRF rankings. The analysis
"Teaching, Learning, and Resources (TLR)," of histograms and descriptive statistics reveals that
"Research and Professional Practices (RPP)," 75% of ranked institutions score below 60% in RPP
"Graduation Outcomes (GO)," "Outreach and and PR parameters, indicating suboptimal
Inclusivity (OI)," and "Perception (PR)." The study performance in perception and research aspects. The
examines the top 100 Engineering institutes of NIRF study also highlights the importance of prioritizing
2023, focusing on their major parameter categories efforts to improve RPP and PR scores to enhance the
and their effectiveness in ranking processes. The overall performance and rankings of engineering
study will be useful to the engineering institutes to institutions in NIRF, as TLR, GO, and OI show
clearly understand the areas of improvement and to relatively consistent performance.
have an action plan for better rankings. Descriptive
statistics reveal that among five major categories RPP Keywords: NIRF 2023, TLR, RPP, GO, OI, PR,
& PR and in the sub-parameters Financial Resources Descriptive statistics, Histogram.
and their Utilisation (FRU), Footprint of Projects and
Professional Practice (FPPP), Metric for Number of 1. Introduction
Ph.D. Students Graduated (GPHD), and
Economically and Socially Challenged Students It was in the early 20th century that university
(ESCS) have the lowest effectiveness among others, rankings began in the United States, and US News and
indicating their minimal contribution in the total World Report became the first organization to publish
institutional rankings in the country in 1983 [1-3].
These rankings have become an important tool for
universities to market themselves and create
perceptions about their quality. Boulton [4] has noted
that a university's ranking can influence funding and
Ajit M. Hebbale project priorities, leading many to prioritize high
Nitte(Deemed to be University),NMAM Institute of Technology rankings for positive publicity. The main goal of
(NMAMIT), Department of Mechanical Engineering, Nitte, implementing a ranking system is to enhance the
Karnataka,574110, Indiaajit.hebbale@gmail.com overall quality of education, teaching & research.
Journal of Engineering Education Transformations , Volume 38, No. 1 , July 2024 , ISSN 2349-2473, eISSN 2394-1707 137
Accreditation and ranking agencies worldwide offer healthy competition among institutions, leading to an
global ratings & rankings, with India's autonomous overall improvement in the quality of education and
bodies like NAAC, and NBA, assessing institutions research in India. The ranking has also helped students
and granting accreditation for institutions and also for and parents make informed decisions about choosing
specific programs. The rankings, published by non- the right institution for higher education. However,
academic media, aim to improve education, there are certain limitations to the NIRF ranking
scholarship, and research standards. However, their methodology. One criticism is that it primarily focuses
limited participation and focus on admission on research output and neglects other essential aspects
campaigns make them questionable [5-7]. The higher of higher education, such as teaching quality and
education system in a country is influenced by its student experience. Another criticism is that the
history and vision, impacting its functioning and ranking methodology is subjective, and the perception
ranking. International university ranking systems parameter is given undue weightage, which may not
have faced criticism for their methodology and bias accurately reflect the quality of an institution. Despite
towards certain cultural factors [8-10]. The Indian these limitations, the NIRF ranking has had a
government introduced the National Institutional significant impact on the Indian higher education
Ranking Framework (NIRF) in 2015 to improve system. The ranking has encouraged institutions to
higher education quality, despite accreditation focus on research and innovation, leading to a
agencies monitoring it. The Ministry of Human substantial increase in research output and patents
Resource Development focuses on human resources filed. The ranking has also led to increased funding for
development, infrastructure improvement, and institutions that have performed well, leading to
expanding access to higher education. The NIRF further improvements in their overall performance.
ranking methodology assesses institutions using five The NIRF ranking has also been beneficial in
categories of parameters namely Teaching, Learning promoting inclusivity and diversity in the Indian
and Resources (TLR)," "Research and Professional higher education system. The outreach and inclusivity
Practices (RPP)," "Graduation Outcomes (GO)," parameter of the ranking evaluates institutions' efforts
"Outreach and Inclusivity (OI)," and "Perception (PR) to promote diversity and inclusion in their admission
[11]. The NIRF ranking in India improves policies and student body. This has led to an increase
competition, education, and research quality, aiding in the representation of marginalized communities in
students, and parents in selecting institutions. higher education institutions. Another notable impact
However, it may overlook teaching quality and of the NIRF ranking is the increased focus on
student experience. industry-academia collaboration. The ranking has
incentivized institutions to engage with industry
In response, the Indian government introduced the partners to promote research and innovation and to
National Institutional Ranking Framework (NIRF) in develop industry-relevant curricula. This has led to an
2015, despite the presence of multiple accreditation increase in industry-academia partnerships, leading to
agencies tasked with monitoring the quality of higher improved employability for students [13,14].
education within the country. The Ministry of Human
Resource Development (MHRD) in India is Several researchers are discussing how research
responsible for developing human resources and performance plays a role in ranking universities. It
improving basic infrastructure through policy and mentions that previous studies have shown the
planning, with a specific focus on expanding access to importance of research performance as an indicator
higher education and improving its quality. The NIRF for university rankings. The research article on
ranking methodology evaluates institutions based on comparative studies of international academic
five parameters: teaching, learning and resources ranking of universities, points out that four selected
(TLR), research and professional practice (RPP), international rankings contained an indicator of
graduation outcomes (GO), outreach and inclusivity research quality, which was the most important
(OI), and perception (PR). Each parameter has a indicator of international university ranking [15]. The
specific weightage, with TLR and RP accounting for various studies conducted on the National
30% each, GO accounting for 15%, OI accounting for Institutional Ranking Framework (NIRF) in India.
15%, and PR accounting for 10%. The ranking is One study found that the parameters used in NIRF are
based on a composite score calculated by assigning comparable to world ranking systems like Times
weights to each parameter and sub-parameter [12]. World University Ranking and QS Ranking. Another
The NIRF ranking has been instrumental in promoting study identified that research output is the major
138 Journal of Engineering Education Transformations , Volume 38, No. 1 , July 2024 , ISSN 2349-2473, eISSN 2394-1707
parameter that influences the NIRF ranking, and there engineering institutions ranked in the NIRF-2023,
is a positive correlation between capital expenditure focusing on the parameters and sub-parameters that
and national ranking score. The NIRF ranking system significantly influence their rankings. A descriptive
has encouraged universities to improve their research cross-sectional research approach is used, and data is
performance, resulting in exponential growth in sourced from the official NIRF website [6]. Minitab
publication count and citations of top-ranked software is used to derive meaningful insights and
universities [16]. The article also outlines the trends. The results of the current work can be used to
objectives and methodology of a new study focused classify and prioritise important metrics as institutions
on the top 100 universities in NIRF-2020, which aims attempt to improve their rankings. Through the use of
to identify the key parameters that determine the focused approaches in the NIRF assessment, it is
ranking of universities and their correlation with possible to improve rankings and improve overall
research output and library expenditure. The NIRF performance. As shown in Table I, there are five prime
ranking serves as a significant initiative in enhancing parameters and sub-parameters for analysing
the quality of higher education and research within engineering ranking metrics.
India. Its positive influence is observed in
encouraging institutions to prioritize research, In the current work, descriptive statistics of the
innovation, inclusivity, and collaboration between composed data are analysed, and the percentage of
academia and industry. Despite certain limitations in effectiveness is calculated by using (1). This
its methodology, the ranking system has effectively percentage helps as a valued metric, revealing the
spurred healthy competition among institutions, degree of influence that each parameter has on its
thereby contributing to the overall advancement of respective score.
education and research quality in the country. This
Mean value
study examines the effect of sub-parameters on the % of Effectiveness = Maximum score attained
× 100 (1)
five prime parameters and their collective effect on the
total score of the NIRF 2023 ranking. 3. Discussion and Analysis:
Fig. 2 shows a histogram showing sub-parameter Table 4:Descriptive Statistics of Sub-parameters of GO.
scores for RPP, showing over 60% of top-ranked Sub-
N Mean St. Dev. Min. Max.
% of
parameters Effectiveness
engineering institutes have scores below 2 in FPPP.
GPH 40 30.00 5.57 9.75 38.72 77.48
The mean and standard deviation align with the
GUE 15 14.56 0.91 9.87 15.00 97.07
overall score distribution. However, only a limited
MS 25 14.93 3.95 8.72 25.00 59.72
number of institutions have achieved a commendable
score in FPPP. For the sub-parameter IPR, the mean GPHD 20 6.13 4.55 0.15 20.00 30.65
perspectives of individuals involved in the field of and RPP exhibit the lowest effectiveness percentages
engineering education with regards to the quality and among the parameters, signifying their minimal
reputation of the institution. The assessment of the PR contribution to the overall NIRF 2021 score.
parameter is conducted through the administration of
surveys and the collection of feedback from various
individuals, including students, alumni, industry
professionals, and other stakeholders. These gathered
opinions and perceptions are then thoroughly
analysed in order to assess the institution's standing
and reputation. The scores obtained in this particular
parameter serve as an indication of the overall
perception of the institution and its ability to
positively influence both students and the industry.
Ÿ The sub-parameter "Financial Resources & [5] Srimathi, H., & Krishnamoorthy, A. (2020).
their Utilization (FRU - 44.18%)" in Category 1 REVIEW ON NIRF. Journal of Critical
- TLR needs improvement, focusing on R e v i e w s , 7 ( 0 4 ) .
increasing annual capital and operational https://doi.org/10.31838/jcr.07.04.48
expenditure per student.
[6] Van der Wende, Marijk. To rank or to be ranked:
Ÿ The least effective sub-parameter, "Footprint of The impact of global rankings in higher
Projects and Professional Practice (FPPP - education. J. Stud. Int. Edu., 2007, 11, 306 – 329.
19.70%)" from RPP, should be addressed to
improve faculty research funding earnings and [7] S, Harley. The impact of research selectivity on
consultancy amounts. academic work and identity in UK universities.
Stud. High. Educ., 2002, 27(2), 187-205.
Ÿ The sub-parameter "Number of Ph.D. Students
Graduated (GPHD - 30.65%)" in Category 3 - [8] Joorel, J. P. Trivedi, K. (2021). Ranking of Indian
GO is the least effective. To address this, Research-Intensive Higher Education
strategic actions like hiring strong research Institutions using Multiple Ranking
faculty, increasing stipends, and fellowships, Methodologies a Correlation Analysis.
improving research infrastructure, establishing DESIDOC Journal of Library & Information
research support services, and fostering T e c h n o l o g y .
Journal of Engineering Education Transformations , Volume 38, No. 1 , July 2024 , ISSN 2349-2473, eISSN 2394-1707 145