Towards a Framework for Evaluating Scientific Efficiency of World-Class Universities

Authors: Veljko Jeremic, Milica Kostic-Stankovic, Aleksandar Markovic, Milan Martic

Abstract:

Evaluating the efficiency of decision making units has been frequently elaborated on in numerous publications. In this paper, the theoretical framework for a novel method of Distance Based Analysis (DBA) is presented. In addition, the method is performed on a sample of the ARWU’s top 54 Universities of the United States; the findings of which clearly demonstrate that the best ranked Universities are far from also being the most efficient.

Keywords: Evaluating Efficiency, Distance Based Analysis, Ranking of Universities, ARWU.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1091058

References:

[1] B. Ivanovic, Classification Theory. Belgrade: Institute for Industrial Economics, 1977.
[2] V. Jeremic, M. Bulajic, M. Martic, and Z. Radojicic, "A Fresh Approach to Evaluating the Academic Ranking of World Universities”, Scientometrics, vol. 87, no. 3, pp. 587-596, 2011.
[3] М. Dоbrоtа, V. Јеrеmic, and А. Маrkоvic, "A New Perspective on the ICT Development Index”, Information Development, vol. 28, no. 4, pp. 271-280, 2012.
[4] V. Јеrеmic, М. Bulајic, М. Маrtic, А. Маrkоvic, G. Sаvic, D. Јеrеmic, and Z. Rаdојicic, "An Evaluation of European Countries Health Systems through Distance Based Analysis”, Hippokratia, vol. 16, no. 2, pp. 170-174, 2012.
[5] Z. Rаdојicic, and V. Јеrеmic, "Quantity or Quality: What Matters More in Ranking Higher Education Institutions?”, Current Science, vol. 103, no. 2, pp. 158-162, 2012.
[6] K. Seke, N. Petrovic, V. Jeremic, J. Vukmirovic, B. Kilibarda, and M. Martic, "Sustainable Development and Public Health: Rating European Countries”, BMC Public Health, vol. 13, no. 77, 2013.
[7] N. A. Bowman, and M. N. Bastedo, "Anchoring Effects in World University Rankings: Exploring Biases in Reputation Scores”, Higher Education, vol. 61, no. 4, pp. 431- 444, 2011.
[8] P. Paruolo, M. Saisana, and A. Saltelli, "Ratings and Rankings: Voodoo or Science?”, Journal of the Royal Statistical Society: Series A (Statistics in Society), vol. 176, no. 3, pp. 609-634, 2013.
[9] М. Јоvаnоvic, V. Јеrеmic, G. Sаvic, М. Bulајic, and М. Маrtic, "How does the normalization of data affect the ARWU ranking?”, Scientometrics, vol. 93, no. 2, pp. 319-327, 2012.
[10] I. Aguillo, J. Bar-IIan, M. Levene, and J. L. Ortega, "Comparing university rankings”, Scientometrics, vol. 85, no. 1, pp. 243–256, 2010.
[11] M. Zitt, and G. Filliatreau, "Big is (Made) Beautiful: Some Comments about the Shanghai Ranking of World-Class Universities”, in J. Sadlak, and N.C. Liu (Eds.), The World-Class University and Ranking: Aiming beyond Status (pp. 141–160). UNESCO-CEPES, Institute of Higher Education, Shanghai Jiao Tong University, and Cluj University Press, 2007.
[12] J. C., Billaut, D. Bouyssou, and P. Vincke, "Should You Believe in the Shanghai Ranking: An MCDM View”, Scientometrics, vol. 84, no. 1, pp. 237–263, 2010.
[13] G. Prathap, "The Research Performance of Top Indian and Chinese Higher Education Institutions Compared”, Current Science, vol. 102, no. 6, p. 827, 2012.
[14] L. Waltman, C. Calero-Medina, J. Kosten, E. Noyons, R. Tijssen, J. Van Eck, T. Van Leeuwen, A. Van Raan, M. Visser, and P. Wouters, "The Leiden Ranking 2011/2012: Data Collection, Indicators, and Interpretation”, Journal of the American Society for Information Science and Technology, vol. 63, no. 12, pp. 2419–2432, 2012.
[15] D. Torres-Salinas, J. G. Moreno-Torres, E. Delgado-Lopez-Cezar, F. Herrera, "A Methodology for Institution-Field Rankings Based On a Bidimensional Analysis: The IFQ2A Index”, Scientometrics, vol. 88, no. 3, pp. 771-786, 2011.
[16] G. Abramo, T. Cicero, and G. D. D’Angelo, "A Field-Standardized Application of DEA to National-Scale Research Assessment of Universities”, Journal of Infometrics, vol. 5, pp. 618-628, 2011.
[17] T. Agasisti, G. Catalano, P. Landoni, and R. Verganti, "Evaluating the Performance of Academic Departments: An Analysis of Research-Related Output Efficiency”, Research Evaluation, vol. 21, no. 1, pp. 2-14, 2012.
[18] R. Mutz, L. Bornmann, and H. D. Daniel, "Types of Research Output Profiles: A Multilevel Latent Class Analysis of the Austrian Science Fund’s Final Project Report Data”, Research Evaluation, vol. 22, pp. 118-133, 2013.