Skip to main content
Erschienen in: Quality & Quantity 1/2018

09.11.2016

Evaluation of the quality and quantity of research results in higher education

verfasst von: Amelia Bucur, Claudiu Vasile Kifor, Silvia Cristina Mărginean

Erschienen in: Quality & Quantity | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The evaluation of the quality and quantity of research results in higher education, both at an institutional and an individual level, has become a must in today’s competitive environment. Universities use sets of indicators validated at national or international level, in order to measure research results and to set goals, but sometimes they need specific systems that are more appropriate in order to reach their strategic objectives. Based on the system of evaluation used by a Romanian medium-sized university, in the first part of the case study from this article, it is mathematically proven that the measurement itself has a great impact on the research results’ dynamics because of the changing behaviour of the academic staff. The model could be applied and customized to any set of indicators used by different universities, and our results prove that a good set of indicators could be a useful tool to increase research performance and to achieve specific goals and strategic objectives in universities. In the second part of the case study, we tried to answer the following question: From a set of indicators used to quantify research activity in higher education, which ones are critical indicators? In order to find an answer to this question, we used the topic of hierarchization of the research indicators in higher-education as a multiple-criteria decision-making problem. The criteria used in the case study are funding from the state budget and from other sources, and national and international visibility of the research results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ab Hamid, M.R., Mustafa, Z., Suradi, N.R.M., Idris, F., Abdullah, M.: Value-based performance excellence measurement for higher education institution: instrument validation. Qual. Quant. 47(6), 3019–3030 (2013)CrossRef Ab Hamid, M.R., Mustafa, Z., Suradi, N.R.M., Idris, F., Abdullah, M.: Value-based performance excellence measurement for higher education institution: instrument validation. Qual. Quant. 47(6), 3019–3030 (2013)CrossRef
Zurück zum Zitat Agrell, P.J., Lence, B.J., Stam, A.: An interactive multicriteria decision model for multipurpose reservoir management: the Shellmouth Reservoir. J. Multi-Criteria Decis. Anal. 7(2), 61–86 (1988)CrossRef Agrell, P.J., Lence, B.J., Stam, A.: An interactive multicriteria decision model for multipurpose reservoir management: the Shellmouth Reservoir. J. Multi-Criteria Decis. Anal. 7(2), 61–86 (1988)CrossRef
Zurück zum Zitat Angilella, S., Corrente, S., Greco, S., Slowinski, R.: Multiple criteria hierarchy process for the Choquet integral. Evol. MultiCriterion Optim. Lect. Notes Comput. Sci. 7811, 475–489 (2013)CrossRef Angilella, S., Corrente, S., Greco, S., Slowinski, R.: Multiple criteria hierarchy process for the Choquet integral. Evol. MultiCriterion Optim. Lect. Notes Comput. Sci. 7811, 475–489 (2013)CrossRef
Zurück zum Zitat Bacon, D.R., Paul, P., Stewart, K.A., Mukhopadhyay, K.: A new tool for identifying research standards and evaluating research performance. J. Mark. Educ. 34(2), 194–208 (2012)CrossRef Bacon, D.R., Paul, P., Stewart, K.A., Mukhopadhyay, K.: A new tool for identifying research standards and evaluating research performance. J. Mark. Educ. 34(2), 194–208 (2012)CrossRef
Zurück zum Zitat Barnes, C.: The emperor’s new clothes: the h-index as a guide to resource allocation in higher education. J. High. Educ. Policy Manag. 36(5), 456–470 (2014)CrossRef Barnes, C.: The emperor’s new clothes: the h-index as a guide to resource allocation in higher education. J. High. Educ. Policy Manag. 36(5), 456–470 (2014)CrossRef
Zurück zum Zitat Beg, I., Rashid, T.: A geometric aggregation operator for decision making. Vietnam J. Comput. Sci. 2, 243–255 (2015)CrossRef Beg, I., Rashid, T.: A geometric aggregation operator for decision making. Vietnam J. Comput. Sci. 2, 243–255 (2015)CrossRef
Zurück zum Zitat Beltramini, R.F., Schlacter, J.L., Kelly, C.: Marketing faculty promotion and tenure policies and practices. J. Mark. Educ. 7(2), 74–80 (1985)CrossRef Beltramini, R.F., Schlacter, J.L., Kelly, C.: Marketing faculty promotion and tenure policies and practices. J. Mark. Educ. 7(2), 74–80 (1985)CrossRef
Zurück zum Zitat Blackmore, P., Blackwell, R.: Strategic leadership in academic development. Stud. High. Educ. 31(3), 373–387 (2006)CrossRef Blackmore, P., Blackwell, R.: Strategic leadership in academic development. Stud. High. Educ. 31(3), 373–387 (2006)CrossRef
Zurück zum Zitat Bucur, A.: Examples of using the SPSS and WinQSB softwares for collecting and analyzing data in order to obtain the optimum quality. Metal. Int. 17(6), 187–191 (2012) Bucur, A.: Examples of using the SPSS and WinQSB softwares for collecting and analyzing data in order to obtain the optimum quality. Metal. Int. 17(6), 187–191 (2012)
Zurück zum Zitat Bucur, A.: Contribuţii la abordarea ştiinţifică a calităţii şi managementului calităţii, prin modelare şi simulare. Lucian Blaga University of Sibiu Publishing House, Sibiu (2015) Bucur, A.: Contribuţii la abordarea ştiinţifică a calităţii şi managementului calităţii, prin modelare şi simulare. Lucian Blaga University of Sibiu Publishing House, Sibiu (2015)
Zurück zum Zitat Burnett, J.J., Amason, R.D., Cunningham, P.: What makes marketing academicians successful? An assessment of teaching, publishing, and service. J. Mark. Educ. 11(3), 7–11 (1989)CrossRef Burnett, J.J., Amason, R.D., Cunningham, P.: What makes marketing academicians successful? An assessment of teaching, publishing, and service. J. Mark. Educ. 11(3), 7–11 (1989)CrossRef
Zurück zum Zitat Choy, C.S., Yew, W.K., Lin, B.: Criteria for measuring KM performance outcomes in organizations. Ind. Manag. Data Syst. 106(7), 917–936 (2006)CrossRef Choy, C.S., Yew, W.K., Lin, B.: Criteria for measuring KM performance outcomes in organizations. Ind. Manag. Data Syst. 106(7), 917–936 (2006)CrossRef
Zurück zum Zitat Ciuiu, D.: MADM in case of simultaneous equations models and economic applications. Procedia Econ. Financ. 8, 167–174 (2014)CrossRef Ciuiu, D.: MADM in case of simultaneous equations models and economic applications. Procedia Econ. Financ. 8, 167–174 (2014)CrossRef
Zurück zum Zitat Coe, R.K., Weinstock, I.: Evaluating journal publications of marketing professors: a second look. J. Mark. Educ. 5(1), 37–42 (1983)CrossRef Coe, R.K., Weinstock, I.: Evaluating journal publications of marketing professors: a second look. J. Mark. Educ. 5(1), 37–42 (1983)CrossRef
Zurück zum Zitat Diwekar, U.M., Rubin, E.S., Frey, H.C.: Optimal design of advanced power systems under uncertainty. Energy Convers. Manag. J. 38, 1725–1735 (1997)CrossRef Diwekar, U.M., Rubin, E.S., Frey, H.C.: Optimal design of advanced power systems under uncertainty. Energy Convers. Manag. J. 38, 1725–1735 (1997)CrossRef
Zurück zum Zitat Ebadi, A., Schiffauerova, A.: How to boost scientific production? A statistical analysis of research funding and other influencing factors. Scientometrics (2016). doi:10.1007/s11192-015-1825-x Ebadi, A., Schiffauerova, A.: How to boost scientific production? A statistical analysis of research funding and other influencing factors. Scientometrics (2016). doi:10.​1007/​s11192-015-1825-x
Zurück zum Zitat Escheauer, H.A.: Multicriteria optimization techniques for highly accurate focusing systems. Multicriteria Optim. Eng. Sci. 37, 309–354 (1988)CrossRef Escheauer, H.A.: Multicriteria optimization techniques for highly accurate focusing systems. Multicriteria Optim. Eng. Sci. 37, 309–354 (1988)CrossRef
Zurück zum Zitat Frangopol, P.T.: Indexul Hirsch – un nou indicator scientometric pentru evaluarea rezultatelor unui cercetător ştiinţific. Revista de Politica Ştiinţei şi Scientometrie 1, 75 (2012) Frangopol, P.T.: Indexul Hirsch – un nou indicator scientometric pentru evaluarea rezultatelor unui cercetător ştiinţific. Revista de Politica Ştiinţei şi Scientometrie 1, 75 (2012)
Zurück zum Zitat Fu, Y., Diwekar, U.: Cost effective environmental management for utilities. Adv. Environ. Res. 8, 173 (2003)CrossRef Fu, Y., Diwekar, U.: Cost effective environmental management for utilities. Adv. Environ. Res. 8, 173 (2003)CrossRef
Zurück zum Zitat Gordon, G., Whitchurch, C.: Managing human resources in higher education: the implications of a diversifying workforce. High. Educ. Manag. Policy 19(2), 135–155 (2007) Gordon, G., Whitchurch, C.: Managing human resources in higher education: the implications of a diversifying workforce. High. Educ. Manag. Policy 19(2), 135–155 (2007)
Zurück zum Zitat Kolesnikov, A., Lebedeva, I.: Investigation of causality based on complex use of statistical methods (case study of social research). Qual. Quant. 47(6), 3043–3050 (2013)CrossRef Kolesnikov, A., Lebedeva, I.: Investigation of causality based on complex use of statistical methods (case study of social research). Qual. Quant. 47(6), 3043–3050 (2013)CrossRef
Zurück zum Zitat Kumar, P., Singh, N., Tewari, N.K.: A nonlinear goal programming model for multistage, multiobjective decision problems with application to grouping and loading problem in a flexible manufacturing system. Eur. J. Oper. Res. 53(2), 166–171 (1991)CrossRef Kumar, P., Singh, N., Tewari, N.K.: A nonlinear goal programming model for multistage, multiobjective decision problems with application to grouping and loading problem in a flexible manufacturing system. Eur. J. Oper. Res. 53(2), 166–171 (1991)CrossRef
Zurück zum Zitat Ionescu, GhGh, Cazan, E., Negruşa, A.L.: Modelarea şi optimizarea deciziilor manageriale. Dacia Publishing House, Cluj-Napoca (1999) Ionescu, GhGh, Cazan, E., Negruşa, A.L.: Modelarea şi optimizarea deciziilor manageriale. Dacia Publishing House, Cluj-Napoca (1999)
Zurück zum Zitat Ionescu, N.I.: An index to quantify the value of research. Revista de Politica Ştiinţei şi Scientometrie 3(2), 108–109 (2014) Ionescu, N.I.: An index to quantify the value of research. Revista de Politica Ştiinţei şi Scientometrie 3(2), 108–109 (2014)
Zurück zum Zitat Li, X., Chen, X.: Multi-criteria group decision making based on trapezoidal intuitionistic fuzzy information. Appl. Soft Comput. 30, 454–461 (2015)CrossRef Li, X., Chen, X.: Multi-criteria group decision making based on trapezoidal intuitionistic fuzzy information. Appl. Soft Comput. 30, 454–461 (2015)CrossRef
Zurück zum Zitat McInnis, C.: Changing academic work roles: the everyday realities challenging quality in teaching. Qual. High. Educ. 6(2), 143–152 (2000)CrossRef McInnis, C.: Changing academic work roles: the everyday realities challenging quality in teaching. Qual. High. Educ. 6(2), 143–152 (2000)CrossRef
Zurück zum Zitat Resteanu, C.: MADM. Teorie şi practică. ICI Publishing House, Bucharest (2006) Resteanu, C.: MADM. Teorie şi practică. ICI Publishing House, Bucharest (2006)
Zurück zum Zitat Rhoades, G.: Reorganising the faculty workforce for flexibility: part-time professional labour. J. High. Educ. 67(6), 624–659 (1996) Rhoades, G.: Reorganising the faculty workforce for flexibility: part-time professional labour. J. High. Educ. 67(6), 624–659 (1996)
Zurück zum Zitat Salmi, J., Saroyan, A.: League tables as policy instruments: uses and misues. High. Educ. Manag. Policy 19(2), 31–68 (2007) Salmi, J., Saroyan, A.: League tables as policy instruments: uses and misues. High. Educ. Manag. Policy 19(2), 31–68 (2007)
Zurück zum Zitat Schy, A.A., Giesy, D.P.: Multicriteria optimization methods for design of aircraft control systems. Multicriteria Optim. Eng. Sci. 37, 225–262 (1988)CrossRef Schy, A.A., Giesy, D.P.: Multicriteria optimization methods for design of aircraft control systems. Multicriteria Optim. Eng. Sci. 37, 225–262 (1988)CrossRef
Zurück zum Zitat Soung, H.K., Chung, H.H.: An interactive procedure for multi-attribute group decision making with incomplete information. Comput. Oper. Res. 26(8), 755–772 (1999)CrossRef Soung, H.K., Chung, H.H.: An interactive procedure for multi-attribute group decision making with incomplete information. Comput. Oper. Res. 26(8), 755–772 (1999)CrossRef
Zurück zum Zitat Seggie, S.H., Griffith, D.A.: What does it take to get promoted in marketing academia? Understanding exceptional publication productivity in the leading marketing journals. J. Mark. 73, 122–132 (2009)CrossRef Seggie, S.H., Griffith, D.A.: What does it take to get promoted in marketing academia? Understanding exceptional publication productivity in the leading marketing journals. J. Mark. 73, 122–132 (2009)CrossRef
Zurück zum Zitat Shepherd, C.D., Carley, S.S., Stuart, R.S.: An exploratory investigation of the periodic performance evaluation processes for marketing faculty: a comparison of doctoral-granting and non-doctoral-granting universities. J. Mark. Educ. 31, 143–153 (2009)CrossRef Shepherd, C.D., Carley, S.S., Stuart, R.S.: An exploratory investigation of the periodic performance evaluation processes for marketing faculty: a comparison of doctoral-granting and non-doctoral-granting universities. J. Mark. Educ. 31, 143–153 (2009)CrossRef
Zurück zum Zitat Shih, K.-H., Liu, Y.-T., Jones, C., Lin, B.: The indicators of human capital for financial institutions. Expert Syst. Appl. 37, 1503–1509 (2010)CrossRef Shih, K.-H., Liu, Y.-T., Jones, C., Lin, B.: The indicators of human capital for financial institutions. Expert Syst. Appl. 37, 1503–1509 (2010)CrossRef
Zurück zum Zitat Silaghi-Dumitrescu, R.: A scientometrics-informed peer-review exercise. Revista de Politica Ştiinţei şi Scientometrie 4(3), 234–237 (2015) Silaghi-Dumitrescu, R.: A scientometrics-informed peer-review exercise. Revista de Politica Ştiinţei şi Scientometrie 4(3), 234–237 (2015)
Zurück zum Zitat Soutar, G.N., Murphy, J.: Journal quality: a Google scholar analysis. Australas. Mark. J. 17, 150–153 (2009)CrossRef Soutar, G.N., Murphy, J.: Journal quality: a Google scholar analysis. Australas. Mark. J. 17, 150–153 (2009)CrossRef
Zurück zum Zitat Steward, M.D., Lewis, B.R.: A comprehensive analysis of marketing journal rankings. J. Mark. Educ. 32(1), 75–92 (2010)CrossRef Steward, M.D., Lewis, B.R.: A comprehensive analysis of marketing journal rankings. J. Mark. Educ. 32(1), 75–92 (2010)CrossRef
Zurück zum Zitat Wei, G.W.: Some geometric aggregation functions and their application to dynamic multiple attribute decision making in the intuitionistic fuzzy setting. Int. J. Uncertain. Fuzziness Knowl. Based Syst. 17(2), 179–196 (2009)CrossRef Wei, G.W.: Some geometric aggregation functions and their application to dynamic multiple attribute decision making in the intuitionistic fuzzy setting. Int. J. Uncertain. Fuzziness Knowl. Based Syst. 17(2), 179–196 (2009)CrossRef
Zurück zum Zitat Whitchurch, C.: Who do they think they are? The changing identities of professional administrators and managers in UK higher education. J. High. Educ. Policy Manag. 28(2), 159–171 (2006)CrossRef Whitchurch, C.: Who do they think they are? The changing identities of professional administrators and managers in UK higher education. J. High. Educ. Policy Manag. 28(2), 159–171 (2006)CrossRef
Zurück zum Zitat Yu, D.: A scientometrics review on aggregation operator research. Scientometrics 105(1), 115–133 (2015)CrossRef Yu, D.: A scientometrics review on aggregation operator research. Scientometrics 105(1), 115–133 (2015)CrossRef
Zurück zum Zitat Zanakis, S., Solomon, H., Wishart, A., Dublish, N.S.: Multi-attribute decision making: a simulation comparison of select methods. Eur. J. Oper. Res. 107(3), 507–529 (1998)CrossRef Zanakis, S., Solomon, H., Wishart, A., Dublish, N.S.: Multi-attribute decision making: a simulation comparison of select methods. Eur. J. Oper. Res. 107(3), 507–529 (1998)CrossRef
Metadaten
Titel
Evaluation of the quality and quantity of research results in higher education
verfasst von
Amelia Bucur
Claudiu Vasile Kifor
Silvia Cristina Mărginean
Publikationsdatum
09.11.2016
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 1/2018
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-016-0452-9

Weitere Artikel der Ausgabe 1/2018

Quality & Quantity 1/2018 Zur Ausgabe

Premium Partner