Abstract
The use made of evaluation output is crucial for understanding the position and effectiveness of evaluation systems. This article examines the development of evaluation in the Italian university system from the 1990 s onwards where serious problems have been and continue to be addressed in the use of evaluation output to improve academic activities and make universities accountable for their behaviour. There is a tendency for evaluation to generate inappropriate or undesired effects and for those being assessed to adopt opportunistic behaviour. Underestimation of the universities’ organisational features is the main reason for so many difficulties.
Similar content being viewed by others
Notes
In 1980, the total number of students was 1,060,274 and in 1999, 1,673,960. During the same period, the number of professors increased from a total of 8,122 to 30,945.
References
Biolcati Rinaldi, F., Checchi, D., Guglielmetti, C., Salini, S., & e Turri, M. (2008). Ranking e valutazione: il caso delle classifiche delle università. Rassegna Italiana di Valutazione, 12(41), 81–114.
Boffo, S., & Moscati, R. (1998). Evaluation in the Italian higher educational system: Many tribes, many territories… many godfathers. European Journal of Education, 33(3), 349–360.
Bressan, M. (2008). Caratteristiche e dimensione dal VTR. In E. Reale, et al. (Eds.), La valutazione della ricerca pubblica. Una analisi della valutazione triennale della ricerca (pp. 17–37). Milano: Franco Angeli.
Capano, G. (2003). Administrative traditions and policy change: When policy paradigms matter. The case of Italian administrative reform during the 1990 s. Public Administration, 81(4), 781–801.
Capano, G. (2008). Looking for serendipity: The problematical reform of government within Italy’s Universities. Higher Education, 55(4), 481–504.
Chelimsky, E. (1997). The coming transformations in evaluation. In E. Chelimsky & W. Shadish (Eds.), Evaluation for the 21th Century (pp. 1–26). Thousand Oaks: Sage.
Chiesi, A. M. (2008). La valutazione della produzione sociologica. Quaderni di sociologia, 52(47), 123–134.
CIVR. (2004). Valutazione triennale della ricerca (VTR). Bando di partecipazione all’esercizio 2001-2003. http://www.civr.it. Accessed September 7 2009.
CNVSU. (2002). L’evoluzione del sistema di valutazione negli ultimi dieci anni. Atenei 5-6 pp. 15–35 http://www.vsu.it. Accessed September 7 2009.
Cohen, M. D., & March, J. G. (1974). Leadership and ambiguity: The American college president. New York: McGraw-Hill.
De Rita, G. (2003). Intervento di saluto. In C. Casciotti (Ed.), La valutazione: un indispensabile strumento di garanzia e di governance (pp. 21–24). Roma: CRUI.
Dente, B. (2006). I nuclei di valutazione dell’Università. Una ricerca promossa dal CNVSU. http://www.vsu.it. Accessed March 7 2009.
DiMaggio, P. J., & Powell, W. (1983). “The iron cage revisited” institutional isomorphism and collective rationality in organizational fields. American Sociological Review, 48, 147–160.
ENQA. (2005). Standards and guidelines for quality assurance in the European higher education area. http://www.enqa.net. Accessed September 7 2009.
Garegnani, P. (2007). Sulla valutazione della ricerca economica. Rivista italiana degli economisti, 2, 177–190.
Henkel, M. (1998). Evaluation in higher education: Conceptual and epistemological foundations. European Journal of Education, 33(3), 285–297.
Hood, C. (2007). Public service management by numbers: Why does it vary? Where has it come from? What are the gaps and the puzzles? Public Money and Management, 27(2), 95–102.
Luzzatto, G., & Moscati, R. (2005). University reform in Italy: Fears, expectations and contradictions. In A. Gornitzka, M. Kogan, & A. Amaral (Eds.), Reform and change in higher education (pp. 153–168). Dordrecht: Cher-Springer.
Meyer, M. W., & Gupta, V. (1994). The performance paradox. Research in Organizational Behavior, 16, 309–369.
Minelli, E., Rebora, G., & Turri, M. (2008a). How can evaluation fail? The case of Italian universities. Quality in Higher Education, 14(2), 157–173.
Minelli, E., Rebora, G., & Turri, M. (2008b). The structure and significance of the Italian research assessment exercise (VTR). In C. Mazza, P. Quattrone, & A. Riccaboni (Eds.), European universities in transition (pp. 221–236). London: Edward Elgar Publishing.
Minelli, E., Rebora, G., Turri, M., & Huisman, J. (2006). The impact of research and teaching evaluation in universities: comparing an Italian and a Dutch case. Quality in Higher Education, 12(2), 109–124.
Mintzberg, H. (1983). Structure in fives: Designing effective organizations. Englewood Cliffs: Prentice-Hall.
MIUR. (2004). Puntualità alle lezioni, chiarezza didattica e disponibilità. Gli studenti universitari giudicano i loro docenti. Università & Ricerca Informazioni, 3, 98–99.
Moscati, R. (2001). Italian university professors in transition. Higher Education, 41(1), 103–129.
Moynihan, D. (2008). Advocacy and Learning: An interactive-dialogue approach to perfomance information use. In W. Van Dooren, W. Van Dooren, & S. van de Walle (Eds.), Performance information in the public sector: How it is used. Basingstoke: Palgrave Mc Millan.
O’Connell, B. T. (2004). Enron. Con: He that filches from me my good name…makes me poor indeed. Critical Perspectives on Accounting, 15, 733–749.
Osservatorio nazionale per la valutazione del sistema universitario. (1998). University Funding Mechanisms and related issues. Doc. 3. http://www.vsu.it. Accessed September 7 2009.
Osservatorio nazionale per la valutazione del sistema universitario. (1998). Ruolo, organizzazione e attività dei Nuclei di valutazione interna delle università: Doc. 10 http://www.vsu.it Accessed September 7 2009.
Patton, M. (1997). Utilization-focused evaluation. Thousand Oaks: Sage.
Perrin, B. (1998). Effective use and misuse of performance measurement American. Journal of Evaluation, 19(3), 367–379.
Power, M. (1997). The audit society. Oxford: Oxford University Press.
Rauhvargers, A., Deane, C. e Pauwels W. (2009). Bologna process stocktaking report 2009. Report from working groups appointed by the Bologna Follow-up Group to the Ministerial Conference in Leuven/Louvain-la-Neuve. 28–29 April 2009. http://www.ond.vlaanderen.be/hogeronderwijs/bologna/conference/documents/Stocktaking_report_2009_FINAL.pdf Accessed May 29 2009.
Rebora, G. (1999). La valutazione dei risultati nelle amministrazioni pubbliche. Milano: Guerini e Associati.
Rebora, G., & Turri, M. (2009). Governance in higher education: An analysis of the Italian experience. In J. Huisman (Ed.), International perspectives on the governance of higher education. Alternative frameworks for coordination (pp. 13–31). Routledge: Abingdon.
Smith, P. (1995). On the unintended consequences of publishing performance indicators in the public sector. International Journal of Public Administration, 18, 277–310.
Stefani, E. (2006). Qualità nell’università. Milano: Franco Angeli.
Turri, M. (2002). Le esperienze di valutazione nelle università italiane: un’analisi critica. In E. Minelli, G. Rebora, & M. Turri (Eds.), Il valore dell’università (pp. 65–96). Milano: Guerini e Associati.
Turri, M. (2005). La valutazione dell’università. Un’analisi dell’impatto istituzionale e organizzativo. Milano: Guerini e Associati.
Turri, M. (2007). I fattori di crisi dei controlli nel caso delle Università. In G. Rebora (Ed.), La crisi dei controlli: imprese e istituzioni a confronto (pp. 279–323). Milano: Pearson Education Italia.
Van de Walle, S., & Van Dooren, W. (2008). Introduction: using public sector performance information. In W. Van Dooren & S. Van de Walle (Eds.), Using public sector performance information (pp. 1–11). Hampshire: Palgrave Macmillan.
VanThiel, S., & Leeuw, F. L. (2002). The performance paradox in the public sector. Public performance and management review, 25(3), 267–281.
Weick, K. E. (1976). Educational organizations as loosely coupled systems. Administrative Science Quarterly, 21(1), 1–20.
Weiss, C. (1972). Utilization of evaluation: Toward comparative study. In C. Weiss (Ed.), Evaluating action programs (pp. 318–326). Boston: Allyn & Bacon.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rebora, G., Turri, M. Critical factors in the use of evaluation in Italian universities. High Educ 61, 531–544 (2011). https://doi.org/10.1007/s10734-010-9347-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10734-010-9347-1