Skip to main content
Erschienen in: Quality & Quantity 2/2017

13.10.2016

Statistical tools for student evaluation of academic educational quality

verfasst von: Violetta Simonacci, Michele Gallo

Erschienen in: Quality & Quantity | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Measuring academic educational quality presents three major difficulties, typical of all customer satisfaction and service quality studies: the use of subjective scales; the ordinal nature of the data; and the multifold structure of satisfaction. In order to solve these problems, principal component analysis (PCA) of compositional data is proposed in this work. The core idea behind this methodology is to analyze by PCA the relative information within the data rather than focusing on absolute scores. This approach is discussed in comparison with a widely used Item Response Theory method (the Partial Credit Model) in order to assess its merits, e.g. always identifying a coherent preference structure. Both procedures were, thus, carried out on a real dataset collected with the 2013/14 ANVUR questionnaire by L’Universitá di Napoli-L’Orientale.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abdullah, F.: The development of HEdPERF: a new measuring instrument of service quality for the higher education sector. Int. J. Consum. Stud. 30(6), 569–581 (2006)CrossRef Abdullah, F.: The development of HEdPERF: a new measuring instrument of service quality for the higher education sector. Int. J. Consum. Stud. 30(6), 569–581 (2006)CrossRef
Zurück zum Zitat Agresti, A.: Analysis of ordinal categorical data, vol. 656. Wiley, New York (2010) Agresti, A.: Analysis of ordinal categorical data, vol. 656. Wiley, New York (2010)
Zurück zum Zitat Aitchison, J.: The statistical analysis of compositional data. Monographs on statistics and applied probability, Chapman and Hall Ltd., London (1986). Reprinted in 2003 with additional material by The Blackburn Press Aitchison, J.: The statistical analysis of compositional data. Monographs on statistics and applied probability, Chapman and Hall Ltd., London (1986). Reprinted in 2003 with additional material by The Blackburn Press
Zurück zum Zitat Aitchison, J.: Principles of compositional data analysis. Lecture Notes-Monograph Series, pp. 73–81 (1994) Aitchison, J.: Principles of compositional data analysis. Lecture Notes-Monograph Series, pp. 73–81 (1994)
Zurück zum Zitat Aitchison, J., Greenacre, M.: Biplots of compositional data. J. R. Stat. Soc. Series C 51(4), 375–392 (2002)CrossRef Aitchison, J., Greenacre, M.: Biplots of compositional data. J. R. Stat. Soc. Series C 51(4), 375–392 (2002)CrossRef
Zurück zum Zitat Andrich, D.: A rating scale formulation for ordered response categories. Psychometrika 43, 561–573 (1978)CrossRef Andrich, D.: A rating scale formulation for ordered response categories. Psychometrika 43, 561–573 (1978)CrossRef
Zurück zum Zitat ANVUR: Proposta operativa per l’avvio delle procedure di rilevamento dell’opinione degli studenti per l’A.A. 2013–2014 (2013) ANVUR: Proposta operativa per l’avvio delle procedure di rilevamento dell’opinione degli studenti per l’A.A. 2013–2014 (2013)
Zurück zum Zitat Bond, T.G., Fox, C.M.: Applying the Rasch Model. Lawrence Erlbaum, Mahwah (2001) Bond, T.G., Fox, C.M.: Applying the Rasch Model. Lawrence Erlbaum, Mahwah (2001)
Zurück zum Zitat Camminatiello, I., Gallo, M., Menini, T.: The objective measurements of student satisfaction by comparing the effects of different factors. Procedia Econ. Financ. 17, 71–78 (2014)CrossRef Camminatiello, I., Gallo, M., Menini, T.: The objective measurements of student satisfaction by comparing the effects of different factors. Procedia Econ. Financ. 17, 71–78 (2014)CrossRef
Zurück zum Zitat Cronin Jr, J. J., Taylor S. A.: Measuring service quality: a reexamination and extension. J. Market. 55–68 (1992) Cronin Jr, J. J., Taylor S. A.: Measuring service quality: a reexamination and extension. J. Market. 55–68 (1992)
Zurück zum Zitat De Leeuw, J., J., Van Rijckevorsel: HOMALS and PRINCALS. Some generalizations of principal components analysis. In: Diday, E., et al. (eds.) Data Analysis and Informatics, pp. 231–241. Amsterdam, North-Holland (1980) De Leeuw, J., J., Van Rijckevorsel: HOMALS and PRINCALS. Some generalizations of principal components analysis. In: Diday, E., et al. (eds.) Data Analysis and Informatics, pp. 231–241. Amsterdam, North-Holland (1980)
Zurück zum Zitat Egozcue, J. J., Barceló-Vidal, C., Martín-Fernéndez, J. A., Jarauta-Bragulat, E., Díaz-Barrero, J. L., Mateu-Figueras, G., Buccianti, A.: Elements of simplicial linear algebra and geometry. Compos. Data Anal. 141–157 (2011) Egozcue, J. J., Barceló-Vidal, C., Martín-Fernéndez, J. A., Jarauta-Bragulat, E., Díaz-Barrero, J. L., Mateu-Figueras, G., Buccianti, A.: Elements of simplicial linear algebra and geometry. Compos. Data Anal. 141–157 (2011)
Zurück zum Zitat Egozcue, J.J., Pawlowsky-Glahn, V., Mateu-Figueras, G., Barceló-Vidal, C.: Isometric logratio transformations for compositional data analysis. Math. Geol. 35, 279–300 (2003)CrossRef Egozcue, J.J., Pawlowsky-Glahn, V., Mateu-Figueras, G., Barceló-Vidal, C.: Isometric logratio transformations for compositional data analysis. Math. Geol. 35, 279–300 (2003)CrossRef
Zurück zum Zitat Filzmoser, P., Hron, K.: Correlation analysis for compositional data. Math. Geosci. 41(8), 905–919 (2009)CrossRef Filzmoser, P., Hron, K.: Correlation analysis for compositional data. Math. Geosci. 41(8), 905–919 (2009)CrossRef
Zurück zum Zitat Gallo, M.: The scaling problems in service quality evaluation. METODOLOSKI ZVEZKI 4 (2), 165–176 (2007) Gallo, M.: The scaling problems in service quality evaluation. METODOLOSKI ZVEZKI 4 (2), 165–176 (2007)
Zurück zum Zitat Gallo, M., Trendafilov, N.T., Buccianti, A.: Sparse PCA and investigation of multi-elements compositional repositories: theory and applications. Environ. Ecol. Stat. 1–14 (2016) Gallo, M., Trendafilov, N.T., Buccianti, A.: Sparse PCA and investigation of multi-elements compositional repositories: theory and applications. Environ. Ecol. Stat. 1–14 (2016)
Zurück zum Zitat Gifi, A.: Nonlinear multivariate analysis, vol. 452 S. DSWO-Press, University of Leiden, Leiden (1981) Gifi, A.: Nonlinear multivariate analysis, vol. 452 S. DSWO-Press, University of Leiden, Leiden (1981)
Zurück zum Zitat Holland, P.W., Wainer, H.: Differential Item Functioning. Lawrence Erlbaum Associates, Hillsdale (1993) Holland, P.W., Wainer, H.: Differential Item Functioning. Lawrence Erlbaum Associates, Hillsdale (1993)
Zurück zum Zitat Iacobucci, D., Ostrom, A., Grayson, K.: Distinguishing service quality and customer satisfaction: the voice of the consumer. J. Consum. Psychol. 4(3), 277–303 (1995)CrossRef Iacobucci, D., Ostrom, A., Grayson, K.: Distinguishing service quality and customer satisfaction: the voice of the consumer. J. Consum. Psychol. 4(3), 277–303 (1995)CrossRef
Zurück zum Zitat Kenett, R.S., Salini, S.: Modern analysis of customer satisfaction surveys: comparison of models and integrated analysis. Appl. Stoch. Models Bus. Ind. 27, 465–475 (2011)CrossRef Kenett, R.S., Salini, S.: Modern analysis of customer satisfaction surveys: comparison of models and integrated analysis. Appl. Stoch. Models Bus. Ind. 27, 465–475 (2011)CrossRef
Zurück zum Zitat Kruskal, J.B.: Nonmetric multidimensional scaling: a numerical method. Psychometrika 29, 115–129 (1964)CrossRef Kruskal, J.B.: Nonmetric multidimensional scaling: a numerical method. Psychometrika 29, 115–129 (1964)CrossRef
Zurück zum Zitat Linacre, J.M.: Facets Rasch Measurement Computer Program. Winsteps.com, Chicago (2004) Linacre, J.M.: Facets Rasch Measurement Computer Program. Winsteps.com, Chicago (2004)
Zurück zum Zitat Manisera, M., Van der Kooij, A.J., Dusseldorp, E.: Identifying the component structure of satisfaction scales by nonlinear principal components analysis. Qual. Technol. Quant. Manag. 7(2), 97–115 (2010) Manisera, M., Van der Kooij, A.J., Dusseldorp, E.: Identifying the component structure of satisfaction scales by nonlinear principal components analysis. Qual. Technol. Quant. Manag. 7(2), 97–115 (2010)
Zurück zum Zitat Marsh, H.W.: SEEQ: a reliable, valid, and useful instrument for collecting students’ evaluations of university teaching. Br. J. Educ. Psychol. 52(1), 77–95 (1982)CrossRef Marsh, H.W.: SEEQ: a reliable, valid, and useful instrument for collecting students’ evaluations of university teaching. Br. J. Educ. Psychol. 52(1), 77–95 (1982)CrossRef
Zurück zum Zitat Pagani, L., Zanarotti, M.C.: Some uses of Rasch Models parameters in customer satisfaction data analysis. Qual. Technol. Quant. Manag. 7(1), 83–95 (2010)CrossRef Pagani, L., Zanarotti, M.C.: Some uses of Rasch Models parameters in customer satisfaction data analysis. Qual. Technol. Quant. Manag. 7(1), 83–95 (2010)CrossRef
Zurück zum Zitat Parasuraman, A., Zeithaml, V.A., Berry, L.L.: Servqual: a multiple item scale for measuring customer perceptions of service quality. J. Retail. 64(1), 12–40 (1988) Parasuraman, A., Zeithaml, V.A., Berry, L.L.: Servqual: a multiple item scale for measuring customer perceptions of service quality. J. Retail. 64(1), 12–40 (1988)
Zurück zum Zitat Pawlowsky-Glahn, V., Egozcue, J.J.: Tolosana-Delgado: Modeling and Analysis of Compositional Data. Wiley, Chichester (2015) Pawlowsky-Glahn, V., Egozcue, J.J.: Tolosana-Delgado: Modeling and Analysis of Compositional Data. Wiley, Chichester (2015)
Zurück zum Zitat Rasch, G.: Probabilistic Models for Some Intelligence and Attainment Tests. Danish Institute for Educational Research, Copenhagen (1960) Rasch, G.: Probabilistic Models for Some Intelligence and Attainment Tests. Danish Institute for Educational Research, Copenhagen (1960)
Zurück zum Zitat van den Boogaart, G.K., Tolosana-Delgado, R.: Analyzing Compositional Data with R. Springer, Heidelberg (2013)CrossRef van den Boogaart, G.K., Tolosana-Delgado, R.: Analyzing Compositional Data with R. Springer, Heidelberg (2013)CrossRef
Zurück zum Zitat Wang, R., Tseng, M.L.: Evaluation of international student satisfaction using fuzzy importance-performance analysis. Procedia-Soc. Behav. Sci. 25, 438–446 (2011)CrossRef Wang, R., Tseng, M.L.: Evaluation of international student satisfaction using fuzzy importance-performance analysis. Procedia-Soc. Behav. Sci. 25, 438–446 (2011)CrossRef
Zurück zum Zitat Wright, B.D., Masters, G.N.: Rating Scale Analysis. MESA Press, Chicago (1982) Wright, B.D., Masters, G.N.: Rating Scale Analysis. MESA Press, Chicago (1982)
Zurück zum Zitat Wright, B.D., Masters, G.N.: The Partial Credit Model. In: Handbook of Modern Item Response Theory, pp. 101–121. Springer, New York (1997) Wright, B.D., Masters, G.N.: The Partial Credit Model. In: Handbook of Modern Item Response Theory, pp. 101–121. Springer, New York (1997)
Zurück zum Zitat Wright, B.D., Masters, G.N.: Computation of OUTFIT and INFIT statistics. Rasch Meas. Trans.3(4), 84–5 (1990) Wright, B.D., Masters, G.N.: Computation of OUTFIT and INFIT statistics. Rasch Meas. Trans.3(4), 84–5 (1990)
Zurück zum Zitat Zani, S., Milioli, M.A., Morlini, I.: Fuzzy composite indicators: an application for measuring customer satisfaction. In: Advances in Theoretical and Applied Statistics, pp. 243–253. Springer, Heidelberg (2013) Zani, S., Milioli, M.A., Morlini, I.: Fuzzy composite indicators: an application for measuring customer satisfaction. In: Advances in Theoretical and Applied Statistics, pp. 243–253. Springer, Heidelberg (2013)
Metadaten
Titel
Statistical tools for student evaluation of academic educational quality
verfasst von
Violetta Simonacci
Michele Gallo
Publikationsdatum
13.10.2016
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 2/2017
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-016-0425-z

Weitere Artikel der Ausgabe 2/2017

Quality & Quantity 2/2017 Zur Ausgabe