Skip to main content
Top
Published in: Quality & Quantity 3/2015

01-05-2015

A classification of university courses based on students’ satisfaction: an application of a two-level mixture item response model

Authors: Silvia Bacci, Michela Gnaldi

Published in: Quality & Quantity | Issue 3/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Over the past years, Italian universities have come under increased pressure to be more competitive and attract more students, and students’ satisfaction has received increasing attention. Students’ opinions about a few aspects of academic life are sought by Italian universities in the form of a satisfaction feedback questionnaire. The aim of this paper is to classify university courses into homogeneous classes with respect to the level of students’ satisfaction through the use of a two-level mixture item response model. The data are drawn from the Italian questionnaire on students’ satisfaction administered at a Faculty of Political Sciences. The latent variables measured by the questionnaire are detected performing a model-based hierarchical clustering. Then, a special case of multilevel mixture factor model characterised by an item response parameterisation and discrete latent variables at all hierarchical levels is estimated. The study allowed us to ascertain (i) the latent dimensionality of students’ satisfaction with higher education courses; (ii) the varied effect of first and second-level covariates on the satisfaction dimensions; and (iii) the different sources of strength/weaknesses of the best and worst courses.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Amendola, A., Vitale, M.: Self-assessment and career choices: a multivariate analysis for the University of Salerno. In: Atti della XLII Riunione scientifica della SIS (2004) Amendola, A., Vitale, M.: Self-assessment and career choices: a multivariate analysis for the University of Salerno. In: Atti della XLII Riunione scientifica della SIS (2004)
go back to reference Arena, M., Arnaboldi, M., Azzone, G.: Student perceptions and central administrative services: the case of higher education in Italy. Stud. High. Educ. 35(8), 941–959 (2010)CrossRef Arena, M., Arnaboldi, M., Azzone, G.: Student perceptions and central administrative services: the case of higher education in Italy. Stud. High. Educ. 35(8), 941–959 (2010)CrossRef
go back to reference Bacci, S., Caviezel, V.: Multilevel IRT models for the university teaching evaluation. J. Appl. Stat. 38, 2775–2791 (2011)CrossRef Bacci, S., Caviezel, V.: Multilevel IRT models for the university teaching evaluation. J. Appl. Stat. 38, 2775–2791 (2011)CrossRef
go back to reference Bacci, S., Bartolucci, F., Gnaldi, M.: A class of multidimensional latent class IRT models for ordinal polytomous item responses. Commun. Stat. Theory Methods 43, 787–800 (2014)CrossRef Bacci, S., Bartolucci, F., Gnaldi, M.: A class of multidimensional latent class IRT models for ordinal polytomous item responses. Commun. Stat. Theory Methods 43, 787–800 (2014)CrossRef
go back to reference Bartolucci, F.: A class of multidimensional IRT models for testing unidimensionality and clustering items. Psychometrika 72, 141–157 (2007)CrossRef Bartolucci, F.: A class of multidimensional IRT models for testing unidimensionality and clustering items. Psychometrika 72, 141–157 (2007)CrossRef
go back to reference Bartolucci, F., Montanari, G., Pandolfi, S.: Dimensionality of the latent structure and item selection via latent class multidimensional IRT models. Psychometrika 77, 782–802 (2012)CrossRef Bartolucci, F., Montanari, G., Pandolfi, S.: Dimensionality of the latent structure and item selection via latent class multidimensional IRT models. Psychometrika 77, 782–802 (2012)CrossRef
go back to reference Bartolucci, F., Bacci, S., Gnaldi, M.: MultiLCIRT: an R package for multidimensional latent class item response models. Comput. Stat. Data Anal. 71, 971–985 (2014)CrossRef Bartolucci, F., Bacci, S., Gnaldi, M.: MultiLCIRT: an R package for multidimensional latent class item response models. Comput. Stat. Data Anal. 71, 971–985 (2014)CrossRef
go back to reference Bigné, E., Moliner, M., Sánchez, J.: Perceived quality and satisfaction in multiservice organisations: the case of Spanish public services. J. Serv. Mark. 17(4), 420–442 (2003)CrossRef Bigné, E., Moliner, M., Sánchez, J.: Perceived quality and satisfaction in multiservice organisations: the case of Spanish public services. J. Serv. Mark. 17(4), 420–442 (2003)CrossRef
go back to reference Cho, S.J., Cohen, A.S.: A multilevel mixture IRT model with an application to DIF. J. Educ. Behav. Stat. 35, 336–370 (2010)CrossRef Cho, S.J., Cohen, A.S.: A multilevel mixture IRT model with an application to DIF. J. Educ. Behav. Stat. 35, 336–370 (2010)CrossRef
go back to reference Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. Ser. B 39, 1–38 (1977) Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. Ser. B 39, 1–38 (1977)
go back to reference Douglas, J., Douglas, A., Barnes, B.: Measuring student satisfaction at a UK university. Qual. Assur. Educ. 14(3), 251–267 (2006)CrossRef Douglas, J., Douglas, A., Barnes, B.: Measuring student satisfaction at a UK university. Qual. Assur. Educ. 14(3), 251–267 (2006)CrossRef
go back to reference Ford, J., Joseph, M., Joseph, B.: Importance-performance analysis as a strategic tool for service marketers: the case of service quality perceptions of business students in New Zealand and the USA. J. Serv. Mark. 13(2), 171–186 (1999)CrossRef Ford, J., Joseph, M., Joseph, B.: Importance-performance analysis as a strategic tool for service marketers: the case of service quality perceptions of business students in New Zealand and the USA. J. Serv. Mark. 13(2), 171–186 (1999)CrossRef
go back to reference Goodman, L.A.: Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 61, 215–231 (1974)CrossRef Goodman, L.A.: Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 61, 215–231 (1974)CrossRef
go back to reference Grilli, L., Rampichini, C.: Multilevel factor models for ordinal variables. Struct. Equ. Model. 14(1), 1–25 (2007)CrossRef Grilli, L., Rampichini, C.: Multilevel factor models for ordinal variables. Struct. Equ. Model. 14(1), 1–25 (2007)CrossRef
go back to reference de Jager, J., Gbadamosi, G.: Specific remedy for specific problem: measuring service quality in South African higher education. High. Educ. 60, 251–267 (2010)CrossRef de Jager, J., Gbadamosi, G.: Specific remedy for specific problem: measuring service quality in South African higher education. High. Educ. 60, 251–267 (2010)CrossRef
go back to reference Lai, L., To, W., Lung, J., Lai, T.: The perceived value of higher education: the voice of Chinese students. High. Educ. 63, 271–287 (2012)CrossRef Lai, L., To, W., Lung, J., Lai, T.: The perceived value of higher education: the voice of Chinese students. High. Educ. 63, 271–287 (2012)CrossRef
go back to reference Lazarsfeld, P.F., Henry, N.W.: Latent Structure Analysis. Houghton Mifflin, Boston (1968) Lazarsfeld, P.F., Henry, N.W.: Latent Structure Analysis. Houghton Mifflin, Boston (1968)
go back to reference Martilla, J., James, J.: Importance-performance analysis. J. Mark. 41(1), 77–79 (1977)CrossRef Martilla, J., James, J.: Importance-performance analysis. J. Mark. 41(1), 77–79 (1977)CrossRef
go back to reference Masters, G.: A Rasch model for partial credit scoring. Psychometrika 47, 149–174 (1982)CrossRef Masters, G.: A Rasch model for partial credit scoring. Psychometrika 47, 149–174 (1982)CrossRef
go back to reference Mergen, E., Grant, D., Widrick, S.: Quality management applied to higher education. Total Qual. Manag. 11(3), 345–352 (2000)CrossRef Mergen, E., Grant, D., Widrick, S.: Quality management applied to higher education. Total Qual. Manag. 11(3), 345–352 (2000)CrossRef
go back to reference Mok, K.: Decentralisation and marketization of education in Singapore: a case study of the school excellence model. J. Educ. Adm. 41(4), 348–366 (2003)CrossRef Mok, K.: Decentralisation and marketization of education in Singapore: a case study of the school excellence model. J. Educ. Adm. 41(4), 348–366 (2003)CrossRef
go back to reference Moro-Egido, A., Panades, Æ.J.: An analysis of student satisfaction: full-time vs. part-time students. Soc. Indic. Res. 96, 363–378 (2010)CrossRef Moro-Egido, A., Panades, Æ.J.: An analysis of student satisfaction: full-time vs. part-time students. Soc. Indic. Res. 96, 363–378 (2010)CrossRef
go back to reference Muraki, E.: A generalized partial credit model: application of an EM algorithm. Appl. Psychol. Meas. 16, 159–176 (1992)CrossRef Muraki, E.: A generalized partial credit model: application of an EM algorithm. Appl. Psychol. Meas. 16, 159–176 (1992)CrossRef
go back to reference Nale, R., Rauch, D., Wathen, S., Barr, P.: An exploratory look at the use of importance-performance analysis as a curricular assessment tool in a school of business. J. Workplace Learn. 12(4), 139–145 (2000)CrossRef Nale, R., Rauch, D., Wathen, S., Barr, P.: An exploratory look at the use of importance-performance analysis as a curricular assessment tool in a school of business. J. Workplace Learn. 12(4), 139–145 (2000)CrossRef
go back to reference Paletta, A.: Il governo dell’università. Tra competizione e accountability. Il Mulino, Bologna (2005) Paletta, A.: Il governo dell’università. Tra competizione e accountability. Il Mulino, Bologna (2005)
go back to reference Palihawadana, G.H.: Modeling module evolution in marketing education. Qual. Assur. Educ. 7(1), 41–46 (1999)CrossRef Palihawadana, G.H.: Modeling module evolution in marketing education. Qual. Assur. Educ. 7(1), 41–46 (1999)CrossRef
go back to reference Petruzzellis, L., D’Uggento, A., Romanazzi, S.: Student satisfaction and quality of service in Italian universities. Manag. Serv. Qual. 16(4), 349–364 (2006)CrossRef Petruzzellis, L., D’Uggento, A., Romanazzi, S.: Student satisfaction and quality of service in Italian universities. Manag. Serv. Qual. 16(4), 349–364 (2006)CrossRef
go back to reference Rebora, G.: La valutazione degli atenei: alla ricerca della qualità. Azienda Pubblica 16, 411–437 (2003) Rebora, G.: La valutazione degli atenei: alla ricerca della qualità. Azienda Pubblica 16, 411–437 (2003)
go back to reference Rebora, G., Turri, M.: Critical factors in the use of evaluation in Italian universities. High. Educ. 61, 531–544 (2011)CrossRef Rebora, G., Turri, M.: Critical factors in the use of evaluation in Italian universities. High. Educ. 61, 531–544 (2011)CrossRef
go back to reference Rienzi, B., Sarmiento, A., McMillin, J.: Alumni perception of the impact of gender on their university experience. J. Coll. Stud. Dev. 34, 154–157 (1993) Rienzi, B., Sarmiento, A., McMillin, J.: Alumni perception of the impact of gender on their university experience. J. Coll. Stud. Dev. 34, 154–157 (1993)
go back to reference Samejima, F.: Estimation of ability using a response pattern of graded scores. Psychom. Monogr. 17. (1969) Samejima, F.: Estimation of ability using a response pattern of graded scores. Psychom. Monogr. 17. (1969)
go back to reference Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 6, 461–464 (1978)CrossRef Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 6, 461–464 (1978)CrossRef
go back to reference Sojkin, B., Bartkowiak, P.: Determinants of higher education choices and student satisfaction: the case of Poland. High. Educ. 63, 565–581 (2011)CrossRef Sojkin, B., Bartkowiak, P.: Determinants of higher education choices and student satisfaction: the case of Poland. High. Educ. 63, 565–581 (2011)CrossRef
go back to reference Soutar, G.N., Turner, J.P.: Student preferences for university: a conjoint analysis. Int. J. Educ. Manag. 16(1), 40–45 (2002)CrossRef Soutar, G.N., Turner, J.P.: Student preferences for university: a conjoint analysis. Int. J. Educ. Manag. 16(1), 40–45 (2002)CrossRef
go back to reference Vermunt, J.K.: Multilevel latent class models. Sociol. Methodol. 33, 213–239 (2003)CrossRef Vermunt, J.K.: Multilevel latent class models. Sociol. Methodol. 33, 213–239 (2003)CrossRef
go back to reference Vermunt, J.K.: Multilevel latent variable modeling: an application in education testing. Austrian J. Stat. 37, 285–299 (2008) Vermunt, J.K.: Multilevel latent variable modeling: an application in education testing. Austrian J. Stat. 37, 285–299 (2008)
go back to reference Vermunt, J.K., Magidson, J.: Latent GOLD 4.0 User’s Guide. Statistical Innovations Inc., Belmont (2005) Vermunt, J.K., Magidson, J.: Latent GOLD 4.0 User’s Guide. Statistical Innovations Inc., Belmont (2005)
go back to reference Voss, R., Gruber, T., Szmigin, I.: Service quality in higher education: the role of student expectations. J. Bus. Res. 60(9), 949–959 (2007)CrossRef Voss, R., Gruber, T., Szmigin, I.: Service quality in higher education: the role of student expectations. J. Bus. Res. 60(9), 949–959 (2007)CrossRef
Metadata
Title
A classification of university courses based on students’ satisfaction: an application of a two-level mixture item response model
Authors
Silvia Bacci
Michela Gnaldi
Publication date
01-05-2015
Publisher
Springer Netherlands
Published in
Quality & Quantity / Issue 3/2015
Print ISSN: 0033-5177
Electronic ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-014-0101-0

Other articles of this Issue 3/2015

Quality & Quantity 3/2015 Go to the issue

Premium Partner