Skip to main content
Erschienen in: Quality & Quantity 2/2017

05.10.2016

Effectiveness of non-selective evaluation test scores for predicting first-year performance in university career: a zero-inflated beta regression approach

verfasst von: Lucio Masserini, Matilde Bini, Monica Pratesi

Erschienen in: Quality & Quantity | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The background preparation of students entering the university system is checked through evaluation tests in Italy. The test is non-selective in most degree programmes, as it does not preclude the possibility of enrolling in the student’s chosen program. However, the initial preparation and attitude of the students seem to be key issues in explaining their performance and predicting the performance outcome of their first-year in university. The evaluation test results are used to predict the students’ performance at the end of the first year by a zero inflated beta regression model. The analysis was conducted on the evaluation test carried out in September 2013 with students at the Department of Economics and Management, University of Pisa.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In this application, the maximum number of credit points during the first year is 57 and not 60 (as given in one year in most European countries), since 3 credits are dedicated to the examination test for evaluating computer skills, for which there are no grades points.
 
Literatur
Zurück zum Zitat Astin, A., Korn, W., Green, K.: Retaining and satisfying students. Educ. Rec. 68(Winter), 36–42 (1987) Astin, A., Korn, W., Green, K.: Retaining and satisfying students. Educ. Rec. 68(Winter), 36–42 (1987)
Zurück zum Zitat Barclay, M.J., Smith, C.W.: The determinants of corporate leverage and dividend policies. J. Appl. Corp. Financ. 7, 4–19 (1995)CrossRef Barclay, M.J., Smith, C.W.: The determinants of corporate leverage and dividend policies. J. Appl. Corp. Financ. 7, 4–19 (1995)CrossRef
Zurück zum Zitat Barndorff-Nielsen, O.E., Jorgensen, B.: Some parametric models on the simplex. J. Multivar. Anal. 39, 106–116 (1991)CrossRef Barndorff-Nielsen, O.E., Jorgensen, B.: Some parametric models on the simplex. J. Multivar. Anal. 39, 106–116 (1991)CrossRef
Zurück zum Zitat Bennett, R.: Determinants of undergraduate student dropout rates in a university business studies department. J. Furth. High. Educ. 27(2), 123–141 (2003)CrossRef Bennett, R.: Determinants of undergraduate student dropout rates in a university business studies department. J. Furth. High. Educ. 27(2), 123–141 (2003)CrossRef
Zurück zum Zitat Bridgeman, B., McCamley-Jenkins, L., Ervin, N.: Predictions of freshman grade-point average from the revised and recentered SAT I: reasoning test. ETS Res. Rep. Ser. 2000(1), 1–16 (2000) Bridgeman, B., McCamley-Jenkins, L., Ervin, N.: Predictions of freshman grade-point average from the revised and recentered SAT I: reasoning test. ETS Res. Rep. Ser. 2000(1), 1–16 (2000)
Zurück zum Zitat Broh, B.A.: Linking extracurricular programming to academic achievement: who benefits and why? Sociol. Educ. 75(1), 69–95 (2002)CrossRef Broh, B.A.: Linking extracurricular programming to academic achievement: who benefits and why? Sociol. Educ. 75(1), 69–95 (2002)CrossRef
Zurück zum Zitat Callender, C.: The impact of term-time employment on higher education students’ academic attainment and achievement. J. Educ. Policy 23(4), 359–377 (2008)CrossRef Callender, C.: The impact of term-time employment on higher education students’ academic attainment and achievement. J. Educ. Policy 23(4), 359–377 (2008)CrossRef
Zurück zum Zitat Carrieri, V., D’Amato, M., Zotti, R.: On the causal effects of selective admission policies on students’ performances: evidence from a quasi-experiment in a large Italian university. Oxford Econ. Pap. 67(4), 1034–1056 (2015)CrossRef Carrieri, V., D’Amato, M., Zotti, R.: On the causal effects of selective admission policies on students’ performances: evidence from a quasi-experiment in a large Italian university. Oxford Econ. Pap. 67(4), 1034–1056 (2015)CrossRef
Zurück zum Zitat Cox, C.: Nonlinear quasi-likelihood models: applications to continuous proportions. Comput. Stat. Data Anal. 21, 449–461 (1996)CrossRef Cox, C.: Nonlinear quasi-likelihood models: applications to continuous proportions. Comput. Stat. Data Anal. 21, 449–461 (1996)CrossRef
Zurück zum Zitat Darling, N.: Participation in extracurricular activities and adolescent adjustment: cross-sectional and longitudinal findings. J. Youth Adolesc. 34, 493–505 (2005)CrossRef Darling, N.: Participation in extracurricular activities and adolescent adjustment: cross-sectional and longitudinal findings. J. Youth Adolesc. 34, 493–505 (2005)CrossRef
Zurück zum Zitat Ferrari, S.L.P., Cribari-Neto, F.: Beta regression for modelling rates and proportions. J. Appl. Stat. 7, 799–815 (2004)CrossRef Ferrari, S.L.P., Cribari-Neto, F.: Beta regression for modelling rates and proportions. J. Appl. Stat. 7, 799–815 (2004)CrossRef
Zurück zum Zitat Fleming, J.: Who will succeed in college? When the SAT predicts Black students’ performance. Rev. High. Educ. 25(3), 281–296 (2002)CrossRef Fleming, J.: Who will succeed in college? When the SAT predicts Black students’ performance. Rev. High. Educ. 25(3), 281–296 (2002)CrossRef
Zurück zum Zitat Fleming, J., Garcia, N.: Are standardized tests fair to African Americans? Predictive validity of the SAT in Black and White institutions. J. High. Educ. 69(5), 471–495 (1998)CrossRef Fleming, J., Garcia, N.: Are standardized tests fair to African Americans? Predictive validity of the SAT in Black and White institutions. J. High. Educ. 69(5), 471–495 (1998)CrossRef
Zurück zum Zitat Francesconi, M., Aina, C., Cappellari, L.: Student performance may not improve when universities are choosier. Eval. Res. Educ. 24(4), 231–242 (2011)CrossRef Francesconi, M., Aina, C., Cappellari, L.: Student performance may not improve when universities are choosier. Eval. Res. Educ. 24(4), 231–242 (2011)CrossRef
Zurück zum Zitat Geiser, S., Studley, R.: UC and the SAT: predictive validity and differential impact of the SAT I and the SAT II at the University of California. Educ. Assess. 8(1), 1–26 (2003)CrossRef Geiser, S., Studley, R.: UC and the SAT: predictive validity and differential impact of the SAT I and the SAT II at the University of California. Educ. Assess. 8(1), 1–26 (2003)CrossRef
Zurück zum Zitat Gose, B.: Study says rigor of high school coursework is the best predictor of college graduation. Chron. High. Educ. XLV(39), A46 (1994) Gose, B.: Study says rigor of high school coursework is the best predictor of college graduation. Chron. High. Educ. XLV(39), A46 (1994)
Zurück zum Zitat Grilli, L., Rampichini, C., Varriale, R.: Statistical modelling of gained university credits to evaluate the role of pre-enrolment assessment tests: an approach based on quantile regression for counts. Stat. Model. 16(1), 47–66 (2016)CrossRef Grilli, L., Rampichini, C., Varriale, R.: Statistical modelling of gained university credits to evaluate the role of pre-enrolment assessment tests: an approach based on quantile regression for counts. Stat. Model. 16(1), 47–66 (2016)CrossRef
Zurück zum Zitat Gupta, A.K., Nadarajah, S.: Handbook of Beta Distribution and Its Applications. Marcel Dekker, New York (2004) Gupta, A.K., Nadarajah, S.: Handbook of Beta Distribution and Its Applications. Marcel Dekker, New York (2004)
Zurück zum Zitat Hermalin, B., Wallace, N.: The determinants of efficiency and solvency in savings and loans. Rand J. Econ. 25, 361–381 (1994)CrossRef Hermalin, B., Wallace, N.: The determinants of efficiency and solvency in savings and loans. Rand J. Econ. 25, 361–381 (1994)CrossRef
Zurück zum Zitat Johnson, N., Kotz, S., Balakrishnan, N.: Continuous Univariate Distributions, 2nd edn. Wiley, New York (1995) Johnson, N., Kotz, S., Balakrishnan, N.: Continuous Univariate Distributions, 2nd edn. Wiley, New York (1995)
Zurück zum Zitat Kieschnick, R., McCullough, B.D.: Regression analysis of variates observed on (0,1): percentages, proportions, and fractions. Stat. Model. 3, 1–21 (2003)CrossRef Kieschnick, R., McCullough, B.D.: Regression analysis of variates observed on (0,1): percentages, proportions, and fractions. Stat. Model. 3, 1–21 (2003)CrossRef
Zurück zum Zitat Kim, M.M.: Historically Black vs. White institutions: academic development among Black students. Rev. High. Educ. 25(4), 385–407 (2002)CrossRef Kim, M.M.: Historically Black vs. White institutions: academic development among Black students. Rev. High. Educ. 25(4), 385–407 (2002)CrossRef
Zurück zum Zitat Kuncel, N.R., Hezlett, S.A., Ones, D.S.: Academic performance, career potential, creativity, and job performance: can one construct predict them all? J. Pers. Soc. Psychol. 86, 148–161 (2004)CrossRef Kuncel, N.R., Hezlett, S.A., Ones, D.S.: Academic performance, career potential, creativity, and job performance: can one construct predict them all? J. Pers. Soc. Psychol. 86, 148–161 (2004)CrossRef
Zurück zum Zitat Kuncel, N.R., Crede, M., Thomas, L.L.: A comprehensive meta-analysis of the predictive validity of the Graduate Management Admission Test (GMAT) and undergraduate grade point average (UGPA). Acad. Manag. Learn. Educ. 6, 51–68 (2007)CrossRef Kuncel, N.R., Crede, M., Thomas, L.L.: A comprehensive meta-analysis of the predictive validity of the Graduate Management Admission Test (GMAT) and undergraduate grade point average (UGPA). Acad. Manag. Learn. Educ. 6, 51–68 (2007)CrossRef
Zurück zum Zitat Lawlor, S., Richman, S., Richman, C.L.: The validity of using the SAT as a criterion for Black and White students’ admission to college. Coll. Stud. J. 31, 507–515 (1997) Lawlor, S., Richman, S., Richman, C.L.: The validity of using the SAT as a criterion for Black and White students’ admission to college. Coll. Stud. J. 31, 507–515 (1997)
Zurück zum Zitat Minnaert, A., Janssen, P.J.: Success and progress in higher education: a structural model of studying. Br. J. Educ. Psychol. 62, 184–192 (1992)CrossRef Minnaert, A., Janssen, P.J.: Success and progress in higher education: a structural model of studying. Br. J. Educ. Psychol. 62, 184–192 (1992)CrossRef
Zurück zum Zitat Moffatt, G. K.: The validity of the SAT as a predictor of grade point average for nontraditional college students. Paper presented at the annual meeting of the Eastern Educational Research Association, Clearwater Beach, FL (ERIC Document Reproduction Service No. ED 356 252), Feb 1993 Moffatt, G. K.: The validity of the SAT as a predictor of grade point average for nontraditional college students. Paper presented at the annual meeting of the Eastern Educational Research Association, Clearwater Beach, FL (ERIC Document Reproduction Service No. ED 356 252), Feb 1993
Zurück zum Zitat Munro, B.H.: Dropouts from higher education: path analysis of a national sample. Am. Educ. Res. J. 18(2), 133–141 (1981)CrossRef Munro, B.H.: Dropouts from higher education: path analysis of a national sample. Am. Educ. Res. J. 18(2), 133–141 (1981)CrossRef
Zurück zum Zitat Noble, J.P., Sawyer, R.L.: Is high school GPA better than admission test scores for predicting academic success in college? Coll. Univ. J. 79(4), 17–22 (2004) Noble, J.P., Sawyer, R.L.: Is high school GPA better than admission test scores for predicting academic success in college? Coll. Univ. J. 79(4), 17–22 (2004)
Zurück zum Zitat Ospina, R., Ferrari, S.L.P.: Inflated beta distributions. Stat. Pap. 51, 111–126 (2010)CrossRef Ospina, R., Ferrari, S.L.P.: Inflated beta distributions. Stat. Pap. 51, 111–126 (2010)CrossRef
Zurück zum Zitat Ospina, R., Ferrari, S.L.P.: A general class of zero-or-one inflated beta regression models. Comput. Stat. Data Anal. 56, 1609–1623 (2012)CrossRef Ospina, R., Ferrari, S.L.P.: A general class of zero-or-one inflated beta regression models. Comput. Stat. Data Anal. 56, 1609–1623 (2012)CrossRef
Zurück zum Zitat Paolino, P.: Maximum likelihood estimation of models with beta-distributed dependent variables. Polit. Anal. 9, 325–346 (2001)CrossRef Paolino, P.: Maximum likelihood estimation of models with beta-distributed dependent variables. Polit. Anal. 9, 325–346 (2001)CrossRef
Zurück zum Zitat Papke, L., Wooldridge, J.: Econometric methods for fractional response variables with an application to 401(K) plan participation rates. J. Appl. Econom. 11, 619–632 (1996)CrossRef Papke, L., Wooldridge, J.: Econometric methods for fractional response variables with an application to 401(K) plan participation rates. J. Appl. Econom. 11, 619–632 (1996)CrossRef
Zurück zum Zitat Park, K.H., Kerr, P.M.: Determinants of academic performance: a multinomial logit approach. J. Econ. Educ. 21(2), 101–111 (1990)CrossRef Park, K.H., Kerr, P.M.: Determinants of academic performance: a multinomial logit approach. J. Econ. Educ. 21(2), 101–111 (1990)CrossRef
Zurück zum Zitat Pascarella, E.T., Terenzini, P.T.: How College Affects Students?. Jossey-Bass, San Francisco (1991) Pascarella, E.T., Terenzini, P.T.: How College Affects Students?. Jossey-Bass, San Francisco (1991)
Zurück zum Zitat Peltier, G.L., Laden, R., Matranga, M.: Student persistence in college: a review of research. J. Coll. Stud. Retent. 1, 357–376 (1999)CrossRef Peltier, G.L., Laden, R., Matranga, M.: Student persistence in college: a review of research. J. Coll. Stud. Retent. 1, 357–376 (1999)CrossRef
Zurück zum Zitat Ramist, L., Lewis, C., McCamley-Jenkins, L.: Student Group Differences in Predicting College Grades: Sex, Language, and Ethnic Groups. College Entrance Examination Board, New York (1994) Ramist, L., Lewis, C., McCamley-Jenkins, L.: Student Group Differences in Predicting College Grades: Sex, Language, and Ethnic Groups. College Entrance Examination Board, New York (1994)
Zurück zum Zitat Rienties, B., Beausaert, S., Grohnert, T., Niemantsverdriet, S., Kommers, P.: Understanding academic performance of international students: the role of ethnicity, academic and social integration. High. Educ. 63, 685–700 (2012)CrossRef Rienties, B., Beausaert, S., Grohnert, T., Niemantsverdriet, S., Kommers, P.: Understanding academic performance of international students: the role of ethnicity, academic and social integration. High. Educ. 63, 685–700 (2012)CrossRef
Zurück zum Zitat Rigby, R.A., Stasinopoulos, D.M.: Generalized additive models for location, scale and shape (with discussion). Appl. Stat. 54, 507–554 (2005) Rigby, R.A., Stasinopoulos, D.M.: Generalized additive models for location, scale and shape (with discussion). Appl. Stat. 54, 507–554 (2005)
Zurück zum Zitat Sawyer, R.: Beyond correlations: usefulness of high school GPA and test scores in making college admissions decisions. Appl. Meas. Educ. 26, 89–112 (2013)CrossRef Sawyer, R.: Beyond correlations: usefulness of high school GPA and test scores in making college admissions decisions. Appl. Meas. Educ. 26, 89–112 (2013)CrossRef
Zurück zum Zitat Simas, A.B., Barreto-Souza, W., Rocha, A.V.: Improved estimators for a general class of beta regression models. Comput. Stat. Data Anal. 54, 348–366 (2010)CrossRef Simas, A.B., Barreto-Souza, W., Rocha, A.V.: Improved estimators for a general class of beta regression models. Comput. Stat. Data Anal. 54, 348–366 (2010)CrossRef
Zurück zum Zitat Smithson, M., Merkle, E.C.: Generalized Linear Models for Categorical and Continuous Limited Dependent Variables. CRC Press, Boca Raton (2013) Smithson, M., Merkle, E.C.: Generalized Linear Models for Categorical and Continuous Limited Dependent Variables. CRC Press, Boca Raton (2013)
Zurück zum Zitat Smithson, M., Verkuilen, J.: A better lemon squeezer? maximum likelihood regression with beta distributed dependent variables. Psychol. Methods 11, 54–71 (2006)CrossRef Smithson, M., Verkuilen, J.: A better lemon squeezer? maximum likelihood regression with beta distributed dependent variables. Psychol. Methods 11, 54–71 (2006)CrossRef
Zurück zum Zitat Stasinopoulos, D.M., Rigby, R.A.: Generalized additive models for location scale and shape (GAMLSS) in R. J. Stat. Softw. 23, 1–43 (2007)CrossRef Stasinopoulos, D.M., Rigby, R.A.: Generalized additive models for location scale and shape (GAMLSS) in R. J. Stat. Softw. 23, 1–43 (2007)CrossRef
Zurück zum Zitat Tross, S.A., Harpeer, J.P., Osher, L.W., Kneidinger, L.M.: Not just the usual cast of characteristics: using personality to predict college student performance and retention. J. Coll. Stud. Dev. 41(3), 323–334 (2000) Tross, S.A., Harpeer, J.P., Osher, L.W., Kneidinger, L.M.: Not just the usual cast of characteristics: using personality to predict college student performance and retention. J. Coll. Stud. Dev. 41(3), 323–334 (2000)
Zurück zum Zitat Tu, W.: Zero inflated data. Encycl. Environ. 4, 2387–2391 (2002) Tu, W.: Zero inflated data. Encycl. Environ. 4, 2387–2391 (2002)
Zurück zum Zitat Vasconcellos, K.L.P., Cribari-Neto, F.: Improved maximum likelihood estimation in a new class of beta regression models. Braz. J. Probab. Stat. 19(1), 13–31 (2005) Vasconcellos, K.L.P., Cribari-Neto, F.: Improved maximum likelihood estimation in a new class of beta regression models. Braz. J. Probab. Stat. 19(1), 13–31 (2005)
Zurück zum Zitat Waugh, G., Micceri, T., Takalkar, P.: Using ethnicity, SAT/ACT scores, and high school GPA to predict retention and graduation rates. Paper presented at the Annual FAIR Conference, Orlando, 15–17 June 1994 Waugh, G., Micceri, T., Takalkar, P.: Using ethnicity, SAT/ACT scores, and high school GPA to predict retention and graduation rates. Paper presented at the Annual FAIR Conference, Orlando, 15–17 June 1994
Zurück zum Zitat Wilson, K.M.A.: Review of research on the prediction of academic performance after the freshman year. ETS Research Report Series 1983(1), i-44 (1983 June) Wilson, K.M.A.: Review of research on the prediction of academic performance after the freshman year. ETS Research Report Series 1983(1), i-44 (1983 June)
Zurück zum Zitat Wolfe, R.N., Johnson, S.D.: Personality as a predictor of college performance. Educ. Psychol. Meas. 55, 177–185 (1995)CrossRef Wolfe, R.N., Johnson, S.D.: Personality as a predictor of college performance. Educ. Psychol. Meas. 55, 177–185 (1995)CrossRef
Zurück zum Zitat Yuehui, W., Fedorov, V.V., Propert, K.J.: Optimal design for dose response using beta distributed responses. J. Biopharm. Stat. 15(5), 753–771 (2005)CrossRef Yuehui, W., Fedorov, V.V., Propert, K.J.: Optimal design for dose response using beta distributed responses. J. Biopharm. Stat. 15(5), 753–771 (2005)CrossRef
Metadaten
Titel
Effectiveness of non-selective evaluation test scores for predicting first-year performance in university career: a zero-inflated beta regression approach
verfasst von
Lucio Masserini
Matilde Bini
Monica Pratesi
Publikationsdatum
05.10.2016
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 2/2017
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-016-0433-z

Weitere Artikel der Ausgabe 2/2017

Quality & Quantity 2/2017 Zur Ausgabe