Skip to main content

2017 | OriginalPaper | Buchkapitel

Improving Peer Assessment Modeling of Teacher’s Grades, The Case of OpenAnswer

verfasst von : Maria De Marsico, Andrea Sterbini, Marco Temperini

Erschienen in: Emerging Technologies for Education

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Questions with answers are rarely used as e-learning assessment tools because of the resulting high workload for the teacher/tutor that should grade them, which can be mitigated by doing peer-assessment. In OpenAnswer we modeled peer-assessment as a Bayesian network connecting the sub-networks representing any participating student to the corresponding answers of her graded peers. The model has shown good ability to predict (without further info from the teacher) the exact teacher’s grade (ground truth) from the peer grades only, and a very good ability to predict it within 1 mark from the right one. In this paper we explore changes to the OpenAnswer model to improve its predictions. The experimental results, obtained by simulating teacher’s grading on real datasets, show the improved predictions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Anderson, L.W., Krathwohl, D.R.(eds.): A Taxonomy for Learning, Teaching, and Assessing: A Revision Of Bloom’s Taxonomy of Educational Objectives. Allyn and Bacon (2000) Anderson, L.W., Krathwohl, D.R.(eds.): A Taxonomy for Learning, Teaching, and Assessing: A Revision Of Bloom’s Taxonomy of Educational Objectives. Allyn and Bacon (2000)
2.
Zurück zum Zitat Bloom, B.S., Engelhart, M.D., Furst,. E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. David McKay, New York (1956) Bloom, B.S., Engelhart, M.D., Furst,. E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. David McKay, New York (1956)
3.
Zurück zum Zitat Castellanos-Nieves, D., Fernández-Breis, J., Valencia-García, R., Martínez-Béjar, R., Iniesta-Moreno, M.: Semantic Web Technologies for supporting learning assessment. Inf. Sci. 181, 9 (2011)CrossRef Castellanos-Nieves, D., Fernández-Breis, J., Valencia-García, R., Martínez-Béjar, R., Iniesta-Moreno, M.: Semantic Web Technologies for supporting learning assessment. Inf. Sci. 181, 9 (2011)CrossRef
4.
Zurück zum Zitat Cho, K., MacArthur, C.: Student revision with peer and expert reviewing. Learn. Instr. 20(4), 328–338 (2010)CrossRef Cho, K., MacArthur, C.: Student revision with peer and expert reviewing. Learn. Instr. 20(4), 328–338 (2010)CrossRef
5.
Zurück zum Zitat Chung, H., Graf, S., Robert Lai, K.: Kinshuk: Enrichment of peer assessment with agent negotiation. IEEE Trans. Learn. Technol. 4(1), 35–46 (2011)CrossRef Chung, H., Graf, S., Robert Lai, K.: Kinshuk: Enrichment of peer assessment with agent negotiation. IEEE Trans. Learn. Technol. 4(1), 35–46 (2011)CrossRef
6.
Zurück zum Zitat Conati, C., Gartner, A., Vanlehn, K.: Using Bayesian networks to manage uncertainty in student modeling. User Model. User-Adap. Inter. 12, 371–417 (2002)CrossRefMATH Conati, C., Gartner, A., Vanlehn, K.: Using Bayesian networks to manage uncertainty in student modeling. User Model. User-Adap. Inter. 12, 371–417 (2002)CrossRefMATH
7.
Zurück zum Zitat El-Kechaï, N., Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F.: Evaluating the performance of a diagnosis system in school algebra. In: Leung, H., Popescu, E., Cao, Y., Lau, R.W.H., Nejdl, W. (eds.) ICWL 2011. LNCS, vol. 7048, pp. 263–272. Springer, Heidelberg (2011). doi:10.1007/978-3-642-25813-8_28 CrossRef El-Kechaï, N., Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F.: Evaluating the performance of a diagnosis system in school algebra. In: Leung, H., Popescu, E., Cao, Y., Lau, R.W.H., Nejdl, W. (eds.) ICWL 2011. LNCS, vol. 7048, pp. 263–272. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-25813-8_​28 CrossRef
8.
Zurück zum Zitat Jackson, K., Trochim, W.: Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods, vol. 5. Sage (2002) Jackson, K., Trochim, W.: Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods, vol. 5. Sage (2002)
9.
Zurück zum Zitat Li, L.X., Liu, X., Steckelberg, A.L.: Assessor or assessee: how student learning improves by giving and receiving peer feedback. Br. J. Ed. Tech. 41(3), 525–536 (2010)CrossRef Li, L.X., Liu, X., Steckelberg, A.L.: Assessor or assessee: how student learning improves by giving and receiving peer feedback. Br. J. Ed. Tech. 41(3), 525–536 (2010)CrossRef
10.
Zurück zum Zitat Miller, P.: The Effect of Scoring Criteria Specificity on Peer and Self-assessment. Assessment & Evaluation in Higher Education, 28/4 (2003) Miller, P.: The Effect of Scoring Criteria Specificity on Peer and Self-assessment. Assessment & Evaluation in Higher Education, 28/4 (2003)
11.
Zurück zum Zitat Palmer, K., Richardson, P.: On-line assessment and free-response input-a pedagogic and technical model for squaring the circle. In Proceeding 7th Computer Assisted Assessment Conference, pp. 289–300 (2003) Palmer, K., Richardson, P.: On-line assessment and free-response input-a pedagogic and technical model for squaring the circle. In Proceeding 7th Computer Assisted Assessment Conference, pp. 289–300 (2003)
12.
Zurück zum Zitat Romero, C., Ventura, S.: Educational data mining: a review of the state of the art. IEEE Trans. SMC Part C 40(6), 601–618 (2010) Romero, C., Ventura, S.: Educational data mining: a review of the state of the art. IEEE Trans. SMC Part C 40(6), 601–618 (2010)
13.
Zurück zum Zitat Sadler, P.M., Good, E.: The impact of self and peer-grading on student learning. Educ. Assess. 11(1), 1–31 (2006)CrossRef Sadler, P.M., Good, E.: The impact of self and peer-grading on student learning. Educ. Assess. 11(1), 1–31 (2006)CrossRef
14.
Zurück zum Zitat Sterbini, A., Temperini, M.: Dealing with open-answer questions in a peer-assessment environment. In: Popescu, E., Li, Q., Klamma, R., Leung, H., Specht, M. (eds.) ICWL 2012. LNCS, vol. 7558, pp. 240–248. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33642-3_26 CrossRef Sterbini, A., Temperini, M.: Dealing with open-answer questions in a peer-assessment environment. In: Popescu, E., Li, Q., Klamma, R., Leung, H., Specht, M. (eds.) ICWL 2012. LNCS, vol. 7558, pp. 240–248. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33642-3_​26 CrossRef
15.
Zurück zum Zitat Sterbini, A., Temperini, M.: Analysis of OpenAnswers via mediated peer-assessment. In: Proceeding International Conference on System Theory, Control and Computing, Workshop SPEL (2013) Sterbini, A., Temperini, M.: Analysis of OpenAnswers via mediated peer-assessment. In: Proceeding International Conference on System Theory, Control and Computing, Workshop SPEL (2013)
16.
Zurück zum Zitat Sterbini, A., Temperini, M.: OpenAnswer, a framework to support teacher’s management of open answers through peer assessment. In: Proceeding Frontiers in Education, pp. 164–170 (2013) Sterbini, A., Temperini, M.: OpenAnswer, a framework to support teacher’s management of open answers through peer assessment. In: Proceeding Frontiers in Education, pp. 164–170 (2013)
17.
Zurück zum Zitat Yamanishi, K., Li, H.: Mining open answers in questionnaire data. IEEE Intell. Syst. 2002, 58–63 (2002)CrossRef Yamanishi, K., Li, H.: Mining open answers in questionnaire data. IEEE Intell. Syst. 2002, 58–63 (2002)CrossRef
Metadaten
Titel
Improving Peer Assessment Modeling of Teacher’s Grades, The Case of OpenAnswer
verfasst von
Maria De Marsico
Andrea Sterbini
Marco Temperini
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-52836-6_64