Skip to main content
Top

2017 | OriginalPaper | Chapter

Improving Peer Assessment Modeling of Teacher’s Grades, The Case of OpenAnswer

Authors : Maria De Marsico, Andrea Sterbini, Marco Temperini

Published in: Emerging Technologies for Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Questions with answers are rarely used as e-learning assessment tools because of the resulting high workload for the teacher/tutor that should grade them, which can be mitigated by doing peer-assessment. In OpenAnswer we modeled peer-assessment as a Bayesian network connecting the sub-networks representing any participating student to the corresponding answers of her graded peers. The model has shown good ability to predict (without further info from the teacher) the exact teacher’s grade (ground truth) from the peer grades only, and a very good ability to predict it within 1 mark from the right one. In this paper we explore changes to the OpenAnswer model to improve its predictions. The experimental results, obtained by simulating teacher’s grading on real datasets, show the improved predictions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Anderson, L.W., Krathwohl, D.R.(eds.): A Taxonomy for Learning, Teaching, and Assessing: A Revision Of Bloom’s Taxonomy of Educational Objectives. Allyn and Bacon (2000) Anderson, L.W., Krathwohl, D.R.(eds.): A Taxonomy for Learning, Teaching, and Assessing: A Revision Of Bloom’s Taxonomy of Educational Objectives. Allyn and Bacon (2000)
2.
go back to reference Bloom, B.S., Engelhart, M.D., Furst,. E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. David McKay, New York (1956) Bloom, B.S., Engelhart, M.D., Furst,. E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. David McKay, New York (1956)
3.
go back to reference Castellanos-Nieves, D., Fernández-Breis, J., Valencia-García, R., Martínez-Béjar, R., Iniesta-Moreno, M.: Semantic Web Technologies for supporting learning assessment. Inf. Sci. 181, 9 (2011)CrossRef Castellanos-Nieves, D., Fernández-Breis, J., Valencia-García, R., Martínez-Béjar, R., Iniesta-Moreno, M.: Semantic Web Technologies for supporting learning assessment. Inf. Sci. 181, 9 (2011)CrossRef
4.
go back to reference Cho, K., MacArthur, C.: Student revision with peer and expert reviewing. Learn. Instr. 20(4), 328–338 (2010)CrossRef Cho, K., MacArthur, C.: Student revision with peer and expert reviewing. Learn. Instr. 20(4), 328–338 (2010)CrossRef
5.
go back to reference Chung, H., Graf, S., Robert Lai, K.: Kinshuk: Enrichment of peer assessment with agent negotiation. IEEE Trans. Learn. Technol. 4(1), 35–46 (2011)CrossRef Chung, H., Graf, S., Robert Lai, K.: Kinshuk: Enrichment of peer assessment with agent negotiation. IEEE Trans. Learn. Technol. 4(1), 35–46 (2011)CrossRef
6.
go back to reference Conati, C., Gartner, A., Vanlehn, K.: Using Bayesian networks to manage uncertainty in student modeling. User Model. User-Adap. Inter. 12, 371–417 (2002)CrossRefMATH Conati, C., Gartner, A., Vanlehn, K.: Using Bayesian networks to manage uncertainty in student modeling. User Model. User-Adap. Inter. 12, 371–417 (2002)CrossRefMATH
7.
go back to reference El-Kechaï, N., Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F.: Evaluating the performance of a diagnosis system in school algebra. In: Leung, H., Popescu, E., Cao, Y., Lau, R.W.H., Nejdl, W. (eds.) ICWL 2011. LNCS, vol. 7048, pp. 263–272. Springer, Heidelberg (2011). doi:10.1007/978-3-642-25813-8_28 CrossRef El-Kechaï, N., Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F.: Evaluating the performance of a diagnosis system in school algebra. In: Leung, H., Popescu, E., Cao, Y., Lau, R.W.H., Nejdl, W. (eds.) ICWL 2011. LNCS, vol. 7048, pp. 263–272. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-25813-8_​28 CrossRef
8.
go back to reference Jackson, K., Trochim, W.: Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods, vol. 5. Sage (2002) Jackson, K., Trochim, W.: Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods, vol. 5. Sage (2002)
9.
go back to reference Li, L.X., Liu, X., Steckelberg, A.L.: Assessor or assessee: how student learning improves by giving and receiving peer feedback. Br. J. Ed. Tech. 41(3), 525–536 (2010)CrossRef Li, L.X., Liu, X., Steckelberg, A.L.: Assessor or assessee: how student learning improves by giving and receiving peer feedback. Br. J. Ed. Tech. 41(3), 525–536 (2010)CrossRef
10.
go back to reference Miller, P.: The Effect of Scoring Criteria Specificity on Peer and Self-assessment. Assessment & Evaluation in Higher Education, 28/4 (2003) Miller, P.: The Effect of Scoring Criteria Specificity on Peer and Self-assessment. Assessment & Evaluation in Higher Education, 28/4 (2003)
11.
go back to reference Palmer, K., Richardson, P.: On-line assessment and free-response input-a pedagogic and technical model for squaring the circle. In Proceeding 7th Computer Assisted Assessment Conference, pp. 289–300 (2003) Palmer, K., Richardson, P.: On-line assessment and free-response input-a pedagogic and technical model for squaring the circle. In Proceeding 7th Computer Assisted Assessment Conference, pp. 289–300 (2003)
12.
go back to reference Romero, C., Ventura, S.: Educational data mining: a review of the state of the art. IEEE Trans. SMC Part C 40(6), 601–618 (2010) Romero, C., Ventura, S.: Educational data mining: a review of the state of the art. IEEE Trans. SMC Part C 40(6), 601–618 (2010)
13.
go back to reference Sadler, P.M., Good, E.: The impact of self and peer-grading on student learning. Educ. Assess. 11(1), 1–31 (2006)CrossRef Sadler, P.M., Good, E.: The impact of self and peer-grading on student learning. Educ. Assess. 11(1), 1–31 (2006)CrossRef
14.
go back to reference Sterbini, A., Temperini, M.: Dealing with open-answer questions in a peer-assessment environment. In: Popescu, E., Li, Q., Klamma, R., Leung, H., Specht, M. (eds.) ICWL 2012. LNCS, vol. 7558, pp. 240–248. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33642-3_26 CrossRef Sterbini, A., Temperini, M.: Dealing with open-answer questions in a peer-assessment environment. In: Popescu, E., Li, Q., Klamma, R., Leung, H., Specht, M. (eds.) ICWL 2012. LNCS, vol. 7558, pp. 240–248. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33642-3_​26 CrossRef
15.
go back to reference Sterbini, A., Temperini, M.: Analysis of OpenAnswers via mediated peer-assessment. In: Proceeding International Conference on System Theory, Control and Computing, Workshop SPEL (2013) Sterbini, A., Temperini, M.: Analysis of OpenAnswers via mediated peer-assessment. In: Proceeding International Conference on System Theory, Control and Computing, Workshop SPEL (2013)
16.
go back to reference Sterbini, A., Temperini, M.: OpenAnswer, a framework to support teacher’s management of open answers through peer assessment. In: Proceeding Frontiers in Education, pp. 164–170 (2013) Sterbini, A., Temperini, M.: OpenAnswer, a framework to support teacher’s management of open answers through peer assessment. In: Proceeding Frontiers in Education, pp. 164–170 (2013)
17.
go back to reference Yamanishi, K., Li, H.: Mining open answers in questionnaire data. IEEE Intell. Syst. 2002, 58–63 (2002)CrossRef Yamanishi, K., Li, H.: Mining open answers in questionnaire data. IEEE Intell. Syst. 2002, 58–63 (2002)CrossRef
Metadata
Title
Improving Peer Assessment Modeling of Teacher’s Grades, The Case of OpenAnswer
Authors
Maria De Marsico
Andrea Sterbini
Marco Temperini
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-52836-6_64

Premium Partner