Skip to main content
Top

2020 | OriginalPaper | Chapter

EFL Writing Assessment: Peer Assessment vs. Automated Essay Scoring

Authors : Meixiu Lu, Qing Deng, Manzhen Yang

Published in: Emerging Technologies for Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study aimed to explore problems and potentials of new technologies in English as foreign language (EFL) writing education. Forty-six students as a foreign language (EFL) learners in a Chinese university participated in this study. They submitted their draft to Pigai Network and Scholar Network separately and received automated essay scoring (AES) and peer assessment (PA) feedback. Results showed a moderate, positive partial correlation between PA and AES, controlling for performance level. The EFL learners in China preferred AES over PA. These findings raise several relevant issues in how to improve peer assessment feedback effectively, such as writing rubric in peer assessment, specialized peer assessment tool, technology assistant and peer feedback.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Berg, E.C.: The effects of trained peer response on ESL students’ revision types and writing quality. J. Second Lang. Writ. 8(3), 215–241 (1999)CrossRef Berg, E.C.: The effects of trained peer response on ESL students’ revision types and writing quality. J. Second Lang. Writ. 8(3), 215–241 (1999)CrossRef
2.
go back to reference Yang, M., Badger, R., Yu, Z.: A comparative study of peer and teacher feedback in a Chinese EFL writing class. J. Second Lang. Writ. 15(3), 179–200 (2006)CrossRef Yang, M., Badger, R., Yu, Z.: A comparative study of peer and teacher feedback in a Chinese EFL writing class. J. Second Lang. Writ. 15(3), 179–200 (2006)CrossRef
3.
go back to reference Attali, Y., Burstein, J.: Automated essay scoring with e-rater®; V.2.0. J. Technol. Learn. Assess. 4(2), i–21 (2006) Attali, Y., Burstein, J.: Automated essay scoring with e-rater®; V.2.0. J. Technol. Learn. Assess. 4(2), i–21 (2006)
4.
go back to reference Dikli, S.: Automated essay scoring. Turk. Online J. Distance Educ. 7(1), 735–738 (2006) Dikli, S.: Automated essay scoring. Turk. Online J. Distance Educ. 7(1), 735–738 (2006)
5.
go back to reference Deane, P.: On the relation between automated-essay scoring and modern views of the writing construct. Assessing Writ. 18(1), 7–24 (2013)CrossRef Deane, P.: On the relation between automated-essay scoring and modern views of the writing construct. Assessing Writ. 18(1), 7–24 (2013)CrossRef
6.
go back to reference Sommers, N.: Responding to student writing. Coll. Compos. Commun. 33(2), 148–156 (1982)CrossRef Sommers, N.: Responding to student writing. Coll. Compos. Commun. 33(2), 148–156 (1982)CrossRef
7.
go back to reference Chang, C.-C., et al.: Reliability and validity of web-based portfolio peer assessment: a case study for a senior high school’s students taking computer course.”. Comput. Educ. 57(1), 1306–1316 (2011)CrossRef Chang, C.-C., et al.: Reliability and validity of web-based portfolio peer assessment: a case study for a senior high school’s students taking computer course.”. Comput. Educ. 57(1), 1306–1316 (2011)CrossRef
8.
go back to reference Chang, C.-C., Yan, C.-F., Tseng, J.-S.: Perceived convenience in an extended technology acceptance model: mobile technology and English learning for college students. Australas. J. Educ. Technol. 28(5), 809–826 (2012)CrossRef Chang, C.-C., Yan, C.-F., Tseng, J.-S.: Perceived convenience in an extended technology acceptance model: mobile technology and English learning for college students. Australas. J. Educ. Technol. 28(5), 809–826 (2012)CrossRef
9.
go back to reference Topping, K.J.: Methodological quandaries in studying process and outcomes in peer assessment. Learn. Instr. 20(4), 339–343 (2010)CrossRef Topping, K.J.: Methodological quandaries in studying process and outcomes in peer assessment. Learn. Instr. 20(4), 339–343 (2010)CrossRef
10.
go back to reference Falchikov, N.: Product comparisons and process benefits of collaborative peer group and self-assessments. Assess. Eval. High. Educ, 11(2), 146–166 (1986)CrossRef Falchikov, N.: Product comparisons and process benefits of collaborative peer group and self-assessments. Assess. Eval. High. Educ, 11(2), 146–166 (1986)CrossRef
11.
go back to reference Falchikov, N., Goldfinch, J.: Student peer assessment in higher education: a meta-analysis comparing peer and teacher marks. Rev. Educ. Res. 70(3), 287–322 (2000)CrossRef Falchikov, N., Goldfinch, J.: Student peer assessment in higher education: a meta-analysis comparing peer and teacher marks. Rev. Educ. Res. 70(3), 287–322 (2000)CrossRef
12.
go back to reference Topping, K.: Peer assessment between students in colleges and universities. Rev. Educ. Res. 68(3), 249–276 (1998)CrossRef Topping, K.: Peer assessment between students in colleges and universities. Rev. Educ. Res. 68(3), 249–276 (1998)CrossRef
13.
go back to reference Meek, S.E.M., Blakemore, L., Marks, L.: Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review. Assess. Eval. High. Educ. 42(6), 1000–1013 (2017)CrossRef Meek, S.E.M., Blakemore, L., Marks, L.: Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review. Assess. Eval. High. Educ. 42(6), 1000–1013 (2017)CrossRef
14.
go back to reference Hovardas, T., Tsivitanidou, O.E., Zacharia, Z.C.: Peer versus expert feedback: an investigation of the quality of peer feedback among secondary school students. Comput. Educ. 71, 133–152 (2014)CrossRef Hovardas, T., Tsivitanidou, O.E., Zacharia, Z.C.: Peer versus expert feedback: an investigation of the quality of peer feedback among secondary school students. Comput. Educ. 71, 133–152 (2014)CrossRef
15.
go back to reference Tsai, C.-C., Lin, S.S.J., Yuan, S.-M.: Developing science activities through a networked peer assessment system. Comput. Educ. 38(1–3), 241–252 (2002)CrossRef Tsai, C.-C., Lin, S.S.J., Yuan, S.-M.: Developing science activities through a networked peer assessment system. Comput. Educ. 38(1–3), 241–252 (2002)CrossRef
16.
go back to reference Hanrahan, S.J., Isaacs, G.: Assessing self-and peer-assessment: the students’ views. High. Educ. Res. Dev. 20(1), 53–70 (2001)CrossRef Hanrahan, S.J., Isaacs, G.: Assessing self-and peer-assessment: the students’ views. High. Educ. Res. Dev. 20(1), 53–70 (2001)CrossRef
17.
go back to reference Fang, Y.: Perceptions of the computer-assisted writing program among EFL college learners. Educ. Technol. Soc. 13(3), 246–256 (2010) Fang, Y.: Perceptions of the computer-assisted writing program among EFL college learners. Educ. Technol. Soc. 13(3), 246–256 (2010)
18.
go back to reference Enright, M.K., Quinlan, T.: Complementing human judgment of essays written by English language learners with e-rater® scoring. Lang. Test. 27(3), 317–334 (2010)CrossRef Enright, M.K., Quinlan, T.: Complementing human judgment of essays written by English language learners with e-rater® scoring. Lang. Test. 27(3), 317–334 (2010)CrossRef
19.
go back to reference Chen, C.-F.E., Cheng, W.-Y.E.C.: Beyond the design of automated writing evaluation: pedagogical practices and perceived learning effectiveness in EFL writing classes. Lang. Learn. Technol. 12(2), 94–112 (2008) Chen, C.-F.E., Cheng, W.-Y.E.C.: Beyond the design of automated writing evaluation: pedagogical practices and perceived learning effectiveness in EFL writing classes. Lang. Learn. Technol. 12(2), 94–112 (2008)
20.
go back to reference Wang, Y.-J., Shang, H.-F., Briody, P.: Exploring the impact of using automated writing evaluation in English as a foreign language university students’ writing. Comput. Assist. Lang. Learn. 26(3), 234–257 (2013)CrossRef Wang, Y.-J., Shang, H.-F., Briody, P.: Exploring the impact of using automated writing evaluation in English as a foreign language university students’ writing. Comput. Assist. Lang. Learn. 26(3), 234–257 (2013)CrossRef
21.
go back to reference Roscoe, R.D., et al.: Presentation, expectations, and experience: Sources of student perceptions of automated writing evaluation. Comput. Hum. Behav. 70, 207–221 (2017)CrossRef Roscoe, R.D., et al.: Presentation, expectations, and experience: Sources of student perceptions of automated writing evaluation. Comput. Hum. Behav. 70, 207–221 (2017)CrossRef
22.
go back to reference Lai, Y.-h.: Which do students prefer to evaluate their essays: peers or computer program. Br. J. Edu. Technol. 41(3), 432–454 (2010)CrossRef Lai, Y.-h.: Which do students prefer to evaluate their essays: peers or computer program. Br. J. Edu. Technol. 41(3), 432–454 (2010)CrossRef
23.
go back to reference Jones, I., Wheadon, C.: Peer assessment using comparative and absolute judgement. Stud. Educ. Eval. 47, 93–101 (2015)CrossRef Jones, I., Wheadon, C.: Peer assessment using comparative and absolute judgement. Stud. Educ. Eval. 47, 93–101 (2015)CrossRef
24.
go back to reference Yu, F.-Y., Wu, C.-P.: Different identity revelation modes in an online peer-assessment learning environment: effects on perceptions toward assessors, classroom climate and learning activities. Comput. Educ. 57(3), 2167–2177 (2011)CrossRef Yu, F.-Y., Wu, C.-P.: Different identity revelation modes in an online peer-assessment learning environment: effects on perceptions toward assessors, classroom climate and learning activities. Comput. Educ. 57(3), 2167–2177 (2011)CrossRef
25.
go back to reference Hoon, T.: Online automated essay assessment: potentials for writing development (2010). Accessed 9 August 2006 Hoon, T.: Online automated essay assessment: potentials for writing development (2010). Accessed 9 August 2006
26.
go back to reference Yeh, Y.-L., Liou, H.-C., Yu, Y.-T.: The influence of automatic essay evaluation and bilingual concordancing on EFL students. English Teach. Learn. 31(1), 117–160 (2007) Yeh, Y.-L., Liou, H.-C., Yu, Y.-T.: The influence of automatic essay evaluation and bilingual concordancing on EFL students. English Teach. Learn. 31(1), 117–160 (2007)
Metadata
Title
EFL Writing Assessment: Peer Assessment vs. Automated Essay Scoring
Authors
Meixiu Lu
Qing Deng
Manzhen Yang
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-38778-5_3

Premium Partner