Top

Published in:

2018 | OriginalPaper | Chapter

What Does a ‘Good’ Essay Look Like? Rainbow Diagrams Representing Essay Quality

Authors : Denise Whitelock, Alison Twiner, John T. E. Richardson, Debora Field, Stephen Pulman

Published in: Technology Enhanced Assessment

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper reports on an essay-writing study using a technical system that has been developed to generate automated feedback on academic essays. The system operates through the combination of a linguistic analysis engine, which processes the text in the essay, and a web application that uses the output of the linguistic analysis engine to generate the feedback. In this paper we focus on one particular visual representation produced by the system, namely “rainbow diagrams”. Using the concept of a reverse rainbow, diagrams are produced which visually represent how concepts are interlinked between the essay introduction (violet nodes) and conclusion (red nodes), and how concepts are linked and developed across the whole essay – thus a measure of how cohesive the essay is as a whole. Using a bank of rainbow diagrams produced from real essays, we rated the diagrams as belonging to high-, medium- or low-scoring essays according to their structure, and compared this rating to the actual marks awarded for the essays. On the basis of this we can conclude that a significant relationship exists between an essay’s rainbow diagram structure and the mark awarded. This finding has vast implications, as it is relatively easy to show users what the diagram for a “good” essay looks like. Users can then compare this to their own work before submission so that they can make necessary changes and so improve their essay’s structure, without concerns over plagiarism. Thus the system is a valuable tool that can be utilised across academic disciplines.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

next chapter How to Obtain Efficient High Reliabilities in Assessing Texts: Rubrics vs Comparative Judgement

Available only for authorised users

Alden Rivers, B., Whitelock, D., Richardson, J.T.E., Field, D., Pulman, S.: Functional, frustrating and full of potential: learners’ experiences of a prototype for automated essay feedback. In: Kalz, M., Ras, E. (eds.) CAA 2014. CCIS, vol. 439, pp. 40–52. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08657-6_4CrossRef

Alexander, P.A., Schallert, D.L., Hare, V.C.: Coming to terms: how researchers in learning and literacy talk about knowledge. Rev. Educ. Res. 61, 315–343 (1991). https://doi.org/10.2307/1170635CrossRef

Banyard, P., Underwood, J., Twiner, A.: Do enhanced communication technologies inhibit or facilitate self-regulated learning? Eur. J. Ed. 41, 473–489 (2006). https://doi.org/10.1111/j.1465-3435.2006.00277.xCrossRef

Butler, D.L., Winne, P.H.: Feedback and self-regulated learning: a theoretical synthesis. Rev. Educ. Res. 65, 245–281 (1995). https://doi.org/10.3102/00346543065003245CrossRef

Chickering, A.W., Gamson, Z.F.: Seven principles for good practice in undergraduate education. Am. Assoc. High. Educ. Bull. 39(7), 3–7 (1987). http://www.aahea.org/aahea/articles/sevenprinciples1987.htm. Accessed 23 Jun 2015

Cohen, J.: Statistical Power Analysis for the Behavioral Sciences, 2nd edn. Academic Press, New York (1988). https://doi.org/10.1016/B978-0-12-179060-8.50001-3CrossRefMATH

Crabtree, J., Roberts, S.: Fat Pipes, Connected People: Rethinking Broadband Britain. The Work Foundation, London (2003). http://www.theworkfoundation.com/DownloadPublication/Report/121_121_fat_pipes.pdf. Accessed 23 Jun 2015

D’Mello, S.K., Picard, R., Graesser, A.C.: Toward an affect-sensitive AutoTutor. IEEE Intell. Syst. 22(4), 53–61 (2007). https://doi.org/10.1109/MIS.2007.79CrossRef

Evans, C.: Making sense of assessment feedback in higher education. Rev. Educ. Res. 83, 70–120 (2013). https://doi.org/10.3102/0034654312474350CrossRef

Gibbs, G., Simpson, C.: Conditions under which assessment supports students’ learning. Learn. Teach. High. Educ. 1, 1–31 (2004). http://insight.glos.ac.uk/tli/resources/lathe/documents/issue%201/articles/simpson.pdf. Accessed 23 Jun 2015

Greene, J.A., Azevedo, R.: The measurement of learners’ self-regulated cognitive and metacognitive processes while using computer-based learning environments. Educ. Psychol. 45, 203–209 (2010). https://doi.org/10.1080/00461520.2010.515935CrossRef

Hattie, J., Timperley, H.: The power of feedback. Rev. Educ. Res. 77, 81–112 (2007). https://doi.org/10.3102/003465430298487CrossRef

Ifenthaler, D.: Intelligent model-based feedback: helping students to monitor their individual learning progress. In: Graf, S., Lin, F., Kinshuk, McGreal, R. (eds.) Intelligent and Adaptive Learning Systems: Technology Enhanced Support for Learners and Teachers, pp. 88–100. IGI Global, Hershey (2011)

Ifenthaler, D., Pirnay-Dummer, P.: Model-based tools for knowledge assessment. In: Spector, J.M., Merrill, M.D., Elen, J., Bishop, M.J. (eds.) Handbook of Research on Educational Communications and Technology, 4th edn, pp. 289–301. Springer, New York (2014). https://doi.org/10.1007/978-1-4614-3185-5_23CrossRef

Moos, D.C., Azevedo, R.: The role of goal structure in undergraduates’ use of self-regulatory variables in two hypermedia learning tasks. J. Educ. Multimed. Hypermed. 15, 49–86 (2006)

Newman, M.E.J.: Mathematics of networks. In: Durlauf, S.N., Blume, L.W. (eds.) The New Palgrave Dictionary of Economics, vol. 5, 2nd edn, pp. 465–470. Palgrave Macmillan, Houndmills (2008)

Price, M., Handley, K., Millar, J.: Feedback: focusing attention on engagement. Stud. High. Educ. 36, 879–896 (2011). https://doi.org/10.1080/03075079.2010.483513CrossRef

Sadler, D.R.: Formative assessment and the design of instructional systems. Instr. Sci. 18, 119–144 (1989). https://doi.org/10.1007/BF00117714CrossRef

Steffens, K.: Self-regulated learning in technology-enhanced learning environments: lessons from a European review. Eur. J. Ed. 41, 353–380 (2006). https://doi.org/10.1111/j.1465-3435.2006.00271.xCrossRef

Whitelock, D., Twiner, A., Richardson, J.T.E., Field, D., Pulman, S.: OpenEssayist: a supply and demand learning analytics tool for drafting academic essays. In: Proceedings of the Fifth International Conference on Learning Analytics and Knowledge, pp. 208–212. ACM (2015)

Title: What Does a ‘Good’ Essay Look Like? Rainbow Diagrams Representing Essay Quality
Authors: Denise Whitelock
Alison Twiner
John T. E. Richardson
Debora Field
Stephen Pulman
Publisher: Springer International Publishing
Book: Technology Enhanced Assessment
Print ISBN: 978-3-319-97806-2

Electronic ISBN: 978-3-319-97807-9

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-97807-9_1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner