Skip to main content
Top

2017 | Supplement | Chapter

Towards Automatic Assessment of Argumentation in Theses Justifications

Authors : Jesús Miguel García-Gorrostieta, Aurelio López-López, Samuel González-López

Published in: Data Driven Approaches in Digital Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Argumentation during the academic life is a critical skill when writing. This skill is needed to communicate clearly ideas and to convince the reader of the presented claims. However, not many students are good arguers and this is a skill difficult to master. This paper presents advances in the development of an argument assessment module. Such module supports students to identify argumentative paragraphs and determine the level of argumentation in the text. The task is achieved employing machine learning techniques with lexical features such as unigrams, bigrams, and argumentative markers categories. We based the module on an annotated collection of student writings, that serves for training. We performed an initial experiment to evaluate argumentative paragraph identification in the justification section of theses, reaching encouraging results, when compared against previously proposed approaches. The module is one component of a Thesis Writing Tutor, an Internet-based learning software for academic writing.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
In Spanish: TURET: Tutor para la Redacción de Tesis.
 
2
Spanish royal academy.
 
3
Advanced College-level Technician degree, study program offered in some countries.
 
Literature
1.
go back to reference Abbas, S., Sawamura, H.: Ales: An innovative argument-learning environment. Online Submission 7(9), 58–67 (2010) Abbas, S., Sawamura, H.: Ales: An innovative argument-learning environment. Online Submission 7(9), 58–67 (2010)
2.
go back to reference Buckingham Shum, S.: The Roots of Computer Supported Argument Visualization, pp. 3–24. Springer London, London (2003) Buckingham Shum, S.: The Roots of Computer Supported Argument Visualization, pp. 3–24. Springer London, London (2003)
3.
go back to reference Burstein, J., Chodorow, M., Leacock, C.: Criterionsm online essay evaluation: an application for automated evaluation of student essays. In: IAAI, pp. 3–10 (2003) Burstein, J., Chodorow, M., Leacock, C.: Criterionsm online essay evaluation: an application for automated evaluation of student essays. In: IAAI, pp. 3–10 (2003)
4.
go back to reference Carstens, L., Toni, F.: Towards relation based argumentation mining. In: NAACL HLT 2015, p. 29 (2015) Carstens, L., Toni, F.: Towards relation based argumentation mining. In: NAACL HLT 2015, p. 29 (2015)
5.
go back to reference Cho, K., Schunn, C.D.: Scaffolded writing and rewriting in the discipline: a web-based reciprocal peer review system. Comput. Educ. 48(3), 409–426 (2007)CrossRef Cho, K., Schunn, C.D.: Scaffolded writing and rewriting in the discipline: a web-based reciprocal peer review system. Comput. Educ. 48(3), 409–426 (2007)CrossRef
6.
go back to reference Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychosoc. Measur. 20(1), 37–46 (1960)CrossRef Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychosoc. Measur. 20(1), 37–46 (1960)CrossRef
7.
go back to reference De Groot, R., Drachman, R., Hever, R., Schwarz, B.B., Hoppe, U., Harrer, A., De Laat, M., Wegerif, R., McLaren, B.M., Baurens, B.: Computer supported moderation of e-discussions: the argunaut approach. In: Proceedings of the 8th International Conference on Computer Supported Collaborative Learning, pp. 168–170. International Society of the Learning Sciences (2007) De Groot, R., Drachman, R., Hever, R., Schwarz, B.B., Hoppe, U., Harrer, A., De Laat, M., Wegerif, R., McLaren, B.M., Baurens, B.: Computer supported moderation of e-discussions: the argunaut approach. In: Proceedings of the 8th International Conference on Computer Supported Collaborative Learning, pp. 168–170. International Society of the Learning Sciences (2007)
8.
go back to reference Florou, E., Konstantopoulos, S., Koukourikos, A., Karampiperis, P.: Argument extraction for supporting public policy formulation. In: Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pp. 49–54 (2013) Florou, E., Konstantopoulos, S., Koukourikos, A., Karampiperis, P.: Argument extraction for supporting public policy formulation. In: Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pp. 49–54 (2013)
9.
go back to reference González-López, S., López-López, A.: Colección de tesis y propuesta de investigación en tics: un recurso para su análisis y estudio. In: XIII Congreso Nacional de Investigación Educativa, pp. 1–15 (2015) González-López, S., López-López, A.: Colección de tesis y propuesta de investigación en tics: un recurso para su análisis y estudio. In: XIII Congreso Nacional de Investigación Educativa, pp. 1–15 (2015)
10.
go back to reference González-López, S., López-López, A.: Lexical analysis of student research drafts in computing. Comput. Appl. Eng. Educ. 23(4), 638–644 (2015)CrossRef González-López, S., López-López, A.: Lexical analysis of student research drafts in computing. Comput. Appl. Eng. Educ. 23(4), 638–644 (2015)CrossRef
11.
go back to reference Goudas, T., Louizos, C., Petasis, G., Karkaletsis, V.: Argument extraction from news, blogs, and social media. In: Likas, A., Blekas, K., Kalles, D. (eds.) SETN 2014. LNCS, vol. 8445, pp. 287–299. Springer, Cham (2014). doi:10.1007/978-3-319-07064-3_23 CrossRef Goudas, T., Louizos, C., Petasis, G., Karkaletsis, V.: Argument extraction from news, blogs, and social media. In: Likas, A., Blekas, K., Kalles, D. (eds.) SETN 2014. LNCS, vol. 8445, pp. 287–299. Springer, Cham (2014). doi:10.​1007/​978-3-319-07064-3_​23 CrossRef
12.
go back to reference Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)CrossRef
13.
go back to reference Huang, C.J., Wang, Y.W., Huang, T.H., Liao, J.J., Chen, C.H., Weng, C.H., Chu, Y.J., Chien, C.Y., Shen, H.Y.: Implementation and performance evaluation of an intelligent online argumentation assessment system. In: 2010 International Conference on Electrical and Control Engineering (ICECE), pp. 2560–2563. IEEE (2010) Huang, C.J., Wang, Y.W., Huang, T.H., Liao, J.J., Chen, C.H., Weng, C.H., Chu, Y.J., Chien, C.Y., Shen, H.Y.: Implementation and performance evaluation of an intelligent online argumentation assessment system. In: 2010 International Conference on Electrical and Control Engineering (ICECE), pp. 2560–2563. IEEE (2010)
14.
go back to reference Katzav, J., Reed, C., Rowe, G.W.A.: Argument research corpus. In: Proceedings of the 2003 Conference on Practical Applications in Language and Computers, pp. 229–239 (2004) Katzav, J., Reed, C., Rowe, G.W.A.: Argument research corpus. In: Proceedings of the 2003 Conference on Practical Applications in Language and Computers, pp. 229–239 (2004)
15.
go back to reference Kirschner, C., Eckle-Kohler, J., Gurevych, I.: Linking the thoughts: analysis of argumentation structures in scientific publications. In: Proceedings of the 2nd Workshop on Argumentation Mining, pp. 1–11 (2015) Kirschner, C., Eckle-Kohler, J., Gurevych, I.: Linking the thoughts: analysis of argumentation structures in scientific publications. In: Proceedings of the 2nd Workshop on Argumentation Mining, pp. 1–11 (2015)
16.
go back to reference Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977)CrossRefMATH Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977)CrossRefMATH
17.
go back to reference Lippi, M., Torroni, P.: Margot: a web server for argumentation mining. Expert Syst. Appl. 65, 292–303 (2016)CrossRef Lippi, M., Torroni, P.: Margot: a web server for argumentation mining. Expert Syst. Appl. 65, 292–303 (2016)CrossRef
18.
go back to reference Loll, F., Pinkwart, N.: Lasad: flexible representations for computer-based collaborative argumentation. Int. J. Hum. Comput. Stud. 71(1), 91–109 (2013)CrossRef Loll, F., Pinkwart, N.: Lasad: flexible representations for computer-based collaborative argumentation. Int. J. Hum. Comput. Stud. 71(1), 91–109 (2013)CrossRef
19.
go back to reference López Ferrero, C., García Negroni, M.: La argumentación en los géneros académicos. In: Actas del Congreso Internacional La Argumentación, pp. 1121–1129. Universidad de Buenos Aires, Buenos Aires (2003) López Ferrero, C., García Negroni, M.: La argumentación en los géneros académicos. In: Actas del Congreso Internacional La Argumentación, pp. 1121–1129. Universidad de Buenos Aires, Buenos Aires (2003)
20.
go back to reference Lynch, C., Ashley, K.D.: Modeling student arguments in research reports. In: Proceedings of the 4th AHFE Conference, pp. 191–201 (2012) Lynch, C., Ashley, K.D.: Modeling student arguments in research reports. In: Proceedings of the 4th AHFE Conference, pp. 191–201 (2012)
21.
go back to reference Mochales, R., Moens, M.F.: Study on the structure of argumentation in case law. In: Proceedings of the 2008 Conference on Legal Knowledge and Information Systems, pp. 11–20 (2008) Mochales, R., Moens, M.F.: Study on the structure of argumentation in case law. In: Proceedings of the 2008 Conference on Legal Knowledge and Information Systems, pp. 11–20 (2008)
22.
go back to reference Mochales, R., Moens, M.F.: Argumentation mining. Artif. Intell. Law 19(1), 1–22 (2011)CrossRef Mochales, R., Moens, M.F.: Argumentation mining. Artif. Intell. Law 19(1), 1–22 (2011)CrossRef
23.
go back to reference Moens, M.F., Boiy, E., Palau, R.M., Reed, C.: Automatic detection of arguments in legal texts. In: Proceedings of the 11th International Conference on Artificial Intelligence and Law, pp. 225–230. ACM (2007) Moens, M.F., Boiy, E., Palau, R.M., Reed, C.: Automatic detection of arguments in legal texts. In: Proceedings of the 11th International Conference on Artificial Intelligence and Law, pp. 225–230. ACM (2007)
24.
go back to reference Peldszus, A., Stede, M.: From argument diagrams to argumentation mining in texts: a survey. Int. J. Cogn. Inf. Nat. Intell. (IJCINI) 7(1), 1–31 (2013)CrossRef Peldszus, A., Stede, M.: From argument diagrams to argumentation mining in texts: a survey. Int. J. Cogn. Inf. Nat. Intell. (IJCINI) 7(1), 1–31 (2013)CrossRef
25.
go back to reference Pinkwart, N., Aleven, V., Ashley, K., Lynch, C.: Evaluating legal argument instruction with graphical representations using largo. Front. Artif. Intell. Appl. 158, 101 (2007) Pinkwart, N., Aleven, V., Ashley, K., Lynch, C.: Evaluating legal argument instruction with graphical representations using largo. Front. Artif. Intell. Appl. 158, 101 (2007)
26.
go back to reference Rahimi, Z., Litman, D., Correnti, R., Wang, E., Matsumura, L.C.: Assessing students use of evidence and organization in response-to-text writing: using natural language processing for rubric-based automated scoring. Int. J. Artif. Intell. Educ., 1–35 (2017) Rahimi, Z., Litman, D., Correnti, R., Wang, E., Matsumura, L.C.: Assessing students use of evidence and organization in response-to-text writing: using natural language processing for rubric-based automated scoring. Int. J. Artif. Intell. Educ., 1–35 (2017)
27.
go back to reference Roscoe, R.D., Allen, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The writing pal intelligent tutoring system: usability testing and development. Comput. Composit. 34, 39–59 (2014)CrossRef Roscoe, R.D., Allen, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The writing pal intelligent tutoring system: usability testing and development. Comput. Composit. 34, 39–59 (2014)CrossRef
28.
go back to reference Sardianos, C., Katakis, I.M., Petasis, G., Karkaletsis, V.: Argument extraction from news. In: NAACL HLT 2015, p. 56 (2015) Sardianos, C., Katakis, I.M., Petasis, G., Karkaletsis, V.: Argument extraction from news. In: NAACL HLT 2015, p. 56 (2015)
29.
go back to reference Stab, C., Gurevych, I.: Identifying argumentative discourse structures in persuasive essays. In: EMNLP, pp. 46–56 (2014) Stab, C., Gurevych, I.: Identifying argumentative discourse structures in persuasive essays. In: EMNLP, pp. 46–56 (2014)
30.
go back to reference Stab, C., Gurevych, I.: Recognizing the absence of opposing arguments in persuasive essays. In: ACL 2016, p. 113 (2016) Stab, C., Gurevych, I.: Recognizing the absence of opposing arguments in persuasive essays. In: ACL 2016, p. 113 (2016)
31.
go back to reference Suthers, D.D.: Architectures for computer supported collaborative learning. In: Proceedings of the IEEE International Conference on Advanced Learning Technologies, pp. 25–28. IEEE (2001) Suthers, D.D.: Architectures for computer supported collaborative learning. In: Proceedings of the IEEE International Conference on Advanced Learning Technologies, pp. 25–28. IEEE (2001)
32.
Metadata
Title
Towards Automatic Assessment of Argumentation in Theses Justifications
Authors
Jesús Miguel García-Gorrostieta
Aurelio López-López
Samuel González-López
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-66610-5_5

Premium Partner