Skip to main content
Top

2015 | OriginalPaper | Chapter

A Learning Analytics Approach to Correlate the Academic Achievements of Students with Interaction Data from an Educational Simulator

Authors : Mehrnoosh Vahdat, Luca Oneto, Davide Anguita, Mathias Funk, Matthias Rauterberg

Published in: Design for Teaching and Learning in a Networked World

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a Learning Analytics approach for understanding the learning behavior of students while interacting with Technology Enhanced Learning tools. In this work we show that it is possible to gain insight into the learning processes of students from their interaction data. We base our study on data collected through six laboratory sessions where first-year students of Computer Engineering at the University of Genoa were using a digital electronics simulator. We exploit Process Mining methods to investigate and compare the learning processes of students. For this purpose, we measure the understandability of their process models through a complexity metric. Then we compare the various clusters of students based on their academic achievements. The results show that the measured complexity has positive correlation with the final grades of students and negative correlation with the difficulty of the laboratory sessions. Consequently, complexity of process models can be used as an indicator of variations of student learning paths.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Siemens, G.: Learning analytics: envisioning a research discipline and a domain of practice. In: International Conference on Learning Analytics and Knowledge (2012) Siemens, G.: Learning analytics: envisioning a research discipline and a domain of practice. In: International Conference on Learning Analytics and Knowledge (2012)
2.
go back to reference Chatti, M.A., Dyckhoff, A.L., Schroeder, U., Thüs, H.: A reference model for learning analytics. Int. J. Technol. Enhanced Learn. 4(5), 318–331 (2012)CrossRef Chatti, M.A., Dyckhoff, A.L., Schroeder, U., Thüs, H.: A reference model for learning analytics. Int. J. Technol. Enhanced Learn. 4(5), 318–331 (2012)CrossRef
3.
go back to reference Romero, C., Ventura, S.: Educational data mining: a survey from 1995 to 2005. Expert Syst. Appl. 33(1), 135–146 (2007)CrossRef Romero, C., Ventura, S.: Educational data mining: a survey from 1995 to 2005. Expert Syst. Appl. 33(1), 135–146 (2007)CrossRef
4.
go back to reference Siemens, G., Long, P.: Penetrating the fog: analytics in learning and education. EDUCAUSE Rev. 46(5), 30 (2011) Siemens, G., Long, P.: Penetrating the fog: analytics in learning and education. EDUCAUSE Rev. 46(5), 30 (2011)
5.
go back to reference Vahdat, M., Ghio, A., Oneto, L., Anguita, D., Funk, M., Rauterberg, M.: Advances in learning analytics and educational data mining. In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (2015) Vahdat, M., Ghio, A., Oneto, L., Anguita, D., Funk, M., Rauterberg, M.: Advances in learning analytics and educational data mining. In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (2015)
6.
go back to reference Kruse, A., Pongsajapan, R.: Student-centered learning analytics. In: CNDLS Thought Papers (2012) Kruse, A., Pongsajapan, R.: Student-centered learning analytics. In: CNDLS Thought Papers (2012)
7.
go back to reference Prince, M.J., Felder, R.M.: Inductive teaching and learning methods: Definitions, comparisons, and research bases. J. Eng. Educ. 95(2), 123–138 (2006)CrossRef Prince, M.J., Felder, R.M.: Inductive teaching and learning methods: Definitions, comparisons, and research bases. J. Eng. Educ. 95(2), 123–138 (2006)CrossRef
8.
go back to reference Vahdat, M., Oneto, L., Ghio, A., Anguita, D., Funk, M., Rauterberg, M.: Human algorithmic stability and human rademacher complexity. In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (2015) Vahdat, M., Oneto, L., Ghio, A., Anguita, D., Funk, M., Rauterberg, M.: Human algorithmic stability and human rademacher complexity. In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (2015)
9.
go back to reference Lee, V.S.: The power of inquiry as a way of learning. Innovative High. Educ. 36(3), 149–160 (2011)CrossRef Lee, V.S.: The power of inquiry as a way of learning. Innovative High. Educ. 36(3), 149–160 (2011)CrossRef
10.
go back to reference De Jong, T., Sotiriou, S., Gillet, D.: Innovations in stem education: the go-lab federation of online labs. Smart Learn. Environ. 1(1), 1–16 (2014) De Jong, T., Sotiriou, S., Gillet, D.: Innovations in stem education: the go-lab federation of online labs. Smart Learn. Environ. 1(1), 1–16 (2014)
11.
go back to reference Donzellini, G., Ponta, D.: A simulation environment for e-learning in digital design. IEEE Trans. Ind. Electron. 54(6), 3078–3085 (2007)CrossRef Donzellini, G., Ponta, D.: A simulation environment for e-learning in digital design. IEEE Trans. Ind. Electron. 54(6), 3078–3085 (2007)CrossRef
12.
go back to reference Bienkowski, M., Feng, M., Means, B.: Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. In: US Department of Education, Office of Educational Technology (2012) Bienkowski, M., Feng, M., Means, B.: Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. In: US Department of Education, Office of Educational Technology (2012)
13.
go back to reference Del Blanco, A., Serrano, A., Freire, M., Martínez-Ortiz, I., Fernández-Manjón, B.: E-learning standards and learning analytics. can data collection be improved by using standard data models? In: IEEEGlobal Engineering Education Conference (2013) Del Blanco, A., Serrano, A., Freire, M., Martínez-Ortiz, I., Fernández-Manjón, B.: E-learning standards and learning analytics. can data collection be improved by using standard data models? In: IEEEGlobal Engineering Education Conference (2013)
15.
go back to reference Trcka, N., Pechenizkiy, M.: From local patterns to global models: Towards domain driven educational process mining. In: International Conference on Intelligent Systems Design and Applications (2009) Trcka, N., Pechenizkiy, M.: From local patterns to global models: Towards domain driven educational process mining. In: International Conference on Intelligent Systems Design and Applications (2009)
16.
go back to reference Pechenizkiy, M., Trcka, N., Vasilyeva, E., Van Der Aalst, W., De Bra, P.: Process mining online assessment data. In: International Working Group on Educational Data Mining (2009) Pechenizkiy, M., Trcka, N., Vasilyeva, E., Van Der Aalst, W., De Bra, P.: Process mining online assessment data. In: International Working Group on Educational Data Mining (2009)
17.
go back to reference Bannert, M., Reimann, P., Sonnenberg, C.: Process mining techniques for analysing patterns and strategies in students self-regulated learning. Metacognition Learn. 9(2), 161–185 (2014)CrossRef Bannert, M., Reimann, P., Sonnenberg, C.: Process mining techniques for analysing patterns and strategies in students self-regulated learning. Metacognition Learn. 9(2), 161–185 (2014)CrossRef
18.
go back to reference Figl, K., Laue, R.: Cognitive complexity in business process modeling. In: Mouratidis, H., Rolland, C. (eds.) CAiSE 2011. LNCS, vol. 6741, pp. 452–466. Springer, Heidelberg (2011) CrossRef Figl, K., Laue, R.: Cognitive complexity in business process modeling. In: Mouratidis, H., Rolland, C. (eds.) CAiSE 2011. LNCS, vol. 6741, pp. 452–466. Springer, Heidelberg (2011) CrossRef
19.
go back to reference Gruhn, V., Laue, R.: Complexity metrics for business process models. In: International Conference on Business Information Systems (2006) Gruhn, V., Laue, R.: Complexity metrics for business process models. In: International Conference on Business Information Systems (2006)
20.
go back to reference Štuikys, V., Damaševičius, R.: Complexity evaluation of feature models and meta-programs. In: Meta-Programming and Model-Driven Meta-Program Development (2013) Štuikys, V., Damaševičius, R.: Complexity evaluation of feature models and meta-programs. In: Meta-Programming and Model-Driven Meta-Program Development (2013)
21.
go back to reference Lassen, K.B., Van Der Aalst, W.M.P.: Complexity metrics for workflow nets. Inf. Softw. Technol. 51(3), 610–626 (2009)CrossRef Lassen, K.B., Van Der Aalst, W.M.P.: Complexity metrics for workflow nets. Inf. Softw. Technol. 51(3), 610–626 (2009)CrossRef
24.
go back to reference Thomas, J.C., Richards, J.T.: Achieving psychological simplicity: measures and methods to reduce cognitive complexity. In: Human-Computer Interaction: Design Issues, Solutions, and Applications (2009) Thomas, J.C., Richards, J.T.: Achieving psychological simplicity: measures and methods to reduce cognitive complexity. In: Human-Computer Interaction: Design Issues, Solutions, and Applications (2009)
25.
go back to reference Rauterberg, M.: A method of a quantitative measurement of cognitive complexity. In: Human-Computer Interaction: Tasks and Organisation (1992) Rauterberg, M.: A method of a quantitative measurement of cognitive complexity. In: Human-Computer Interaction: Tasks and Organisation (1992)
26.
go back to reference Holzinger, A., Popova, E., Peischl, B., Ziefle, M.: On complexity reduction of user interfaces for safety-critical systems. In: Quirchmayr, G., Basl, J., You, I., Xu, L., Weippl, E. (eds.) CD-ARES 2012. LNCS, vol. 7465, pp. 108–122. Springer, Heidelberg (2012) CrossRef Holzinger, A., Popova, E., Peischl, B., Ziefle, M.: On complexity reduction of user interfaces for safety-critical systems. In: Quirchmayr, G., Basl, J., You, I., Xu, L., Weippl, E. (eds.) CD-ARES 2012. LNCS, vol. 7465, pp. 108–122. Springer, Heidelberg (2012) CrossRef
27.
go back to reference Ham, D.H., Park, J., Jung, W.: A framework-based approach to identifying and organizing the complexity factors of human-system interaction. IEEE Syst. J. 5(2), 213–222 (2011)CrossRef Ham, D.H., Park, J., Jung, W.: A framework-based approach to identifying and organizing the complexity factors of human-system interaction. IEEE Syst. J. 5(2), 213–222 (2011)CrossRef
28.
go back to reference Rauterberg, M.: How to measure cognitive complexity in human-computer interaction. In: Cybernetics and Systems Research (1996) Rauterberg, M.: How to measure cognitive complexity in human-computer interaction. In: Cybernetics and Systems Research (1996)
29.
go back to reference Sapounidis, T., Demetriadis, S., Stamelos, I.: Evaluating children performance with graphical and tangible robot programming tools. Pers. Ubiquit. Comput. 19(1), 225–237 (2015)CrossRef Sapounidis, T., Demetriadis, S., Stamelos, I.: Evaluating children performance with graphical and tangible robot programming tools. Pers. Ubiquit. Comput. 19(1), 225–237 (2015)CrossRef
30.
go back to reference Mohamed, N., Sulaiman, R.F., Endut, W.R.: The use of cyclomatic complexity metrics in programming performance’s assessment. Procedia-Soc. Beha. Sci. 90, 497–503 (2013)CrossRef Mohamed, N., Sulaiman, R.F., Endut, W.R.: The use of cyclomatic complexity metrics in programming performance’s assessment. Procedia-Soc. Beha. Sci. 90, 497–503 (2013)CrossRef
31.
go back to reference Ponta, D., Anguita, D., Da Bormida, G., Donzellini, G.: Ten years of activity on computer-aided learning for electronics: Needs, experiences, field evaluation. In: Congreso sobre tecnologías aplicadas a la enseñanza de la electrónica (1998) Ponta, D., Anguita, D., Da Bormida, G., Donzellini, G.: Ten years of activity on computer-aided learning for electronics: Needs, experiences, field evaluation. In: Congreso sobre tecnologías aplicadas a la enseñanza de la electrónica (1998)
32.
go back to reference Vahdat, M., Oneto, L., Ghio, A., Donzellini, G., Anguita, D., Funk, M., Rauterberg, M.: A learning analytics methodology to profile students behavior and explore interactions with a digital electronics simulator. In: de Freitas, S., Rensing, C., Ley, T., Muñoz-Merino, P.J. (eds.) EC-TEL 2014. LNCS, vol. 8719, pp. 596–597. Springer, Heidelberg (2014) CrossRef Vahdat, M., Oneto, L., Ghio, A., Donzellini, G., Anguita, D., Funk, M., Rauterberg, M.: A learning analytics methodology to profile students behavior and explore interactions with a digital electronics simulator. In: de Freitas, S., Rensing, C., Ley, T., Muñoz-Merino, P.J. (eds.) EC-TEL 2014. LNCS, vol. 8719, pp. 596–597. Springer, Heidelberg (2014) CrossRef
33.
go back to reference Van Der Aalst, W.M.: Tool support. In: Process Mining (2011) Van Der Aalst, W.M.: Tool support. In: Process Mining (2011)
34.
go back to reference Günther, C.W., van der Aalst, W.M.P.: Fuzzy mining – adaptive process simplification based on multi-perspective metrics. In: Alonso, G., Dadam, P., Rosemann, M. (eds.) BPM 2007. LNCS, vol. 4714, pp. 328–343. Springer, Heidelberg (2007) CrossRef Günther, C.W., van der Aalst, W.M.P.: Fuzzy mining – adaptive process simplification based on multi-perspective metrics. In: Alonso, G., Dadam, P., Rosemann, M. (eds.) BPM 2007. LNCS, vol. 4714, pp. 328–343. Springer, Heidelberg (2007) CrossRef
35.
go back to reference Van der Aalst, W., Weijters, T., Maruster, L.: Workflow mining: Discovering process models from event logs. IEEE Trans. Knowl. Data Eng. 16(9), 1128–1142 (2004)CrossRef Van der Aalst, W., Weijters, T., Maruster, L.: Workflow mining: Discovering process models from event logs. IEEE Trans. Knowl. Data Eng. 16(9), 1128–1142 (2004)CrossRef
Metadata
Title
A Learning Analytics Approach to Correlate the Academic Achievements of Students with Interaction Data from an Educational Simulator
Authors
Mehrnoosh Vahdat
Luca Oneto
Davide Anguita
Mathias Funk
Matthias Rauterberg
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-24258-3_26

Premium Partner