Skip to main content

2020 | OriginalPaper | Buchkapitel

Recommending Insightful Drill-Downs Based on Learning Processes for Learning Analytics Dashboards

verfasst von : Shiva Shabaninejad, Hassan Khosravi, Sander J. J. Leemans, Shazia Sadiq, Marta Indulska

Erschienen in: Artificial Intelligence in Education

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Learning Analytics Dashboards (LADs) make use of rich and complex data about students and their learning activities to assist educators in understanding and making informed decisions about student learning and the design and improvement of learning processes. With the increase in the volume, velocity, variety and veracity of data on students, manual navigation and sense-making of such multi-dimensional data have become challenging. This paper proposes an analytical approach to assist LAD users with navigating the large set of possible drill-down actions to identify insights about learning behaviours of the sub-cohorts. A distinctive feature of the proposed approach is that it takes a process mining lens to examine and compare students’ learning behaviours. The process oriented approach considers the flow and frequency of the sequences of performed learning activities, which is increasingly recognised as essential for understanding and optimising learning. We present results from an application of our approach in an existing LAD using a course with 875 students, with high demographic and educational diversity. We demonstrate the insights the approach enables, exploring how the learning behaviour of an identified sub-cohort differs from the remaining students and how the derived insights can be used by instructors.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Approval from our Human Research Ethics Committee (#2019002181) was received for conducting this study.
 
Literatur
1.
Zurück zum Zitat Lee, D.J.L., Dev, H., Hu, H., Elmeleegy, H., Parameswaran, A.: Avoiding drill-down fallacies with vispilot: Assisted exploration of data subsets. In: ICII, pp. 186–196 (2019) Lee, D.J.L., Dev, H., Hu, H., Elmeleegy, H., Parameswaran, A.: Avoiding drill-down fallacies with vispilot: Assisted exploration of data subsets. In: ICII, pp. 186–196 (2019)
4.
Zurück zum Zitat Aguilar, S., Lonn, S., Teasley, S.D.: Perceptions and use of an early warning system during a higher education transition program. In: Proceedings of the Fourth International Conference On Learning Analytics and Knowledge, pp. 113–117 (2014) Aguilar, S., Lonn, S., Teasley, S.D.: Perceptions and use of an early warning system during a higher education transition program. In: Proceedings of the Fourth International Conference On Learning Analytics and Knowledge, pp. 113–117 (2014)
6.
Zurück zum Zitat Bodily, R., Kay, J., Aleven, V., Jivet, I., Davis, D., Xhakaj, F., Verbert, K.: Open learner models and learning analytics dashboards: a systematic review. In: ICLAK, pp. 41–50 (2018) Bodily, R., Kay, J., Aleven, V., Jivet, I., Davis, D., Xhakaj, F., Verbert, K.: Open learner models and learning analytics dashboards: a systematic review. In: ICLAK, pp. 41–50 (2018)
7.
Zurück zum Zitat Bogarín, A., Cerezo, R., Romero, C.: A survey on educational process mining. Wiley Interdisc. Rev.: Data Mining Knowl. Disc. 8(1), e1230 (2018) Bogarín, A., Cerezo, R., Romero, C.: A survey on educational process mining. Wiley Interdisc. Rev.: Data Mining Knowl. Disc. 8(1), e1230 (2018)
8.
Zurück zum Zitat Bogarín, A., Romero, C., Cerezo, R., Sánchez-Santillán, M.: Clustering for improving educational process mining. In: Proceedings of the Fourth International Conference on Learning Analytics And Knowledge, pp. 11–15. ACM (2014) Bogarín, A., Romero, C., Cerezo, R., Sánchez-Santillán, M.: Clustering for improving educational process mining. In: Proceedings of the Fourth International Conference on Learning Analytics And Knowledge, pp. 11–15. ACM (2014)
9.
Zurück zum Zitat Brouns, F., Zorrilla Pantaleón, M.E., Álvarez Saiz, E.E., Solana-González, P., Cobo Ortega, Á., Rocha Blanco, E.R., Collantes Viaña, M., Rodríguez Hoyos, C., De Lima Silva, M., Marta-Lazo, C., et al.: Eco d2. 5 learning analytics requirements and metrics report (2015) Brouns, F., Zorrilla Pantaleón, M.E., Álvarez Saiz, E.E., Solana-González, P., Cobo Ortega, Á., Rocha Blanco, E.R., Collantes Viaña, M., Rodríguez Hoyos, C., De Lima Silva, M., Marta-Lazo, C., et al.: Eco d2. 5 learning analytics requirements and metrics report (2015)
10.
11.
Zurück zum Zitat Cooper, K., Khosravi, H.: Graph-based visual topic dependency models: supporting assessment design and delivery at scale. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 11–15 (2018) Cooper, K., Khosravi, H.: Graph-based visual topic dependency models: supporting assessment design and delivery at scale. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 11–15 (2018)
12.
Zurück zum Zitat Dyckhoff, A.L., Zielke, D., Bültmann, M., Chatti, M.A., Schroeder, U.: Design and implementation of a learning analytics toolkit for teachers. J. Educ. Technol. Soc. 15(3), 58–76 (2012) Dyckhoff, A.L., Zielke, D., Bültmann, M., Chatti, M.A., Schroeder, U.: Design and implementation of a learning analytics toolkit for teachers. J. Educ. Technol. Soc. 15(3), 58–76 (2012)
14.
Zurück zum Zitat Elaachak, L., Belahbibe, A., Bouhorma, M.: Towards a system of guidance, assistance and learning analytics based on multi agent system applied on serious games. Int. J. Electr. Comput. Eng. 5(2), 344 (2015) Elaachak, L., Belahbibe, A., Bouhorma, M.: Towards a system of guidance, assistance and learning analytics based on multi agent system applied on serious games. Int. J. Electr. Comput. Eng. 5(2), 344 (2015)
16.
Zurück zum Zitat Fulantelli, G., Taibi, D., Arrigo, M.: A framework to support educational decision making in mobile learning. Comput. Hum. Behav. 47, 50–59 (2015)CrossRef Fulantelli, G., Taibi, D., Arrigo, M.: A framework to support educational decision making in mobile learning. Comput. Hum. Behav. 47, 50–59 (2015)CrossRef
17.
18.
Zurück zum Zitat Ghazal, M.A., Ibrahim, O., Salama, M.A.: Educational process mining: a systematic literature review. In: 2017 European Conference on Electrical Engineering and Computer Science (EECS), pp. 198–203. IEEE (2017) Ghazal, M.A., Ibrahim, O., Salama, M.A.: Educational process mining: a systematic literature review. In: 2017 European Conference on Electrical Engineering and Computer Science (EECS), pp. 198–203. IEEE (2017)
19.
Zurück zum Zitat Iandoli, L., Quinto, I., De Liddo, A., Shum, S.B.: Socially augmented argumentation tools: Rationale, design and evaluation of a debate dashboard. Int. J. Hum.-Comput. Stud. 72(3), 298–319 (2014)CrossRef Iandoli, L., Quinto, I., De Liddo, A., Shum, S.B.: Socially augmented argumentation tools: Rationale, design and evaluation of a debate dashboard. Int. J. Hum.-Comput. Stud. 72(3), 298–319 (2014)CrossRef
20.
Zurück zum Zitat Išljamović, S., Lalić, S.: Academic dashboard for tracking students’ efficiency. In: Proceedings of the XIV International Symposium Symorg 2014: New Business Models and sustainable competitiveness, p. 84. fon (2014) Išljamović, S., Lalić, S.: Academic dashboard for tracking students’ efficiency. In: Proceedings of the XIV International Symposium Symorg 2014: New Business Models and sustainable competitiveness, p. 84. fon (2014)
21.
Zurück zum Zitat Joglekar, M., Garcia-Molina, H., Parameswaran, A.: Interactive data exploration with smart drill-down. IEEE Trans. Knowl. Data Eng. 31(1), 46–60 (2017)CrossRef Joglekar, M., Garcia-Molina, H., Parameswaran, A.: Interactive data exploration with smart drill-down. IEEE Trans. Knowl. Data Eng. 31(1), 46–60 (2017)CrossRef
24.
Zurück zum Zitat Khosravi, H., Cooper, K.: Topic dependency models: graph-based visual analytics for communicating assessment data. J. Learn. Anal. 5(3), 136–153 (2018)CrossRef Khosravi, H., Cooper, K.: Topic dependency models: graph-based visual analytics for communicating assessment data. J. Learn. Anal. 5(3), 136–153 (2018)CrossRef
25.
Zurück zum Zitat Khosravi, H., Cooper, K.M.: Using learning analytics to investigate patterns of performance and engagement in large classes. In: Proceedings of the 2017 ACM sigcse technical symposium on computer science education, pp. 309–314 (2017) Khosravi, H., Cooper, K.M.: Using learning analytics to investigate patterns of performance and engagement in large classes. In: Proceedings of the 2017 ACM sigcse technical symposium on computer science education, pp. 309–314 (2017)
26.
Zurück zum Zitat Khosravi, H., Kitto, K., Williams, J.J.: Ripple: a crowdsourced adaptive platform for recommendation of learning activities. arXiv preprint arXiv:1910.05522 (2019) Khosravi, H., Kitto, K., Williams, J.J.: Ripple: a crowdsourced adaptive platform for recommendation of learning activities. arXiv preprint arXiv:​1910.​05522 (2019)
27.
Zurück zum Zitat Khosravi, H., Sadiq, S., Gasevic, D.: Development and adoption of an adaptive learning system: reflections and lessons learned. In: Proceedings of the 51st ACM Technical Symposium on Computer Science Education, p. 58–64. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3328778.3366900 Khosravi, H., Sadiq, S., Gasevic, D.: Development and adoption of an adaptive learning system: reflections and lessons learned. In: Proceedings of the 51st ACM Technical Symposium on Computer Science Education, p. 58–64. Association for Computing Machinery, New York (2020). https://​doi.​org/​10.​1145/​3328778.​3366900
29.
Zurück zum Zitat Leemans, S.J.J., Syring, A.F., van der Aalst, W.M.P.: Earth movers’ stochastic conformance checking. In: Business Process Management Forum - BPM Forum 2019, Proceedings, Vienna, Austria, 1–6 September 2019, pp. 127–143 (2019) Leemans, S.J.J., Syring, A.F., van der Aalst, W.M.P.: Earth movers’ stochastic conformance checking. In: Business Process Management Forum - BPM Forum 2019, Proceedings, Vienna, Austria, 1–6 September 2019, pp. 127–143 (2019)
30.
Zurück zum Zitat Marsh, D.R., Schroeder, D.G., Dearden, K.A., Sternin, J., Sternin, M.: The power of positive deviance. BMJ 329(7475), 1177–1179 (2004)CrossRef Marsh, D.R., Schroeder, D.G., Dearden, K.A., Sternin, J., Sternin, M.: The power of positive deviance. BMJ 329(7475), 1177–1179 (2004)CrossRef
31.
Zurück zum Zitat Martinez-Maldonado, R., Yacef, K., Kay, J.: TSCL: a conceptual model to inform understanding of collaborative learning processes at interactive tabletops. Int. J. Hum.-Comput. Stud. 83, 62–82 (2015)CrossRef Martinez-Maldonado, R., Yacef, K., Kay, J.: TSCL: a conceptual model to inform understanding of collaborative learning processes at interactive tabletops. Int. J. Hum.-Comput. Stud. 83, 62–82 (2015)CrossRef
33.
Zurück zum Zitat Matcha, W., Gašević, D., Uzir, N.A., Jovanović, J., Pardo, A.: Analytics of learning strategies: associations with academic performance and feedback. In: Proceedings of the 9th International Conference on Learning Analytics & Knowledge, pp. 461–470 (2019) Matcha, W., Gašević, D., Uzir, N.A., Jovanović, J., Pardo, A.: Analytics of learning strategies: associations with academic performance and feedback. In: Proceedings of the 9th International Conference on Learning Analytics & Knowledge, pp. 461–470 (2019)
34.
Zurück zum Zitat Ramos-Soto, A., Lama, M., Vázquez-Barreiros, B., Bugarín, A., Mucientes, M., Barro, S.: Towards textual reporting in learning analytics dashboards. In: 2015 IEEE 15th International Conference on Advanced Learning Technologies, pp. 260–264. IEEE (2015) Ramos-Soto, A., Lama, M., Vázquez-Barreiros, B., Bugarín, A., Mucientes, M., Barro, S.: Towards textual reporting in learning analytics dashboards. In: 2015 IEEE 15th International Conference on Advanced Learning Technologies, pp. 260–264. IEEE (2015)
35.
36.
Zurück zum Zitat Santos, J.L., Verbert, K., Govaerts, S., Duval, E.: Addressing learner issues with stepup! an evaluation. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge, pp. 14–22 (2013) Santos, J.L., Verbert, K., Govaerts, S., Duval, E.: Addressing learner issues with stepup! an evaluation. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge, pp. 14–22 (2013)
37.
Zurück zum Zitat Sarawagi, S.: User-adaptive exploration of multidimensional data. In: VLDB, pp. 307–316 (2000) Sarawagi, S.: User-adaptive exploration of multidimensional data. In: VLDB, pp. 307–316 (2000)
40.
Zurück zum Zitat Schneider, D.K., Class, B., Benetos, K., Da Costa, J., Follonier, V.: Learning process analytics for a self-study class in a semantic mediawiki. In: Proceedings of The International Symposium on Open Collaboration, pp. 1–4 (2014) Schneider, D.K., Class, B., Benetos, K., Da Costa, J., Follonier, V.: Learning process analytics for a self-study class in a semantic mediawiki. In: Proceedings of The International Symposium on Open Collaboration, pp. 1–4 (2014)
41.
Zurück zum Zitat Schwendimann, B.A., Rodriguez-Triana, M.J., et al.: Perceiving learning at a glance: a systematic literature review of learning dashboard research, pp. 30–41. IEEE TLT (2017) Schwendimann, B.A., Rodriguez-Triana, M.J., et al.: Perceiving learning at a glance: a systematic literature review of learning dashboard research, pp. 30–41. IEEE TLT (2017)
42.
Zurück zum Zitat Shabaninejad, S., Khosravi, H., Indulska, M., Bakharia, A., Isaias, P.:Automated insightful drill-down recommendations for learning analytics dashboards (2020) Shabaninejad, S., Khosravi, H., Indulska, M., Bakharia, A., Isaias, P.:Automated insightful drill-down recommendations for learning analytics dashboards (2020)
43.
Zurück zum Zitat Sin, K., Muthu, L.: Application of big data in education data mining and learning analytics-a literature review. ICTACT J. Soft Comput. 5(4), 1035–1049 (2015)CrossRef Sin, K., Muthu, L.: Application of big data in education data mining and learning analytics-a literature review. ICTACT J. Soft Comput. 5(4), 1035–1049 (2015)CrossRef
44.
Zurück zum Zitat Tarmazdi, H., Vivian, R., Szabo, C., Falkner, K., Falkner, N.: Using learning analytics to visualise computer science teamwork. In: Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, pp. 165–170 (2015) Tarmazdi, H., Vivian, R., Szabo, C., Falkner, K., Falkner, N.: Using learning analytics to visualise computer science teamwork. In: Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, pp. 165–170 (2015)
45.
Zurück zum Zitat Tobarra, L., Ros, S., Hernández, R., Robles-Gómez, A., Caminero, A.C., Pastor, R.: Integrated analytic dashboard for virtual evaluation laboratories and collaborative forums. In: 2014 XI Tecnologias Aplicadas a la Ensenanza de la Electronica (Technologies Applied to Electronics Teaching)(TAEE), pp. 1–6. IEEE (2014) Tobarra, L., Ros, S., Hernández, R., Robles-Gómez, A., Caminero, A.C., Pastor, R.: Integrated analytic dashboard for virtual evaluation laboratories and collaborative forums. In: 2014 XI Tecnologias Aplicadas a la Ensenanza de la Electronica (Technologies Applied to Electronics Teaching)(TAEE), pp. 1–6. IEEE (2014)
46.
Zurück zum Zitat Trcka, N., Pechenizkiy, M.: From local patterns to global models: towards domain driven educational process mining. In: 2009 Ninth International Conference on Intelligent Systems Design and Applications, pp. 1114–1119. IEEE (2009) Trcka, N., Pechenizkiy, M.: From local patterns to global models: towards domain driven educational process mining. In: 2009 Ninth International Conference on Intelligent Systems Design and Applications, pp. 1114–1119. IEEE (2009)
48.
Zurück zum Zitat Verbert, K., Duval, E., Klerkx, J., Govaerts, S., Santos, J.L.: Learning analytics dashboard applications. Am. Behav. Sci. 57(10), 1500–1509 (2013)CrossRef Verbert, K., Duval, E., Klerkx, J., Govaerts, S., Santos, J.L.: Learning analytics dashboard applications. Am. Behav. Sci. 57(10), 1500–1509 (2013)CrossRef
49.
Zurück zum Zitat Vidal, J.C., Vázquez-Barreiros, B., Lama, M., Mucientes, M.: Recompiling learning processes from event logs. Knowl.-Based Syst. 100, 160–174 (2016)CrossRef Vidal, J.C., Vázquez-Barreiros, B., Lama, M., Mucientes, M.: Recompiling learning processes from event logs. Knowl.-Based Syst. 100, 160–174 (2016)CrossRef
Metadaten
Titel
Recommending Insightful Drill-Downs Based on Learning Processes for Learning Analytics Dashboards
verfasst von
Shiva Shabaninejad
Hassan Khosravi
Sander J. J. Leemans
Shazia Sadiq
Marta Indulska
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-52237-7_39

Premium Partner