Skip to main content
Top

2017 | OriginalPaper | Chapter

6. Overcoming the MOOC Data Deluge with Learning Analytic Dashboards

Authors : Lorenzo Vigentini, Andrew Clayphan, Xia Zhang, Mahsa Chitsaz

Published in: Learning Analytics: Fundaments, Applications, and Trends

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the proliferation of MOOCs and the large amount of data collected, a lot of questions have been asked about their value and effectiveness. One of the key issues emerging is the difficulty in the sense—making from the data available. The use of analytic dashboards has been suggested to provide quick insights and distil the large volume of learner interaction data generated. These dashboards hold the promise of providing a contextualized view of data and facilitating useful research exploration. However, little has been done in defining how these dashboards should be created, often resulting in a proliferation of systems for each new research agenda. We present our experience of building MOOC dashboards for two different platforms, namely Coursera and FutureLearn, motivated by a set of design goals with input from a diverse set of stakeholders. We demonstrate the features of the system and how it has served to make data accessible and useable. We report on problems faced, drawing on analyses of think-aloud sessions conducted with real educators, which have informed our dashboard process.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
Please refer to the note at the end of the chapter with links to the respective websites.
 
Literature
go back to reference Amo D (2013) MOOCs: experimental approaches for quality in pedagogical and design fundamentals. Proceedings of the first international conference on technological ecosystem for enhancing multiculturality. ACM, New York, pp 219–223CrossRef Amo D (2013) MOOCs: experimental approaches for quality in pedagogical and design fundamentals. Proceedings of the first international conference on technological ecosystem for enhancing multiculturality. ACM, New York, pp 219–223CrossRef
go back to reference Arnold KE, Pistilli MD (2012) Course signals at Purdue: using learning analytics to increase student success. Proceedings of the 2Nd international conference on learning analytics and knowledge. ACM, New York, pp 267–270CrossRef Arnold KE, Pistilli MD (2012) Course signals at Purdue: using learning analytics to increase student success. Proceedings of the 2Nd international conference on learning analytics and knowledge. ACM, New York, pp 267–270CrossRef
go back to reference Azevedo R, Harley J, Trevors G, et al (2013) Using trace data to examine the complex roles of cognitive, metacognitive, and emotional self-regulatory processes during learning with multi-agent systems. In: Azevedo R, Aleven V (eds) International handbook of metacognition and learning technologies. Springer, New York, pp 427–449 Azevedo R, Harley J, Trevors G, et al (2013) Using trace data to examine the complex roles of cognitive, metacognitive, and emotional self-regulatory processes during learning with multi-agent systems. In: Azevedo R, Aleven V (eds) International handbook of metacognition and learning technologies. Springer, New York, pp 427–449
go back to reference Bayne S, Ross J (2014) The pedagogy of the Massive Open Online Course (MOOC): the UK view. Higher Education Academy, New York Bayne S, Ross J (2014) The pedagogy of the Massive Open Online Course (MOOC): the UK view. Higher Education Academy, New York
go back to reference Brooke J (1996) SUS-A quick and dirty usability scale. Usability Eval Ind 189:4–7 Brooke J (1996) SUS-A quick and dirty usability scale. Usability Eval Ind 189:4–7
go back to reference Campbell JP, DeBlois PB, Oblinger DG (2007) Academic analytics: a new tool for a new era. Educ Rev 42:40 Campbell JP, DeBlois PB, Oblinger DG (2007) Academic analytics: a new tool for a new era. Educ Rev 42:40
go back to reference Churchill D, King M, Fox B (2013) Learning design for science education in the 21st century. J Inst Educ Res 45:404–421 Churchill D, King M, Fox B (2013) Learning design for science education in the 21st century. J Inst Educ Res 45:404–421
go back to reference Clow D (2013) MOOCs and the funnel of participation. In: Proceedings of the third international conference on learning analytics and knowledge. ACM, pp 185–189 Clow D (2013) MOOCs and the funnel of participation. In: Proceedings of the third international conference on learning analytics and knowledge. ACM, pp 185–189
go back to reference Cobos R, Gil S, Lareo A, Vargas FA (2016) Open-DLAs: an open dashboard for learning analytics. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 265–268CrossRef Cobos R, Gil S, Lareo A, Vargas FA (2016) Open-DLAs: an open dashboard for learning analytics. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 265–268CrossRef
go back to reference Conrad F, Blair J, Tracy E (1999) Verbal reports are data! A theoretical approach to cognitive interviews. In: Proceedings of the federal committee on statistical methodology research conference. Tuesday B sessions, pp 11–20 Conrad F, Blair J, Tracy E (1999) Verbal reports are data! A theoretical approach to cognitive interviews. In: Proceedings of the federal committee on statistical methodology research conference. Tuesday B sessions, pp 11–20
go back to reference Corrin L, de Barba P (2015) How do students interpret feedback delivered via dashboards? Proceedings of the fifth international conference on learning analytics and knowledge. ACM, New York, pp 430–431 Corrin L, de Barba P (2015) How do students interpret feedback delivered via dashboards? Proceedings of the fifth international conference on learning analytics and knowledge. ACM, New York, pp 430–431
go back to reference Corrin L, Kennedy G, de Barba P, et al (2015) Loop: a learning analytics tool to provide teachers with useful data visualisations. Perth, Australia, pp 409–413 Corrin L, Kennedy G, de Barba P, et al (2015) Loop: a learning analytics tool to provide teachers with useful data visualisations. Perth, Australia, pp 409–413
go back to reference Daniel J (2012) Making sense of MOOCs: musings in a maze of myth, paradox and possibility. J Interact Media Educ 2012: Art. 18 Daniel J (2012) Making sense of MOOCs: musings in a maze of myth, paradox and possibility. J Interact Media Educ 2012: Art. 18
go back to reference Davis HC, Dickens K, Leon Urrutia M, Sanchéz Vera M. del M, White S (2014) MOOCs for universities and learners an analysis of motivating factors. Presented at the 6th International Conference on Computer Supported Education. Retrieved from http://eprints.soton.ac.uk/363714/ Davis HC, Dickens K, Leon Urrutia M, Sanchéz Vera M. del M, White S (2014) MOOCs for universities and learners an analysis of motivating factors. Presented at the 6th International Conference on Computer Supported Education. Retrieved from http://​eprints.​soton.​ac.​uk/​363714/​
go back to reference Leon-Urrutia M, Cobos R, Dickens K, White S, Davis H (2016) Visualising the MOOC experience: a dynamic MOOC dashboard built through institutional collaboration. In Research Track https://www.emoocs2016.eu Graz, Austria, pp 461–471 Leon-Urrutia M, Cobos R, Dickens K, White S, Davis H (2016) Visualising the MOOC experience: a dynamic MOOC dashboard built through institutional collaboration. In Research Track https://​www.​emoocs2016.​eu Graz, Austria, pp 461–471
go back to reference Drachsler H, Kalz M (2016) The MOOC and learning analytics innovation cycle (MOLAC): a reflective summary of ongoing research and its challenges. J Comput Assist Learn n/a–n/a. doi:10.1111/jcal.12135 Drachsler H, Kalz M (2016) The MOOC and learning analytics innovation cycle (MOLAC): a reflective summary of ongoing research and its challenges. J Comput Assist Learn n/a–n/a. doi:10.​1111/​jcal.​12135
go back to reference Duval E (2011) Attention Please!: learning analytics for visualization and recommendation. Proceedings of the 1st international conference on learning analytics and knowledge. ACM, New York, pp 9–17CrossRef Duval E (2011) Attention Please!: learning analytics for visualization and recommendation. Proceedings of the 1st international conference on learning analytics and knowledge. ACM, New York, pp 9–17CrossRef
go back to reference Fredericks C, Lopez G, Shnayder V et al (2016) Instructor dashboards in EdX. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 335–336CrossRef Fredericks C, Lopez G, Shnayder V et al (2016) Instructor dashboards in EdX. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 335–336CrossRef
go back to reference Govaerts S, Verbert K, Duval E, Pardo A (2012) The student activity meter for awareness and self-reflection. CHI ’12 extended abstracts on human factors in computing systems. ACM, New York, pp 869–884 Govaerts S, Verbert K, Duval E, Pardo A (2012) The student activity meter for awareness and self-reflection. CHI ’12 extended abstracts on human factors in computing systems. ACM, New York, pp 869–884
go back to reference Kia FS, Pardos ZA, Hatala M Learning dashboard: bringing student background and performance online Kia FS, Pardos ZA, Hatala M Learning dashboard: bringing student background and performance online
go back to reference Leon Urrutia M, Cobos R, Dickens K, et al (2016) Visualising the MOOC experience: a dynamic MOOC dashboard built through institutional collaboration Leon Urrutia M, Cobos R, Dickens K, et al (2016) Visualising the MOOC experience: a dynamic MOOC dashboard built through institutional collaboration
go back to reference Mohanty S, Jagadeesh M, Srivatsa H (2013) Big data imperatives: enterprise “Big Data” warehouse, “BI” implementations and analytics Apress Mohanty S, Jagadeesh M, Srivatsa H (2013) Big data imperatives: enterprise “Big Data” warehouse, “BI” implementations and analytics Apress
go back to reference Nielsen J (1994) Usability engineering. Elsevier Nielsen J (1994) Usability engineering. Elsevier
go back to reference Pardos ZA, Kao K (2015) moocRP: an open-source analytics platform. Proceedings of the second (2015) ACM conference on learning @ scale. ACM, New York, pp 103–110 Pardos ZA, Kao K (2015) moocRP: an open-source analytics platform. Proceedings of the second (2015) ACM conference on learning @ scale. ACM, New York, pp 103–110
go back to reference Pijeira Díaz HJ, Santofimia Ruiz J, Ruipérez-Valiente JA et al (2016) A demonstration of ANALYSE: a learning analytics tool for open edX. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 329–330CrossRef Pijeira Díaz HJ, Santofimia Ruiz J, Ruipérez-Valiente JA et al (2016) A demonstration of ANALYSE: a learning analytics tool for open edX. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 329–330CrossRef
go back to reference Rieman J, Franzke M, Redmiles D (1995) Usability evaluation with the cognitive walkthrough. Conference companion on human factors in computing systems. ACM, New York, pp 387–388CrossRef Rieman J, Franzke M, Redmiles D (1995) Usability evaluation with the cognitive walkthrough. Conference companion on human factors in computing systems. ACM, New York, pp 387–388CrossRef
go back to reference Ruiz JS, Díaz HJP, Ruipérez-Valiente JA et al (2014) Towards the development of a learning analytics extension in open edX. Proceedings of the second international conference on technological ecosystems for enhancing multiculturality. ACM, New York, pp 299–306 Ruiz JS, Díaz HJP, Ruipérez-Valiente JA et al (2014) Towards the development of a learning analytics extension in open edX. Proceedings of the second international conference on technological ecosystems for enhancing multiculturality. ACM, New York, pp 299–306
go back to reference Seaton DT, Bergner Y, Chuang I, et al (2013) Towards real-time analytics in MOOCs. In: IWTA@ LAK Seaton DT, Bergner Y, Chuang I, et al (2013) Towards real-time analytics in MOOCs. In: IWTA@ LAK
go back to reference Siemens G, Gasevic D, Haythornthwaite C, et al (2011) Open learning analytics: an integrated and modularized platform. Open University Press Siemens G, Gasevic D, Haythornthwaite C, et al (2011) Open learning analytics: an integrated and modularized platform. Open University Press
go back to reference Stephens-Martinez K, Hearst MA, Fox A (2014) Monitoring MOOCs: which information sources do instructors value? Proceedings of the first ACM conference on learning @ scale conference. ACM, New York, pp 79–88CrossRef Stephens-Martinez K, Hearst MA, Fox A (2014) Monitoring MOOCs: which information sources do instructors value? Proceedings of the first ACM conference on learning @ scale conference. ACM, New York, pp 79–88CrossRef
go back to reference Vatrapu R, Reimann P, Bull S, Johnson M (2013) An eye-tracking study of notational, informational, and emotional aspects of learning analytics representations. Proceedings of the third international conference on learning analytics and knowledge. ACM, New York, pp 125–134CrossRef Vatrapu R, Reimann P, Bull S, Johnson M (2013) An eye-tracking study of notational, informational, and emotional aspects of learning analytics representations. Proceedings of the third international conference on learning analytics and knowledge. ACM, New York, pp 125–134CrossRef
go back to reference Veeramachaneni K, Halawa S, Dernoncourt F, et al (2014a) MOOCdb: developing standards and systems to support MOOC data science Veeramachaneni K, Halawa S, Dernoncourt F, et al (2014a) MOOCdb: developing standards and systems to support MOOC data science
go back to reference Veeramachaneni K, O’Reilly U-M, Taylor C (2014b) Towards feature engineering at scale for data from massive open online courses Veeramachaneni K, O’Reilly U-M, Taylor C (2014b) Towards feature engineering at scale for data from massive open online courses
go back to reference Verbert K, Govaerts S, Duval E et al (2013b) Learning dashboards: an overview and future research opportunities. Pers Ubiquitous Comput 18:1499–1514. doi:10.1007/s00779-013-0751-2 Verbert K, Govaerts S, Duval E et al (2013b) Learning dashboards: an overview and future research opportunities. Pers Ubiquitous Comput 18:1499–1514. doi:10.​1007/​s00779-013-0751-2
go back to reference Vigentini L, Zhao C (2016) Evaluating the “student” experience in MOOCs. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 161–164CrossRef Vigentini L, Zhao C (2016) Evaluating the “student” experience in MOOCs. Proceedings of the third (2016) ACM conference on learning @ scale. ACM, New York, pp 161–164CrossRef
go back to reference Wharton C, Bradford J, Jeffries R, Franzke M (1992) Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations. Proc SIGCHI Conf Hum Factors Comput Syst, pp 381–388 Wharton C, Bradford J, Jeffries R, Franzke M (1992) Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations. Proc SIGCHI Conf Hum Factors Comput Syst, pp 381–388
Metadata
Title
Overcoming the MOOC Data Deluge with Learning Analytic Dashboards
Authors
Lorenzo Vigentini
Andrew Clayphan
Xia Zhang
Mahsa Chitsaz
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-52977-6_6

Premium Partner