ABSTRACT
In the last five years, the world has seen a remarkable level of interest in Massive Open Online Courses, or MOOCs. A consistent message from universities participating in MOOC delivery is their eagerness to understand students' online learning processes. This paper reports on an exploratory investigation of students' learning processes in two MOOCs which have different curriculum and assessment designs. When viewed through the lens of common MOOC learning analytics, the high level of initial student interest and, ultimately, the high level of attrition, makes these two courses appear very similar to each other, and to MOOCs in general. With the goal of developing a greater understanding of students' patterns of learning behavior in these courses, we investigated alternative learning analytic approaches and visual representations of the output of these analyses. Using these approaches we were able to meaningfully classify student types and visualize patterns of student engagement which were previously unclear. The findings from this research contribute to the educational community's understanding of students' engagement and performance in MOOCs, and also provide the broader learning analytics community with suggestions of new ways to approach learning analytic data analysis and visualization.
- G. Balakrishnan and D. Coetzee. Predicting student retention in massive open online courses using hidden markov models. http://www.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-109.html, 2013.Google Scholar
- M. Bostock, V. Ogievetsky, and J. Heer. D3: Data-driven documents. IEEE Trans. Visualization & Comp. Graphics (Proc. InfoVis), 2011. Google ScholarDigital Library
- L. B. Breslow, D. E. Pritchard, J. De Boer, G. S. Stump, A. D. Ho, and D. Seaton. Studying learning in the worldwide classroom: Research into edx's first mooc. Research & Practice in Assessment, 8:13--25, 2013.Google Scholar
- C. G. Brinton, M. Chiang, S. Jain, H. Lam, Z. Liu, and F. M. F. Wong. Learning about social learning in moocs: From statistical analysis to generative model. CoRR, abs/1312.2159, 2013.Google Scholar
- D. Clow. Moocs and the funnel of participation. In Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK '13, pages 185--189, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- F. Dochy, M. Segers, and M. M. Buehl. The relation between assessment practices and outcomes of studies: The case of research on prior knowledge. Review of educational research, 69(2):145--186, 1999.Google Scholar
- E. Duval. Attention please!: learning analytics for visualization and recommendation. In Proceedings of the 1st International Conference on Learning Analytics and Knowledge, LAK '11, pages 9--17, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
- R. Ellis and P. Goodyear. Students' experiences of e-learning in higher education: the ecology of sustainable innovation. Routledge, 2009.Google Scholar
- G. D. Haertel, H. J. Walberg, and T. Weinstein. Psychological models of educational performance: A theoretical synthesis of constructs. Review of Educational Research, 53(1):75--91, 1983.Google ScholarCross Ref
- T. S. Judd and G. E. Kennedy. More sense from audit trails: Exploratory sequential data analysis. In Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference, pages 476--484, 2004.Google Scholar
- G. E. Kennedy and T. S. Judd. Making sense of audit trail data. Australian Journal of Educational Technology, 20(1):18--32, 2004.Google ScholarCross Ref
- R. F. Kizilcec, C. Piech, and E. Schneider. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK '13, pages 170--179, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- R. Kop, H. Fournier, and J. Mak. A pedagogy of abundance or a pedagogy to support human beings? participant support on massive open online courses. The International Review of Research in Open and Distance Learning, 12(7), 2011.Google ScholarCross Ref
- A. Littlejohn. Understanding massive open online courses. http://cemca.org.in/ckfinder/userfiles/files/EdTech%20Notes%202_Littlejohn_final_1June2013.pdf, 2013.Google Scholar
- MOOCs@Edinburgh Group. Moocs @ edinburgh 2013: Report #1. http://hdl.handle.net/1842/6683, May 2013.Google Scholar
- M. Olmos and L. Corrin. Learning analytics: A case study of the process of design of visualizations. Journal of Asynchronous Learning Networks, 16(3):39--49, June 2012.Google Scholar
- P. R. Pintrich, R. W. Marx, and R. A. Boyle. Beyond cold conceptual change: The role of motivational beliefs and classroom contextual factors in the process of conceptual change. Review of Educational research, 63(2):167--199, 1993.Google ScholarCross Ref
- R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2008. ISBN 3-900051-07-0.Google Scholar
- G. Siemens and P. Long. Penetrating the fog: Analytics in learning and education. Educause Review, 46(5):30--32, 2011.Google Scholar
- M. Waite, J. Mackness, G. Roberts, and E. Lovegrove. Liminal participants and skilled orienteers: Learner participation in a mooc for new lecturers. MERLOT Journal of Online Learning and Teaching, 9(2):200--215, 2013.Google Scholar
Index Terms
- Visualizing patterns of student engagement and performance in MOOCs
Recommendations
Examining engagement: analysing learner subpopulations in massive open online courses (MOOCs)
LAK '15: Proceedings of the Fifth International Conference on Learning Analytics And KnowledgeMassive open online courses (MOOCs) are now being used across the world to provide millions of learners with access to education. Many learners complete these courses successfully, or to their own satisfaction, but the high numbers who do not finish ...
Moving Through MOOCS: Pedagogy, Learning Design and Patterns of Engagement
Design for Teaching and Learning in a Networked WorldAbstractMassive open online courses (MOOCs) are part of the lifelong learning experience of people worldwide. Many of these learners participate fully. However, the high levels of dropout on most of these courses are a cause for concern. Previous studies ...
Student engagement in massive open online courses
Completion rates in massive open online courses MOOCs are disturbingly low. Existing analysis has focused on patterns of resource access and prediction of drop-out using learning analytics. In contrast, the effectiveness of teaching programs in ...
Comments