Geza Kovacs
ABSTRACT
Online courses on sites such as Coursera use quizzes embedded inside lecture videos (in-video quizzes) to help learners test their understanding of the video. This paper analyzes how users interact with in-video quizzes, and how in-video quizzes influence users' lecture viewing behavior. We analyze the viewing logs of users who took the Machine Learning course on Coursera. Users engage heavily with in-video quizzes -- 74% of viewers who start watching a video will attempt its corresponding in-video quiz. We observe spikes in seek activity surrounding in-video quizzes, particularly seeks from the in-video quiz to the preceding section. We show that this is likely due to users reviewing the preceding section to help them answer the quiz, as the majority of users who seek backwards from in-video quizzes have not yet submitted a correct answer, but will later attempt the quiz. Some users appear to use quiz-oriented navigation strategies, such as seeking directly from the start of the video to in-video quizzes, or skipping from one quiz to the next. We discuss implications of our findings on the design of lecture-viewing platforms.
- Robert Allen. 1998.The Web: interactive and multimedia education. Computer Networks and ISDN Systems 30, 16 (1998), 1717--1727. Google Scholar
Digital Library
- Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2014.Engaging with massive online courses. In Proceedings of the 23rd international conference on World wide web. International World Wide Web Conferences Steering Committee, 687--698. Google ScholarDigital Library
- Philip J Guo, Juho Kim, and Rob Rubin. 2014.How video production affects student engagement: An empirical study of mooc videos. In Proceedings of the first ACM conference on Learning@ scale conference. ACM, 41--50. Google ScholarDigital Library
- Philip J Guo and Katharina Reinecke. 2014.Demographic differences in how students navigate through MOOCs. In Proceedings of the first ACM conference on Learning@ scale conference. ACM, 21--30. Google ScholarDigital Library
- Mina C Johnson-Glenberg. 2010.Embedded formative e-assessment: who benefits, who falters. Educational Media International 47, 2 (2010), 153--171.Google ScholarCross Ref
- Juho Kim, Philip J Guo, Carrie J Cai, Shang-Wen Daniel Li, Krzysztof Z Gajos, and Robert C Miller. 2014a.Data-driven interaction techniques for improving navigation of educational videos. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 563--572. Google ScholarDigital Library
- Juho Kim, Philip J Guo, Daniel T Seaton, Piotr Mitros, Krzysztof Z Gajos, and Robert C Miller. 2014b.Understanding in-video dropouts and interaction peaks in online lecture videos. In Proceedings of the first ACM conference on Learning@at Scale conference. ACM, 31--40. Google ScholarDigital Library
- René F Kizilcec, Chris Piech, and Emily Schneider. 2013.Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the third international conference on learning analytics and knowledge. ACM, 170--179. Google ScholarDigital Library
- Rene F Kizilcec and Emily Schneider. 2015.Motivation as a Lens to Understand Online Learners: Towards Data-Driven Design with the OLEI Scale. ACM Transactions on Computer-Human Interaction (TOCHI) 22, 2 (2015), 5. Google ScholarDigital Library
- Henry L Roediger III and Andrew C Butler. 2011.The critical role of retrieval practice in long-term retention. Trends in cognitive sciences 15, 1 (2011), 20--27.Google Scholar
Index Terms
- Effects of In-Video Quizzes on MOOC Lecture Viewing
Recommendations
The Effect of Peer Assessment Rubrics on Learners' Satisfaction and Performance Within a Blended MOOC Environment
CSEDU 2015: Proceedings of the 7th International Conference on Computer Supported Education - Volume 2Massive Open Online Courses (MOOCs) have a remarkable ability to expand access to a large scale of
participants worldwide, beyond the formality of the higher education systems. MOOCs support participants
to be actively involved in collaborative learning ...
Student Perceptions towards Positive and Negative Aspects of MOOC-based Blended Learning
ICEMT '22: Proceedings of the 6th International Conference on Education and Multimedia TechnologyIt has been several years since Massive Open Online Courses (MOOCs) made their way into higher education, and several forms have arisen from this novel method of information acquisition. Teachers have been incorporating MOOCs into traditional classroom ...
Understanding ESL Students' Motivations to Increase MOOC Accessibility
L@S '16: Proceedings of the Third (2016) ACM Conference on Learning @ ScaleMassive Open Online Courses (MOOCs) have the potential to bridge education and literacy gaps by offering high quality, free courses to anyone with an Internet connection. MOOCs in their present state, however, may be relatively inaccessible to non-...
Comments