Hyungyu Shin
Joseph Jay Williams
ABSTRACT
Online instructional videos are ubiquitous, but it is difficult for instructors to gauge learners' experience and their level of comprehension or confusion regarding the lecture video. Moreover, learners watching the videos may become disengaged or fail to reflect and construct their own understanding. This paper explores instructor and learner perceptions of in-video prompting where learners answer reflective questions while watching videos. We conducted two studies with crowd workers to understand the effect of prompting in general, and the effect of different prompting strategies on both learners and instructors. Results show that some learners found prompts to be useful checkpoints for reflection, while others found them distracting. Instructors reported the collected responses to be generally more specific than what they have usually collected. Also, different prompting strategies had different effects on the learning experience and the usefulness of responses as feedback.
Supplemental Material
- Akshay Agrawal, Jagadish Venkatraman, Shane Leonard, and Andreas Paepcke. 2015. YouEDU: addressing confusion in MOOC discussion forums by recommending instructional video clips. (2015).Google Scholar
- Vincent Aleven, Niels Pinkwart, Kevin Ashley, and Collin Lynch. 2006. Supporting self-explanation of argument transcripts: Specific v. generic prompts. In Workshop of Intelligent Tutoring Systems for Ill-Defined domains, 8th International Conference on Intelligent Tutoring Systems. 47--55.Google Scholar
- Lori Breslow, David E Pritchard, Jennifer DeBoer, Glenda S Stump, Andrew D Ho, and Daniel T Seaton. 2013. Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment 8 (2013).Google Scholar
- Yuanzhe Chen, Qing Chen, Mingqian Zhao, Sebastien Boyer, Kalyan Veeramachaneni, and Huamin Qu. 2016. DropoutSeer: Visualizing learning patterns in Massive Open Online Courses for dropout reasoning and prediction. In Visual Analytics Science & Technology (VAST), 2016 IEEE Conference on. IEEE, 111--120.Google ScholarCross Ref
- Michelene TH Chi, Nicholas Leeuw, Mei-Hung Chiu, and Christian LaVancher. 1994. Eliciting self-explanations improves understanding. Cognitive science 18, 3 (1994), 439--477.Google Scholar
- Clark A Chinn and William F Brewer. 1993. The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction. Review of educational research 63, 1 (1993), 1--49.Google Scholar
- John F Chizmar and Anthony L Ostrosky. 1998. The one-minute paper: Some empirical findings. The Journal of Economic Education 29, 1 (1998), 3--10.Google ScholarCross Ref
- K Patricia Cross and Thomas A Angelo. 1988. Classroom Assessment Techniques. A Handbook for Faculty. (1988).Google Scholar
- Elena L Glassman, Juho Kim, Andrés Monroy-Hernández, and Meredith Ringel Morris. 2015. Mudslide: A spatially anchored census of student confusion for online lecture videos. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1555--1564. Google ScholarDigital Library
- Jeffrey D Karpicke and Janell R Blunt. 2011. Retrieval practice produces more learning than elaborative studying with concept mapping. Science 331, 6018 (2011), 772--775.Google ScholarCross Ref
- Juho Kim, Philip J Guo, Carrie J Cai, Shang-Wen Daniel Li, Krzysztof Z Gajos, and Robert C Miller. 2014. Data-driven interaction techniques for improving navigation of educational videos. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 563--572. Google ScholarDigital Library
- René F Kizilcec, Jeremy N Bailenson, and Charles J Gomez. 2015. The instructor's face in video instruction: Evidence from two large-scale field studies. Journal of Educational Psychology 107, 3 (2015), 724.Google ScholarCross Ref
- Geza Kovacs. 2016. Effects of in-video Quizzes on MOOC lecture viewing. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale. ACM, 31--40. Google ScholarDigital Library
- Yi-Chieh Lee, Wen-Chieh Lin, Fu-Yin Cherng, Hao-Chuan Wang, Ching-Ying Sung, and Jung-Tai King. 2015. Using time-anchored peer comments to enhance social interaction in online educational videos. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 689--698. Google ScholarDigital Library
- Margaret Mazzolini and Sarah Maddison. 2007. When to jump in: The role of the instructor in online discussion forums. Computers & Education 49, 2 (2007), 193--213. Google ScholarDigital Library
- Samuel T Moulton, Selen Türkay, and Stephen M Kosslyn. 2017. Does a presentation's medium affect its message? PowerPoint, Prezi, and oral presentations. PloS one 12, 7 (2017), e0178774.Google ScholarCross Ref
- Amy Pavel, Dan B Goldman, Björn Hartmann, and Maneesh Agrawala. 2016. VidCrit: Video-based Asynchronous Video Review. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 517--528. Google ScholarDigital Library
- Daniel L Schwartz and Taylor Martin. 2004. Inventing to prepare for future learning: The hidden efficiency of encouraging original student production in statistics instruction. Cognition and Instruction 22, 2 (2004), 129--184.Google ScholarCross Ref
- Vikash Singh, Sarah Abdellahi, Mary Lou Maher, and Celine Latulipe. 2016. The Video Collaboratory as a Learning Environment. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education. ACM, 352--357. Google ScholarDigital Library
- Kristin Stephens-Martinez, Marti A Hearst, and Armando Fox. 2014. Monitoring moocs: which information sources do instructors value?. In Proceedings of the first ACM conference on Learning@ scale conference. ACM, 79--88. Google ScholarDigital Library
- Richard L Weaver and Howard W Cotrell. 1985. Mental aerobics: The half-sheet response. Innovative Higher Education 10, 1 (1985), 23--31.Google ScholarCross Ref
- Miaomiao Wen, Diyi Yang, and Carolyn Rose. 2014. Sentiment Analysis in MOOC Discussion Forums: What does it tell us?. In Educational data mining 2014.Google Scholar
- Joseph J Williams and Tania Lombrozo. 2010. The role of explanation in discovery and generalization: Evidence from category learning. Cognitive Science 34, 5 (2010), 776--806.Google ScholarCross Ref
- Joseph Jay Williams, Tania Lombrozo, Anne Hsu, Bernd Huber, and Juho Kim. 2016. Revising Learner Misconceptions Without Feedback: Prompting for Reflection on Anomalies. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 470--474. Google ScholarDigital Library
- Joseph Jay Williams, Tania Lombrozo, and Bob Rehder. 2013. The hazards of explanation: Overgeneralization in the face of exceptions. Journal of Experimental Psychology: General 142, 4 (2013), 1006.Google ScholarCross Ref
- Han Zhang, Maosong Sun, Xiaochen Wang, Zhengyang Song, Jie Tang, and Jimeng Sun. 2017. Smart Jump: Automated Navigation Suggestion for Videos in MOOCs. In Proceedings of the 26th International Conference on World Wide Web Companion. International World Wide Web Conferences Steering Committee, 331--339. Google ScholarDigital Library
- Saijing Zheng, Pamela Wisniewski, Mary Beth Rosson, and John M Carroll. 2016. Ask the Instructors: Motivations and Challenges of Teaching Massive Open Online Courses. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 206--221. Google ScholarDigital Library
Index Terms
- Understanding the Effect of In-Video Prompting on Learners and Instructors
Recommendations
Cognitive, metacognitive and motivational perspectives on preflection in self-regulated online learning
The results complement research on self-regulated learning in online learning environments.Findings indicate the benefits of directed preflective prompts for novice learners.Personalisation and adaptation of prompting in online learning is crucial for ...
“It Feels Like I am Talking into a Void”: Understanding Interaction Gaps in Synchronous Online Classrooms
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsThis paper investigates in-class interactions in synchronous online classrooms when the choice of modality is discretionary, such that students choose when and if they turn on their cameras and microphones. Instructor interviews (N = 7) revealed that ...
Perception of MOOC Pedagogical Tools and Learners' Learning Styles in MOOC Blended Teaching: a Case Study
ICEBT '19: Proceedings of the 2019 3rd International Conference on E-Education, E-Business and E-TechnologyRapid development has been achieved since the emergence of MOOC in 2008, but there are still many defects in the popularization of MOOC. Developing blended teaching by utilizing is considered to be one of effective means to overcome these shortcomings. ...
Comments