Elena L. Glassman
Juho Kim
Andrés Monroy-Hernández
Meredith Ringel Morris
ABSTRACT
Educators have developed an effective technique to get feedback after in-person lectures, called "muddy cards." Students are given time to reflect and write the "muddiest" (least clear) point on an index card, to hand in as they leave class. This practice of assigning end-of-lecture reflection tasks to generate explicit student feedback is well suited for adaptation to the challenge of supporting feedback in online video lectures. We describe the design and evaluation of Mudslide, a prototype system that translates the practice of muddy cards into the realm of online lecture videos. Based on an in-lab study of students and teachers, we find that spatially contextualizing students' muddy point feedback with respect to particular lecture slides is advantageous to both students and teachers. We also reflect on further opportunities for enhancing this feedback method based on teachers' and students' experiences with our prototype.
- Altman, D.G. Practical statistics for medical research. CRC Press, 1990. Google Scholar
Cross Ref
- Angelo, T.A. and Cross, K.P. Classroom assessment techniques. 1993.Google Scholar
- Breslow, L., Pritchard, D.E., DeBoer, J., Stump, G.S., Ho, A.D., and Seaton, D.T. Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment 8, (2013), 13--25.Google Scholar
- Brush, A.J.B., Bargeron, D., Grudin, J., Borning, A., and Gupta, A. Supporting Interaction Outside of Class: Anchored Discussions vs. Discussion Boards. CSCL 2002, International Society of the Learning Sciences (2002), 425--434. Google ScholarDigital Library
- Cohen, J. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 20, 1 (1960), 37--46.Google ScholarCross Ref
- Craig, S., Graesser, A., Sullins, J., and Gholson, B. Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media 29, 3 (2004), 241--250.Google ScholarCross Ref
- Cross, A., Bayyapunedi, M., Ravindran, D., Cutrell, E., and Thies, W. VidWiki: Enabling the Crowd to Improve the Legibility of Online Educational Videos. Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, ACM (2014), 1167--1175. Google ScholarDigital Library
- D'Mello, S., Lehman, B., Pekrun, R., and Graesser, A. Confusion can be beneficial for learning. Learning and Instruction 29, (2014), 153--170.Google ScholarCross Ref
- Freeman, S., Eddy, S.L., McDonough, M., et al. Active learning increases student performance in science, engineering, and mathematics. PNAS 111, 23 (2014), 8410--8415.Google ScholarCross Ref
- Hall, S.R. Teaching By Questioning. MIT Aero-Astro Annual, 2003, 29--35.Google Scholar
- Harwood, W.S. The one-minute paper: a communication tool for large lecture classes. J. Chemical Education 73, 3 (1996), 229.Google ScholarCross Ref
- Herreid, C.F. and Schiller, N.A. Case studies and the flipped classroom. J. College Science Teaching 42, 5 (2013), 62--66.Google Scholar
- Kibler, J. Cognitive Disequilibrium. In S. Goldstein and J.A. Naglieri, eds., Encyclopedia of Child Behavior and Development. Springer US, 2011, 380--380.Google Scholar
- Kim, J., Guo, P.J., Cai, C.J., Li, S.-W.D., Gajos, K.Z., and Miller, R.C. Data-Driven Interaction Techniques for Improving Navigation of Educational Videos. UIST 2014. Google ScholarDigital Library
- Kulkarni, C., Wei, K.P., Le, H., et al. Peer and self assessment in massive online classes. ACM Trans. on Computer-Human Interaction 20, 6 (2013), 33. Google ScholarDigital Library
- Lombard, M., Snyder-Duch, J., and Bracken, C.C. Practical resources for assessing and reporting intercoder reliability in content analysis research projects. Retrieved April 19, (2004), 2004.Google Scholar
- Luther, K., Pavel, A., Wu, W., et al. CrowdCrit: crowdsourcing and aggregating visual design critique. CSCW 2014, ACM (2014), 21--24. Google ScholarDigital Library
- Mosteller, F. The "Muddiest Point in the Lecture" as a feedback device. On Teaching and Learning: J. Harvard-Danforth Center 3, (1989), 10--21.Google Scholar
- Sadler, D.R. Formative assessment and the design of instructional systems. Instructional science 18, 2 (1989), 119--144.Google Scholar
- Surowiecki, J. The wisdom of crowds. Random House LLC, 2005. Google ScholarDigital Library
- Wattenberg, M. and Viegas, F.B. The Word Tree, an Interactive Visual Concordance. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1221--1228. Google ScholarDigital Library
- Wilson, R.C. Improving faculty teaching: Effective use of student evaluations and consultants. J. Higher Education, (1986), 196--211.Google Scholar
- Xu, A., Huang, S.-W., and Bailey, B. Voyant: generating structured feedback on visual designs using a crowd of non-experts. CSCW 2014, ACM (2014), 1433--1444. Google ScholarDigital Library
- Zyto, S., Karger, D., Ackerman, M., and Mahajan, S. Successful classroom deployment of a social document annotation system. CHI 2012, ACM (2012), 1883--1892. Google ScholarDigital Library
Index Terms
- Mudslide: A Spatially Anchored Census of Student Confusion for Online Lecture Videos
Recommendations
Learning in a flipped english classroom from university students' perspectives
ICIET '18: Proceedings of the 6th International Conference on Information and Education TechnologyThis study set out to explore university students' perceptions of learning English as a foreign language in a flipped classroom. In this study, a flipped learning task was proposed as a means to promote the students' active learning, which required them ...
Jump-starting team-based learning in the computer science classroom
ITiCSE '13: Proceedings of the 18th ACM conference on Innovation and technology in computer science educationIn recent years we have witnessed a resurgence of learner-centered techniques in the college classroom--though not predominantly in the Computer Science classroom. Of all, Peer Instruction (PI) and Team-Based Learning (TBL) have proven themselves as the ...
Customized Teaching Scenarios for Smartphones in University Lecture Settings
CSEDU 2016: Proceedings of the 8th International Conference on Computer Supported EducationMany teachers use Audience Response Systems (ARS) in lectures to re-activate their listeners and to get an insight in studentsâ knowledge of the current lecture contents. Plenty of such applications have been developed in recent years, they provide a ...
Comments