Xuanchong Li
ABSTRACT
Massive Open Online Courses (MOOCs) enable everyone to receive high-quality education. However, current MOOC creators cannot provide an effective, economical, and scalable method to detect cheating on tests, which would be required for any certification. In this paper, we propose a Massive Open Online Proctoring (MOOP) framework, which combines both automatic and collaborative approaches to detect cheating behaviors in online tests. The MOOP framework consists of three major components: Automatic Cheating Detector (ACD), Peer Cheating Detector (PCD), and Final Review Committee (FRC). ACD uses webcam video or other sensors to monitor students and automatically flag suspected cheating behavior. Ambiguous cases are then sent to the PCD, where students peer-review flagged webcam video to confirm suspicious cheating behaviors. Finally, the list of suspicious cheating behaviors is sent to the FRC to make the final punishing decision. Our experiment show that ACD and PCD can detect usage of a cheat sheet with good accuracy and can reduce the overall human resources required to monitor MOOCs for cheating.
- ProctorU. http://www.proctoru.com/.Google Scholar
- ProctorU: Overview and Technology Requirements. http://www.ao.uiuc.edu/support/source/student_services/proctoru_tech.html.Google Scholar
- THE TRIBUNAL. http://na.leagueoflegends.com/tribunal/.Google Scholar
- Aggarwal, J., and Ryoo, M. S. Human activity analysis: A review. ACM Computing Surveys (CSUR) 43, 3 (2011), 16. Google ScholarDigital Library
- Case, R., and Cabalka, P. Remote proctoring: Results of a pilot program at western governors university. Proceedings of the 25th Annual Conference on Distance Teaching and Learning 10 (2009), 2010.Google Scholar
- Dick, M., Sheard, J., Bareiss, C., Carter, J., Joyce, D., Harding, T., and Laxer, C. Addressing student cheating: Definitions and solutions. In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education, ITiCSE-WGR '02, ACM (New York, NY, USA, 2002), 172--184. Google ScholarDigital Library
- Eisenberg, A. Keeping an Eye on Online Test-Takers. The New York Times, 2013.Google Scholar
- Jiang, Y.-G., Dai, Q., Xue, X., Liu, W., and Ngo, C.-W. Trajectory-based modeling of human actions with motion reference points. In Computer Vision - ECCV 2012. Springer, 2012, 425--438. Google ScholarDigital Library
- Matikainen, P., Hebert, M., and Sukthankar, R. Trajectons: Action recognition through the motion analysis of tracked features. In Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, IEEE (2009), 514--521.Google ScholarCross Ref
- Mostow, J., Chang, K.-M., and Nelson, J. Toward exploiting eeg input in a reading tutor. In Proceedings of the 15th International Conference on Artificial Intelligence in Education, AIED'11, Springer-Verlag (Berlin, Heidelberg, 2011), 230--237. Google ScholarDigital Library
- Pappano, L. The Year of the MOOC. The New York Times, 2012.Google Scholar
- Prince, D. J., Fulton, R. A., and Garsombke, T. W. Comparisons of proctored versus non-proctored testing strategies in graduate distance education curriculum. Journal of College Teaching & Learning 6, 7 (2009).Google Scholar
- Richardson, R., and North, M. Strengthening the trust in online courses: A common sense approach. J. Comput. Sci. Coll. 28, 5 (May 2013), 266--272. Google ScholarDigital Library
- Rogers, C. F. Faculty perceptions about e-cheating during online testing. J. Comput. Sci. Coll. 22, 2 (Dec. 2006), 206--212. Google ScholarDigital Library
- Shaw, A. D., Horton, J. J., and Chen, D. L. Designing incentives for inexpert human raters. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW '11, ACM (New York, NY, USA, 2011), 275--284. Google ScholarDigital Library
- Wang, H., Klaser, A., Schmid, C., and Liu, C.-L. Action recognition by dense trajectories. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, IEEE (2011), 3169--3176. Google ScholarDigital Library
- Wang, H., Kläser, A., Schmid, C., and Liu, C.-L. Dense trajectories and motion boundary descriptors for action recognition. International journal of computer vision 103, 1 (2013), 60--79.Google ScholarCross Ref
- Wang, H., Schmid, C., et al. Action recognition with improved trajectories. In International Conference on Computer Vision (2013). Google ScholarDigital Library
- Young, J. R. Dozens of Plagiarism Incidents Are Reported in Coursera's Free Online Courses. The Chronicle of Higher Education, 2012.Google Scholar
- Zhang, Y., and van der Schaar, M. Reputation-based incentive protocols in crowdsourcing applications. In INFOCOM, 2012 Proceedings IEEE (March 2012), 2140--2148.Google Scholar
Index Terms
- Massive Open Online Proctor: Protecting the Credibility of MOOCs certificates
Recommendations
Supporting learners' self-regulated learning in Massive Open Online Courses
AbstractIn MOOCs, learners are typically presented with great autonomy over their learning process. Therefore, learners should engage in self-regulated learning (SRL) in order to successfully study in a MOOC. Learners however often struggle to self-...
Highlights- Learners struggle to regulate their learning in massive open online courses (MOOCs).
- A self-regulated learning (SRL) intervention was implemented in three MOOCs.
- Learners' SRL was measured with trace data variables.
- ...
Benefit and Cost Analysis of Massive Open Online Courses: Pedagogical Implications on Higher Education
There has been much research done on online learning including research on online educational activities and methods. The use of technology is gaining rising importance in higher education due to the benefits that it brings. In terms of adopting new ...
Benefit and Cost Analysis of Massive Open Online Courses: Pedagogical Implications on Higher Education
There has been much research done on online learning including research on online educational activities and methods. The use of technology is gaining rising importance in higher education due to the benefits that it brings. In terms of adopting new ...
Comments