Colin A. Higgins
Abstract
This article reports on the design, implementation, and usage of the CourseMarker (formerly known as CourseMaster) courseware Computer Based Assessment (CBA) system at the University of Nottingham. Students use CourseMarker to solve (programming) exercises and to submit their solutions. CourseMarker returns immediate results and feedback to the students. Educators author a variety of exercises that benefit the students while offering practical benefits. To date, both educators and students have been hampered by CBA software that has been constructed to assess text-based or multiple-choice answers only. Although there exist a few CBA systems with some capability to automatically assess programming coursework, none assess Java programs and none are as flexible, architecture-neutral, robust, or secure as the CourseMarker CBA system.
- Arnow, D. and Barshay, O. 1999a. On-line programming examinations using WebToTeach. In Proceedings of the 4th Annual SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (Krakow, Poland, June 27--30). 21-24. Google Scholar
- Arnow, D. and Barshey, O. 1999b. WebToTeach: An interactive focused programming exercise system. In Proceedings of the 29th ASEE/IEEE Frontiers in Education Conference (Puerto Rico, Nov.).Google Scholar
- Ahmadzadeh, M., Elliman, D., and Higgins, C. 2005. An analysis of patterns of debugging among novice computer science students. In Proceedings of the ITiCSE 2005 Conference (Lisbon). Google Scholar
- Al-Yahya, M., Higgins, C., Brailsford, T., and Ashman, H. 2005. Question Master: An open model for reusing dialogue in learning environments. In Proceedings of the CAL'05 Conference on Virtual Learning.Google Scholar
- Benford, S. D., Burke, E. K., Foxley, E., Gutteridge, N. H., and Mohd Zin, A. 1993. Experiences with the Ceilidh system. In Proceedings of the 1st International Conference on Computer Based Learning in Science (Vienna).Google Scholar
- Benford, S. D., Burke, E. K., Foxley, E., Gutteridge, N. H., Higgins, C., and Mohd Zin, A. 1994. Software support for automated assessment and administration. J. Res. Comput. Edu. (1994).Google Scholar
- Charman, D. and Elmes, A. 1998. Computer Based Assessment: A Guide to Good Practice. Vol. I. University of Plymouth, 1998.Google Scholar
- Culwin, F. and Lancaster, T. 2001. Plagiarism issues for higher education. Inf. Security 21, 2, 36--41.Google Scholar
- Daly, C. 1999. RoboProf and an introductory computer programming course. In Proceedings of the 4th Annual SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (Krakow, June 27--30). 155--158. Google Scholar
- Foxley, E., Higgins, C., Hegazy, T., Symeonidis, P., and Tsintsifas, A. 2001a. The CourseMaster CBA system: Improvements over Ceilid. In Proceedings of the Fifth International Computer Assisted Assessment Conference (Loughborough University, UK, July 2--4). 189--201.Google Scholar
- Foxley, E., Higgins, C., Symeonidis, P., and Tsintsifas, A. 2001b. The CourseMaster automated assessment system---A next generation Ceilidh. In Proceedings of the Workshop on Computer Assisted Assessment to Support the ICS Disciplines (University of Warwick, April 5--6).Google Scholar
- Foxley, E., Higgins, C., Tsintsifas, A., and Symeonidis, P. 2000. The Ceilidh-CourseMaster system, An introduction. In Proceedings of the. 4th Java in the Curriculum Conference (South Bank University, UK, Jan. 24).Google Scholar
- Foxley, E., Tsintsifas, A., Higgins, C., and Symeonidis P. 1999. Ceilidh, A system for the automatic evaluation of students' programming work. In Proceedings of the CBLISS 99 Conference (University of Twente, Holland, July 2--7).Google Scholar
- Foxley, E., Higgins, C., Symeonidis, P., and Tsintsifas, A. 1998. Security issues under Ceilidh's WWW interface. In Proceedings of the ICCE'98 Conference (Beijing, Oct. 14--17). 235--240.Google Scholar
- Higgins, C., Symeonidis, P., and Tsintsifas, A. 2002a. Diagram-based CBA using DATsys and CourseMaster. In Proceedings of the International Conference on Computers in Education (ICCE2002, Auckland, New Zealand, Dec. 3--6). Google Scholar
- Higgins, C., Tsintsifas, A., and Symeonidis, P. 2002b. CourseMaster marking programs and diagrams. In Proceedings of the Dealing with Plagiarism in ICS Education Conference (Warwick, April 11--12).Google Scholar
- Hyvönen, J. and Malmi, L. 1993. TRAKLA---A system for teaching algorithms using email and a graphical editor. In Proceedings of the HYPERMEDIA Conference (Vaasa). 141--147.Google Scholar
- Jackson, D. and Usher, M. 1997. Grading student programs using ASSYST, In Proceedings of the 28th SIGCSE Technical Symposium on Computer Science Education (San Jose, CA, Feb. 27--March 1). 335--339. Google Scholar
- Luck, M. and Joy, M. S. 1999. A secure on-line submission system. Softw. --- Pract. Exper. 29, 8, 721--740. Google Scholar
- Mason, D. and Woit, D. 1998. Integrating technology into computer science examinations. In Proceedings of the 29th SIGCSE Technical Symposium on Computer Science Education (Atlanta, GA, Feb. 26--March 1). 1401--1404. Google Scholar
- Sun Microsystems. 1999. The JAVA HotSpot performance engine architecture. White paper. http://java.sun.com/products/hotspot/whitepaper.html, 1999.Google Scholar
- Symeonidis, P. 2001. An in-depth review of CourseMaster marking subsystem. Tech. Rep., LTR Group, University of Nottingham, UK.Google Scholar
- Symeonidis, P. 1998. Creating an exercise using CourseMarker (formerly JavaCeilidh). Tech. Rep., LTR Group, University of Nottingham, UK.Google Scholar
- Yong, C. and Higgins, C. 2003. Automatically creating personalised exercises based on student profiles. In Proceedings of the ITiCSE 2003 Conference (Thessaloniki, Greece, June 30--July 2). Google Scholar
Index Terms
- Automated assessment and experiences of teaching programming
Recommendations
A Phenomenological Study of Online Assessment Perceptions of Macao Higher Learning Institutions During the COVID-19 Pandemic: :Dual Perspectives of Students and Instructors
ICEDS '22: Proceedings of the 2022 3rd International Conference on Education Development and StudiesOnline assessment is the key issue of studying online learning during the COVID-19 pandemic. Often, online assessments are understood as the mirror to face-to-face learning assessments. In fact, online assessment should start from the premise that all ...
Automated Assessment of Programming Assignments
CSERC '13: Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education ResearchThis is a position paper in which I argue that massive open online programming courses can benefit by the application of automated assessment of programming assignments.
I gathered success factors and identified concerns related to automatic assessment ...
Beyond Programming: A Computer-Based Assessment of Computational Thinking Competency
Computational Thinking (CT), entailing both domain-general and domain-specific skills, is a competency fundamental to computing education and beyond. However, as a cross-domain competency, appropriate assessment design and method remain equivocal. Indeed, ...
Comments