Judy Sheard
Simon
Angela Carbone
Tony Clear
Michael de Raadt
Daryl D'Souza
Raymond Lister
ABSTRACT
This paper describes the development of a classification scheme that can be used to investigate the characteristics of introductory programming examinations. We describe the process of developing the scheme, explain its categories, and present a taste of the results of a pilot analysis of a set of CS1 exam papers. This study is part of a project that aims to investigate the nature and composition of formal examination instruments used in the summative assessment of introductory programming students, and the pedagogical intentions of the educators who construct these instruments.
- Anderson, L. W. and L. Sosniak, A., "Excerpts from the "Taxonomy of Educational Objectives, The Classification of Educational Goals, Handbook I: Cognitive Domain," in Bloom's Taxonomy: A Forty Year Retrospective, L. W. Anderson and L. Sosniak, A., Eds., ed Chicago, Illinois, USA: The University of Chicago Press, 1994, 9--27.Google Scholar
- Banerjee, M., M. Capozzoli, L. McSweeney, and D. Sinha, "Beyond kappa: a review of interrater agreement measures," Canadian Journal of Statistics, 27:3--23, 1999.Google ScholarCross Ref
- Biggs, J. B., "What the Student Does: teaching for enhanced learning," Higher Education Research and Development, 18:57--75, 1999.Google ScholarCross Ref
- Clear, T., J. Whalley, R. Lister, A. Carbone, M. Hu, J. Sheard, B. Simon, and E. Thompson, "Reliably classifying novice programmer exam response using the SOLO taxonomy," in NACCQ 2008, Auckland, New Zealand, 2008.Google Scholar
- Dale, N., "Content and emphasis in CS1," inroads - The SIGCSE Bulletin, 37:69--73, 2005. Google ScholarDigital Library
- Dale, N., "Most difficult topics in CS1: Results of an online survey of educators," inroads - The SIGCSE Bulletin, 38:49--53, 2006. Google ScholarDigital Library
- Dart, B. and G. Boulton-Lewis, "The SOLO model: Addressing fundamental measurement issues," in Teaching and Learning in Higher Education, M. Turpin, Ed., ed Camberwell, Victoria, Australia: ACER Press, 1998, 145--176.Google Scholar
- Davies, M. and J. L. Fleiss, "Measuring agreement for multinomial data," Biometrics, 38:1047--1051, 1982.Google ScholarCross Ref
- Goldfinch, T., A. L. Carew, A. Gardner, A. Henderson, T. McCarthy, and G. Thomas, "Cross-institutional comparison of mechanics examinations: A guide for the curious," in AaaE conference, Yeppoon, 2008, 1--8.Google Scholar
- Lister, R., "Concrete and other neo-piagetian forms of reasoning in the novice programmer," in 13th Australasian Computing Education conference, Perth, Australia, 2011. Google ScholarDigital Library
- Lister, R., T. Clear, Simon, D. J. Bouvier, P. Carter, A. Eckerdal, J. Jacková, M. Lopez, R. McCartney, P. Robbins, O. Seppälä, and E. Thompson, "Naturally occurring data as research instrument: Analyzing examination responses to study the novice programmer," inroads - The SIGCSE Bulletin, 41:156--173, 2010. Google ScholarDigital Library
- Lopez, M., J. Whalley, P. Robbins, and R. Lister, "Relationships between reading, tracing and writing skills in introductory programming.," in Fourth International Workshop on Computing Education Research (ICER '08), Sydney, Australia, 2008, 101--112. Google ScholarDigital Library
- Morrison, B., M. Clancy, R. McCartney, B. Richards, and K. Sanders, "Applying data structures in exams," in SIGCSE'11, Dallas, Texas, USA, 2011, 353--358. Google ScholarDigital Library
- Parsons, D. and P. Haden, "Parson's programmimg puzzles: A fun and effective learning tool for first programming courses," in Eighth Australasian Computing Education conference (ACE2006), Hobart, Australia, 2006, 157--163. Google ScholarDigital Library
- Petersen, A., M. Craig, and D. Zingaro, "Reviewing CS1 exam question content," in SIGCSE'11, Dallas, Texas, USA, 2011, 631--636. Google ScholarDigital Library
- Ramsden, P., Learning to Teach in Higher Education. New York, NY, USA: Routledge, 1992.Google Scholar
- Schulte, C. and J. Bennedsen, "What do teachers teach in introductory programming?," in Second International Computing Education Research workshop (ICER'06), Canterbury, UK, 2006, 17--28. Google ScholarDigital Library
- Sheard, J., A. Carbone, R. Lister, B. Simon, E. Thompson, and J. Whalley, "Going SOLO to assess novice programmers," in 13th Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE'08), Madrid, Spain, 2008, 209--213. Google ScholarDigital Library
- Shuhidan, S., M. Hamilton, and D. D'Souza, "Instructor perspectives of multiple-choice questions in summative assessment for novice programmers," Computer Science Education, 20:229--259, 2010.Google ScholarCross Ref
- Simon, A. Carbone, M. De Raadt, R. Lister, M. Hamilton, and J. Sheard, "Classifying computing education papers: Process and results," in 4th International Workshop on Computing Education research (ICER 2008), Sydney, NSW, Australia, 2008, 161--171. Google ScholarDigital Library
- Simon, B., M. Clancy, R. McCartney, B. Morrison, B. Richards, and K. Sanders, "Making sense of data structure exams," in International Computing Education Research workshop (ICER'10), Aarhus, Denmark, 2010, 97--105. Google ScholarDigital Library
- Tew, A., "Assessing Fundamental Introductory Computing Concept Knowledge in a Language Independent Manner," PhD Dissertation, 2010. Google ScholarDigital Library
- Tew, A. E., "Developing a validated assessment of fundamental CS1 concepts," in SIGCSE'10, Milwaukee, Wisconsin, USA, 2010, 97--101. Google ScholarDigital Library
- Venables, A., G. Tan, and R. Lister, "A closer look at tracing, explaining and code writing skills in the novice programmer," in The fifth International Computing Education Research Workshop (ICER 2009), Berkeley, California, USA, 2009. Google ScholarDigital Library
- Whalley, J., R. Lister, E. Thompson, T. Clear, P. Robbins, P. K. A. Kumar, and C. Prasad, "An Australasian study of reading and comprehension skills in novice programmers, using the Bloom and SOLO taxonomies," in Eighth Australasian Computing Education conference (ACE2006), Hobart, Australia, 2006, 243--252. Google ScholarDigital Library
Index Terms
- Exploring programming assessment instruments: a classification scheme for examination questions
Index terms have been assigned to the content through auto-classification.
Recommendations
Introductory programming: examining the exams
ACE '12: Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123This paper describes a classification scheme that can be used to investigate the characteristics of introductory programming examinations. The scheme itself is described and its categories explained. We describe in detail the process of determining the ...
Assignment and sequence: why some students can't recognise a simple swap
Koli Calling '11: Proceedings of the 11th Koli Calling International Conference on Computing Education ResearchIn the current cycle of the continuing drive to discover why some students have such difficulty learning to program, the goalposts have been moving ever closer to the very fundamentals. On the basis of some very simple multiple-choice questions asked in ...
Natural language in introductory programming: an experimental study
ITiCSE '11: Proceedings of the 16th annual joint conference on Innovation and technology in computer science educationAlthough characterized as being "high level", classical programming languages such as Pascal and C have a grammar that is very different from natural language. In this research field, two main streams are noteworthy, one of them is characterized by an ...
Comments