Ma. Mercedes T. Rodrigo
Abstract
We study which observable affective states and behaviors relate to students' achievement within a CS1 programming course. To this end, we use a combination of human observation, midterm test scores, and logs of student interactions with the compiler within an Integrated Development Environment (IDE). We find that confusion, boredom and engagement in IDE-related on-task conversation are associated with lower achievement. We find that a student's midterm score can be tractably predicted with simple measures such as the student's average number of errors, number of pairs of compilations in error, number pairs of compilations with the same error, pairs of compilations with the same edit location and pairs of compilations with the same error location. This creates the potential to respond to evidence that a student is at-risk for poor performance before they have even completed a programming assignment.
- Baker, R.S., Corbett, A.T., Koedinger, K.R., and Wagner, A.Z. (2004) Off-task behavior in the Cognitive Tutor classroom: When students "Game The System". ACM CHI 2004: Computer--Human Interaction, 383--390. Google Scholar
Digital Library
- Bennedsen J. and Caspersen M. E. Optimists Have More Fun, But Do They Learn Better? -- On the Influence of Emotional and Social Factors on Learning Introductory Computer Science. Computer Science Education, 18, 1, 2008, 1--16.Google Scholar
- Cohen, J. 1960. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement, 20, 37--46.Google ScholarCross Ref
- Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York: Harper and Row.Google Scholar
- D'Mello, S. K., Craig, S. D., Witherspoon, A., McDaniel, B., Graesser, A. 2005. Integrating affect sensors in an intelligent tutoring system. In "Affective Interactions: The Computer in the Affective Loop Workshop" In conjunction with International conference on Intelligent User Interfaces, 7--13. Google ScholarDigital Library
- Field, A. 2005. Discovering Statistics Using SPSS. London: Sage Publications. Psychology Press: Philadelphia, PA. Google ScholarDigital Library
- Goold, A. and Rimmer, R. 2000. Factors affecting performance in first-year computing. SIGCSE Bull. 32, 2 (Jun. 2000), 39--43. DOI= http://doi.acm.org/10.1145/355354.355369 Google ScholarDigital Library
- Graesser, A. C. Chipman, P., King, B., McDaniel, B., and D'Mello, S (2007). Emotions and Learning with AutoTutor. 13th International Conference on Artificial Intelligence in Education (AIED 2007). R. Luckin et al. (Eds), (pp 569--571). IOS Press. Google ScholarDigital Library
- Halland, K. and Malan, K. 2003. Reflections by teachers learning to program. In Proceedings of the 2003 Annual Research Conference of the South African institute of Computer Scientists and information Technologists on Enablement Through Technology (September 17 -- 19, 2003). J. Eloff, A. Engelbrecht, P. Kotzé, and M. Eloff, Eds. ACM International Conference Proceeding Series, vol. 47. South African Institute for Computer Scientists and Information Technologists, 165--172. Google ScholarDigital Library
- Khan, I. A., Hierons, R. M., and Brinkman, W. P. 2007. Mood independent programming. In Proceedings of the 14th European Conference on Cognitive Ergonomics: invent! Explore! (London, United Kingdom, August 28 -- 31, 2007). ECCE '07, vol. 250. ACM, New York, NY, 269--272. DOI= http://doi.acm.org/10.1145/1362550.1362606 Google ScholarDigital Library
- Kinnunen, P., McCartney, R., Murphy, L., and Thomas, L. 2007. Through the eyes of instructors: a phenomenographic investigation of student success. In Proceedings of the Third international Workshop on Computing Education Research (Atlanta, Georgia, USA, September 15 -- 16, 2007). ICER '07. ACM, New York, NY, 61--72. DOI= http://doi.acm.org/10.1145/1288580.1288589 Google ScholarDigital Library
- Kumar, S. 2008. The rise and fall of a good programmer. Ubiquity 9, 14 (Apr. 2008), 1--5. DOI= http://doi.acm.org/10.1145/1366321.1366323 Google ScholarDigital Library
- Jadud, M. C. 2006. An Exploration of Novice Compilation Behavior in BlueJ. Doctoral thesis. University of KentGoogle Scholar
- Joni, S., Soloway, E., Goldman, R., and Ehrlich, K. 1983. Just so stories: how the program got that bug. SIGCUE Outlook 17, 4 (Sep. 1983), 13--26. DOI= http://doi.acm.org/10.1145/1045083.1045086 Google ScholarDigital Library
- Lane, H. C. and VanLehn, K. 2005. Intention--based scoring: an approach to measuring success at solving the composition problem. In Proceedings of the 36th SIGCSE Technical Symposium on Computer Science Education (St. Louis, Missouri, USA, February 23 -- 27, 2005). SIGCSE '05. ACM, New York, NY, 373--377. DOI= http://doi.acm.org/10.1145/1047344.1047471 Google ScholarDigital Library
- Ovans, R. 2004. The programmer life-cycle. SIGSOFT Softw. Eng. Notes 29, 3 (May. 2004), 25--26. DOI= http://doi.acm.org/10.1145/986710.986720 Google ScholarDigital Library
- Perkins, D. N., Hancock, C., Hobbs, R., Martin F., and Simmons, R. 1985. Conditions of Learning in Novice Programmers. Concept Paper. Educational Technology Center, Harvard Graduate School of Education..Google Scholar
- Rodrigo, M. M. T., Baker, R. S. J. d., Lagud, M. C. V., Lim, S. A. L., Macapanpan, A. F., Pascua, S. A. M. S., Santillano, J. Q., Sevilla, L. R. S., Sugay, J. O., Tep, S.,&Viehland, N. J. B. (2007). Affect and usage choices in simulation problem-solving environments. In R. Luckin, K. R. Koedinger, J. Greer (Eds.), 13th International Conference on Artificial Intelligence in Education, 145--152. Google ScholarDigital Library
- Spohrer, J. C. and Soloway, E. 1986. Novice mistakes: are the folk wisdoms correct?. Commun. ACM 29, 7 (Jul. 1986), 624--632. DOI= http://doi.acm.org/10.1145/6138.6145 Google ScholarDigital Library
- Tabanao, E., Rodrigo, M. M. T., and Jadud M. 2008. Identifying at-risk novice programmers through the analysis of online protocols. Philippine Computing Society Congress 2008, (UP Diliman, Quezon City, FebruaryGoogle Scholar
Index Terms
- Affective and behavioral predictors of novice programmer achievement
Recommendations
Affective and behavioral predictors of novice programmer achievement
ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science educationWe study which observable affective states and behaviors relate to students' achievement within a CS1 programming course. To this end, we use a combination of human observation, midterm test scores, and logs of student interactions with the compiler ...
Predicting at-risk novice Java programmers through the analysis of online protocols
ICER '11: Proceedings of the seventh international workshop on Computing education researchIn this study, we attempted to quantify indicators of novice programmer progress in the task of writing programs, and we evaluated the use of these indicators for identifying academically at-risk students. Over the course of nine weeks, students ...
Effects of B-learning and F2F learning environments on students' achievement in QBASIC programming
In higher education, teaching methods, learning style, student workload, and previous programming experience, among others are factors that greatly influence students' achievement particularly in programming courses. However, research has shown that ...
Comments