ABSTRACT
Recent research, and our own experience as educators, has highlighted the need for an approach to CS1 that includes consideration of students' emotional state. Unfortunately, collection of affect data usually requires a large investment of time and resources. In this article, we describe a simple and easy tool for collection of student affect data. We illustrate how these data can provide detailed insight into the quality of curricular materials and make accurate predictions of student performance. Based on our first year using the tool, we identify specific response patterns that can identify a student at risk of CS1 failure. Students who find classroom exercises both difficult and boring, or who recognize a programming problem as involving familiar material but have no clear plan as to how to solve the problem, are likely to struggle as the course proceeds.
- R. Baker, S.K. D'Mello, M. Rodrigo and A.C. Graesser. 2010. Better to Be Frustrated than Bored: The Incidence, Persistence, and Impact of Learners' Cognitive-Affective States during Interactions with Three Different Computer-Based Learning Environments. International Journal of Human-Computer Studies April 2010. Google ScholarDigital Library
- R. S. Baker, S. M. Gowda, M. Wixon, J. Kalka, A. Z. Wagner, A. Salvi, V. Aleven, G. W. Kusbit, J. Ocumpaugh, and L. Rossi. 2012. Towards sensor-free affect detection in cognitive tutor algebra. In Proceedings of the 5th International Conference on Educational Data Mining (EDM 2012), 126--133.Google Scholar
- I. Blanchette and A. Richards. 2010. The influence of affect on higher level cognition: A review of research on interpretation, judgement, decision making and reasoning. Cognition and Emotion, 2010, 24 (4), 561_595.Google Scholar
- N. Bosch. 2016. Detecting Student Engagement: Human Versus Machine UMAP '16, July 13--17, 2016, Halifax, NS, Canada Google ScholarDigital Library
- N. Bosch and S. D'Mello. 2013. Sequential Patterns of Affective States of Novice Programmers. The First Workshop on AI-supported Education for Computer Science (AIEDCS 2013). 1--10.Google Scholar
- N. Bosch, S.K. D'Mello, J. Ocumpaugh, R,S, Baker and V. Shute. 2016. Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms, ACM Transactions on Interactive Intelligent Systems, 6, 2, 17.Google ScholarDigital Library
- J. Carter and P. Dewan. 2010. Design, Implementation, and Evaluation of an Approach for Determining When Programmers are Having Difficulty. GROUP'10, November 7--10, 2010, Sanibel Island, Florida, USA. Google ScholarDigital Library
- S.D. Craig, A.C. Graesser, J. Sullins and B. Gholson. 2004. Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media, 29, 3, 241--250, Oct 2004 Google ScholarCross Ref
- S. D'Mello, N. Person and B. Lehman. 2009. Antecedent-Consequent Relationships and Cyclical Patterns between Affective States and Problem Solving Outcomes. Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling. 57--64.Google Scholar
- A. Graesser and S.K. D'Mello. 2012. Emotions during the learning of difficult material. In B. Ross (Ed.), Psychology of Learning and Motivation, 57, 183--226. Google ScholarCross Ref
- S. Hansen and E. Eddy. 2007. Engagement and Frustration in Programming Projects. SIGCSE'07, March 7--10, 2007, Covington, Kentucky, USA. Google ScholarDigital Library
- E.F. Iepsen, M. Bercht and E. Reategui. 2013. Detection and Assistance to Students Who Show Frustration in Learning of Algorithms, Proceedings of IEEE Frontier in Education Conference, October 2013, 1183--1189. Google ScholarCross Ref
- A. Kapoor, W. Burleson and R.W. Picard. 2007. Automatic prediction of frustration. Int. J. Human-Computer Studies, 65, 724--736. Google ScholarDigital Library
- P. Kinnunen and B. Simon, B. 2011. CS Majors' Self-Efficacy Perceptions in CS1: Results in Light of Social Cognitive Theory. ICER'11, August 8--9, 2011, Providence, Rhode Island, USA.Google ScholarDigital Library
- M. Kleine, T. Goetz, R. Pekrun and N. Hall. 2005. The structure of students' emotions experienced during a mathematical achievement test. Zentralblatt für Didaktik der Mathematik (ZDM 2005), 37, 3.Google Scholar
- B. Kort, R. Reilly and R. W. Picard. 2001. An Affective Model of Interplay Between Emotions and Learning: Reengineering Educational Pedagogy-Building a Learning Companion, Proceedings of the 2nd IEEE Int'l Conf. Advanced Learning Technologies (ICALT 2001), IEEE CS Press. Google ScholarCross Ref
- D. Lee, M. Rodrigo, R. Baker, J. d, Sugay and A. Coronel. 2011. Exploring the relationship between novice programmer confusion and achievement. In: S. D'Mello, A. Graesser, B. Schuller and J.C. Martin, J.C. (eds.) Affective Computing and Intelligent Interaction, pp. 175--184. Springer, Berlin Heidelberg (2011).Google Scholar
- M. J. Lee and A.J. Ko. 2011. Personifying Programming Tool Feedback Improves Novice Programmers' Learning. ICER'11, August 8--9, 2011, Providence, RI, USA. Google ScholarDigital Library
- Z. Liu, V. Pataranutaporn, J. Ocumpaugh, R. Baker (2013) Sequences of Frustration and Confusion, and Learning. Proceedings of the 6th International Conference on Educational Data Mining, 114 -- 120.Google Scholar
- A.W. Meade and S.B. Craig. 2011. Identifying Careless Responses in Survey Data. Proceedings of the 26th Annual Meeting of the Society for Industrial and Organizational Psychology, Chicago, IL.Google Scholar
- D. Parsons, K. Wood and P.Haden. 2015. What are we Doing When we Assess Programming? Proceedings of the 17th Australasian Computing Education Conference (ACE 2015), Sydney Australia, 27--30 January. 2015.Google Scholar
- Pears, A., East, P., McCartney, R., Ratcliffe, M.B., Stamouli, I., Berglund, A., Kinnunen, P., Moström, J-E., Schulte, C., Eckerdal, A., Malmi, L., Murphy, L., Simon, B. and Lynda Thomas. 2007. What's the problem?: teachers' experience of student learning successes and failures. Proceedings of the Seventh Baltic Sea Conference on Computing Education Research, November 15--18, 2007, Koli National Park, FinlandGoogle Scholar
- R. Pekrun, T. Goetz, L. Daniels, R. Stupinsky and R. Perry. 2010. Boredom in Achievement Settings: Exploring Control-Value Antecedents and Performance Outcomes of a Neglected Emotion. Journal of Educational Psychology, 102, 3, 531--549 Google ScholarCross Ref
- R. Pekrun, T. Goetz, W. Titz and R. Perry. 2002. Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research, Educational Psychologist, 37, 2, 91--106 Google ScholarCross Ref
- A Robins, J. Rountree and N. Rountree. 2003. Learning and Teaching Programming: A Review. Computer Science Education. 13, 2, 137--172. Google ScholarCross Ref
- A. Robins. 2010. Learning Edge Momentum: A new account of outcomes in CS1. Computer Science Education, 20, 1, 37--71. Google ScholarCross Ref
- Simes, R. J. 1986. An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73,3,751--754. Google ScholarCross Ref
- M.J. Scott and G. Ghinea. 2014. Measuring Enrichment: The Assembly and Validation of an Instrument to Assess Student Self-Beliefs in CS1. ICER'14, August 11--13, 2014, Glasgow, Scotland, UK. Google ScholarDigital Library
- V. Shute, S. D'Mello, R. Baker, C. Cho, N. Bosch, J. Ocumpaugh, M. Ventura and V. Almeda, V. 2015. Modeling how incoming knowledge, persistence, affective states, and in-game progress influence student learning from an educational game. Computers and Education, 86, 224--235.Google ScholarDigital Library
- A. Vihavainen, J. Airaksinen and C. Watson. 2014. A Systematic Review of Approaches for Teaching Introductory Programming and Their Influence on Success ICER '14, August 11 - 13 2014, Glasgow, United KingdomGoogle Scholar
- F.T. Villavicencio and A.B. Bernardo. 2013. Positive academic emotions moderate the relationship between self-regulation and academic achievement. British Journal of Educational Psychology (2013), 83, 329--340. Google ScholarCross Ref
- M.G. Zikuda, I Stuchlikova, I. and T. Jank. 2013. Emotional Aspects of Learning and Teaching: Reviewing the Field - Discussing the Issues Orbis scholae, 7, 2, 7--22.Google Scholar
Index Terms
- Student affect in CS1: insights from an easy data collection tool
Recommendations
Challenges and Approaches for Data Collection to Understand Student Retention: (Abstract Only)
SIGCSE '18: Proceedings of the 49th ACM Technical Symposium on Computer Science EducationFor many years, computing faculty have devoted substantial time and energy to the retention of diverse populations. But how are we doing really? The ACM Retention Committee has identified at least 5 populations of interest in tracking student retention: ...
The 'Art' of Programming: Exploring Student Conceptions of Programming through the Use of Drawing Methodology
ICER '17: Proceedings of the 2017 ACM Conference on International Computing Education ResearchIn this exploratory study, we analysed 396 drawings by first-year programming students in response to the question "what does programming mean to you". We were surprised by the level of care that students gave to their drawings, and we were confronted ...
Collecting Participation Data Across NSF CS10K-Funded Professional Development Providers (Abstract Only)
SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science EducationComputer Science (CS) is a rapidly growing and evolving field, with many secondary teachers participating in professional development (PD) to offer CS courses in their schools as the entry point to a CS education pipeline. In 2014 the Evaluator Working ...
Comments