skip to main content
10.1145/3141880.3141881acmotherconferencesArticle/Chapter ViewAbstractPublication Pageskoli-callingConference Proceedingsconference-collections
research-article

Student affect in CS1: insights from an easy data collection tool

Published:16 November 2017Publication History

ABSTRACT

Recent research, and our own experience as educators, has highlighted the need for an approach to CS1 that includes consideration of students' emotional state. Unfortunately, collection of affect data usually requires a large investment of time and resources. In this article, we describe a simple and easy tool for collection of student affect data. We illustrate how these data can provide detailed insight into the quality of curricular materials and make accurate predictions of student performance. Based on our first year using the tool, we identify specific response patterns that can identify a student at risk of CS1 failure. Students who find classroom exercises both difficult and boring, or who recognize a programming problem as involving familiar material but have no clear plan as to how to solve the problem, are likely to struggle as the course proceeds.

References

  1. R. Baker, S.K. D'Mello, M. Rodrigo and A.C. Graesser. 2010. Better to Be Frustrated than Bored: The Incidence, Persistence, and Impact of Learners' Cognitive-Affective States during Interactions with Three Different Computer-Based Learning Environments. International Journal of Human-Computer Studies April 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. S. Baker, S. M. Gowda, M. Wixon, J. Kalka, A. Z. Wagner, A. Salvi, V. Aleven, G. W. Kusbit, J. Ocumpaugh, and L. Rossi. 2012. Towards sensor-free affect detection in cognitive tutor algebra. In Proceedings of the 5th International Conference on Educational Data Mining (EDM 2012), 126--133.Google ScholarGoogle Scholar
  3. I. Blanchette and A. Richards. 2010. The influence of affect on higher level cognition: A review of research on interpretation, judgement, decision making and reasoning. Cognition and Emotion, 2010, 24 (4), 561_595.Google ScholarGoogle Scholar
  4. N. Bosch. 2016. Detecting Student Engagement: Human Versus Machine UMAP '16, July 13--17, 2016, Halifax, NS, Canada Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. N. Bosch and S. D'Mello. 2013. Sequential Patterns of Affective States of Novice Programmers. The First Workshop on AI-supported Education for Computer Science (AIEDCS 2013). 1--10.Google ScholarGoogle Scholar
  6. N. Bosch, S.K. D'Mello, J. Ocumpaugh, R,S, Baker and V. Shute. 2016. Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms, ACM Transactions on Interactive Intelligent Systems, 6, 2, 17.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. J. Carter and P. Dewan. 2010. Design, Implementation, and Evaluation of an Approach for Determining When Programmers are Having Difficulty. GROUP'10, November 7--10, 2010, Sanibel Island, Florida, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. S.D. Craig, A.C. Graesser, J. Sullins and B. Gholson. 2004. Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media, 29, 3, 241--250, Oct 2004 Google ScholarGoogle ScholarCross RefCross Ref
  9. S. D'Mello, N. Person and B. Lehman. 2009. Antecedent-Consequent Relationships and Cyclical Patterns between Affective States and Problem Solving Outcomes. Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling. 57--64.Google ScholarGoogle Scholar
  10. A. Graesser and S.K. D'Mello. 2012. Emotions during the learning of difficult material. In B. Ross (Ed.), Psychology of Learning and Motivation, 57, 183--226. Google ScholarGoogle ScholarCross RefCross Ref
  11. S. Hansen and E. Eddy. 2007. Engagement and Frustration in Programming Projects. SIGCSE'07, March 7--10, 2007, Covington, Kentucky, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. E.F. Iepsen, M. Bercht and E. Reategui. 2013. Detection and Assistance to Students Who Show Frustration in Learning of Algorithms, Proceedings of IEEE Frontier in Education Conference, October 2013, 1183--1189. Google ScholarGoogle ScholarCross RefCross Ref
  13. A. Kapoor, W. Burleson and R.W. Picard. 2007. Automatic prediction of frustration. Int. J. Human-Computer Studies, 65, 724--736. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. P. Kinnunen and B. Simon, B. 2011. CS Majors' Self-Efficacy Perceptions in CS1: Results in Light of Social Cognitive Theory. ICER'11, August 8--9, 2011, Providence, Rhode Island, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Kleine, T. Goetz, R. Pekrun and N. Hall. 2005. The structure of students' emotions experienced during a mathematical achievement test. Zentralblatt für Didaktik der Mathematik (ZDM 2005), 37, 3.Google ScholarGoogle Scholar
  16. B. Kort, R. Reilly and R. W. Picard. 2001. An Affective Model of Interplay Between Emotions and Learning: Reengineering Educational Pedagogy-Building a Learning Companion, Proceedings of the 2nd IEEE Int'l Conf. Advanced Learning Technologies (ICALT 2001), IEEE CS Press. Google ScholarGoogle ScholarCross RefCross Ref
  17. D. Lee, M. Rodrigo, R. Baker, J. d, Sugay and A. Coronel. 2011. Exploring the relationship between novice programmer confusion and achievement. In: S. D'Mello, A. Graesser, B. Schuller and J.C. Martin, J.C. (eds.) Affective Computing and Intelligent Interaction, pp. 175--184. Springer, Berlin Heidelberg (2011).Google ScholarGoogle Scholar
  18. M. J. Lee and A.J. Ko. 2011. Personifying Programming Tool Feedback Improves Novice Programmers' Learning. ICER'11, August 8--9, 2011, Providence, RI, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Z. Liu, V. Pataranutaporn, J. Ocumpaugh, R. Baker (2013) Sequences of Frustration and Confusion, and Learning. Proceedings of the 6th International Conference on Educational Data Mining, 114 -- 120.Google ScholarGoogle Scholar
  20. A.W. Meade and S.B. Craig. 2011. Identifying Careless Responses in Survey Data. Proceedings of the 26th Annual Meeting of the Society for Industrial and Organizational Psychology, Chicago, IL.Google ScholarGoogle Scholar
  21. D. Parsons, K. Wood and P.Haden. 2015. What are we Doing When we Assess Programming? Proceedings of the 17th Australasian Computing Education Conference (ACE 2015), Sydney Australia, 27--30 January. 2015.Google ScholarGoogle Scholar
  22. Pears, A., East, P., McCartney, R., Ratcliffe, M.B., Stamouli, I., Berglund, A., Kinnunen, P., Moström, J-E., Schulte, C., Eckerdal, A., Malmi, L., Murphy, L., Simon, B. and Lynda Thomas. 2007. What's the problem?: teachers' experience of student learning successes and failures. Proceedings of the Seventh Baltic Sea Conference on Computing Education Research, November 15--18, 2007, Koli National Park, FinlandGoogle ScholarGoogle Scholar
  23. R. Pekrun, T. Goetz, L. Daniels, R. Stupinsky and R. Perry. 2010. Boredom in Achievement Settings: Exploring Control-Value Antecedents and Performance Outcomes of a Neglected Emotion. Journal of Educational Psychology, 102, 3, 531--549 Google ScholarGoogle ScholarCross RefCross Ref
  24. R. Pekrun, T. Goetz, W. Titz and R. Perry. 2002. Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research, Educational Psychologist, 37, 2, 91--106 Google ScholarGoogle ScholarCross RefCross Ref
  25. A Robins, J. Rountree and N. Rountree. 2003. Learning and Teaching Programming: A Review. Computer Science Education. 13, 2, 137--172. Google ScholarGoogle ScholarCross RefCross Ref
  26. A. Robins. 2010. Learning Edge Momentum: A new account of outcomes in CS1. Computer Science Education, 20, 1, 37--71. Google ScholarGoogle ScholarCross RefCross Ref
  27. Simes, R. J. 1986. An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73,3,751--754. Google ScholarGoogle ScholarCross RefCross Ref
  28. M.J. Scott and G. Ghinea. 2014. Measuring Enrichment: The Assembly and Validation of an Instrument to Assess Student Self-Beliefs in CS1. ICER'14, August 11--13, 2014, Glasgow, Scotland, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. V. Shute, S. D'Mello, R. Baker, C. Cho, N. Bosch, J. Ocumpaugh, M. Ventura and V. Almeda, V. 2015. Modeling how incoming knowledge, persistence, affective states, and in-game progress influence student learning from an educational game. Computers and Education, 86, 224--235.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. A. Vihavainen, J. Airaksinen and C. Watson. 2014. A Systematic Review of Approaches for Teaching Introductory Programming and Their Influence on Success ICER '14, August 11 - 13 2014, Glasgow, United KingdomGoogle ScholarGoogle Scholar
  31. F.T. Villavicencio and A.B. Bernardo. 2013. Positive academic emotions moderate the relationship between self-regulation and academic achievement. British Journal of Educational Psychology (2013), 83, 329--340. Google ScholarGoogle ScholarCross RefCross Ref
  32. M.G. Zikuda, I Stuchlikova, I. and T. Jank. 2013. Emotional Aspects of Learning and Teaching: Reviewing the Field - Discussing the Issues Orbis scholae, 7, 2, 7--22.Google ScholarGoogle Scholar

Index Terms

  1. Student affect in CS1: insights from an easy data collection tool

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    Koli Calling '17: Proceedings of the 17th Koli Calling International Conference on Computing Education Research
    November 2017
    215 pages
    ISBN:9781450353014
    DOI:10.1145/3141880

    Copyright © 2017 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 16 November 2017

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate80of182submissions,44%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader