skip to main content
10.1145/3017680.3017711acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Using Learning Analytics to Investigate Patterns of Performance and Engagement in Large Classes

Published:08 March 2017Publication History

ABSTRACT

Educators continue to face significant challenges in providing high quality, post-secondary instruction in large classes including: motivating and engaging diverse populations (e.g., academic ability and backgrounds, generational expectations); and providing helpful feedback and guidance. Researchers investigate solutions to these kinds of challenges from alternative perspectives, including learning analytics (LA). Here, LA techniques are applied to explore the data collected for a large, flipped introductory programming class to (1) identify groups of students with similar patterns of performance and engagement; and (2) provide them with more meaningful appraisals that are tailored to help them effectively master the learning objectives. Two studies are reported, which apply clustering to analyze the class population, followed by an analysis of a subpopulation with extreme behaviours.

References

  1. A. Ahadi, R. Lister, H. Haapala, and A. Vihavainen. Exploring machine learning methods to automatically identify students in need of assistance. ICER '15, pages 121--130. ACM, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. Barber and M. Sharkey. Course correction: Using analytics to predict course success. LAK '12, pages 259--262. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Berland, T. Martin, T. Benton, C. Petrick Smith, and D. Davis. Using learning analytics to understand the learning pathways of novice programmers. Journal of the Learning Sciences, 22(4):564--599, 2013. Google ScholarGoogle ScholarCross RefCross Ref
  4. P. Blikstein. Using learning analytics to assess students' behavior in open-ended programming tasks. LAK '11, pages 110--116. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. P. Blikstein. Multimodal learning analytics. LAK '13, pages 102--106. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. C. Brooks, C. Thompson, and S. Teasley. A time series interaction analysis method for building predictive models of learners using log data. LAK '15, pages 126--135. ACM, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. E. Duval. Attention please!: learning analytics for visualization and recommendation. LAK '11, pages 9--17. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. R. Ferguson and D. Clow. Consistent commitment: Patterns of engagement across time in massive open online courses (moocs). Journal of Learning Analytics, 2(3):55--80, 2015. Google ScholarGoogle ScholarCross RefCross Ref
  9. R. Ferguson and D. Clow. Examining engagement: Analysing learner subpopulations in massive open online courses (moocs). LAK '15, pages 51--58. ACM, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. M. Jayaprakash, E. W. Moody, E. J. Laurıa, J. R. Regan, and J. D. Baron. Early alert of academically at-risk students: An open source analytics initiative. Journal of Learning Analytics, 1(1):6--47, 2014. Google ScholarGoogle ScholarCross RefCross Ref
  11. R. F. Kizilcec, C. Piech, and E. Schneider. Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses. LAK '13, pages 170--179. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. E. Lahtinen. A categorization of novice programmers: a cluster analysis study. PPIG '16, pages 32--41, 2007.Google ScholarGoogle Scholar
  13. Y. Ma, B. Liu, C. K. Wong, P. S. Yu, and S. M. Lee. Targeting the right students using data mining. KDD '00, pages 457--464, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. C. Piech, M. Sahami, D. Koller, S. Cooper, and P. Blikstein. Modeling how students learn to program. SIGCSE '12, pages 153--160. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. L. Porter, D. Zingaro, and R. Lister. Predicting student success using fine grain clicker data. ICER '14, pages 51--58. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. B. Rienties and B. A. Rivers. Measuring and understanding learner emotions: Evidence and prospects. LACE, 2014.Google ScholarGoogle Scholar
  17. S. B. Shum and R. Ferguson. Social learning analytics. Educational technology & society, 15(3):3--26, 2012.Google ScholarGoogle Scholar
  18. G. Siemens and R. S. J. d. Baker. Learning analytics and educational data mining: Towards communication and collaboration. LAK '12, pages 252--254. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. R. L. Thorndike. Who belongs in the family? Psychometrika, 18(4):267--276, 1953. Google ScholarGoogle ScholarCross RefCross Ref
  20. R. Tibshirani, G. Walther, and T. Hastie. Estimating the number of clusters in a data set via the gap statistic. Journal of the Royal Statistical Society: Series B, 63(2):411--423, 2001. Google ScholarGoogle ScholarCross RefCross Ref
  21. K. Verbert, N. Manouselis, X. Ochoa, M. Wolpers, H. Drachsler, I. Bosnic, and E. Duval. Context-aware recommender systems for learning: a survey and future challenges. Learning Technologies, IEEE Transactions on, 5(4):318--335, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Using Learning Analytics to Investigate Patterns of Performance and Engagement in Large Classes

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education
      March 2017
      838 pages
      ISBN:9781450346986
      DOI:10.1145/3017680

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 8 March 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      SIGCSE '17 Paper Acceptance Rate105of348submissions,30%Overall Acceptance Rate1,595of4,542submissions,35%

      Upcoming Conference

      SIGCSE Virtual 2024

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader