Wannisa Matcha
Dragan Gašević
Abelardo Pardo
ABSTRACT
Learning analytics has the potential to detect and explain characteristics of learning strategies through analysis of trace data and communicate the findings via feedback. However, the role of learning analytics-based feedback in selection and regulation of learning strategies is still insufficiently explored and understood. This research aims to examine the sequential and temporal characteristics of learning strategies and investigate their association with feedback. Three years of trace data were collected from online pre-class activities of a flipped classroom, where different types of feedback were employed in each year. Clustering, sequence mining, and process mining were used to detect and interpret learning tactics and strategies. Inferential statistics were used to examine the association of feedback with the learning performance and the detected learning strategies. The results suggest a positive association between the personalised feedback and the effective strategies.
- Biggs 1987. Student Approaches to Learning and Studying.Google Scholar
- Bjork, R. a., Dunlosky, J. and Kornell, N. 2013. Self-Regulated Learning: Beliefs, Techniques, and Illusions. Annual Review of Psychology. 64, 1 (2013), 64, 417--444.Google ScholarCross Ref
- Bodily, R. and Verbert, K. 2017. Trends and issues in student-facing learning analytics reporting systems research. Proceedings of the Seventh International Learning Analytics & Knowledge Conference on - LAK '17. 1, 212 (2017), 309--318. Google ScholarDigital Library
- Byrne, M., Flood, B. and Willis, P. 2010. The relationship between learning approaches and learning outcomes: a study of Irish accounting students The relationship between learning approaches and learning outcomes: a study of Irish. 9284, (2010).Google Scholar
- Chonkar, S.P., Ha, T.C., Chu, S.S.H., Ng, A.X., Lim, M.L.S., Ee, T.X., Ng, M.J. and Tan, K.H. 2018. The predominant learning approaches of medical students. BMC Medical Education. 18, 1 (2018), 1--8.Google ScholarCross Ref
- Cicchinelli, A., Veas, E., Pardo, A., Pammer-Schindler, V., Fessl, A., Barreiros, C. and Lindstädt, S. 2018. Finding traces of self-regulated learning in activity streams. Proceedings of the 8th International Conference on Learning Analytics and Knowledge - LAK '18. (2018), 191--200. Google ScholarDigital Library
- Corrin, L. and de Barba, P. 2015. How Do Students Interpret Feedback Delivered via Dashboards? International Conference on Learning Analytics and Knowledge. (2015), 430--431. Google ScholarDigital Library
- Dabbagh, N. 2007. The online learner: Characteristics and pedagogical implications. Contemporary Issues in Technology and Teacher Education. 7, 3 (2007), 217--226.Google Scholar
- Derry, S.J. 1989. Putting learning strategies to work. Educational Leadership. 47, 5 (1989), 4--10.Google Scholar
- DiFrancesca, D., Nietfeld, J.L. and Cao, L. 2016. A comparison of high and low achieving students on self-regulated learning variables. Learning and Individual Differences. 45, (2016), 228--236.Google Scholar
- Diseth, Å. and Martinsen, Ø. 2003. Approaches to Learning, Cognitive Style, and Motives as Predictors of Academic Achievement. Educational Psychology. 23, 2 (2003), 195--207.Google ScholarCross Ref
- Dunlosky, J. 2013. Strengthening the Student Toolbox. American Educator. 37, 3 (2013), 12--21.Google Scholar
- Entwistle, N. 2007. Research into student learning and university teaching. The British Psychological Society. October (2007), 1--18.Google Scholar
- Entwistle, N.J. 1991. Approaches to Learning and Perceptions of the Learning Environment: Introduction to the Special Issue. Higher Eduation. 22, 3 (1991), 201--204.Google ScholarCross Ref
- Entwistle, N.J. 2009. Teaching for understanding at university: Deep approaches and distinctive ways of thinking. Palgrave Macmillan.Google Scholar
- Evans, C. 2013. Making Sense of Assessment Feedback in Higher Education. Review of Educational Research. 83, 1 (2013), 70--120.Google ScholarCross Ref
- Ferreira, D.R. and Gillblad, D. 2009. Discovering Process Models from Unlabelled Event Logs. Business Process Management. 5701, (2009), 143--158.Google Scholar
- Fincham, O.E., Gasevic, D. V., Jovanovic, J.M. and Pardo, A. 2018. From Study Tactics to Learning Strategies: An Analytical Method for Extracting Interpretable Representations. IEEE Transactions on Learning Technologies. 1382, c (2018), 1--14.Google Scholar
- Freeman, S., Eddy, S.L., McDonough, M., Smith, M.K., Okoroafor, N., Jordt, H. and Wenderoth, M.P. 2014. Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences. 111, 23 (2014), 8410--8415.Google ScholarCross Ref
- Gabadinho, A., Ritschard, G., Studer, M. and Muller, N.S. 2008. Mining sequence data in R with the TraMineR package: A user's guide. Department of Econometrics and Laboratory of Demography, University of Geneva, Switzerland. 1, (2008), 1--124.Google Scholar
- Gašević, D., Dawson, S., Rogers, T. and Gasevic, D. 2016. Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education. 28, (2016), 68--84.Google Scholar
- Gašević, D., Dawson, S. and Siemens, G. 2015. Let's not forget: Learning analytics are about learning. TechTrends. 59, 1 (2015).Google Scholar
- Gašević, D., Jovanović, J., Pardo, A. and Dawson, S. 2017. Detecting Learning Strategies with Analytics: Links with Self-Reported Measures and Academic Performance. Journal of Learning Analytics. 4, 2 (2017), 113--128.Google ScholarCross Ref
- Gašević, D., Kovanović, V. and Joksimović, S. 2017. Piecing the Learning Analytics Puzzle: A Consolidated Model of a Field of Research and Practice. Learning: Research and Practice. 3, 1 (2017), 63--78.Google Scholar
- Gatta, R., Lenkowicz, J., Vallati, M. and Stefanini, A. 2017. pMineR: Processes Mining in Medicine.Google Scholar
- Hadwin, A.F., Nesbit, J.C., Jamieson-Noel, D., Code, J. and Winne, P.H. 2007. Examining trace data to explore self-regulated learning. Metacognition and Learning. 2, 2--3 (2007), 107--124.Google ScholarCross Ref
- Hattie, J. and Timperley, H. 2007. The Power of Feedback. Review of Educational Research. 77, 1 (2007), 81--112.Google ScholarCross Ref
- Jovanovic, J., Gasevic, D., Dawson, S., Pardo, A. and Mirriahi, N. 2017. Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education. 33, (2017), 74--85.Google Scholar
- Khan, I. and Pardo, A. 2016. Data2U: Scalable Real time Student Feedback in Active Learning Environments. LAK '16 6th International Conference on Learning Analytics and Knowledge, April 25 - 29, 2016. (2016), 249--253. Google ScholarDigital Library
- Van der Kleij, F.M., Feskens, R.C.W. and Eggen, T.J.H.M. 2015. Effects of Feedback in a Computer-Based Learning Environment on Students' Learning Outcomes: A Meta-Analysis. Review of Educational Research. 85, 4 (2015), 475--511.Google ScholarCross Ref
- Kluger, A.N. and DeNisi, A. 1996. Effects of feedback intervention on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin. 119, 2 (1996), 254--284.Google ScholarCross Ref
- Kovanović, V., Gašević, D., Joksimović, S., Hatala, M. and Olusola, A. 2015. Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions. Internet and Higher Education. 27, (2015), 74--89.Google Scholar
- Lai, C.L. and Hwang, G.J. 2016. A self-regulated flipped classroom approach to improving students' learning performance in a mathematics course. Computers and Education. 100, (2016), 126--140. Google ScholarDigital Library
- Lust, G., Elen, J. and Clarebout, G. 2013. Regulation of tool-use within a blended course: Student differences and performance effects. Computers and Education. 60, 1 (2013), 385--395. Google ScholarDigital Library
- Maldonado-Mahauad, J., Pérez-Sanagustín, M., Kizilcec, R.F., Morales, N. and Munoz-Gama, J. 2018. Mining theory-based patterns from Big data: Identifying self-regulated learning strategies in Massive Open Online Courses. Computers in Human Behavior. 80, (2018), 179--196. Google ScholarDigital Library
- Malmberg, J., Järvenoja, H. and Järvelä, S. 2010. Tracing elementary school students' study tactic use in gStudy by examining a strategic and self-regulated learning. Computers in Human Behavior. 26, 5 (2010), 1034--1042. Google ScholarDigital Library
- Malmberg, J., Sanna, J. and Kirschner, P.A. 2014. Elementary school students' strategic learning: Does task-type matter? Metacognition and Learning. 9, 2 (2014), 113--136.Google ScholarCross Ref
- Marton, F. and Säljö, R. 1976. on Qualitative Differences in Learning: I-Outcome and Process*. British Journal of Educational Psychology. 46, 1 (1976), 4--11.Google ScholarCross Ref
- Mattick, K., Dennis, I. and Bligh, J. 2004. Approaches to learning and studying in medical students: Validation of a revised inventory and its relation to student characteristics and performance. Medical Education. 38, 5 (2004), 535--543.Google ScholarCross Ref
- Molenaar, I. 2014. Advances in temporal analysis in learning and instruction. Frontline Learning Research. 6, (2014), 15--24.Google Scholar
- Nandagopal, K. and Ericsson, K.A. 2012. An expert performance approach to the study of individual differences in self-regulated learning activities in upper-level college students. Learning and Individual Differences. 22, 5 (2012), 597--609.Google ScholarCross Ref
- O'Flaherty, J. and Phillips, C. 2015. The use of flipped classrooms in higher education: A scoping review. Internet and Higher Education. 25, (2015), 85--95.Google Scholar
- Pardo, A., Gasevic, D., Jovanovic, J.M., Dawson, S. and Mirriahi, N. 2018. Exploring Student Interactions with Preparation Activities in a Flipped Classroom Experience. IEEE Transactions on Learning Technologies. (2018).Google Scholar
- Pardo, A., Jovanovic, J., Dawson, S., Gasevic, D. and Mirriahi, N. 2017. Using Learning Analytics to Scale the Provision of Personalised Feedback. British Journal of Educational Technology. (2017).Google Scholar
- Pressley, M., Borkowski, J.G. and Schneider, W. 1987. Cognitive Strategies: Good Strategy Users Coordinate Metacognition and Knowledge. Annals of Child Development. 4, 2 (1987), 89--129.Google Scholar
- Price, M., Handley, K., Millar, J. and O'Donovan, B. 2010. Feedback: all that effort, but what is the effect? Assessment & Evaluation in Higher Education. 35, 3 (2010), 277--289.Google ScholarCross Ref
- Proctor, B.E., Prevatt, F.F., Adams, K.S., Reaser, A. and Petscher, Y. 2006. Study Skills Profiles of Normal-Achieving and Academically-Struggling College Students. Journal of College Student Development. 47, 1 (2006), 37--51.Google ScholarCross Ref
- Rahman, A.A., Aris, B., Rosli, M.S., Mohamed, H., Abdullah, Z. and Zaid, N.M. 2015. Significance of preparedness in flipped classroom. Advanced Science Letters. 21, 10 (2015), 3388--3390.Google ScholarCross Ref
- Verbert, K., Duval, E., Klerkx, J., Govaerts, S. and Santos, J.L. 2013. Learning Analytics Dashboard Applications. American Behavioral Scientist. February (2013), 1500--1509.Google Scholar
- Weinstein, C.E., Husman, J. and Dierking, D.R. 2000. Self-regulation interventions with a focus on learning strategies. Handbook of Self-Regulation. 22, (2000), 727--747.Google ScholarCross Ref
- Winne, P.H. 2006. How Software Technologies Can Improve Research on Learning and Bolster School Reform. Educational Psychologist. 41, 1 (2006), 5--17.Google ScholarCross Ref
- Winne, P.H. 2013. Learning Strategies, Study Skills, and Self-Regulated Learning in Postsecondary Education. Higher Education: Handbook of Theory and Research. 28 (2013), 337--403.Google Scholar
- Winne, P.H. and Hadwin, A.F. 1998. Studying as Self-Regulated Learning. Metacognition in educational theory and practice. 93, (1998), 277--304.Google Scholar
- Winne, P.H., Jamieson-Noel, D. and Muis, K. 2002. Methodological issues and advances in researching tactics, strategies, and self-regulated learning.Google Scholar
- Winne, P.H., Vh, D.J.H., Ode, R.U., Suhglfwv, J. and Riihuv, R. Chapter 21: Learning Analytics for Self-Regulated Learning. 241--249.Google Scholar
- Winstone, N.E., Nash, R.A., Rowntree, J. and Parker, M. 2017. 'It'd be useful, but I wouldn't use it': barriers to university students' feedback seeking and recipience. Studies in Higher Education. 42, 11 (2017), 2026--2041.Google ScholarCross Ref
- Yip, M.C.W. 2007. Differences in Learning and Study Strategies between High and Low Achieving University Students: A Hong Kong study. Educational Psychology. 27, 4 (2007), 597--606.Google ScholarCross Ref
- Zeegers, P. 2001. Approaches to learning in science: A longitudinal study. (2001), 115--132.Google Scholar
- Zhou, M. and Winne, P.H. 2012. Modeling academic achievement by self-reported versus traced goal orientation. Learning and Instruction. 22, 6 (2012), 413--419.Google ScholarCross Ref
Index Terms
- Analytics of Learning Strategies: Associations with Academic Performance and Feedback
Recommendations
Impact of learning analytics feedback on self-regulated learning: Triangulating behavioural logs with students’ recall
LAK21: LAK21: 11th International Learning Analytics and Knowledge ConferenceLearning analytics (LA) has been presented as a viable solution for scaling timely and personalised feedback to support students’ self-regulated learning (SRL). Research is emerging that shows some positive associations between personalised feedback ...
Analytics of learning strategies: the association with the personality traits
LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & KnowledgeStudying online requires well-developed self-regulated learning skills to properly manage one's learning strategies. Learning analytics research has proposed novel methods for extracting theoretically meaningful learning strategies from trace data ...
Analytics of time management and learning strategies for effective online learning in blended environments
LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & KnowledgeThis paper reports on the findings of a study that proposed a novel learning analytics methodology that combines three complimentary techniques - agglomerative hierarchical clustering, epistemic network analysis, and process mining. The methodology ...
Comments