Abstract
This exploratory case study examined in depth the studying activities of eight students across two studying episodes, and compared traces of actual studying activities to self-reports of self-regulated learning. Students participated in a 2-hour activity using our gStudy software to complete a course assignment. We used log file data to construct profiles of self-regulated learning activity in four ways: (a) frequency of studying events, (b) patterns of studying activity, (c) timing and sequencing of events, and (d) content analyses of students’ notes and summaries. Findings indicate that students’ self-reports may not calibrate to actual studying activity. Analyses of log file traces of studying activities provide important information for defining strategies and sequences of fine-grained studying actions. We contrast these analytic methods and illustrate how trace-based profiles of students’ self-regulated studying inform models of metacognitive monitoring, evaluation, and self-regulated adaptation.
Similar content being viewed by others
References
Andris, J. F. (1996). The relationship of indices of student navigational patterns in a hypermedia geology lab simulation to two measures of learning style. Journal of Educational Multimedia and Hypermedia, 5, 303–315.
Beasley, R. E., & Vila, J. A. (1992). The identification of navigation patterns in a multimedia environment: A case study. Journal of Educational Multimedia and Hypermedia, 1, 209–222.
Fitzgerald, G. E., & Semrau, L. P. (1998). The effects of learner differences on usage patterns and learning outcomes with hypermedia case studies. Journal of Educational Multimedia and Hypermedia 7, 309–331.
Guzdial, M., Berger, C., Jones, T., Horney, M., Anderson-Inman, L., Winne, P. H., & Nesbit, H. (1995). Analyzing student use of educational software with event recordings. Unpublished manuscript, Georgia Institute of Technology, Atlanta.
Hadwin, A. F., & Leard, T. (2001). Navigation profiles: Self-regulating learning examined through 5 analytical representations of log file data. In A. F. Hadwin (organizer). Log file navigation profiles and analysis: Methods for tracking and examining hypermedia navigation. Symposium presented the Annual Meeting of the American Educational Research Association: Seattle, WA, April.
Hadwin, A. F., Winne, P. H., Nesbit, J. C., & Murphy, C. (2005). LogReader: A toolkit for analyzing gStudy log data and computing transition metrics (version 1.0) [computer program]. Burnaby, BC: Simon Fraser University.
Hadwin, A. F., Winne, P. H., Stockley, D. B., Nesbit, J., & Woszczyna, C. (2001). Context moderates students’ self-reports about how they study. Journal of Educational Psychology, 93, 477–487.
Hofer, B. K., Yu, S. L., & Pintrich, P. R. (1998). Teaching college students to be self-regulated learning. In D. H. Schunk & B. J. Zimmerman (Eds.), Self-regulated learning: From teaching to self-reflective practice (pp. 57–85). New York, NY: Guilford Press.
Horney, M. A., & Anderson-Inman, L. (1994). The ElectroText project: hypertext reading patterns of middle school students. Journal of Educational Multimedia and Hypermedia, 3, 71–91.
Jones, T., & Jones, M. (1997). MacSQEAL: A tool for exploration of hypermedia log file sequences. In T. Müldner & T. C. Reeves, Proceedings of Ed-Media 1997 (pp. 709–716). Charlottesville, VA: AACE.
Kelly, A. E., & O’Donnell, A. (1994). Hypertext and the study strategies of preservice teachers: Issues in instructional hypertext design. Journal of Educational Computing Research, 10, 373–387.
Lawless, K. A., & Kulikowich, J. M. (1996). Understanding hypertext navigation through cluster analysis. Journal of Educational Computing Research, 14, 385–399.
Lawless, K. A., & Kulikowich, J. M. (1998). Domain knowledge, interest, and hypertext navigation: A study of individual differences. Journal of Educational Multimedia and Hypermedia, 7, 51–69.
Leard, T., & Hadwin, A. F. (2001, April). Log file analysis: A review of the literature. In A. F. Hadwin (organizer). Log file navigation profiles and analysis: Methods for tracking and examining hypermedia navigation. Symposium presented the Annual Meeting of the American Educational Research Association: Seattle, WA.
Lickorish, A., & Wright, P. (1994). Menus and memory load: Navigation strategies in interactive search tasks. International Journal of Human–Computer Studies, 40, 965–1008.
Misanchuk, E. R., & Schwier, R. A. (1992). Representing interactive multimedia and hypermedia audit trials Journal of Educational Multimedia and Hypermedia, 1, 355–372.
Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1991). A manual for the use of the motivated strategies for learning questionnaire. MI: University of Michigan.
Pintrich, P. R., Wolters, C. A., & Baxter, G. P. (2000). Assessing metacognition and self-regulated learning. In G. Schraw & J. C. Impara. (Eds.) Issues in the measurement of metacognition (pp. 43–97). Lincoln, NE: Buros Institute of Mental Measurement.
Polanco, X (2003). Concepts, measures and indicators in web-based analysis. III Taller, Madrid 3–5/03/2003.
Reed, W. M., & Oughton, J. M. (1997). Computer experience and interval-based hypermedia navigation. Journal of Research on Computing in Education, 30(1), 38–52.
Schroeder, E. E., & Grabowski, B. L. (1995). Patterns of exploration and learning with hypermedia. Journal of Educational Computing Research, 13, 313–336.
Winne, P. H., Gupta, L., & Nesbit, J. C. (1994). Exploring individual differences in studying strategies using graph theoretic statistics. The Alberta Journal of Educational Research, XL(2), 177–193.
Winne, P. H., Hadwin, A. F., Nesbit, J. C., Kumar, V., & Beaudoin, L. (2006a). gStudy: A toolkit for developing computer-supported tutorials and researching learning strategies and instruction (version 3.1) [computer program]. Burnaby, BC: Simon Fraser University.
Winne, P. H., & Jamieson-Noel, D. L. (2002). Exploring students’ calibration of self-reports about study tactics and achievement. Contemporary Educational Psychology, 27, 551–572.
Winne, P. H., Jamieson-Noel, D. L., & Muis, K. (2002). Methodological issues and advances in researching tactics, strategies, and self-regulated learning. In M. L. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (Vol. 12) (pp. 121–155). Greenwich, CT: JAI.
Winne, P. H., Nesbit, J. C., Kumar, V., Hadwin, A. F., Lajoie, S. P., Azevedo, R., et al. (2006b). Supporting self-regulated learning with gStudy software: The Learning Kit project. Technology, Instruction, Cognition and Learning, 3, 105–113.
Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp 531–566). Orlando, FL: Academic Press.
Yin, R. K. (2003). Case study research: Design and Methods. Thousand Oaks, CA: Sage Publications.
Zimmerman, B. J. (1994). Dimensions of academic self-regulation: A conceptual framework for education. In D. H. Schunk, & B. J. Zimmerman (Eds.) Self-regulation of learning and achievement: Issues and educational applications. (pp. 3–21). Hillsdale NJ: Lawrence Erlbaum Associates.
Acknowledgement
Support for this research was provided by grants to Allyson F. Hadwin from the Social Sciences and Humanities Research Council of Canada (410-2001-1263); and to Philip H. Winne from the Social Sciences and Humanities Research Council of Canada (410-2002-1787 and 512-2003-1012), the Canada Research Chair Program and Simon Fraser University.
We thank the participants from Educational Psychology 220 who graciously shared their log file data. We also thank Christopher Murphy and Nasir Rather who programmed the LogAnalyzer and rapidly responded to our sometimes hourly requests for additions or modifications.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Hadwin, A.F., Nesbit, J.C., Jamieson-Noel, D. et al. Examining trace data to explore self-regulated learning. Metacognition Learning 2, 107–124 (2007). https://doi.org/10.1007/s11409-007-9016-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11409-007-9016-7