nach oben

Education and Information Technologies

Erschienen in:

01.05.2023

Multimodal learning analytics for assessing teachers’ self-regulated learning in planning technology-integrated lessons in a computer-based environment

verfasst von: Lingyun Huang, Tenzin Doleck, Boyin Chen, Xiaoshan Huang, Chengyi Tan, Susanne P. Lajoie, Minhong Wang

Erschienen in: Education and Information Technologies | Ausgabe 12/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Teachers’ self-regulated learning (SRL) plays a crucial role in developing technological pedagogical content knowledge (TPACK), a complex professional skill. It is crucial to identify teachers’ SRL activities that may lead to favorable TPACK. Previous studies have focused on the analysis of individual data sources from self-reported surveys or log files, which are insufficient to capture all SRL activities in the TPACK context. While multimodal learning analytics (MMLA) has the potential to improve SRL measurement, it remains unknown how multimodal data collected from different sources can be combined to identify salient features of SRL activities and examine how TPACK outcomes can be predicted by SRL activities identified from multimodal data. This study combined multimodal data from computer logs and think-aloud data to analyze teachers’ SRL activities in designing a technology-integrated lesson. We identified the salient features of SRL from the combined data and explored how identified SRL activities might predict TPACK outcomes reflected in teacher-generated lesson plans. The results of random forest regression analysis show that three SRL activities from the logs and two from the think-aloud data formed the best combination that explained a significant proportion of variances in TPACK performance. The impact of MMLA in SRL measurement and the implication of this study are discussed.

Vorheriger Artikel Factors effecting digital citizenship in education sector: A systematic review and future direction

Nächster Artikel Choosing optimal means of knowledge visualization based on eye tracking for online education

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Ahn, B. “Tony,” & Harley, J. M. (2020). Facial expressions when learning with a Queer History App: Application of the control value theory of achievement emotions. British Journal of Educational Technology, 51(5), 1563–1576. https://doi.org/10.1111/bjet.12989

Angeli, C., & Valanides, N. (2009). Epistemological and methodological issues for the conceptualization, development, and assessment of ICT–TPCK: Advances in technological pedagogical content knowledge (TPCK). Computers & Education, 52(1), 154–168. https://doi.org/10.1016/j.compedu.2008.07.006CrossRef

Antonietti, A., Colombo, B., & Di Nuzzo, C. (2015). Metacognition in self-regulated multimedia learning: Integrating behavioural, psychophysiological and introspective measures. Learning, Media and Technology, 40(2), 187–209. https://doi.org/10.1080/17439884.2014.933112CrossRef

Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210. https://doi.org/10.1016/j.chb.2019.03.025CrossRef

Biau, G., & Scornet, E. (2016). A random forest guided tour. TEST, 25(2), 197–227. https://doi.org/10.1007/s11749-016-0481-7MathSciNetCrossRefMATH

Blikstein, P., & Worsley, M. (2016). Multimodal learning analytics and education data mining: Using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 2. https://doi.org/10.18608/jla.2016.32.11CrossRef

Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32.CrossRefMATH

Cho, M.-H., & Yoo, J. S. (2017). Exploring online students’ self-regulated learning with self-reported surveys and log files: A data mining approach. Interactive Learning Environments, 25(8), 970–982. https://doi.org/10.1080/10494820.2016.1232278CrossRef

Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284CrossRef

Ejubović, A., & Puška, A. (2019). Impact of self-regulated learning on academic performance and satisfaction of students in the online environment. Knowledge Management & E-Learning, 11(3), 345–363. https://doi.org/10.34105/j.kmel.2019.11.018

Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87(3), 215–251. https://doi.org/10.1037/0033-295X.87.3.215CrossRef

Fan, Y., Lim, L., van der Graaf, J., Kilgour, J., Raković, M., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022a). Improving the measurement of self-regulated learning using multi-channel data. Metacognition and Learning. https://doi.org/10.1007/s11409-022-09304-zCrossRef

Fan, Y., van der Graaf, J., Lim, L., Raković, M., Singh, S., Kilgour, J., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022b). Towards investigating the validity of measurement of self-regulated learning based on trace data. Metacognition and Learning. https://doi.org/10.1007/s11409-022-09291-1CrossRef

Farrell, T. S. C. (2002). Lesson planning. In J. C. Richards & W. A. Renandya (Eds.), Methodology of language teaching: An anthology of current practice (pp. 30–39). Cambridge University Press.CrossRef

Gašević, D., Greiff, S., & Shaffer, D. W. (2022). Towards strengthening links between learning analytics and assessment: Challenges and potentials of a promising new bond. Computers in Human Behavior, 134, 107304. https://doi.org/10.1016/j.chb.2022.107304CrossRef

Greene, J. A., Bolick, C. M., & Robertson, J. (2010). Fostering historical knowledge and thinking skills using hypermedia learning environments: The role of self-regulated learning. Computers & Education, 54(1), 230–243. https://doi.org/10.1016/j.compedu.2009.08.006CrossRef

Greene, J. A., Plumley, R. D., Urban, C. J., Bernacki, M. L., Gates, K. M., Hogan, K. A., Demetriou, C., & Panter, A. T. (2021). Modeling temporal self-regulatory processing in a higher education biology course. Learning and Instruction, 72, 101201. https://doi.org/10.1016/j.learninstruc.2019.04.002CrossRef

Haataja, E., Dindar, M., Malmberg, J., & Järvelä, S. (2022). Individuals in a group: Metacognitive and regulatory predictors of learning achievement in collaborative learning. Learning and Individual Differences, 96, 102146. https://doi.org/10.1016/j.lindif.2022.102146CrossRef

Hu, C. C., Yeh, H. C., & Chen, N. S. (2021). Teacher development in robot and IoT knowledge, skills, and attitudes with the use of the TPACK-based Support-Stimulate-Seek approach. Interactive Learning Environments, 1–20. https://doi.org/10.1080/10494820.2021.2019058

Huang, L., Li, S., Poitras, E. G., & Lajoie, S. P. (2020). Latent profiles of self‐regulated learning and their impacts on teachers’ technology integration. British Journal of Educational Technology, 52(2), 695–713. https://doi.org/10.1111/bjet.13050

Huang, L., & Lajoie, S. P. (2021). Process analysis of teachers’ self-regulated learning patterns in technological pedagogical content knowledge development. Computers & Education, 166, 104–169. https://doi.org/10.1016/j.compedu.2021.104169

Kayri, M., Kayri, I., & Gencoglu, M. T. (2017). The performance comparison of Multiple Linear Regression, Random Forest and Artificial Neural Network by using photovoltaic and atmospheric data. 2017 14th International Conference on Engineering of Modern Electric Systems (EMES), 1–4. https://doi.org/10.1109/EMES.2017.7980368

Kovanovic, V., Gašević, D., Dawson, S., Joksimovic, S., & Baker, R. (2015). Does time-on-task estimation matter? Implications on validity of learning analytics findings. Journal of Learning Analytics, 2(3), 3. https://doi.org/10.18608/jla.2015.23.6CrossRef

Lee, Y., & Lee, J. (2014). Enhancing pre-service teachers’ self-efficacy beliefs for technology integration through lesson planning practice. Computers & Education, 73, 121–128. https://doi.org/10.1016/j.compedu.2014.01.001CrossRef

Malmberg, J., Järvelä, S., Holappa, J., Haataja, E., Huang, X., & Siipo, A. (2019). Going beyond what is visible: What multichannel data can reveal about interaction in the context of collaborative learning? Computers in Human Behavior, 96, 235–245. https://doi.org/10.1016/j.chb.2018.06.030CrossRef

Ordóñez, L. D., Schweitzer, M. E., Galinsky, A. D., & Bazerman, M. H. (2009). Goals gone wild: The systematic side effects of overprescribing soal setting. Academy of Management Perspectives, 23(1), 6–16. https://doi.org/10.5465/amp.2009.37007999CrossRef

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, E. (2011). Scikit-learn: Machine learning in python. Journal of Machine Learning Research, 12, 2825–2830.MathSciNetMATH

Poitras, E., Doleck, T., Huang, L., Li, S., & Lajoie, S. P. (2017). Advancing teacher technology education using open-ended learning environments as research and training platforms. Australasian Journal of Educational Technology, 33(3). https://doi.org/10.14742/ajet.3498

Poitras, E. G., Fazeli, N., & Mayne, Z. R. (2018). Modeling student teachers’ information-seeking behaviors while learning with network-based tutors. Journal of Educational Technology Systems, 47(2), 227–247. https://doi.org/10.1177/0047239518797086CrossRef

Sharma, K., & Giannakos, M. (2020). Multimodal data capabilities for learning: What can multimodal data tell us about learning? British Journal of Educational Technology, 51(5), 1450–1484. https://doi.org/10.1111/bjet.12993CrossRef

Siadaty, M., Gašević, D., & Hatala, M. (2016). Associations between technological scaffolding and micro-level processes of self-regulated learning: A workplace study. Computers in Human Behavior, 55, 1007–1019. https://doi.org/10.1016/j.chb.2015.10.035CrossRef

Smith, P. F., Ganesh, S., & Liu, P. (2013). A comparison of random forest regression and multiple linear regression for prediction in neuroscience. Journal of Neuroscience Methods, 220(1), 85–91. https://doi.org/10.1016/j.jneumeth.2013.08.024CrossRef

Sonnenberg, C., & Bannert, M. (2019). Using process mining to examine the sustainability of instructional support: How stable are the effects of metacognitive prompting on self-regulatory behavior? Computers in Human Behavior. https://doi.org/10.1016/j.chb.2018.06.003CrossRef

Srivastava, N., Fan, Y., Rakovic, M., Singh, S., Jovanovic, J., van der Graaf, J., Lim, L., Surendrannair, S., Kilgour, J., Molenaar, I., Bannert, M., Moore, J., & Gasevic, D. (2022). Effects of Internal and External Conditions on Strategies of Self-regulated Learning: A Learning Analytics Study. LAK22: 12th International Learning Analytics and Knowledge Conference, 392–403. https://doi.org/10.1145/3506860.3506972

Winne, P. H. (2018). Theorizing and researching levels of processing in self-regulated learning. The British Journal of Educational Psychology, 88(1), 9–20. https://doi.org/10.1111/bjep.12173CrossRef

Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), The educational psychology series. Metacognition in educational theory and practice (pp. 277–304). Lawrence Erlbaum Associates Publishers.

Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 531–566). Academic. https://doi.org/10.1016/B978-012109890-2/50045-7CrossRef

Zheng, J., Huang, L., Li, S., Lajoie, S. P., Chen, Y., & Hmelo-Silver, C. E. (2021). Self regulation and emotion matter: A case study of instructor interactions with a learning analytics dashboard. Computers & Education, 161, 104061. https://doi.org/10.1016/j.compedu.2020.104061

Zhou, M., & Winne, P. H. (2012). Modeling academic achievement by self-reported versus traced goal orientation. Learning and Instruction, 22(6), 413–419. https://doi.org/10.1016/j.learninstruc.2012.03.004CrossRef

Titel: Multimodal learning analytics for assessing teachers’ self-regulated learning in planning technology-integrated lessons in a computer-based environment
verfasst von: Lingyun Huang
Tenzin Doleck
Boyin Chen
Xiaoshan Huang
Chengyi Tan
Susanne P. Lajoie
Minhong Wang
Publikationsdatum: 01.05.2023
Verlag: Springer US
Erschienen in: Education and Information Technologies / Ausgabe 12/2023
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI: https://doi.org/10.1007/s10639-023-11804-7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 12/2023

An investigation of the social influence processes of flipped class students: An application of the extension of the technology acceptance model

“Nothing replaces meeting my students at class”: Analysing academics’ views regarding distance education

Interactive notebooks for achieving learning outcomes in a graduate course: a pedagogical approach

Investigating behavior patterns of students during online self-directed learning through process mining

My Lovely Granny’s Farm: An immersive virtual reality training system for children with autism spectrum disorder

Exploring the design space of virtual tutors for children with autism spectrum disorder

Premium Partner