Skip to main content
Erschienen in: Education and Information Technologies 3/2022

23.10.2021

Diagnosing virtual patients in a technology-rich learning environment: a sequential Mining of Students’ efficiency and behavioral patterns

verfasst von: Juan Zheng, Shan Li, Susanne P. Lajoie

Erschienen in: Education and Information Technologies | Ausgabe 3/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study examined the relationships between clinical reasoning behaviors and diagnostic efficiency in the context of diagnosing a virtual patient in BioWorld, a technology-rich environment designed for medical students to practice clinical reasoning skills. Eighty-two medical students who correctly solved a patient case with Diabetes Mellitus were included in this study. These students were grouped into efficient and less efficient groups based on the time they spent diagnosing the case using k-means clustering. Students’ clinical reasoning behaviors were recorded in log files and further coded as either relevant or irrelevant to the final correct diagnosis. Independent t-tests and sequential pattern mining were then conducted to compare the differences between efficient and less efficient groups. Results revealed that students in the less efficient group collected significantly more irrelevant evidence, ordered more lab tests, and proposed more incorrect hypotheses than efficient students. Moreover, less efficient students demonstrated more disorganized behavioral patterns than efficient students. These findings underscored metacognitive skills in delivering an efficient diagnosis. This study also informs the practice of medical education in terms of the development of expertise, as well as the design of interventions and scaffolding in promoting efficient learning or clinical reasoning.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Azevedo, R, Taub, M., & Mudrick, N. (2015). Technologies supporting self-regulated learning. The SAGE encyclopedia of educational technology, 731–734. Azevedo, R, Taub, M., & Mudrick, N. (2015). Technologies supporting self-regulated learning. The SAGE encyclopedia of educational technology, 731–734.
Zurück zum Zitat Charlin, B., Boshuizen, H. P. A., Custers, E. J., & Feltovich, P. J. (2007). Scripts and clinical reasoning. Medical Education, 41(12), 1178–1184.CrossRef Charlin, B., Boshuizen, H. P. A., Custers, E. J., & Feltovich, P. J. (2007). Scripts and clinical reasoning. Medical Education, 41(12), 1178–1184.CrossRef
Zurück zum Zitat Charlin, B., Tardif, J., & Boshuizen, H. P. A. (2000). Scripts and medical diagnostic knowledge: Theory and applications for clinical reasoning instruction and research. Academic Medicine, 75(2), 182–190.CrossRef Charlin, B., Tardif, J., & Boshuizen, H. P. A. (2000). Scripts and medical diagnostic knowledge: Theory and applications for clinical reasoning instruction and research. Academic Medicine, 75(2), 182–190.CrossRef
Zurück zum Zitat Chen, P. P., & Bembenutty, H. (2018). Calibration of performance and academic delay of gratification: Individual and group differences in self-regulation of learning. Handbook of Self-Regulation of Learning and Performance, 407–420. Chen, P. P., & Bembenutty, H. (2018). Calibration of performance and academic delay of gratification: Individual and group differences in self-regulation of learning. Handbook of Self-Regulation of Learning and Performance, 407–420.
Zurück zum Zitat Claessens, B. J. C., Van Eerde, W., Rutte, C. G., & Roe, R. A. (2007). A review of the time management literature. Personnel Review, 36(2), 255–276.CrossRef Claessens, B. J. C., Van Eerde, W., Rutte, C. G., & Roe, R. A. (2007). A review of the time management literature. Personnel Review, 36(2), 255–276.CrossRef
Zurück zum Zitat Durning, S. J., Costanzo, M. E., Artino, A. R., Graner, J., van der Vleuten, C., Beckman, T. J., Wittich, C. M., Roy, M. J., Holmboe, E. S., & Schuwirth, L. (2015). Neural basis of nonanalytical reasoning expertise during clinical evaluation. Brain and Behavior, 5(3). https://doi.org/10.1002/brb3.309 Durning, S. J., Costanzo, M. E., Artino, A. R., Graner, J., van der Vleuten, C., Beckman, T. J., Wittich, C. M., Roy, M. J., Holmboe, E. S., & Schuwirth, L. (2015). Neural basis of nonanalytical reasoning expertise during clinical evaluation. Brain and Behavior, 5(3). https://​doi.​org/​10.​1002/​brb3.​309
Zurück zum Zitat Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1990). Medical problem solving: A ten-year retrospective. Evaluation & the Health Professions, 13(1), 5–36.CrossRef Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1990). Medical problem solving: A ten-year retrospective. Evaluation & the Health Professions, 13(1), 5–36.CrossRef
Zurück zum Zitat Evans, B. J., Stanley, R. O., Mestrovic, R., & Rose, L. (1991). Effects of communication skills training on students’ diagnostic efficiency. Medical Education, 25(6), 517–526.CrossRef Evans, B. J., Stanley, R. O., Mestrovic, R., & Rose, L. (1991). Effects of communication skills training on students’ diagnostic efficiency. Medical Education, 25(6), 517–526.CrossRef
Zurück zum Zitat Gabadinho, A., Ritschard, G., Studer, M., & Müller, N. S. (2009). Mining sequence data in R with the TraMineR package: A users guide for version 1.2. In Geneva: University of Geneva. Gabadinho, A., Ritschard, G., Studer, M., & Müller, N. S. (2009). Mining sequence data in R with the TraMineR package: A users guide for version 1.2. In Geneva: University of Geneva.
Zurück zum Zitat Grafsgaard, J. F. (2014). Multimodal affect modeling in task-oriented tutorial dialogue. North Carolina State University. Grafsgaard, J. F. (2014). Multimodal affect modeling in task-oriented tutorial dialogue. North Carolina State University.
Zurück zum Zitat Kinnebrew, J. S., Loretz, K. M., & Biswas, G. (2013). A contextualized, differential sequence mining method to derive students’ learning behavior patterns. Journal of Educational Data Mining, 5(1), 190–219. Kinnebrew, J. S., Loretz, K. M., & Biswas, G. (2013). A contextualized, differential sequence mining method to derive students’ learning behavior patterns. Journal of Educational Data Mining, 5(1), 190–219.
Zurück zum Zitat Kuiper, R. A. (2013). Integration of innovative clinical reasoning pedagogies into a baccalaureate nursing curriculum. Creative Nursing, 19(3), 128–139.CrossRef Kuiper, R. A. (2013). Integration of innovative clinical reasoning pedagogies into a baccalaureate nursing curriculum. Creative Nursing, 19(3), 128–139.CrossRef
Zurück zum Zitat Kuiper, R., Pesut, D., & Kautz, D. (2009). Promoting the self-regulation of clinical reasoning skills in nursing students. The Open Nursing Journal, 3, 76.CrossRef Kuiper, R., Pesut, D., & Kautz, D. (2009). Promoting the self-regulation of clinical reasoning skills in nursing students. The Open Nursing Journal, 3, 76.CrossRef
Zurück zum Zitat Lajoie, S. P. (2009). Developing Professional Expertise with a Cognitive Apprenticeship Model: Examples from Avionics and Medicine. In K. A. Ericsson (Ed.), Development of Professional Expertise: Toward Measurement of Expert Performance and Design of Optimal Learning Environments (pp. 61–83). New York: Cambridge University Press. Lajoie, S. P. (2009). Developing Professional Expertise with a Cognitive Apprenticeship Model: Examples from Avionics and Medicine. In K. A. Ericsson (Ed.), Development of Professional Expertise: Toward Measurement of Expert Performance and Design of Optimal Learning Environments (pp. 61–83). New York: Cambridge University Press.
Zurück zum Zitat Lajoie, S. P., & Gube, M. (2018). Adaptive expertise in medical education: Accelerating learning trajectories by fostering self-regulated learning. Medical Teacher, 40(8), 809–812. Lajoie, S. P., & Gube, M. (2018). Adaptive expertise in medical education: Accelerating learning trajectories by fostering self-regulated learning. Medical Teacher, 40(8), 809–812.
Zurück zum Zitat Lajoie, S. P., Naismith, L., Poitras, E., Hong, Y.-J., Cruz-Panesso, I., Ranellucci, J., … Wiseman, J. (2013). Technology-Rich Tools to Support Self-Regulated Learning and Performance in Medicine. In Roger Azevedo & V. Aleven (Eds.), International Handbook of Metacognition and Learning Technologies (pp. 229–242). New York, NY: Springer. Lajoie, S. P., Naismith, L., Poitras, E., Hong, Y.-J., Cruz-Panesso, I., Ranellucci, J., … Wiseman, J. (2013). Technology-Rich Tools to Support Self-Regulated Learning and Performance in Medicine. In Roger Azevedo & V. Aleven (Eds.), International Handbook of Metacognition and Learning Technologies (pp. 229–242). New York, NY: Springer.
Zurück zum Zitat Li, S., Zheng, J., & Lajoie, S. P. (2020). Efficient clinical reasoning: Knowing when to start and when to stop. Education in the Health Professions, 3(1), 1. Li, S., Zheng, J., & Lajoie, S. P. (2020). Efficient clinical reasoning: Knowing when to start and when to stop. Education in the Health Professions, 3(1), 1.
Zurück zum Zitat Li, S., Zheng, J., Poitras, E., & Lajoie, S. (2018, June). The allocation of time matters to students’ performance in clinical reasoning. In International Conference on Intelligent Tutoring Systems (pp. 110–119). Springer, Cham. Li, S., Zheng, J., Poitras, E., & Lajoie, S. (2018, June). The allocation of time matters to students’ performance in clinical reasoning. In International Conference on Intelligent Tutoring Systems (pp. 110–119). Springer, Cham.
Zurück zum Zitat Malmberg, J., Järvelä, S., & Järvenoja, H. (2017). Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology, 49, 160–174.CrossRef Malmberg, J., Järvelä, S., & Järvenoja, H. (2017). Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology, 49, 160–174.CrossRef
Zurück zum Zitat Pintrich, P. R., & Zusho, A. (2002). Student motivation and self-regulated learning in the college classroom. In J. C. Smart & W. G. Tierney (Eds.), Higher education: Handbook of theory and research (pp. 55–128). Springer. Pintrich, P. R., & Zusho, A. (2002). Student motivation and self-regulated learning in the college classroom. In J. C. Smart & W. G. Tierney (Eds.), Higher education: Handbook of theory and research (pp. 55–128). Springer.
Zurück zum Zitat Poitras, E. G., Naismith, L. M., Doleck, T., & Lajoie, S. P. (2016). Using learning analytics to identify medical student misconceptions in an online virtual patient environment. Online Learning, 20(2), 183–194. Poitras, E. G., Naismith, L. M., Doleck, T., & Lajoie, S. P. (2016). Using learning analytics to identify medical student misconceptions in an online virtual patient environment. Online Learning, 20(2), 183–194.
Zurück zum Zitat Rangel, J. C., Cartmill, C., Martimianakis, M. A., Kuper, A., & Whitehead, C. R. (2017). In search of educational efficiency: 30 years of medical Education’s top-cited articles. Medical Education, 51(9), 918–934.CrossRef Rangel, J. C., Cartmill, C., Martimianakis, M. A., Kuper, A., & Whitehead, C. R. (2017). In search of educational efficiency: 30 years of medical Education’s top-cited articles. Medical Education, 51(9), 918–934.CrossRef
Zurück zum Zitat Simmons, B. (2010). Clinical reasoning: Concept analysis. Journal of Advanced Nursing, 66(5), 1151–1158.CrossRef Simmons, B. (2010). Clinical reasoning: Concept analysis. Journal of Advanced Nursing, 66(5), 1151–1158.CrossRef
Zurück zum Zitat Simon, H. A. (1990). Invariants of human behavior. Annual Review of Psychology, 41(1), 1–20.CrossRef Simon, H. A. (1990). Invariants of human behavior. Annual Review of Psychology, 41(1), 1–20.CrossRef
Zurück zum Zitat Struyf, E., Beullens, J., Van Damme, B., Janssen, P., & Jaspaert, H. (2005). A new methodology for teaching clinical reasoning skills: Problem solving clinical seminars. Medical Teacher, 27(4), 364–368.CrossRef Struyf, E., Beullens, J., Van Damme, B., Janssen, P., & Jaspaert, H. (2005). A new methodology for teaching clinical reasoning skills: Problem solving clinical seminars. Medical Teacher, 27(4), 364–368.CrossRef
Zurück zum Zitat Winne, P. H., Hadwin, A. F., & Perry, N. E. (2013). Metacognition and computer-supported collaborative learning. In C. E. Hmelo-Silver, C. A. Chinn, C. Chan, & A. M. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 462–479). Routledge. Winne, P. H., Hadwin, A. F., & Perry, N. E. (2013). Metacognition and computer-supported collaborative learning. In C. E. Hmelo-Silver, C. A. Chinn, C. Chan, & A. M. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 462–479). Routledge.
Zurück zum Zitat Wolters, C. A., Won, S., & Hussain, M. (2017). Examining the relations of time management and procrastination within a model of self-regulated learning. Metacognition and Learning, 12(3), 381–399. Wolters, C. A., Won, S., & Hussain, M. (2017). Examining the relations of time management and procrastination within a model of self-regulated learning. Metacognition and Learning, 12(3), 381–399.
Metadaten
Titel
Diagnosing virtual patients in a technology-rich learning environment: a sequential Mining of Students’ efficiency and behavioral patterns
verfasst von
Juan Zheng
Shan Li
Susanne P. Lajoie
Publikationsdatum
23.10.2021
Verlag
Springer US
Erschienen in
Education and Information Technologies / Ausgabe 3/2022
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-021-10772-0

Weitere Artikel der Ausgabe 3/2022

Education and Information Technologies 3/2022 Zur Ausgabe

Premium Partner