Skip to main content
Erschienen in: Journal of Science Education and Technology 3/2020

13.04.2020

Increasing Student Use of a Learner Dashboard

verfasst von: Rebecca L. Sansom, Robert Bodily, Caroline O. Bates, Heather Leary

Erschienen in: Journal of Science Education and Technology | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Use of online learning systems, such as learner dashboards, is increasing in university chemistry courses. Learning analytics can support student learning by providing feedback on concept mastery. This paper investigated how student use of a chemistry learner dashboard might be increased through class structure, instructor practice, and dashboard design changes across three iterations in a general chemistry course. Once acceptable levels of student dashboard use were achieved, further investigation of how students interacted with the dashboard, including accessing the variety of available resources, was conducted. Survey data and clickstream data from the dashboard were collected and analyzed in a convergent mixed methods design. This study found that changes in course structure, teacher practice, and dashboard design increased use of the dashboard and utilization of the variety of materials offered in it. Recommendations for instructors to effectively utilize a learner dashboard and increase student trust in the system are provided.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Aguilar, S. J. (2018). Examining the relationship between comparative and self-focused academic data visualizations in at-risk college students' academic motivation. J Res Technol Educ, 50(1), 84–103.CrossRef Aguilar, S. J. (2018). Examining the relationship between comparative and self-focused academic data visualizations in at-risk college students' academic motivation. J Res Technol Educ, 50(1), 84–103.CrossRef
Zurück zum Zitat Black, A. E., & Deci, E. L. (2000). The effects of instructors’ autonomy support and students’ autonomous motivation on learning organic chemistry: a self-determination theory perspective. Sci Educ, 84(6), 740–756.CrossRef Black, A. E., & Deci, E. L. (2000). The effects of instructors’ autonomy support and students’ autonomous motivation on learning organic chemistry: a self-determination theory perspective. Sci Educ, 84(6), 740–756.CrossRef
Zurück zum Zitat Bodily, R., & Verbert, K. (2017b). Trends and issues in student-facing learning analytics reporting systems research. In Proceedings of the Seventh International Learning Analytics and Knowledge Conference (LAK ‘17) (pp. 309–318). ACM. https://doi.org/10.1145/3027385.3027403. Bodily, R., & Verbert, K. (2017b). Trends and issues in student-facing learning analytics reporting systems research. In Proceedings of the Seventh International Learning Analytics and Knowledge Conference (LAK ‘17) (pp. 309–318). ACM. https://​doi.​org/​10.​1145/​3027385.​3027403.
Zurück zum Zitat Bodily, R., Ikahihifo, T. K., Mackley, B., & Graham, C. R. (2018a). The design, development, and implementation of student-facing learning analytics dashboards. Journal of Computing in Higher Education, 30(3), 572–598. Bodily, R., Ikahihifo, T. K., Mackley, B., & Graham, C. R. (2018a). The design, development, and implementation of student-facing learning analytics dashboards. Journal of Computing in Higher Education, 30(3), 572–598.
Zurück zum Zitat Bodily, R., Kay, J., Aleven, V., Davis, D., Jivet, I., Xhakaj, F., & Verbert, K. (2018b). Open learner models and learning analytics dashboards: a systematic review. In Proceedings of the Eight International Learning Analytics & Knowledge Conference (pp. 1–10). ACM. https://doi.org/10.1145/3170358.3170409. Bodily, R., Kay, J., Aleven, V., Davis, D., Jivet, I., Xhakaj, F., & Verbert, K. (2018b). Open learner models and learning analytics dashboards: a systematic review. In Proceedings of the Eight International Learning Analytics & Knowledge Conference (pp. 1–10). ACM. https://​doi.​org/​10.​1145/​3170358.​3170409.
Zurück zum Zitat Chamala, R. R., Ciochina, R., Grossman, R. B., Finkel, R. A., Kannan, S., & Ramachandran, P. (2006). EPOCH: an organic chemistry homework program that offers response-specific feedback to students. J Chem Educ, 83(1), 164.CrossRef Chamala, R. R., Ciochina, R., Grossman, R. B., Finkel, R. A., Kannan, S., & Ramachandran, P. (2006). EPOCH: an organic chemistry homework program that offers response-specific feedback to students. J Chem Educ, 83(1), 164.CrossRef
Zurück zum Zitat Creswell, J. W., & Plano-Clark, V. L. (2018). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications. Creswell, J. W., & Plano-Clark, V. L. (2018). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications.
Zurück zum Zitat Eichler, J. F., & Peeples, J. (2013). Online homework put to the test: a report on the impact of two online learning systems on student performance in general chemistry. J Chem Educ, 90(9), 1137–1143.CrossRef Eichler, J. F., & Peeples, J. (2013). Online homework put to the test: a report on the impact of two online learning systems on student performance in general chemistry. J Chem Educ, 90(9), 1137–1143.CrossRef
Zurück zum Zitat Few, S. (2006). Information dashboard design: the effective visual communication of data. Sebastopol, CA: O’Reilly Media. Few, S. (2006). Information dashboard design: the effective visual communication of data. Sebastopol, CA: O’Reilly Media.
Zurück zum Zitat Gibbons, A. S. (2014). An architectural approach to instructional design. New York: Routledge. Gibbons, A. S. (2014). An architectural approach to instructional design. New York: Routledge.
Zurück zum Zitat Grabe, M., & Christopherson, K. (2008). Optional student use of online lecture resources: resource preferences, performance and lecture attendance. J Comput Assist Learn, 24(1), 1–10.CrossRef Grabe, M., & Christopherson, K. (2008). Optional student use of online lecture resources: resource preferences, performance and lecture attendance. J Comput Assist Learn, 24(1), 1–10.CrossRef
Zurück zum Zitat Grann, J., & Bushway, D. (2014). Competency map: visualizing student learning to promote student success. In Proceedings of the fourth international conference on learning analytics and knowledge (LAK ‘14) (pp. 168–172). New York, NY: ACM.CrossRef Grann, J., & Bushway, D. (2014). Competency map: visualizing student learning to promote student success. In Proceedings of the fourth international conference on learning analytics and knowledge (LAK ‘14) (pp. 168–172). New York, NY: ACM.CrossRef
Zurück zum Zitat Hatziapostolou, T., & Paraskakis, I. (2010). Enhancing the impact of formative feedback on student learning through an online feedback system. Electron J E-Learn, 8(2), 111–122. Hatziapostolou, T., & Paraskakis, I. (2010). Enhancing the impact of formative feedback on student learning through an online feedback system. Electron J E-Learn, 8(2), 111–122.
Zurück zum Zitat Holanda, O., Ferreira, R., Costa, E., Bittencourt, I. I., Melo, J., Peixoto, M., et al. (2012). Educational resources recommendation system based on agents and semantic web for helping students in a virtual learning environment. Int J Web Based Commun, 8(3), 333–353.CrossRef Holanda, O., Ferreira, R., Costa, E., Bittencourt, I. I., Melo, J., Peixoto, M., et al. (2012). Educational resources recommendation system based on agents and semantic web for helping students in a virtual learning environment. Int J Web Based Commun, 8(3), 333–353.CrossRef
Zurück zum Zitat Kerlyl, A., Hall, P., & Bull, S. (2007). Bringing chatbots into education: towards natural language negotiation of open learner models. In R. Ellis, T. Allen, & A. Tuson (Eds.), Applications and innovations in intelligent systems XIVI (pp. 179–192). Bari, Italy: Springer.CrossRef Kerlyl, A., Hall, P., & Bull, S. (2007). Bringing chatbots into education: towards natural language negotiation of open learner models. In R. Ellis, T. Allen, & A. Tuson (Eds.), Applications and innovations in intelligent systems XIVI (pp. 179–192). Bari, Italy: Springer.CrossRef
Zurück zum Zitat Kim, J., Jo, I. H., & Park, Y. (2016). Effects of learning analytics dashboard: analyzing the relations among dashboard utilization, satisfaction, and learning achievement. Asia Pacific Educ Rev, 17(1), 13–24.CrossRef Kim, J., Jo, I. H., & Park, Y. (2016). Effects of learning analytics dashboard: analyzing the relations among dashboard utilization, satisfaction, and learning achievement. Asia Pacific Educ Rev, 17(1), 13–24.CrossRef
Zurück zum Zitat Kuosa, K., Distante, D., Tervakari, A., Cerulo, L., Fernandez, A., Koro, J., et al. (2016). Interactive visualization tools to improve learning and teaching in online learning environments. International Journal of Distance Education Technologies (IJDET), 14(1), 1–21.CrossRef Kuosa, K., Distante, D., Tervakari, A., Cerulo, L., Fernandez, A., Koro, J., et al. (2016). Interactive visualization tools to improve learning and teaching in online learning environments. International Journal of Distance Education Technologies (IJDET), 14(1), 1–21.CrossRef
Zurück zum Zitat Liberatore, M. W. (2011). Improved student achievement using personalized online homework for a course in material and energy balances. Chem Eng Educ, 45(3), 184–190. Liberatore, M. W. (2011). Improved student achievement using personalized online homework for a course in material and energy balances. Chem Eng Educ, 45(3), 184–190.
Zurück zum Zitat Malik, K., Martinez, N., Romero, J., Schubel, S., & Janowicz, P. A. (2014). Mixed-methods study of online and written organic chemistry homework. J Chem Educ, 91(11), 1804–1809.CrossRef Malik, K., Martinez, N., Romero, J., Schubel, S., & Janowicz, P. A. (2014). Mixed-methods study of online and written organic chemistry homework. J Chem Educ, 91(11), 1804–1809.CrossRef
Zurück zum Zitat Mampadi, F., Chen, S. Y., Ghinea, G., & Chen, M.-P. (2011). Design of adaptive hypermedia learning systems: a cognitive style approach. Comput Educ, 56(4), 1003–1011.CrossRef Mampadi, F., Chen, S. Y., Ghinea, G., & Chen, M.-P. (2011). Design of adaptive hypermedia learning systems: a cognitive style approach. Comput Educ, 56(4), 1003–1011.CrossRef
Zurück zum Zitat Maull, K., Saldivar, M. G., & Sumner, T. (2011). Understanding digital library adoption: a use diffusion approach. In Proceedings of ACM/IEEE joint conference on digital libraries (pp. 121–130). New York, NY: ACM. Maull, K., Saldivar, M. G., & Sumner, T. (2011). Understanding digital library adoption: a use diffusion approach. In Proceedings of ACM/IEEE joint conference on digital libraries (pp. 121–130). New York, NY: ACM.
Zurück zum Zitat Muldner, K., Wixon, M., Rai, D., Burleson, W., Woolf, B., & Arroyo, I. (2015). Exploring the impact of a learning dashboard on student affect. In Proceedings of the international conference on artificial intelligence in education (AIED) (pp. 307–317). Cham, Switzerland: Springer.CrossRef Muldner, K., Wixon, M., Rai, D., Burleson, W., Woolf, B., & Arroyo, I. (2015). Exploring the impact of a learning dashboard on student affect. In Proceedings of the international conference on artificial intelligence in education (AIED) (pp. 307–317). Cham, Switzerland: Springer.CrossRef
Zurück zum Zitat Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud High Educ, 31(2), 199–218.CrossRef Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud High Educ, 31(2), 199–218.CrossRef
Zurück zum Zitat Ott, C., Robins, A., Haden, P., & Shephard, K. (2015). Illustrating performance indicators and course characteristics to support students’ self-regulated learning in CS1. Comput Sci Educ, 25(2), 174–198.CrossRef Ott, C., Robins, A., Haden, P., & Shephard, K. (2015). Illustrating performance indicators and course characteristics to support students’ self-regulated learning in CS1. Comput Sci Educ, 25(2), 174–198.CrossRef
Zurück zum Zitat Own, Z. (2010). The application of an adaptive, web-based learning environment on oxidation-reduction reactions. Int J Sci Math Educ, 8(1), 1–23. Own, Z. (2010). The application of an adaptive, web-based learning environment on oxidation-reduction reactions. Int J Sci Math Educ, 8(1), 1–23.
Zurück zum Zitat Parker, L. L., & Loudon, G. M. (2013). Case study using online homework in undergraduate organic chemistry: results and student attitudes. J Chem Educ, 90(1), 37–44.CrossRef Parker, L. L., & Loudon, G. M. (2013). Case study using online homework in undergraduate organic chemistry: results and student attitudes. J Chem Educ, 90(1), 37–44.CrossRef
Zurück zum Zitat Peng, J. C. (2009). Using an online homework system to submit accounting homework: role of cognitive need, computer efficacy, and perception. J Educ Bus, 84(5), 263–268.CrossRef Peng, J. C. (2009). Using an online homework system to submit accounting homework: role of cognitive need, computer efficacy, and perception. J Educ Bus, 84(5), 263–268.CrossRef
Zurück zum Zitat Pennington, M. C. (2004). Cycles of innovation in the adoption of information technology: a view for language teaching. Comput Assist Lang Learn, 17(1), 7–33.CrossRef Pennington, M. C. (2004). Cycles of innovation in the adoption of information technology: a view for language teaching. Comput Assist Lang Learn, 17(1), 7–33.CrossRef
Zurück zum Zitat Richards-Babb, M., Drelick, J., Henry, Z., & Robertson-Honecker, J. (2011). Online homework, help or hindrance? What students think and how they perform. J Coll Sci Teach, 40(4), 81–93. Richards-Babb, M., Drelick, J., Henry, Z., & Robertson-Honecker, J. (2011). Online homework, help or hindrance? What students think and how they perform. J Coll Sci Teach, 40(4), 81–93.
Zurück zum Zitat Rogers, E. M. (2003). Diffusion of innovations. New York, NY: The Free Press. Rogers, E. M. (2003). Diffusion of innovations. New York, NY: The Free Press.
Zurück zum Zitat Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol, 55(1), 68–78.CrossRef Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol, 55(1), 68–78.CrossRef
Zurück zum Zitat Saldaña, J. (2015). The coding manual for qualitative researchers. London, England: Sage. Saldaña, J. (2015). The coding manual for qualitative researchers. London, England: Sage.
Zurück zum Zitat Santos, J. L., Verbert, K., Govaerts, S., & Duval, E. (2013). Addressing learner issues with StepUp!: an evaluation. In Proceedings of the third international conference on learning analytics and knowledge (LAK ‘13) (pp. 14–22). New York, NY: Springer.CrossRef Santos, J. L., Verbert, K., Govaerts, S., & Duval, E. (2013). Addressing learner issues with StepUp!: an evaluation. In Proceedings of the third international conference on learning analytics and knowledge (LAK ‘13) (pp. 14–22). New York, NY: Springer.CrossRef
Zurück zum Zitat Santos, O. C., Boticario, J. G., & Pérez-Marín, D. (2014). Extending web-based educational systems with personalised support through user centred design recommendations along the e-learning life cycle. Science of Computer Programming, 88, 92–109. Santos, O. C., Boticario, J. G., & Pérez-Marín, D. (2014). Extending web-based educational systems with personalised support through user centred design recommendations along the e-learning life cycle. Science of Computer Programming, 88, 92–109.
Zurück zum Zitat Schwendimann, B. A., Rodríguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., et al. (2017). Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans Learn Technol, 10(1), 30–41.CrossRef Schwendimann, B. A., Rodríguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., et al. (2017). Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans Learn Technol, 10(1), 30–41.CrossRef
Zurück zum Zitat Shih, C.-F., & Venkatesh, A. (2004). Beyond adoption: development and application of a use-diffusion model. J Mark, 68(1), 59–72.CrossRef Shih, C.-F., & Venkatesh, A. (2004). Beyond adoption: development and application of a use-diffusion model. J Mark, 68(1), 59–72.CrossRef
Zurück zum Zitat Suárez-Rodríguez, J., Almerich, G., Orellana, N., & Díaz-García, I. (2018). A basic model of integration of ICT by teachers: competence and use. Educ Technol Res Dev, 66(5), 1165–1187.CrossRef Suárez-Rodríguez, J., Almerich, G., Orellana, N., & Díaz-García, I. (2018). A basic model of integration of ICT by teachers: competence and use. Educ Technol Res Dev, 66(5), 1165–1187.CrossRef
Zurück zum Zitat Tervakari, A. M., Silius, K., Koro, J., Paukkeri, J., & Pirttilä, O. (2014). Usefulness of information visualizations based on educational data. In IEEE global engineering education conference, EDUCON (pp. 142–151). New York, NY: IEEE. Retrieved from. Tervakari, A. M., Silius, K., Koro, J., Paukkeri, J., & Pirttilä, O. (2014). Usefulness of information visualizations based on educational data. In IEEE global engineering education conference, EDUCON (pp. 142–151). New York, NY: IEEE. Retrieved from.
Zurück zum Zitat Tondeur, J., van Braak, J., Ertmer, P. A., & Ottenbreit-Leftwich, A. (2017). Understanding the relationship between teachers’ pedagogical beliefs and technology use in education: a systematic review of qualitative evidence. Educ Technol Res Dev, 65(3), 555–575.CrossRef Tondeur, J., van Braak, J., Ertmer, P. A., & Ottenbreit-Leftwich, A. (2017). Understanding the relationship between teachers’ pedagogical beliefs and technology use in education: a systematic review of qualitative evidence. Educ Technol Res Dev, 65(3), 555–575.CrossRef
Zurück zum Zitat Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. Am Behav Sci, 57(10), 1500–1509.CrossRef Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. Am Behav Sci, 57(10), 1500–1509.CrossRef
Zurück zum Zitat Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., et al. (2014). Learning dashboards: an overview and future research opportunities. Pers Ubiquit Comput, 18(6), 1499–1514. Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., et al. (2014). Learning dashboards: an overview and future research opportunities. Pers Ubiquit Comput, 18(6), 1499–1514.
Zurück zum Zitat Wood, S., Seawright, L., Trevor, G., Macfarlane, D., & Stacey, S. (2010, August). ChemCompanion, a digital text for the first-year college chemistry course. In Abstracts of Papers of the American Chemical Society Volume 240. Washington, DC: American Chemical Society. Wood, S., Seawright, L., Trevor, G., Macfarlane, D., & Stacey, S. (2010, August). ChemCompanion, a digital text for the first-year college chemistry course. In Abstracts of Papers of the American Chemical Society Volume 240. Washington, DC: American Chemical Society.
Zurück zum Zitat Woolf, B. P. (2009). Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning. Burlington, MA: Morgan Kaufmann. Woolf, B. P. (2009). Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning. Burlington, MA: Morgan Kaufmann.
Zurück zum Zitat Xu, Z., & Makos, A. (2015). Investigating the impact of a notification system on student behaviors in a discourse-intensive hybrid course. In Proceedings of the fifth international conference on learning analytics and knowledge (LAK ‘15) (pp. 402–403). New York, NY: ACM. Xu, Z., & Makos, A. (2015). Investigating the impact of a notification system on student behaviors in a discourse-intensive hybrid course. In Proceedings of the fifth international conference on learning analytics and knowledge (LAK ‘15) (pp. 402–403). New York, NY: ACM.
Metadaten
Titel
Increasing Student Use of a Learner Dashboard
verfasst von
Rebecca L. Sansom
Robert Bodily
Caroline O. Bates
Heather Leary
Publikationsdatum
13.04.2020
Verlag
Springer Netherlands
Erschienen in
Journal of Science Education and Technology / Ausgabe 3/2020
Print ISSN: 1059-0145
Elektronische ISSN: 1573-1839
DOI
https://doi.org/10.1007/s10956-020-09824-w

Weitere Artikel der Ausgabe 3/2020

Journal of Science Education and Technology 3/2020 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.