Skip to main content
Top
Published in: Journal of Computers in Education 1/2020

21-05-2019

A review of learning analytics intervention in higher education (2011–2018)

Authors: Billy Tak-ming Wong, Kam Cheong Li

Published in: Journal of Computers in Education | Issue 1/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Intervention has long been practised in higher education to provide assistance for at-risk or underachieving learners. With the development of learning analytics, the delivery of intervention has been informed by data-driven approaches to identify learners’ problems and provide them with just-in-time and personalised support. However, intervention has been claimed to be the greatest challenge in learning analytics and has yet to be widely implemented. This paper reviews 24 case studies of learning analytics intervention in higher education. The cases were categorised and summarised according to their objectives, the data used, the intervention methods, the outcomes obtained and the challenges encountered. The results show that intervention practices have focused most frequently on increasing students’ study performance, offering personalised feedback and improving student retention. The frequent types of data involved students’ online learning behaviours, study performance, demographics and course selection information. The most commonly used intervention methods involved offering personalised recommendations and visualising learning data. The interventions have led to outcomes such as enhancing study performance, retention and course registration, as well as productivity and effectiveness in learning and teaching. The challenges covered a wide range of aspects, including the scalability of intervention, conditions for implementing intervention, limitations of the channels for delivering intervention and the evaluation of intervention effectiveness. The results suggest that learning analytics intervention has the potential to further extend its scope of practices to serve a wider range of purposes, but more studies on the empirical evidence, even with null or negative results, are needed to support its long-term effectiveness and sustainability.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
Relevant articles were found on Scopus and the Web of Science starting from 2011.
 
Literature
go back to reference Beattie, S., Woodley, C., & Souter, K. (2014). Creepy analytics and learner data rights: Proceedings of the Ascilite 2014 Conference (pp. 421–425). Dunedin, New Zealand. Beattie, S., Woodley, C., & Souter, K. (2014). Creepy analytics and learner data rights: Proceedings of the Ascilite 2014 Conference (pp. 421–425). Dunedin, New Zealand.
go back to reference Bramucci, R., & Gaston, J. (2012). Sherpa: Increasing student success with a recommendation engine: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge – LAK’12 (pp. 82–83). Vancouver, Canada. Bramucci, R., & Gaston, J. (2012). Sherpa: Increasing student success with a recommendation engine: Proceedings of the 2nd International Conference on Learning Analytics and KnowledgeLAK’12 (pp. 82–83). Vancouver, Canada.
go back to reference Cerezo, R., Suarez, N., Núñez, J. C., & Sánchez-Santillán, M. (2014). eGraph tool: Graphing the learning process in LMSs: Proceedings of the 4th International Conference on Learning Analytics and Knowledge – LAK’14 (pp. 273–274). Indianapolis, Indiana, USA. Cerezo, R., Suarez, N., Núñez, J. C., & Sánchez-Santillán, M. (2014). eGraph tool: Graphing the learning process in LMSs: Proceedings of the 4th International Conference on Learning Analytics and KnowledgeLAK’14 (pp. 273–274). Indianapolis, Indiana, USA.
go back to reference Choi, S. P. M., Lam, S. S., Li, K. C., & Wong, B. T. M. (2018). Learning analytics at low cost: At-risk student prediction with clicker data and systematic proactive interventions. Educational Technology & Society,21(2), 273–290. Choi, S. P. M., Lam, S. S., Li, K. C., & Wong, B. T. M. (2018). Learning analytics at low cost: At-risk student prediction with clicker data and systematic proactive interventions. Educational Technology & Society,21(2), 273–290.
go back to reference Clow, D. (2012). The learning analytics cycle: Closing the loop effectively: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). Vancouver, Canada. Clow, D. (2012). The learning analytics cycle: Closing the loop effectively: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). Vancouver, Canada.
go back to reference Clow, D. (2013). An overview of learning analytics. Teaching in Higher Education,18(6), 683–695.CrossRef Clow, D. (2013). An overview of learning analytics. Teaching in Higher Education,18(6), 683–695.CrossRef
go back to reference Dodge, B., Whitmer, J., & Frazee, J. P. (2015). Improving undergraduate student achievement in large blended courses through data-driven interventions: Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 412–413). New York, USA. Dodge, B., Whitmer, J., & Frazee, J. P. (2015). Improving undergraduate student achievement in large blended courses through data-driven interventions: Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 412–413). New York, USA.
go back to reference Fuchs, D., Mock, D., Morgan, P., & Young, C. (2003). Responsiveness-to-intervention: Definitions, evidence, and implications for the learning disabilities construct. Learning Disabilities Research and Practice,18(3), 157–171.CrossRef Fuchs, D., Mock, D., Morgan, P., & Young, C. (2003). Responsiveness-to-intervention: Definitions, evidence, and implications for the learning disabilities construct. Learning Disabilities Research and Practice,18(3), 157–171.CrossRef
go back to reference Gašević, D., Dawson, S., Rogers, T., & Gašević, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education,28, 68–84.CrossRef Gašević, D., Dawson, S., Rogers, T., & Gašević, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education,28, 68–84.CrossRef
go back to reference Grann, J., & Bushway, D. (2014). Competency map: Visualizing student learning to promote student success: Proceedings of the 4th International Conference on Learning Analytics and Knowledge – LAK’14 (pp. 267–268). Indianapolis, USA. Grann, J., & Bushway, D. (2014). Competency map: Visualizing student learning to promote student success: Proceedings of the 4th International Conference on Learning Analytics and KnowledgeLAK’14 (pp. 267–268). Indianapolis, USA.
go back to reference Grawemeyer, B., Mavrikis, M., Holmes, W., Gutierrez-Santos, S., Wiedmann, M., & Rummel, N. (2016). Affecting off-task behaviour: How affect-aware feedback can improve student learning: Proceedings of the 5th International Conference on Learning Analytics and Knowledge – LAK’16 (pp. 104–113). Edinburgh, United Kingdom. Grawemeyer, B., Mavrikis, M., Holmes, W., Gutierrez-Santos, S., Wiedmann, M., & Rummel, N. (2016). Affecting off-task behaviour: How affect-aware feedback can improve student learning: Proceedings of the 5th International Conference on Learning Analytics and KnowledgeLAK’16 (pp. 104–113). Edinburgh, United Kingdom.
go back to reference Jayaprakash, S. M., & Lauría, E. J. M. (2014). Open academic early alert system: Technical demonstration: Proceedings of the 4th International Conference on Learning Analytics and Knowledge – LAK’14 (pp. 267–268). Indianapolis, USA. Jayaprakash, S. M., & Lauría, E. J. M. (2014). Open academic early alert system: Technical demonstration: Proceedings of the 4th International Conference on Learning Analytics and KnowledgeLAK’14 (pp. 267–268). Indianapolis, USA.
go back to reference Khalil, M., & Ebner, M. (2015). Learning analytics: Principles and constraints: Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2015 (pp. 1326–1336). Montréal, Canada. Khalil, M., & Ebner, M. (2015). Learning analytics: Principles and constraints: Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2015 (pp. 1326–1336). Montréal, Canada.
go back to reference Kimberly, E. A., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge – LAK’12 (pp. 267–270). Vancouver, Canada. Kimberly, E. A., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and KnowledgeLAK’12 (pp. 267–270). Vancouver, Canada.
go back to reference Li, K. C., Ye, C. J., & Wong, B. T. M. (2018). Status of learning analytics in Asia: Perspectives of higher education stakeholders. In Lam, et al. (Eds.), Technology in education: Innovative solutions and practices (pp. 267–275). New York: Springer.CrossRef Li, K. C., Ye, C. J., & Wong, B. T. M. (2018). Status of learning analytics in Asia: Perspectives of higher education stakeholders. In Lam, et al. (Eds.), Technology in education: Innovative solutions and practices (pp. 267–275). New York: Springer.CrossRef
go back to reference Lonn, S., Aguilar, S., & Teasley, S. D. (2013). Issues, challenges, and lessons learned when scaling up a learning analytics intervention: Proceedings of the 3rd International Conference on Learning Analytics and Knowledge – LAK’13 (pp. 235–239). Leuven, Belgium. Lonn, S., Aguilar, S., & Teasley, S. D. (2013). Issues, challenges, and lessons learned when scaling up a learning analytics intervention: Proceedings of the 3rd International Conference on Learning Analytics and KnowledgeLAK’13 (pp. 235–239). Leuven, Belgium.
go back to reference Lonn, S., Aguilar, S. J., & Teasley, S. D. (2015). Investigating student motivation in the context of a learning analytics intervention during a summer bridge program. Computers in Human Behaviour,47, 90–97.CrossRef Lonn, S., Aguilar, S. J., & Teasley, S. D. (2015). Investigating student motivation in the context of a learning analytics intervention during a summer bridge program. Computers in Human Behaviour,47, 90–97.CrossRef
go back to reference Lu, O. H. T., Huang, J. C. H., Huang, A. Y. Q., & Yang, S. J. H. (2017). Applying learning analytics for improving students engagement and learning outcomes in an MOOCs enabled collaborative programming course. Interactive Learning Environments,25(2), 220–234.CrossRef Lu, O. H. T., Huang, J. C. H., Huang, A. Y. Q., & Yang, S. J. H. (2017). Applying learning analytics for improving students engagement and learning outcomes in an MOOCs enabled collaborative programming course. Interactive Learning Environments,25(2), 220–234.CrossRef
go back to reference McKay, T., Miller, K., & Tritz, J. (2012). What to do with actionable intelligence: E2Coach as an intervention engine: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 88–91). Vancouver, Canada. McKay, T., Miller, K., & Tritz, J. (2012). What to do with actionable intelligence: E2Coach as an intervention engine: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 88–91). Vancouver, Canada.
go back to reference McNely, B. J., Gestwicki, P., Hill, J. H., Parli-Horne, P., & Johnson, E. (2012). Learning analytics for collaborative writing: A prototype and case study: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge – LAK’12 (pp. 222–225). Vancouver, Canada. McNely, B. J., Gestwicki, P., Hill, J. H., Parli-Horne, P., & Johnson, E. (2012). Learning analytics for collaborative writing: A prototype and case study: Proceedings of the 2nd International Conference on Learning Analytics and KnowledgeLAK’12 (pp. 222–225). Vancouver, Canada.
go back to reference Miller, W. L., Baker, R. S., Labrum, M. J., Petsche, K., Liu, Y-H., & Wagner, A. Z. (2015). Automated detection of proactive remediation by teachers in reasoning mind classrooms: Proceedings of the 5th International Conference on Learning Analytics and Knowledge – LAK’15 (pp. 290–294). Poughkeepsie, New York. Miller, W. L., Baker, R. S., Labrum, M. J., Petsche, K., Liu, Y-H., & Wagner, A. Z. (2015). Automated detection of proactive remediation by teachers in reasoning mind classrooms: Proceedings of the 5th International Conference on Learning Analytics and KnowledgeLAK’15 (pp. 290–294). Poughkeepsie, New York.
go back to reference Molinaro, M., Steinwachs, M., Li, Q., & Guzman-Alvarez, A. (2016). Promoting instructor and department action via simple, actionable tools and analyses: The 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop (pp. 36–40). Edinburgh, UK. Molinaro, M., Steinwachs, M., Li, Q., & Guzman-Alvarez, A. (2016). Promoting instructor and department action via simple, actionable tools and analyses: The 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop (pp. 36–40). Edinburgh, UK.
go back to reference Nam, S., Lonn, S., Brown, T., Davis, C. S., & Koch, D. (2014). Customized course advising: Investigating engineering student success with incoming profiles and patterns of concurrent course enrollment: Proceedings of the 4th International Conference on Learning Analytics and Knowledge – LAK’14 (pp. 267–268). Indianapolis, USA. Nam, S., Lonn, S., Brown, T., Davis, C. S., & Koch, D. (2014). Customized course advising: Investigating engineering student success with incoming profiles and patterns of concurrent course enrollment: Proceedings of the 4th International Conference on Learning Analytics and KnowledgeLAK’14 (pp. 267–268). Indianapolis, USA.
go back to reference Rienties, B., Boroowa, A., Cross, S., Farrington-Flint, L., Herodotou, C., Prescott, L., Woodthorpe, J. (2016). Reviewing three case-studies of learning analytics interventions at the Open University UK: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 534–535). Edinburgh, United Kingdom. Rienties, B., Boroowa, A., Cross, S., Farrington-Flint, L., Herodotou, C., Prescott, L., Woodthorpe, J. (2016). Reviewing three case-studies of learning analytics interventions at the Open University UK: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 534–535). Edinburgh, United Kingdom.
go back to reference Rienties, B., Cross, S., & Zdrahal, Z. (2017). Implementing a learning analytics intervention and evaluation framework: What works? In B. K. Daniel (Ed.), Big data and learning analytics in higher education (pp. 147–166). Heidelberg: Springer.CrossRef Rienties, B., Cross, S., & Zdrahal, Z. (2017). Implementing a learning analytics intervention and evaluation framework: What works? In B. K. Daniel (Ed.), Big data and learning analytics in higher education (pp. 147–166). Heidelberg: Springer.CrossRef
go back to reference Rivera-Pelayo, V., Munk, J., Zacharias, V., & Braun, S. (2013). Live interest meter: Learning from quantified feedback in mass lectures: Proceedings of the 3rd International Conference on Learning Analytics and Knowledge – LAK’13 (pp. 23–27). Leuven, Belgium. Rivera-Pelayo, V., Munk, J., Zacharias, V., & Braun, S. (2013). Live interest meter: Learning from quantified feedback in mass lectures: Proceedings of the 3rd International Conference on Learning Analytics and KnowledgeLAK’13 (pp. 23–27). Leuven, Belgium.
go back to reference Santos, J. L., Verbert, K., Govaerts, S., & Duval, E. (2013). Addressing learner issues with StepUp!: An evaluation: Proceedings of the 3rd International Conference on Learning Analytics and Knowledge – LAK’13 (pp. 14–22). Leuven, Belgium. Santos, J. L., Verbert, K., Govaerts, S., & Duval, E. (2013). Addressing learner issues with StepUp!: An evaluation: Proceedings of the 3rd International Conference on Learning Analytics and KnowledgeLAK’13 (pp. 14–22). Leuven, Belgium.
go back to reference Si Na, K., & Tasir, Z. (2017). A systematic review of learning analytics intervention contributing to student success in online learning: Proceedings of the 2017 International Conference on Learning and Teaching in Computing and Engineering (pp. 62–68). Hong Kong, China. Si Na, K., & Tasir, Z. (2017). A systematic review of learning analytics intervention contributing to student success in online learning: Proceedings of the 2017 International Conference on Learning and Teaching in Computing and Engineering (pp. 62–68). Hong Kong, China.
go back to reference Siadaty, M., Gasevic, D., & Hatala, M. (2016a). Associations between technological scaffolding and micro-level processes of self-regulated learning: A workplace study. Computers in Human Behavior,55, 1007–1019.CrossRef Siadaty, M., Gasevic, D., & Hatala, M. (2016a). Associations between technological scaffolding and micro-level processes of self-regulated learning: A workplace study. Computers in Human Behavior,55, 1007–1019.CrossRef
go back to reference Siadaty, M., Gasevic, D., & Hatala, M. (2016b). Measuring the impact of technological scaffolding interventions on micro-level processes of self-regulated workplace learning. Computers in Human Behavior,59, 469–482.CrossRef Siadaty, M., Gasevic, D., & Hatala, M. (2016b). Measuring the impact of technological scaffolding interventions on micro-level processes of self-regulated workplace learning. Computers in Human Behavior,59, 469–482.CrossRef
go back to reference Siemens, G. (2012). Learning analytics: Envisioning a research discipline and a domain of practice. Paper presented in the 2nd International Conference on Learning Analytics and Knowledge. Vancouver, Canada. Siemens, G. (2012). Learning analytics: Envisioning a research discipline and a domain of practice. Paper presented in the 2nd International Conference on Learning Analytics and Knowledge. Vancouver, Canada.
go back to reference Smith, V., Lange, A., & Huston, D. R. (2012). Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses. Journal of Asynchronous Learning Networks,16(3), 51–61. Smith, V., Lange, A., & Huston, D. R. (2012). Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses. Journal of Asynchronous Learning Networks,16(3), 51–61.
go back to reference van Horne, S., Curran, M., Smith, A., van Buren, J., Zahrieh, D., Larsen, R., et al. (2018). Facilitating student success in introductory Chemistry with feedback in an online platform. Technology, Knowledge and Learning,23(1), 21–40.CrossRef van Horne, S., Curran, M., Smith, A., van Buren, J., Zahrieh, D., Larsen, R., et al. (2018). Facilitating student success in introductory Chemistry with feedback in an online platform. Technology, Knowledge and Learning,23(1), 21–40.CrossRef
go back to reference van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics. Computers & Education,90(1), 80–94.CrossRef van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics. Computers & Education,90(1), 80–94.CrossRef
go back to reference Villano, R., Harrison, S., Lynch, G., & Chen, G. (2018). Linking early alert systems and student retention: A survival analysis approach. Higher Education,76(5), 903–920.CrossRef Villano, R., Harrison, S., Lynch, G., & Chen, G. (2018). Linking early alert systems and student retention: A survival analysis approach. Higher Education,76(5), 903–920.CrossRef
go back to reference Wise, A. F. (2014). Designing pedagogical interventions to support student use of learning analytics: Proceedings of the 4th International Conference on Learning Analytics and Knowledge (pp. 203–211). Indiana, USA. Wise, A. F. (2014). Designing pedagogical interventions to support student use of learning analytics: Proceedings of the 4th International Conference on Learning Analytics and Knowledge (pp. 203–211). Indiana, USA.
go back to reference Wise, A. E., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics,1(2), 48–71.CrossRef Wise, A. E., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics,1(2), 48–71.CrossRef
go back to reference Wong, B. T. M. (2017). Learning analytics in higher education: An analysis of case studies. Asian Association of Open Universities Journal,12(1), 21–40.CrossRef Wong, B. T. M. (2017). Learning analytics in higher education: An analysis of case studies. Asian Association of Open Universities Journal,12(1), 21–40.CrossRef
go back to reference Wong, W. Y., & Lavrencic, M. (2016). Using a risk management approach in analytics for curriculum and program quality improvement: the 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop (pp. 10–14). Edinburgh, UK. Wong, W. Y., & Lavrencic, M. (2016). Using a risk management approach in analytics for curriculum and program quality improvement: the 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop (pp. 10–14). Edinburgh, UK.
go back to reference Wong, B. T. M., Li, K. C., & Choi, S. P. M. (2018). Trends in learning analytics practices: A review of higher education institutions. Interactive Technology and Smart Education,15(2), 132–154.CrossRef Wong, B. T. M., Li, K. C., & Choi, S. P. M. (2018). Trends in learning analytics practices: A review of higher education institutions. Interactive Technology and Smart Education,15(2), 132–154.CrossRef
go back to reference Xiong, X., Wang, Y., & Beck, J. B. (2015). Improving students’ long-term retention performance: A study on personalized retention schedules: Proceedings of the 5th International Conference on Learning Analytics and Knowledge – LAK’15 (pp. 325–329). Poughkeepsie, New York. Xiong, X., Wang, Y., & Beck, J. B. (2015). Improving students’ long-term retention performance: A study on personalized retention schedules: Proceedings of the 5th International Conference on Learning Analytics and KnowledgeLAK’15 (pp. 325–329). Poughkeepsie, New York.
Metadata
Title
A review of learning analytics intervention in higher education (2011–2018)
Authors
Billy Tak-ming Wong
Kam Cheong Li
Publication date
21-05-2019
Publisher
Springer Berlin Heidelberg
Published in
Journal of Computers in Education / Issue 1/2020
Print ISSN: 2197-9987
Electronic ISSN: 2197-9995
DOI
https://doi.org/10.1007/s40692-019-00143-7

Other articles of this Issue 1/2020

Journal of Computers in Education 1/2020 Go to the issue

Premium Partner