Skip to main content
Top
Published in:

17-07-2023 | Original research

Unleashing the Power of Predictive Analytics to Identify At-Risk Students in Computer Science

Authors: Umar Bin Qushem, Solomon Sunday Oyelere, Gökhan Akçapınar, Rogers Kaliisa, Mikko-Jussi Laakso

Published in: Technology, Knowledge and Learning | Issue 3/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Predicting academic performance for students majoring in computer science has long been a significant field of research in computing education. Previous studies described that accurate prediction of students’ early-stage performance could identify low-performing students and take corrective action to improve performance. Besides, adopting machine learning algorithms with predictive analytics has proven possible and meaningful. The traditional approach of looking after students without uncovering the root causes of poor performance has shifted dramatically into improving the quality of the educational processes of students, teachers, and stakeholders. Thus, this study employed predictive analytics to develop an early warning prediction model using computing science degree performance data at a public institution. Predictive models based on our data analysis revealed that low, medium, and high-performing students could be predicted with an accuracy of 88% using only the grades of the courses they took in the second year. Moreover, 96% accuracy was achieved when all course grades were used in predictive models. The courses that are important in determining the overall performance of the students were also analyzed. By employing a multi-method approach, utilizing a large dataset spanning four academic years, and including a diverse sample of 430 students, our study offers a robust foundation to researchers, designers, and computer science educators for understanding and predicting student performance. The enhanced generalizability and implications for educational practice position our study as a valuable contribution to the field, paving the way for further advancements in predictive analytics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Akçapınar, G., Altun, A., & Aşkar, P. (2019a). Using learning analytics to develop early-warning system for at-risk students. International Journal of Educational Technology in Higher Education, 16(1), 1–20.CrossRef Akçapınar, G., Altun, A., & Aşkar, P. (2019a). Using learning analytics to develop early-warning system for at-risk students. International Journal of Educational Technology in Higher Education, 16(1), 1–20.CrossRef
go back to reference Akçapınar, G., Hasnine, M. N., Majumdar, R., Flanagan, B., & Ogata, H. (2019b). Developing an early-warning system for spotting at-risk students by using eBook interaction logs. Smart Learning Environments, 6(1), 4.CrossRef Akçapınar, G., Hasnine, M. N., Majumdar, R., Flanagan, B., & Ogata, H. (2019b). Developing an early-warning system for spotting at-risk students by using eBook interaction logs. Smart Learning Environments, 6(1), 4.CrossRef
go back to reference Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019). Educational data mining and learning analytics for 21st century higher education: A review and synthesis. Telematics and Informatics, 37, 13–49.CrossRef Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019). Educational data mining and learning analytics for 21st century higher education: A review and synthesis. Telematics and Informatics, 37, 13–49.CrossRef
go back to reference Arnold, K. E., & Pistilli, M. D. (2012). April. Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 267–270). Arnold, K. E., & Pistilli, M. D. (2012). April. Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 267–270).
go back to reference Ayán, M. N. R., & García, M. T. C. (2008). Prediction of university students’ academic achievement by linear and logistic models. The Spanish journal of psychology, 11(1), 275–288.CrossRef Ayán, M. N. R., & García, M. T. C. (2008). Prediction of university students’ academic achievement by linear and logistic models. The Spanish journal of psychology, 11(1), 275–288.CrossRef
go back to reference Bañeres, D., Rodríguez, M. E., Guerrero-Roldán, A. E., & Karadeniz, A. (2020). An early warning system to detect at-risk students in online higher education. Applied Sciences, 10(13), 4427.CrossRef Bañeres, D., Rodríguez, M. E., Guerrero-Roldán, A. E., & Karadeniz, A. (2020). An early warning system to detect at-risk students in online higher education. Applied Sciences, 10(13), 4427.CrossRef
go back to reference Beckham, N. R., Akeh, L. J., Mitaart, G. N. P., & Moniaga, J. V. (2023). Determining factors that affect student performance using various machine learning methods. Procedia Computer Science, 216, 597–603.CrossRef Beckham, N. R., Akeh, L. J., Mitaart, G. N. P., & Moniaga, J. V. (2023). Determining factors that affect student performance using various machine learning methods. Procedia Computer Science, 216, 597–603.CrossRef
go back to reference Chanlekha, H., & Niramitranon, J. (2018). September. Student performance prediction model for early-identification of at-risk students in traditional classroom settings. In Proceedings of the 10th International Conference on Management of Digital EcoSystems (pp. 239–245). Chanlekha, H., & Niramitranon, J. (2018). September. Student performance prediction model for early-identification of at-risk students in traditional classroom settings. In Proceedings of the 10th International Conference on Management of Digital EcoSystems (pp. 239–245).
go back to reference Chung, J. Y., & Lee, S. (2019). Dropout early warning systems for high school students using machine learning. Children and Youth Services Review, 96, 346–353.CrossRef Chung, J. Y., & Lee, S. (2019). Dropout early warning systems for high school students using machine learning. Children and Youth Services Review, 96, 346–353.CrossRef
go back to reference Cohen, J. (1960). A coefficient of Agreement for Nominal Scales. Educational Psychological Measurement, 20(1), 37–46.CrossRef Cohen, J. (1960). A coefficient of Agreement for Nominal Scales. Educational Psychological Measurement, 20(1), 37–46.CrossRef
go back to reference Daud, A., Aljohani, N. R., Abbasi, R. A., Lytras, M. D., Abbas, F., & Alowibdi, J. S. (2017). April. Predicting student performance using advanced learning analytics. In Proceedings of the 26th international conference on world wide web companion (pp. 415–421). Daud, A., Aljohani, N. R., Abbasi, R. A., Lytras, M. D., Abbas, F., & Alowibdi, J. S. (2017). April. Predicting student performance using advanced learning analytics. In Proceedings of the 26th international conference on world wide web companion (pp. 415–421).
go back to reference Dinov, I. D. (2023). Variable importance and feature selection. Data Science and Predictive Analytics: Biomedical and Health applications using R (pp. 579–639). Cham: Springer International Publishing.CrossRef Dinov, I. D. (2023). Variable importance and feature selection. Data Science and Predictive Analytics: Biomedical and Health applications using R (pp. 579–639). Cham: Springer International Publishing.CrossRef
go back to reference Galdino, G. S., de Sandes-Freitas, T. V., de Andrade, L. G. M., Adamian, C. M. C., Meneses, G. C., da Silva Junior, G. B., & de Daher, F., E (2023). Development and validation of a simple machine learning tool to predict mortality in leptospirosis. Scientific Reports, 13(1), 4506.CrossRef Galdino, G. S., de Sandes-Freitas, T. V., de Andrade, L. G. M., Adamian, C. M. C., Meneses, G. C., da Silva Junior, G. B., & de Daher, F., E (2023). Development and validation of a simple machine learning tool to predict mortality in leptospirosis. Scientific Reports, 13(1), 4506.CrossRef
go back to reference Hasan, R., Palaniappan, S., Raziff, A. R. A., Mahmood, S., & Sarker, K. U. (2018). August. Student academic performance prediction by using decision tree algorithm. In 2018 4th International Conference on Computer and Information Sciences (ICCOINS) (pp. 1–5). IEEE. Hasan, R., Palaniappan, S., Raziff, A. R. A., Mahmood, S., & Sarker, K. U. (2018). August. Student academic performance prediction by using decision tree algorithm. In 2018 4th International Conference on Computer and Information Sciences (ICCOINS) (pp. 1–5). IEEE.
go back to reference Hasan, R., Palaniappan, S., Mahmood, S., Abbas, A., Sarker, K. U., & Sattar, M. U. (2020). Predicting Student performance in higher Educational Institutions using Video Learning Analytics and Data Mining techniques. Applied Sciences, 10(11), 3894.CrossRef Hasan, R., Palaniappan, S., Mahmood, S., Abbas, A., Sarker, K. U., & Sattar, M. U. (2020). Predicting Student performance in higher Educational Institutions using Video Learning Analytics and Data Mining techniques. Applied Sciences, 10(11), 3894.CrossRef
go back to reference Herodotou, C., Rienties, B., Verdin, B., & Boroowa, A. (2019). Predictive learning analytics ‘at scale’: Guidelines to successful implementation in Higher Education based on the case of the Open University UK. Journal of Learning Analytics, 6(1), 85–95.CrossRef Herodotou, C., Rienties, B., Verdin, B., & Boroowa, A. (2019). Predictive learning analytics ‘at scale’: Guidelines to successful implementation in Higher Education based on the case of the Open University UK. Journal of Learning Analytics, 6(1), 85–95.CrossRef
go back to reference Hoffait, A. S., & Schyns, M. (2017). Early detection of university students with potential difficulties. Decision Support Systems, 101, 1–11.CrossRef Hoffait, A. S., & Schyns, M. (2017). Early detection of university students with potential difficulties. Decision Support Systems, 101, 1–11.CrossRef
go back to reference Huang, S., & Fang, N. (2013). Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models. Computers and Education, 61, 133–145.CrossRef Huang, S., & Fang, N. (2013). Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models. Computers and Education, 61, 133–145.CrossRef
go back to reference Huang, A. Y., Lu, O. H., Huang, J. C., Yin, C. J., & Yang, S. J. (2020). Predicting students’ academic performance by using educational big data and learning analytics: Evaluation of classification methods and learning logs. Interactive Learning Environments, 28(2), 206–230.CrossRef Huang, A. Y., Lu, O. H., Huang, J. C., Yin, C. J., & Yang, S. J. (2020). Predicting students’ academic performance by using educational big data and learning analytics: Evaluation of classification methods and learning logs. Interactive Learning Environments, 28(2), 206–230.CrossRef
go back to reference Kasem, A., Shahrin, S. N. A. M., & Wan, A. T. (2018). October. Learning analytics in Universiti Teknologi Brunei: predicting graduates performance. In 2018 Fourth International Conference on Advances in Computing, Communication and Automation (ICACCA) (pp. 1–5). IEEE. Kasem, A., Shahrin, S. N. A. M., & Wan, A. T. (2018). October. Learning analytics in Universiti Teknologi Brunei: predicting graduates performance. In 2018 Fourth International Conference on Advances in Computing, Communication and Automation (ICACCA) (pp. 1–5). IEEE.
go back to reference Kursa, M. B., & Rudnicki, W. R. (2010). Feature selection with the Boruta package. Journal Of Statistical Software, 36(11), 1–13.CrossRef Kursa, M. B., & Rudnicki, W. R. (2010). Feature selection with the Boruta package. Journal Of Statistical Software, 36(11), 1–13.CrossRef
go back to reference Kuzilek, J., Hlosta, M., Herrmannova, D., Zdrahal, Z., Vaclavek, J., & Wolff, A. (2015). OU Analyse: Analysing at-risk students at the Open University. Learning Analytics Review, 1–16. Kuzilek, J., Hlosta, M., Herrmannova, D., Zdrahal, Z., Vaclavek, J., & Wolff, A. (2015). OU Analyse: Analysing at-risk students at the Open University. Learning Analytics Review, 1–16.
go back to reference Lykourentzou, I., Giannoukos, I., Mpardis, G., Nikolopoulos, V., & Loumos, V. (2009). Early and dynamic student achievement prediction in e-learning courses using neural networks. Journal of the American Society for Information Science and Technology, 60(2), 372–380.CrossRef Lykourentzou, I., Giannoukos, I., Mpardis, G., Nikolopoulos, V., & Loumos, V. (2009). Early and dynamic student achievement prediction in e-learning courses using neural networks. Journal of the American Society for Information Science and Technology, 60(2), 372–380.CrossRef
go back to reference Magill, M. A. (1997). June. Classroom models for illustrating dynamics principles part i.–particle kinematics and kinetics. In Proc. of the ASEE Annual Conf. Magill, M. A. (1997). June. Classroom models for illustrating dynamics principles part i.–particle kinematics and kinetics. In Proc. of the ASEE Annual Conf.
go back to reference Majumder, S., & Mason, C. M. (2023). Applying an interpretable machine learning approach to assess intraspecific trait variation under landscape-scale population differentiation. bioRxiv, 2023–04. Majumder, S., & Mason, C. M. (2023). Applying an interpretable machine learning approach to assess intraspecific trait variation under landscape-scale population differentiation. bioRxiv, 2023–04.
go back to reference McMahon, B. M., & Sembiante, S. F. (2020). Re-envisioning the purpose of early warning systems: Shifting the mindset from student identification to meaningful prediction and intervention. Review of Education, 8(1), 266–301.CrossRef McMahon, B. M., & Sembiante, S. F. (2020). Re-envisioning the purpose of early warning systems: Shifting the mindset from student identification to meaningful prediction and intervention. Review of Education, 8(1), 266–301.CrossRef
go back to reference Nabil, A., Seyam, M., & Abou-Elfetouh, A. (2021). Prediction of students’ academic performance based on courses’ grades using deep neural networks. Ieee Access: Practical Innovations, Open Solutions, 9, 140731–140746.CrossRef Nabil, A., Seyam, M., & Abou-Elfetouh, A. (2021). Prediction of students’ academic performance based on courses’ grades using deep neural networks. Ieee Access: Practical Innovations, Open Solutions, 9, 140731–140746.CrossRef
go back to reference Qushem, U. B., Christopoulos, A., Oyelere, S. S., Ogata, H., & Laakso, M. J. (2021). Multimodal Technologies in Precision Education: Providing New Opportunities or adding more Challenges? Education Sciences, 11(7), 338.CrossRef Qushem, U. B., Christopoulos, A., Oyelere, S. S., Ogata, H., & Laakso, M. J. (2021). Multimodal Technologies in Precision Education: Providing New Opportunities or adding more Challenges? Education Sciences, 11(7), 338.CrossRef
go back to reference Romero, C., Romero, J. R., & Ventura, S. (2014). A survey on pre-processing educational data. Educational data mining (pp. 29–64). Cham: Springer.CrossRef Romero, C., Romero, J. R., & Ventura, S. (2014). A survey on pre-processing educational data. Educational data mining (pp. 29–64). Cham: Springer.CrossRef
go back to reference Sandhu, H., Kumar, R. N., & Garg, P. (2021). Machine learning-based modeling to predict inhibitors of acetylcholinesterase. Molecular Diversity, 1–10. Sandhu, H., Kumar, R. N., & Garg, P. (2021). Machine learning-based modeling to predict inhibitors of acetylcholinesterase. Molecular Diversity, 1–10.
go back to reference Şen, B., Uçar, E., & Delen, D. (2012). Predicting and analyzing secondary education placement-test scores: A data mining approach. Expert Systems with Applications, 39(10), 9468–9476.CrossRef Şen, B., Uçar, E., & Delen, D. (2012). Predicting and analyzing secondary education placement-test scores: A data mining approach. Expert Systems with Applications, 39(10), 9468–9476.CrossRef
go back to reference Trakunphutthirak, R., Cheung, Y., & Lee, V. C. (2019). July. A study of educational data mining: Evidence from a thai university. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 33, No. 01, pp. 734–741). Trakunphutthirak, R., Cheung, Y., & Lee, V. C. (2019). July. A study of educational data mining: Evidence from a thai university. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 33, No. 01, pp. 734–741).
go back to reference Veenstra, C. P., Dey, E. L., & Herrin, G. D. (2008). Is modeling of freshman engineering success different from modeling of non-engineering success? Journal of Engineering Education, 97(4), 467–479.CrossRef Veenstra, C. P., Dey, E. L., & Herrin, G. D. (2008). Is modeling of freshman engineering success different from modeling of non-engineering success? Journal of Engineering Education, 97(4), 467–479.CrossRef
go back to reference Ware, W. B., & Galassi, J. P. (2006). Using correlational and prediction data to enhance student achievement in K-12 schools: A practical application for school counselors. Professional School Counseling, 344–356. Ware, W. B., & Galassi, J. P. (2006). Using correlational and prediction data to enhance student achievement in K-12 schools: A practical application for school counselors. Professional School Counseling, 344–356.
go back to reference Williams, L., Titus, K. J., & Pittman, J. M. (2021). January. How Early is Early Enough: Correlating Student Performance with Final Grades. In Proceedings of 5th Conference on Computing Education Practice (pp. 13–16). Williams, L., Titus, K. J., & Pittman, J. M. (2021). January. How Early is Early Enough: Correlating Student Performance with Final Grades. In Proceedings of 5th Conference on Computing Education Practice (pp. 13–16).
Metadata
Title
Unleashing the Power of Predictive Analytics to Identify At-Risk Students in Computer Science
Authors
Umar Bin Qushem
Solomon Sunday Oyelere
Gökhan Akçapınar
Rogers Kaliisa
Mikko-Jussi Laakso
Publication date
17-07-2023
Publisher
Springer Netherlands
Published in
Technology, Knowledge and Learning / Issue 3/2024
Print ISSN: 2211-1662
Electronic ISSN: 2211-1670
DOI
https://doi.org/10.1007/s10758-023-09674-6

Premium Partners