Skip to main content
Top
Published in: Social Network Analysis and Mining 1/2024

01-12-2024 | Original Article

Evaluating teachers’ effectiveness in classrooms: an ML-based assessment portfolio

Authors: Renu Sabharwal, Shah J. Miah

Published in: Social Network Analysis and Mining | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Effective teachers are strongly committed to creating a positive learning experience, instinct, and impact for transforming students’ learning. The transforming elements can be defined through related attributes, such as self-efficacy, regular attendance, and cooperative behavior. However, this involves a significant data analysis task to measure teachers’ performance and predict their effectiveness in the education domain. Underpinned by a recognized design perspective of design science research, this study establishes a methodological framework for designing a solution artifact utilizing machine learning algorithms informing the design science research for IS design. We designed a new solution artifact utilizing a case dataset, specifically, a record of the UCI machine learning repository. Researchers can measure teachers’ effectiveness through the proposed innovative technique that elevates distinct resources to configure learning opportunities and relevant monitoring of learning. To evaluate the proposed ML model in measuring teachers’ effectiveness, we validated the prediction by contrasting it with other comparable models. We developed two ML models using K-means and hierarchical algorithms and found that the K-means presented the best outcome in representing three clusters: negative, positive, and neutral feedback, also showing 99% accuracy using the random forest classifier. Therefore, the K-means clustering technique is selected to be the core component of the solution for predicting teachers’ effectiveness.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Abaidullah AM, Ahmed N, Ali E (2015) Identifying hidden patterns in students’ feedback through cluster analysis. Int J of Comput Theory Eng 7(1):16CrossRef Abaidullah AM, Ahmed N, Ali E (2015) Identifying hidden patterns in students’ feedback through cluster analysis. Int J of Comput Theory Eng 7(1):16CrossRef
go back to reference Abdulhafedh A (2021) Incorporating K-means, hierarchical clustering and PCA in customer segmentation. J City Dev 3(1):12–30 Abdulhafedh A (2021) Incorporating K-means, hierarchical clustering and PCA in customer segmentation. J City Dev 3(1):12–30
go back to reference Agaoglu M (2016) Predicting instructor performance using data mining techniques in higher education. IEEE Access 4:2379–2387CrossRef Agaoglu M (2016) Predicting instructor performance using data mining techniques in higher education. IEEE Access 4:2379–2387CrossRef
go back to reference Ahmadi F, Ahmad MS (2013) Data mining in teacher evaluation system using WEKA. Int J Comput Appl 63(10):12–18 Ahmadi F, Ahmad MS (2013) Data mining in teacher evaluation system using WEKA. Int J Comput Appl 63(10):12–18
go back to reference Ahmed AM, Rizaner A, Ulusoy AH (2016) Using data mining to predict instructor performance. Procedia Comput Sci 102:137–142CrossRef Ahmed AM, Rizaner A, Ulusoy AH (2016) Using data mining to predict instructor performance. Procedia Comput Sci 102:137–142CrossRef
go back to reference Anderson LW (2004) Increasing teacher effectiveness. International publication institute for education planning assessment of teacher effectiveness of human resources. UNESCO 41(4):778–820 Anderson LW (2004) Increasing teacher effectiveness. International publication institute for education planning assessment of teacher effectiveness of human resources. UNESCO 41(4):778–820
go back to reference Asanbe M, Osofisan A, William W (2016) Teachers’ performance evaluation in the higher educational institution using data mining technique. Int J Appl Inf Syst (IJAIS) 10:10–15 Asanbe M, Osofisan A, William W (2016) Teachers’ performance evaluation in the higher educational institution using data mining technique. Int J Appl Inf Syst (IJAIS) 10:10–15
go back to reference Bergmann P, Fauser M, Sattlegger D, Steger C (2020) Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings. In: Paper presented at the proceedings of the IEEE/CVF conference on computer vision and pattern recognition 4183–4192 Bergmann P, Fauser M, Sattlegger D, Steger C (2020) Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings. In: Paper presented at the proceedings of the IEEE/CVF conference on computer vision and pattern recognition 4183–4192
go back to reference Block E, Crochet F, Jones L, Papa T (2012) The importance of teacher’s effectiveness. Creat Educ 3(06):1164CrossRef Block E, Crochet F, Jones L, Papa T (2012) The importance of teacher’s effectiveness. Creat Educ 3(06):1164CrossRef
go back to reference Brna P (1999) Artificial intelligence in educational software: has its time come? Br J Educ Technol 30(1):79–81CrossRef Brna P (1999) Artificial intelligence in educational software: has its time come? Br J Educ Technol 30(1):79–81CrossRef
go back to reference Cheng X, Sun J, Zarifis A (2020) Artificial intelligence and deep learning in educational technology research and practice. Br J Educ Technol 51(5):1653–1656CrossRef Cheng X, Sun J, Zarifis A (2020) Artificial intelligence and deep learning in educational technology research and practice. Br J Educ Technol 51(5):1653–1656CrossRef
go back to reference Deb AB, Dey L (2017) Outlier detection and removal algorithm in K-means and hierarchical clustering. World J Comput Appl Technol 5(2):24–29CrossRef Deb AB, Dey L (2017) Outlier detection and removal algorithm in K-means and hierarchical clustering. World J Comput Appl Technol 5(2):24–29CrossRef
go back to reference Doan S, Schweig JD, Mihaly K (2019) The consistency of composite ratings of teacher effectiveness: evidence from New Mexico. Am Educ Res J 56(6):2116–2146CrossRef Doan S, Schweig JD, Mihaly K (2019) The consistency of composite ratings of teacher effectiveness: evidence from New Mexico. Am Educ Res J 56(6):2116–2146CrossRef
go back to reference Fahd K, Miah SJ, Ahmed K, Venkatraman S, Miao Y (2021) Integrating design science research and design based research frameworks for developing education support systems. Educ Inf Technol 26:4027–4048CrossRef Fahd K, Miah SJ, Ahmed K, Venkatraman S, Miao Y (2021) Integrating design science research and design based research frameworks for developing education support systems. Educ Inf Technol 26:4027–4048CrossRef
go back to reference Fahd K, Venkatraman S, Miah SJ, Ahmed K (2022) Application of machine learning in higher education to assess student academic performance, at-risk, and attrition: A meta-analysis of literature. Educ Inf Technol 27(1):1–33 Fahd K, Venkatraman S, Miah SJ, Ahmed K (2022) Application of machine learning in higher education to assess student academic performance, at-risk, and attrition: A meta-analysis of literature. Educ Inf Technol 27(1):1–33
go back to reference Goldhaber D, Anthony E (2007) Can teacher quality be effectively assessed? national board certification as a signal of effective teaching. Rev Econ Stat 89(1):134–150CrossRef Goldhaber D, Anthony E (2007) Can teacher quality be effectively assessed? national board certification as a signal of effective teaching. Rev Econ Stat 89(1):134–150CrossRef
go back to reference Gregor S, Hevner AR (2013) Positioning and presenting design science research for maximum impact. MIS Q 37(2):337–355CrossRef Gregor S, Hevner AR (2013) Positioning and presenting design science research for maximum impact. MIS Q 37(2):337–355CrossRef
go back to reference Heck RH (2009) Teacher effectiveness and student achievement: investigating a multilevel cross-classified model. J Educ Adm 47(2):227–249CrossRef Heck RH (2009) Teacher effectiveness and student achievement: investigating a multilevel cross-classified model. J Educ Adm 47(2):227–249CrossRef
go back to reference Hemaid RK, El-Halees AM (2015) Improving teacher performance using data mining. Int J Adv Res Comput Commun Eng 4(2):407–412CrossRef Hemaid RK, El-Halees AM (2015) Improving teacher performance using data mining. Int J Adv Res Comput Commun Eng 4(2):407–412CrossRef
go back to reference Hershberg T, Simon VA, Lea-Kruger B (2004) The revelations of value-added: an assessment model that measures student growth in ways that NCLB fails to do. Sch Adm 61(11):10 Hershberg T, Simon VA, Lea-Kruger B (2004) The revelations of value-added: an assessment model that measures student growth in ways that NCLB fails to do. Sch Adm 61(11):10
go back to reference Hevner AR (2007) A three cycle view of design science research. Scand J Inf Syst 19(2):4 Hevner AR (2007) A three cycle view of design science research. Scand J Inf Syst 19(2):4
go back to reference Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105CrossRef Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105CrossRef
go back to reference Irshadullah FKHM (2018) A review of the effect of education and good trained teachers on students’ performance. Humanit Soc Sci 25:93–99 Irshadullah FKHM (2018) A review of the effect of education and good trained teachers on students’ performance. Humanit Soc Sci 25:93–99
go back to reference Järvelä S, Gašević D, Seppänen T, Pechenizkiy M, Kirschner PA (2020) Bridging learning sciences, machine learning and affective computing for understanding cognition and affect in collaborative learning. Br J Educ Technol 51(6):2391–2406CrossRef Järvelä S, Gašević D, Seppänen T, Pechenizkiy M, Kirschner PA (2020) Bridging learning sciences, machine learning and affective computing for understanding cognition and affect in collaborative learning. Br J Educ Technol 51(6):2391–2406CrossRef
go back to reference Järvinen P (2007) Action research is similar to design science. Qual Quant 41:37–54CrossRef Järvinen P (2007) Action research is similar to design science. Qual Quant 41:37–54CrossRef
go back to reference Kane TJ, McCaffrey DF, Miller T, Staiger DO (2013) Have we identified effective teachers? validating measures of effective teaching using random assignment. In: Paper presented at the research paper. MET Project. Bill & Melinda Gates Foundation Kane TJ, McCaffrey DF, Miller T, Staiger DO (2013) Have we identified effective teachers? validating measures of effective teaching using random assignment. In: Paper presented at the research paper. MET Project. Bill & Melinda Gates Foundation
go back to reference Kumar S (2017) A modern data mining method for assessment of teaching assistant in higher educational institutions. Int J Comput Sci Inf Technol 8(3):424–429 Kumar S (2017) A modern data mining method for assessment of teaching assistant in higher educational institutions. Int J Comput Sci Inf Technol 8(3):424–429
go back to reference Lupascu AR, Pânisoară G, Pânisoară I-O (2014) Characteristics of effective teacher. Procedia Soc Behav Sci 127:534–538CrossRef Lupascu AR, Pânisoară G, Pânisoară I-O (2014) Characteristics of effective teacher. Procedia Soc Behav Sci 127:534–538CrossRef
go back to reference Mardikyan S, Badur B (2011) Analyzing teaching performance of instructors using data mining techniques. Inform Educ 10(2):245–257CrossRef Mardikyan S, Badur B (2011) Analyzing teaching performance of instructors using data mining techniques. Inform Educ 10(2):245–257CrossRef
go back to reference Miah SJ (2009) End user as application developer for decision support. In: Proceedings of the American conference on information systems, (AMCIS 2009), Sun Francesco, USA, 142 Miah SJ (2009) End user as application developer for decision support. In: Proceedings of the American conference on information systems, (AMCIS 2009), Sun Francesco, USA, 142
go back to reference Miah SJ, McGrath GM, Kerr D (2016) Design science research for decision support systems development: recent publication trends in the premier IS journals. Australas J Inf Syst 20:1–14 Miah SJ, McGrath GM, Kerr D (2016) Design science research for decision support systems development: recent publication trends in the premier IS journals. Australas J Inf Syst 20:1–14
go back to reference Niemi H, Tirri K (1996) Effectiveness of teacher education. New challenges and approaches to evaluation. Reports from the Department of Teacher Education in Tampere University. ERIC Niemi H, Tirri K (1996) Effectiveness of teacher education. New challenges and approaches to evaluation. Reports from the Department of Teacher Education in Tampere University. ERIC
go back to reference Ogor EN (2007) Student academic performance monitoring and evaluation using data mining techniques. In: Paper presented at the electronics, robotics and automotive mechanics conference (CERMA 2007) Ogor EN (2007) Student academic performance monitoring and evaluation using data mining techniques. In: Paper presented at the electronics, robotics and automotive mechanics conference (CERMA 2007)
go back to reference Ola A, Pallaniappan S (2013) A data mining model for evaluation of instructors’ performance in higher institutions of learning using machine learning algorithms. Int J Concep Comput Inf Technol 1(1):17–22 Ola A, Pallaniappan S (2013) A data mining model for evaluation of instructors’ performance in higher institutions of learning using machine learning algorithms. Int J Concep Comput Inf Technol 1(1):17–22
go back to reference Onafowora LL (2005) Teacher efficacy issues in the practice of novice teachers. Educ Res Q 28(4):34–43 Onafowora LL (2005) Teacher efficacy issues in the practice of novice teachers. Educ Res Q 28(4):34–43
go back to reference Orozco W, Rodríguez-García MÁ, Fernández A (2019) Teaching effectiveness: an innovative evaluation model. In: International workshop on learning technology for education in cloud. Springer International Publishing, Cham, pp 450–461 Orozco W, Rodríguez-García MÁ, Fernández A (2019) Teaching effectiveness: an innovative evaluation model. In: International workshop on learning technology for education in cloud. Springer International Publishing, Cham, pp 450–461
go back to reference Pal AK, Pal S (2013) Evaluation of teacher’s performance: a data mining approach. Int J Comput Sci Mob Comput 2(12):359–369 Pal AK, Pal S (2013) Evaluation of teacher’s performance: a data mining approach. Int J Comput Sci Mob Comput 2(12):359–369
go back to reference Papamitsiou ZK, Economides AA (2014) Learning analytics and educational data mining in practice: a systematic literature review of empirical evidence. J Educ Technol Soc 17(4):49–64 Papamitsiou ZK, Economides AA (2014) Learning analytics and educational data mining in practice: a systematic literature review of empirical evidence. J Educ Technol Soc 17(4):49–64
go back to reference Parihar R (2011) Concept of Teacher Effectiveness. New Dehli: Jaypee Brother Publications Policy Implications. USA: University of Missouri-Columbia Parihar R (2011) Concept of Teacher Effectiveness. New Dehli: Jaypee Brother Publications Policy Implications. USA: University of Missouri-Columbia
go back to reference Peffers K, Tuunanen T, Rothenberger MA, Chatterjee S (2007) A design science research methodology for information systems research. J Manag Inf Syst 24(3):45–77CrossRef Peffers K, Tuunanen T, Rothenberger MA, Chatterjee S (2007) A design science research methodology for information systems research. J Manag Inf Syst 24(3):45–77CrossRef
go back to reference Sanders WL (2000) Value-added assessment from student achievement data: opportunities and hurdles CREATE NATIONAL EVALUATION INSTITUTE July 21, 2000. J Pers Eval Educ 14(4):329–339CrossRef Sanders WL (2000) Value-added assessment from student achievement data: opportunities and hurdles CREATE NATIONAL EVALUATION INSTITUTE July 21, 2000. J Pers Eval Educ 14(4):329–339CrossRef
go back to reference Shinkfield AJ, Stufflebeam DL (2012) Teacher evaluation: Guide to effective practice (Vol. 41). Springer, Berlin Shinkfield AJ, Stufflebeam DL (2012) Teacher evaluation: Guide to effective practice (Vol. 41). Springer, Berlin
go back to reference Skourdoumbis A (2014) Teacher effectiveness: making the difference to student achievement? Br J Educ Stud 62(2):111–126CrossRef Skourdoumbis A (2014) Teacher effectiveness: making the difference to student achievement? Br J Educ Stud 62(2):111–126CrossRef
go back to reference Tschannen-Moran M, Hoy AW (2001) Teacher efficacy: capturing an elusive construct. Teach Teach Educ 17(7):783–805CrossRef Tschannen-Moran M, Hoy AW (2001) Teacher efficacy: capturing an elusive construct. Teach Teach Educ 17(7):783–805CrossRef
go back to reference Vaishnavi VK (2007) Design science research methods and patterns: innovating information and communication technology. Auerbach Publications, New YorkCrossRef Vaishnavi VK (2007) Design science research methods and patterns: innovating information and communication technology. Auerbach Publications, New YorkCrossRef
go back to reference Vaishnavi VK, Kuechler W (2007) Introduction to design science research in information and communication technology. In: Vaishnavi VK, Vaishnavi VK, Kuechler W (eds) Design science research methods and patterns: innovating information and communication technology. Taylor & Francis Group, United KingdomCrossRef Vaishnavi VK, Kuechler W (2007) Introduction to design science research in information and communication technology. In: Vaishnavi VK, Vaishnavi VK, Kuechler W (eds) Design science research methods and patterns: innovating information and communication technology. Taylor & Francis Group, United KingdomCrossRef
go back to reference Vijayalakshmi V, Panimalar K, Janarthanan S (2020) Predicting the performance of instructors using Machine-learning algorithms. High Technol Lett 26(12):694–705 Vijayalakshmi V, Panimalar K, Janarthanan S (2020) Predicting the performance of instructors using Machine-learning algorithms. High Technol Lett 26(12):694–705
go back to reference Williams K, Hebert D (2020) Teacher evaluation systems: a literature review on issues and impact. Res Issues Contemp Educ 5(1):42–50 Williams K, Hebert D (2020) Teacher evaluation systems: a literature review on issues and impact. Res Issues Contemp Educ 5(1):42–50
go back to reference Yadav SK, Bharadwaj B, Pal S (2012). Mining education data to predict student’s retention: a comparative study. arXiv:1203.2987 Yadav SK, Bharadwaj B, Pal S (2012). Mining education data to predict student’s retention: a comparative study. arXiv:​1203.​2987
go back to reference Zakaria I, Nor MYBM, Alias B (2021) The effect of teachers’ professionalism on students’ success. Int J Acad Res Bus Soc Sci 11(1):483–500 Zakaria I, Nor MYBM, Alias B (2021) The effect of teachers’ professionalism on students’ success. Int J Acad Res Bus Soc Sci 11(1):483–500
go back to reference Zhou H, Lu J, Huang Y, Chen Y (2021) Research on key technology of classroom teaching evaluation based on artificial intelligence. In Journal of Physics: Conference series (Vol. 1757, No. 1, p. 012014). IOP publishing Zhou H, Lu J, Huang Y, Chen Y (2021) Research on key technology of classroom teaching evaluation based on artificial intelligence. In Journal of Physics: Conference series (Vol. 1757, No. 1, p. 012014). IOP publishing
Metadata
Title
Evaluating teachers’ effectiveness in classrooms: an ML-based assessment portfolio
Authors
Renu Sabharwal
Shah J. Miah
Publication date
01-12-2024
Publisher
Springer Vienna
Published in
Social Network Analysis and Mining / Issue 1/2024
Print ISSN: 1869-5450
Electronic ISSN: 1869-5469
DOI
https://doi.org/10.1007/s13278-023-01195-5

Other articles of this Issue 1/2024

Social Network Analysis and Mining 1/2024 Go to the issue

Premium Partner