Skip to main content
Top

2024 | OriginalPaper | Chapter

A Causality-Based Interpretable Cognitive Diagnosis Model

Authors : Jinwei Zhou, Zhengyang Wu, Changzhe Yuan, Lizhang Zeng

Published in: Neural Information Processing

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Cognitive diagnosis model (abbr.CDM) aims to assess students’ cognitive processes during learning, enabling personalized support based on their needs. Nevertheless, deep learning-based CDMs are inherently opaque, posing challenges in providing psychological insights into the reasoning behind predicted outcomes. We address this by creating three interpretable parameters: skill mastery, exercise difficulty, and exercise discrimination. Inspired by Bayesian networks and neural networks, we use feature engineering for extraction of interpretable parameters and tree-enhanced naive Bayes classifiers for prediction. Our method balances interpretability and accuracy. Experimentally, we compare our approach to traditional and advanced models on four datasets, analyzing each feature’s impact. We conduct ablation studies on each feature to examine their contribution to student performance prediction. Thus, causality-based interpretable cognitive diagnosis model (CBICDM) has great potential for providing adaptive and personalized instructions with causal reasoning in real-world educational systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abdelrahman, G., Wang, Q., Nunes, B.P.: Knowledge tracing: a survey. ACM Comput. Surv. 55(11), 224:1–224:37 (2023) Abdelrahman, G., Wang, Q., Nunes, B.P.: Knowledge tracing: a survey. ACM Comput. Surv. 55(11), 224:1–224:37 (2023)
2.
go back to reference Agarwal, N., Das, S.: Interpretable machine learning tools: a survey. In: 2020 IEEE Symposium Series on Computational Intelligence, SSCI 2020, Canberra, Australia, 1–4 December 2020, pp. 1528–1534. IEEE (2020) Agarwal, N., Das, S.: Interpretable machine learning tools: a survey. In: 2020 IEEE Symposium Series on Computational Intelligence, SSCI 2020, Canberra, Australia, 1–4 December 2020, pp. 1528–1534. IEEE (2020)
3.
go back to reference Chen, V., Li, J., Kim, J.S., Plumb, G., Talwalkar, A.: Interpretable machine learning: moving from mythos to diagnostics. Commun. ACM 65(8), 43–50 (2022)CrossRef Chen, V., Li, J., Kim, J.S., Plumb, G., Talwalkar, A.: Interpretable machine learning: moving from mythos to diagnostics. Commun. ACM 65(8), 43–50 (2022)CrossRef
4.
go back to reference De La Torre, J.: Dina model and parameter estimation: a didactic. J. Educ. Behav. Stat. 34(1), 115–130 (2009)CrossRef De La Torre, J.: Dina model and parameter estimation: a didactic. J. Educ. Behav. Stat. 34(1), 115–130 (2009)CrossRef
5.
go back to reference Embretson, S.E., Reise, S.P.: Item Response Theory. Psychology Press, London (2013)CrossRef Embretson, S.E., Reise, S.P.: Item Response Theory. Psychology Press, London (2013)CrossRef
6.
go back to reference Fouss, F., Pirotte, A., Renders, J.M., Saerens, M.: Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19(3), 355–369 (2007)CrossRef Fouss, F., Pirotte, A., Renders, J.M., Saerens, M.: Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19(3), 355–369 (2007)CrossRef
7.
go back to reference Gallager, R.G., Humblet, P.A., Spira, P.M.: A distributed algorithm for minimum-weight spanning trees. ACM Trans. Program. Lang. Syst. (TOPLAS) 5(1), 66–77 (1983)CrossRefMATH Gallager, R.G., Humblet, P.A., Spira, P.M.: A distributed algorithm for minimum-weight spanning trees. ACM Trans. Program. Lang. Syst. (TOPLAS) 5(1), 66–77 (1983)CrossRefMATH
8.
go back to reference Gao, L., Zhao, Z., Li, C., Zhao, J., Zeng, Q.: Deep cognitive diagnosis model for predicting students’ performance. Futur. Gener. Comput. Syst. 126, 252–262 (2022)CrossRef Gao, L., Zhao, Z., Li, C., Zhao, J., Zeng, Q.: Deep cognitive diagnosis model for predicting students’ performance. Futur. Gener. Comput. Syst. 126, 252–262 (2022)CrossRef
9.
go back to reference Kotak, P., Modi, H.: Enhancing the data mining tool WEKA. In: 5th International Conference on Computing, Communication and Security, ICCCS 2020, Patna, India, 14–16 October 2020, pp. 1–6. IEEE (2020) Kotak, P., Modi, H.: Enhancing the data mining tool WEKA. In: 5th International Conference on Computing, Communication and Security, ICCCS 2020, Patna, India, 14–16 October 2020, pp. 1–6. IEEE (2020)
10.
go back to reference Liu, Q., et al.: Fuzzy cognitive diagnosis for modelling examinee performance. ACM Trans. Intell. Syst. Technol. (TIST) 9(4), 1–26 (2018)CrossRef Liu, Q., et al.: Fuzzy cognitive diagnosis for modelling examinee performance. ACM Trans. Intell. Syst. Technol. (TIST) 9(4), 1–26 (2018)CrossRef
11.
go back to reference Mack, D.L., Biswas, G., Koutsoukos, X.D., Mylaraswamy, D.: Using tree augmented Naıve Bayes classifiers to improve engine fault models. In: Uncertainty in Artificial Intelligence: Bayesian Modeling Applications Workshop. Citeseer (2011) Mack, D.L., Biswas, G., Koutsoukos, X.D., Mylaraswamy, D.: Using tree augmented Naıve Bayes classifiers to improve engine fault models. In: Uncertainty in Artificial Intelligence: Bayesian Modeling Applications Workshop. Citeseer (2011)
12.
go back to reference Minn, S., Vie, J.J., Takeuchi, K., Kashima, H., Zhu, F.: Interpretable knowledge tracing: simple and efficient student modeling with causal relations. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 12810–12818 (2022) Minn, S., Vie, J.J., Takeuchi, K., Kashima, H., Zhu, F.: Interpretable knowledge tracing: simple and efficient student modeling with causal relations. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 12810–12818 (2022)
13.
go back to reference Minn, S., Yu, Y., Desmarais, M.C., Zhu, F., Vie, J.J.: Deep knowledge tracing and dynamic student classification for knowledge tracing. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 1182–1187. IEEE (2018) Minn, S., Yu, Y., Desmarais, M.C., Zhu, F., Vie, J.J.: Deep knowledge tracing and dynamic student classification for knowledge tracing. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 1182–1187. IEEE (2018)
14.
go back to reference Piech, C., et al.: Deep knowledge tracing. In: Advances in Neural Information Processing Systems, vol. 28 (2015) Piech, C., et al.: Deep knowledge tracing. In: Advances in Neural Information Processing Systems, vol. 28 (2015)
15.
go back to reference Rabiner, L., Juang, B.: An introduction to hidden Markov models. IEEE ASSP Mag. 3(1), 4–16 (1986)CrossRef Rabiner, L., Juang, B.: An introduction to hidden Markov models. IEEE ASSP Mag. 3(1), 4–16 (1986)CrossRef
16.
go back to reference Su, Y., et al.: Time-and-concept enhanced deep multidimensional item response theory for interpretable knowledge tracing. Knowl. Based Syst. 218, 106819 (2021)CrossRef Su, Y., et al.: Time-and-concept enhanced deep multidimensional item response theory for interpretable knowledge tracing. Knowl. Based Syst. 218, 106819 (2021)CrossRef
17.
go back to reference Wang, F., et al.: Neural cognitive diagnosis for intelligent education systems. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 6153–6161 (2020) Wang, F., et al.: Neural cognitive diagnosis for intelligent education systems. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 6153–6161 (2020)
18.
go back to reference Wang, F., et al.: Neuralcd: a general framework for cognitive diagnosis. IEEE Trans. Knowl. Data Eng. (2022) Wang, F., et al.: Neuralcd: a general framework for cognitive diagnosis. IEEE Trans. Knowl. Data Eng. (2022)
19.
go back to reference Wang, W., Ma, H., Zhao, Y., Li, Z., He, X.: Tracking knowledge proficiency of students with calibrated Q-matrix. Expert Syst. Appl. 192, 116454 (2022)CrossRef Wang, W., Ma, H., Zhao, Y., Li, Z., He, X.: Tracking knowledge proficiency of students with calibrated Q-matrix. Expert Syst. Appl. 192, 116454 (2022)CrossRef
20.
go back to reference Wojtas, M., Chen, K.: Feature importance ranking for deep learning. Adv. Neural. Inf. Process. Syst. 33, 5105–5114 (2020) Wojtas, M., Chen, K.: Feature importance ranking for deep learning. Adv. Neural. Inf. Process. Syst. 33, 5105–5114 (2020)
21.
go back to reference Wu, R., et al.: Cognitive modelling for predicting examinee performance. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015) Wu, R., et al.: Cognitive modelling for predicting examinee performance. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)
22.
go back to reference Yang, H., et al.: A novel quantitative relationship neural network for explainable cognitive diagnosis model. Knowl.-Based Syst. 250, 109156 (2022)CrossRef Yang, H., et al.: A novel quantitative relationship neural network for explainable cognitive diagnosis model. Knowl.-Based Syst. 250, 109156 (2022)CrossRef
23.
go back to reference Zhang, J., Shi, X., King, I., Yeung, D.Y.: Dynamic key-value memory networks for knowledge tracing. In: Proceedings of the 26th International Conference on World Wide Web, pp. 765–774 (2017) Zhang, J., Shi, X., King, I., Yeung, D.Y.: Dynamic key-value memory networks for knowledge tracing. In: Proceedings of the 26th International Conference on World Wide Web, pp. 765–774 (2017)
Metadata
Title
A Causality-Based Interpretable Cognitive Diagnosis Model
Authors
Jinwei Zhou
Zhengyang Wu
Changzhe Yuan
Lizhang Zeng
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-8067-3_16

Premium Partner