Skip to main content

2018 | OriginalPaper | Buchkapitel

Investigating Textual Case-Based XAI

verfasst von : Rosina O. Weber, Adam J. Johs, Jianfei Li, Kent Huang

Erschienen in: Case-Based Reasoning Research and Development

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper demonstrates how case-based reasoning (CBR) can be used for an explainable artificial intelligence (XAI) approach to justify solutions produced by an opaque learning method (i.e., target method), particularly in the context of unstructured textual data. Our general hypothesis is twofold: (1) There exists patterns in the relationship between problems and solutions and there should be data or a body of knowledge that describes how problems and solutions relate; and (2) the identification, manipulation, and learning of such patterns through case features can help create and reuse explanations for solutions produced by the target method. When the target method relies on neural network architectures (e.g., deep learning), the resulting latent space (i.e., word embeddings) becomes useful for finding patterns and semantic relatedness in textual data. In the proposed approach, case problems are input-output pairs from the target method, and case solutions are explanations. We exemplify our approach by explaining recommended citations from Citeomatic - a multi-layer neural-network architecture from the Allen Institute for Artificial Intelligence. Citation analysis is the body of knowledge that describes how query documents (i.e., inputs) relate to recommended citations (i.e., outputs). We build cases and similarity assessment to learn features that represent patterns between problems and solutions that can lead to the reuse of corresponding explanations. The illustrative implementation we present becomes an explanation-augmented citation recommender that targets human-computer trust.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sørmo, F., Cassens, J., Aamodt, A.: Explanation in case-based reasoning: perspectives and goals. Artif. Intell. Rev. 24(2), 109–143 (2005)CrossRef Sørmo, F., Cassens, J., Aamodt, A.: Explanation in case-based reasoning: perspectives and goals. Artif. Intell. Rev. 24(2), 109–143 (2005)CrossRef
2.
Zurück zum Zitat Nugent, C., Cunningham, P.: A case-based explanation system for black-box systems. Artif. Intell. Rev. 24(2), 163–178 (2005)CrossRef Nugent, C., Cunningham, P.: A case-based explanation system for black-box systems. Artif. Intell. Rev. 24(2), 163–178 (2005)CrossRef
3.
Zurück zum Zitat Weber, R.O., Ashley, K.D., Brüninghaus, S.: Textual case-based reasoning. Knowl. Eng. Rev. 20(3), 255–260 (2005)CrossRef Weber, R.O., Ashley, K.D., Brüninghaus, S.: Textual case-based reasoning. Knowl. Eng. Rev. 20(3), 255–260 (2005)CrossRef
4.
Zurück zum Zitat Biran, O., Cotton, C.: Explanation and justification in machine learning: a survey. In: Aha, D.W., Darrell, T., Pazzani, M., Reid, D., Sammut, C., Stone, P. (eds.) Explainable AI: Papers from the IJCAI Workshop, pp. 8–13. Melbourne, Australia (2017) Biran, O., Cotton, C.: Explanation and justification in machine learning: a survey. In: Aha, D.W., Darrell, T., Pazzani, M., Reid, D., Sammut, C., Stone, P. (eds.) Explainable AI: Papers from the IJCAI Workshop, pp. 8–13. Melbourne, Australia (2017)
6.
Zurück zum Zitat Leake, D.B.: Evaluating explanations: a content theory. Lawrence Erlbaum Associates (1992). Reprint Psychology Press, New York (2014) Leake, D.B.: Evaluating explanations: a content theory. Lawrence Erlbaum Associates (1992). Reprint Psychology Press, New York (2014)
7.
Zurück zum Zitat Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013) Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
9.
Zurück zum Zitat Xiong, C., Power, R., Callan, J.: Explicit semantic ranking for academic search via knowledge graph embedding. In: Proceedings of the 26th International Conference on World Wide Web, pp. 1271–1279. ACM (2017) Xiong, C., Power, R., Callan, J.: Explicit semantic ranking for academic search via knowledge graph embedding. In: Proceedings of the 26th International Conference on World Wide Web, pp. 1271–1279. ACM (2017)
10.
Zurück zum Zitat Nanba, H., Okumura, M.: Towards multi-paper summarization using reference information. In: Sixteenth International Joint Conference on Artificial Intelligence, pp. 926–931 (1999)CrossRef Nanba, H., Okumura, M.: Towards multi-paper summarization using reference information. In: Sixteenth International Joint Conference on Artificial Intelligence, pp. 926–931 (1999)CrossRef
11.
Zurück zum Zitat Qazvinian, V., et al.: Generating extractive summaries of scientific paradigms. J. Artif. Intell. Res. 46, 165–201 (2013)MathSciNetCrossRef Qazvinian, V., et al.: Generating extractive summaries of scientific paradigms. J. Artif. Intell. Res. 46, 165–201 (2013)MathSciNetCrossRef
12.
Zurück zum Zitat Tsafnat, G., Dunn, A., Glasziou, P., Coiera, E.: The automation of systematic reviews. BMJ 346, f139 (2013)CrossRef Tsafnat, G., Dunn, A., Glasziou, P., Coiera, E.: The automation of systematic reviews. BMJ 346, f139 (2013)CrossRef
13.
Zurück zum Zitat Garfield, E.: Citation indexes for science. Science 122, 108–111 (1955)CrossRef Garfield, E.: Citation indexes for science. Science 122, 108–111 (1955)CrossRef
14.
Zurück zum Zitat Small, H.: Co-citation in scientific literature-new measure of relationship between 2 documents. J. Am. Soc. Inf. Sci. 24(4), 265–269 (1973)CrossRef Small, H.: Co-citation in scientific literature-new measure of relationship between 2 documents. J. Am. Soc. Inf. Sci. 24(4), 265–269 (1973)CrossRef
15.
Zurück zum Zitat Ding, Y., Zhang, G., Chambers, T., Song, M., Wang, X., Zhai, C.: Content-based citation analysis. The next generation of citation analysis. J. Assoc. Inf. Sci. Technol. 65(9), 1820–1833 (2014)CrossRef Ding, Y., Zhang, G., Chambers, T., Song, M., Wang, X., Zhai, C.: Content-based citation analysis. The next generation of citation analysis. J. Assoc. Inf. Sci. Technol. 65(9), 1820–1833 (2014)CrossRef
16.
Zurück zum Zitat Huang, W., Wu, Z., Chen, L., Mitra, P., Giles, C.L.: A neural probabilistic model for context based citation recommendation. In: AAAI, pp. 2404–2410. AAAI (2015) Huang, W., Wu, Z., Chen, L., Mitra, P., Giles, C.L.: A neural probabilistic model for context based citation recommendation. In: AAAI, pp. 2404–2410. AAAI (2015)
17.
Zurück zum Zitat Valenzuela, M., Ha, V., Etzioni, O.: Identifying meaningful citations. In: AAAI Workshop: Scholarly Big Data (2015) Valenzuela, M., Ha, V., Etzioni, O.: Identifying meaningful citations. In: AAAI Workshop: Scholarly Big Data (2015)
18.
Zurück zum Zitat Blake, C.: Beyond genes, proteins, and abstracts: Identifying scientific claims from full-text biomedical articles. J. Biomed. Inf. 43(2), 173–189 (2010)CrossRef Blake, C.: Beyond genes, proteins, and abstracts: Identifying scientific claims from full-text biomedical articles. J. Biomed. Inf. 43(2), 173–189 (2010)CrossRef
19.
Zurück zum Zitat Radev, D.R., Muthukrishnan, P., Qazvinian, V., Abu-Jbara, A.: The ACL anthology network corpus. Lang. Resour. Eval. 47(4), 919–944 (2013)CrossRef Radev, D.R., Muthukrishnan, P., Qazvinian, V., Abu-Jbara, A.: The ACL anthology network corpus. Lang. Resour. Eval. 47(4), 919–944 (2013)CrossRef
21.
Zurück zum Zitat Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188–1196 (2014) Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188–1196 (2014)
22.
Zurück zum Zitat Kusner, M., Sun, Y., Kolkin, N., Weinberger, K.: From word embeddings to document distances. In: International Conference on Machine Learning, pp. 957–966 (2015) Kusner, M., Sun, Y., Kolkin, N., Weinberger, K.: From word embeddings to document distances. In: International Conference on Machine Learning, pp. 957–966 (2015)
23.
Zurück zum Zitat Schank, R.C.: Explanation Patterns– Understanding Mechanically and Creatively. Lawrence Erlbaum, New York (1986) Schank, R.C.: Explanation Patterns– Understanding Mechanically and Creatively. Lawrence Erlbaum, New York (1986)
24.
Zurück zum Zitat Schank, R.C., Leake, D.: Creativity and learning in a case-based explainer. Artif. Intell. 40(1–3), 353–385 (1989)CrossRef Schank, R.C., Leake, D.: Creativity and learning in a case-based explainer. Artif. Intell. 40(1–3), 353–385 (1989)CrossRef
26.
Zurück zum Zitat Kofod-Petersen, A., Cassens, J., Aamodt, A.: Explanatory capabilities in the CREEK knowledge-intensive case-based reasoner. Front. Artif. Intell. Appl. 173, 28–35 (2008) Kofod-Petersen, A., Cassens, J., Aamodt, A.: Explanatory capabilities in the CREEK knowledge-intensive case-based reasoner. Front. Artif. Intell. Appl. 173, 28–35 (2008)
28.
Zurück zum Zitat Kindermans, P-J, et al.: The (un)reliability of saliency methods. In: 31st Conference on Neural Information Processing Systems (NIPS) (2017) Kindermans, P-J, et al.: The (un)reliability of saliency methods. In: 31st Conference on Neural Information Processing Systems (NIPS) (2017)
29.
Zurück zum Zitat Wilson, D.C., Bradshaw, S.: CBR Textuality. Expert. Updat. 3(1), 28–37 (2000) Wilson, D.C., Bradshaw, S.: CBR Textuality. Expert. Updat. 3(1), 28–37 (2000)
31.
Zurück zum Zitat Dumais, S.T., Furnas, G.W., Landauer, T.K., Deerwester, S., Harshman, R.: Using latent semantic analysis to improve access to textual information. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 281–285. ACM (1988) Dumais, S.T., Furnas, G.W., Landauer, T.K., Deerwester, S., Harshman, R.: Using latent semantic analysis to improve access to textual information. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 281–285. ACM (1988)
Metadaten
Titel
Investigating Textual Case-Based XAI
verfasst von
Rosina O. Weber
Adam J. Johs
Jianfei Li
Kent Huang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01081-2_29