Skip to main content
Top
Published in:
Cover of the book

2021 | OriginalPaper | Chapter

A Multi-layered Approach for Tailored Black-Box Explanations

Authors : Clément Henin, Daniel Le Métayer

Published in: Pattern Recognition. ICPR International Workshops and Challenges

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Explanations for algorithmic decision systems can take different forms, they can target different types of users with different goals. One of the main challenges in this area is therefore to devise explanation methods that can accommodate this variety of situations. A first step to address this challenge is to allow explainees to express their needs in the most convenient way, depending on their level of expertise and motivation. In this paper, we present a solution to this problem based on a multi-layered approach allowing users to express their requests for explanations at different levels of abstraction. We illustrate the approach with the application of a proof-of-concept system called IBEX to two case studies.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
With the associated learning data set, if available.
 
2
Other taxonomies of explainees’ profiles have already been proposed, in particular in [4] and [5]. Our contribution is consistent with them, but involves some simplifications, justified by pragmatic needs.
 
3
In addition to the ADS, as defined in the context.
 
4
In the current version of IBEX, threshold \(T_1\) is set to 10 and \(T_2\) is set to 50.
 
Literature
1.
go back to reference Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 1–42 (2018). Article no. 93 Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 1–42 (2018). Article no. 93
2.
go back to reference Miller, T., Howe, P., Sonenberg, L.: Explainable AI: beware of inmates running the asylum. In: IJCAI 2017 Workshop on Explainable AI (XAI), vol. 36 (2017) Miller, T., Howe, P., Sonenberg, L.: Explainable AI: beware of inmates running the asylum. In: IJCAI 2017 Workshop on Explainable AI (XAI), vol. 36 (2017)
4.
go back to reference Tomsett, R., Braines, D., Harborne, D., Preece, A.D., Chakraborty, S.: Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. CoRR abs/1806.07552 (2018) Tomsett, R., Braines, D., Harborne, D., Preece, A.D., Chakraborty, S.: Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. CoRR abs/1806.07552 (2018)
5.
go back to reference Arrieta, A.B., et al.: Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. arXiv:1910.10045 [cs]arXiv: 1910.10045 Arrieta, A.B., et al.: Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. arXiv:​1910.​10045 [cs]arXiv: 1910.10045
9.
go back to reference Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harvard J. Law Technol. 31, 841–887 (2018) Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harvard J. Law Technol. 31, 841–887 (2018)
10.
go back to reference Stumpf, S., et al.: Toward harnessing user feedback for machine learning 10 (2007) Stumpf, S., et al.: Toward harnessing user feedback for machine learning 10 (2007)
11.
go back to reference Lim, B.Y., Dey, A.K., Avrahami, D.: Why and why not explanations improve the intelligibility of context-aware intelligent systems. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 2009, p. 2119. ACM Press (2009). https://doi.org/10.1145/1518701.1519023 Lim, B.Y., Dey, A.K., Avrahami, D.: Why and why not explanations improve the intelligibility of context-aware intelligent systems. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 2009, p. 2119. ACM Press (2009). https://​doi.​org/​10.​1145/​1518701.​1519023
12.
go back to reference Lakkaraju, H., Kamar, E., Caruana, R., Leskovec, J.: Interpretable & explorable approximations of black box models. arXiv preprint arXiv:1707.01154 Lakkaraju, H., Kamar, E., Caruana, R., Leskovec, J.: Interpretable & explorable approximations of black box models. arXiv preprint arXiv:​1707.​01154
13.
go back to reference Ribeiro, M.T., Singh, S., Guestrin, C.: Anchors: high-precision model-agnostic explanations. In: AAAI Conference on Artificial Intelligence (2018) Ribeiro, M.T., Singh, S., Guestrin, C.: Anchors: high-precision model-agnostic explanations. In: AAAI Conference on Artificial Intelligence (2018)
14.
go back to reference Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., Detyniecki, M.: The dangers of post-hoc interpretability: unjustified counterfactual explanations. arXiv:1907.09294 [cs, stat]arXiv: 1907.09294 Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., Detyniecki, M.: The dangers of post-hoc interpretability: unjustified counterfactual explanations. arXiv:​1907.​09294 [cs, stat]arXiv: 1907.09294
16.
17.
go back to reference Henin, C., Le Métayer, D.: A generic framework for black-box explanations. In: Proceedings of the International Workshop on Fair and Interpretable Learning Algorithms (FILA 2020). IEEE (2020) Henin, C., Le Métayer, D.: A generic framework for black-box explanations. In: Proceedings of the International Workshop on Fair and Interpretable Learning Algorithms (FILA 2020). IEEE (2020)
21.
go back to reference Poursabzi-Sangdeh, F., Goldstein, D.G., Hofman, J.M., Vaughan, J.W., Wallach, H.: Manipulating and measuring model interpretability. arXiv:1802.07810 [cs]arXiv: 1802.07810 Poursabzi-Sangdeh, F., Goldstein, D.G., Hofman, J.M., Vaughan, J.W., Wallach, H.: Manipulating and measuring model interpretability. arXiv:​1802.​07810 [cs]arXiv: 1802.07810
22.
go back to reference Hall, M., et al.: A systematic method to understand requirements for explainable AI (XAI) systems 7 (2019) Hall, M., et al.: A systematic method to understand requirements for explainable AI (XAI) systems 7 (2019)
23.
go back to reference Arya, V., et al.: One explanation does not fit all: a toolkit and taxonomy of AI explainability techniques. arXiv:1909.03012 [cs, stat]arXiv: 1909.03012 Arya, V., et al.: One explanation does not fit all: a toolkit and taxonomy of AI explainability techniques. arXiv:​1909.​03012 [cs, stat]arXiv: 1909.03012
26.
go back to reference Madumal, P., Miller, T., Sonenberg, L., Vetere, F.: A grounded interaction protocol for explainable artificial intelligence. arXiv:1903.02409 [cs]arXiv: 1903.02409 Madumal, P., Miller, T., Sonenberg, L., Vetere, F.: A grounded interaction protocol for explainable artificial intelligence. arXiv:​1903.​02409 [cs]arXiv: 1903.02409
27.
go back to reference Nori, H., Jenkins, S., Koch, P., Caruana, R.: InterpretML: a unified framework for machine learning interpretability. arXiv preprint arXiv:1909.09223 Nori, H., Jenkins, S., Koch, P., Caruana, R.: InterpretML: a unified framework for machine learning interpretability. arXiv preprint arXiv:​1909.​09223
28.
go back to reference Klaise, J., Van Looveren, A., Vacanti, G., Coca, A.: Alibi: Algorithms for monitoring and explaining machine learning models (2020) Klaise, J., Van Looveren, A., Vacanti, G., Coca, A.: Alibi: Algorithms for monitoring and explaining machine learning models (2020)
29.
go back to reference Biecek, P.: DALEX: explainers for complex predictive models in R. J. Mach. Learn. Res. 19(84), 1–5 (2018)MATH Biecek, P.: DALEX: explainers for complex predictive models in R. J. Mach. Learn. Res. 19(84), 1–5 (2018)MATH
30.
go back to reference Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?” Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016) Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?” Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)
31.
go back to reference Dhurandhar, A., Iyengar, V., Luss, R., Shanmugam, K.: A formal framework to characterize interpretability of procedures. arXiv:1707.03886 [cs]arXiv: 1707.03886 Dhurandhar, A., Iyengar, V., Luss, R., Shanmugam, K.: A formal framework to characterize interpretability of procedures. arXiv:​1707.​03886 [cs]arXiv: 1707.03886
Metadata
Title
A Multi-layered Approach for Tailored Black-Box Explanations
Authors
Clément Henin
Daniel Le Métayer
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-68796-0_1

Premium Partner