Top

Published in:

2020 | OriginalPaper | Chapter

Machine Learning Models Interpretations: User Demands Exploration

Authors : Anna Smirnova, Alena Suvorova

Published in: Digital Transformation and Global Society

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Automated decision making is becoming more and more popular in various domains and demonstrates high performance capabilities. The growing model complexity has limited the opportunities for understanding and justifying the model behaviour. Explainable Artificial Intelligence (XAI) has emerged to make complex models more transparent and provide insights of model behaviour. There are numerous XAI tools for implementing different types of explanations, but the majority of these tools’ outputs are quite complex and can be misused. Therefore, this research aims to make explanations more comprehensible. We plan to review existing approaches to explanation, study user needs for interpretation tools and propose the design of the tool, selecting the appropriate approach and returning explanation in a simple form.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Factors of Temporal Behavior in Online Media: What Shapes Time on Internet?

next chapter Game Experience Evaluation. A Study of Game Reviews on the Steam Platform

Ahmad, M.A., Eckert, C., McKelvey, G., Zolfaghar, K., Zahid, A., Teredesai, A.: Death vs. data science: predicting end of life. In: The Thirtieth AAAI Conference on Innovative Applications of Artificial Intelligence, pp. 7719–7726 (2018). www.aaai.org

Ahmad, M.A., Eckert, C., Teredesai, A., McKelvey, G.: Interpretable machine learning in healthcare. IEEE Intell. Inform. Bull. 19(1), 1–7 (2017). http://arxiv.org/abs/1705.10301

Burrell, J.: How the machine ‘thinks’: understanding opacity in machine learning algorithms. Big Data Soc. 3(1) (2016). https://doi.org/10.1177/2053951715622512

Bussone, A., Stumpf, S., O’Sullivan, D.: The role of explanations on trust and reliance in clinical decision support systems. In: 2015 International Conference on Healthcare Informatics, pp. 160–169. IEEE (2015)

Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., Elhadad, N.: Intelligible models for healthcare. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2015, pp. 1721–1730. ACM Press, New York (2015). https://doi.org/10.1145/2783258.2788613. http://dl.acm.org/citation.cfm?doid=2783258.2788613

Eiband, M., Schneider, H., Bilandzic, M., Fazekas-Con, J., Haug, M., Hussmann, H.: Bringing transparency design into practice. In: 23rd International Conference on Intelligent User Interfaces, pp. 211–223 (2018)

Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., Kagal, L.: Explaining explanations: an overview of interpretability of machine learning. In: 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), pp. 80–89. IEEE (2018)

Hind, M.: Explaining explainable AI. XRDS: Crossroads ACM Mag. Stud. 25(3), 16–19 (2019)CrossRef

Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., Vaughan, J.W.: Interpreting interpretability: understanding data scientists’ use of interpretability tools for machine learning. Technical report, working paper (2019)

10.

Khaitzin, E., Shlomo, R., Anderson, M.: Privacy enforcement at a large scale for GDPR compliance. In: Proceedings of the 11th ACM International Systems and Storage Conference, p. 124. Association for Computing Machinery (ACM), June 2018. https://doi.org/10.1145/3211890.3211913

11.

Krebs, L.M., et al.: Tell me what you know. In: Conference on Human Factors in Computing Systems - CHI 2019, pp. 1–6. ACM Press, New York (2019). https://doi.org/10.1145/3290607.3312808. http://dl.acm.org/citation.cfm?doid=3290607.3312808

12.

Lipton, Z.C.: The mythos of model interpretability. Queue 16(3), 30:31–30:57 (2018). https://doi.org/10.1145/3236386.3241340. http://arxiv.org/abs/1606.03490

13.

Lundberg, S., Lee, S.I.: A unified approach to interpreting model predictions. In: Advances in Neural Information Processing Systems, pp. 4765–4774, May 2017. http://arxiv.org/abs/1705.07874

14.

McInerney, J., et al.: Explore, exploit, and explain. In: Proceedings of the 12th ACM Conference on Recommender Systems - RecSys 2018, pp. 31–39. ACM Press, New York (2018). https://doi.org/10.1145/3240323.3240354. http://dl.acm.org/citation.cfm?doid=3240323.3240354

15.

Miller, T.: Explanation in artificial intelligence: insights from the social sciences. Artif. Intell. 267, 1–38 (2019). https://doi.org/10.1016/j.artint.2018.07.007MathSciNetCrossRefMATH

16.

Ming, Y., Qu, H., Bertini, E.: RuleMatrix: visualizing and understanding classifiers with rules. IEEE Trans. Vis. Comput. Graph. 25(1), 342–352 (2019). https://doi.org/10.1109/TVCG.2018.2864812CrossRef

17.

Molnar, C.: Interpretable machine learning (2019)

18.

Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should i trust you?” In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2016, pp. 1135–1144. ACM Press, New York (2016). https://doi.org/10.1145/2939672.2939778. http://dl.acm.org/citation.cfm?doid=2939672.2939778

19.

Roski, J., Bo-Linn, G.W., Andrews, T.A.: Creating value in health care through big data: opportunities and policy implications. Health Aff. 33(7), 1115–1122 (2014)CrossRef

20.

Rudin, C., Wagstaff, K.L.: Machine learning for science and society. Mach. Learn. 95, 1–9 (2014). https://doi.org/10.1007/s10994-013-5425-9MathSciNetCrossRef

21.

Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harv. JL & Tech. 31, 841 (2017)

22.

Wexler, J., Pushkarna, M., Bolukbasi, T., Wattenberg, M., Viégas, F., Wilson, J.: The what-if tool: interactive probing of machine learning models. IEEE Trans. Vis. Comput. Graph. 26(1), 56–65 (2019)

23.

Wolf, C.T.: Explainability scenarios: towards scenario-based XAI design. In: Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 252–257 (2019)

24.

Zhou, L., Pan, S., Wang, J., Vasilakos, A.V.: Machine learning on big data: opportunities and challenges. Neurocomputing 237, 350–361 (2017)CrossRef

Title: Machine Learning Models Interpretations: User Demands Exploration
Authors: Anna Smirnova
Alena Suvorova
Publisher: Springer International Publishing
Book: Digital Transformation and Global Society
Print ISBN: 978-3-030-65217-3

Electronic ISBN: 978-3-030-65218-0

Copyright Year: 2020
DOI: https://doi.org/10.1007/978-3-030-65218-0_8

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner