Skip to main content
Erschienen in:
Buchtitelbild

2019 | OriginalPaper | Buchkapitel

Towards a Transparent Deep Ensemble Method Based on Multiagent Argumentation

verfasst von : Naziha Sendi, Nadia Abchiche-Mimouni, Farida Zehraoui

Erschienen in: Explainable, Transparent Autonomous Agents and Multi-Agent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Ensemble methods improve the machine learning results by combining different models. However, one of the major drawbacks of these approaches is their opacity, as they do not provide results explanation and they do not allow prior knowledge integration. As the use of machine learning increases in critical areas, the explanation of classification results and the ability to introduce domain knowledge inside the learned model have become a necessity. In this paper, we present a new deep ensemble method based on argumentation that combines machine learning algorithms with a multiagent system in order to explain the results of classification and to allow injecting prior knowledge. The idea is to extract arguments from classifiers and combine the classifiers using argumentation. This allows to exploit the internal knowledge of each classifier, to provide an explanation for the decisions and facilitate integration of domain knowledge. The results demonstrate that our method effectively improves deep learning performance in addition to providing explanations and transparency of the predictions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adadi, A., Berrada, M.: Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access 6, 52138–52160 (2018)CrossRef Adadi, A., Berrada, M.: Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access 6, 52138–52160 (2018)CrossRef
3.
Zurück zum Zitat Amgoud, L., Parsons, S., Maudet, N.: Arguments, dialogue, and negotiation. In: ECAI (2000) Amgoud, L., Parsons, S., Maudet, N.: Arguments, dialogue, and negotiation. In: ECAI (2000)
7.
8.
Zurück zum Zitat Bologna, G., Hayashi, Y.: A comparison study on rule extraction from neural network ensembles, boosted shallow trees, and SVMs. Appl. Comput. Intell. Soft Comput. 2018, 1–20 (2018)CrossRef Bologna, G., Hayashi, Y.: A comparison study on rule extraction from neural network ensembles, boosted shallow trees, and SVMs. Appl. Comput. Intell. Soft Comput. 2018, 1–20 (2018)CrossRef
10.
Zurück zum Zitat Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)MATH Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)MATH
12.
Zurück zum Zitat Craven, M., Shavlik, J.W.: Using sampling and queries to extract rules from trained neural networks. In: ICML (1994) Craven, M., Shavlik, J.W.: Using sampling and queries to extract rules from trained neural networks. In: ICML (1994)
13.
Zurück zum Zitat Craven, M.W., Shavlik, J.W.: Extracting tree-structured representations of trained networks. In: Proceedings of the 8th International Conference on Neural Information Processing Systems, NIPS 1995, pp. 24–30. MIT Press, Cambridge (1995) Craven, M.W., Shavlik, J.W.: Extracting tree-structured representations of trained networks. In: Proceedings of the 8th International Conference on Neural Information Processing Systems, NIPS 1995, pp. 24–30. MIT Press, Cambridge (1995)
16.
Zurück zum Zitat Dung, P.M.: On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games. Artif. Intell. 77(2), 321–357 (1995)MathSciNetCrossRef Dung, P.M.: On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games. Artif. Intell. 77(2), 321–357 (1995)MathSciNetCrossRef
17.
Zurück zum Zitat Forgy, C.: Rete: a fast algorithm for the many pattern/many object pattern match problem. Artif. Intell. 19(1), 17–37 (1982)CrossRef Forgy, C.: Rete: a fast algorithm for the many pattern/many object pattern match problem. Artif. Intell. 19(1), 17–37 (1982)CrossRef
18.
Zurück zum Zitat Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm (1996) Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm (1996)
19.
Zurück zum Zitat Fu, L.: Rule generation from neural networks. IEEE Trans. Syst. Man Cybern. 24, 1114–1124 (1994)CrossRef Fu, L.: Rule generation from neural networks. IEEE Trans. Syst. Man Cybern. 24, 1114–1124 (1994)CrossRef
20.
Zurück zum Zitat Garcia, F.J.C., Robb, D.A., Liu, X., Laskov, A., Patrón, P., Hastie, H.F.: Explain yourself: a natural language interface for scrutable autonomous robots. CoRR arXiv:abs/1803.02088 (2018) Garcia, F.J.C., Robb, D.A., Liu, X., Laskov, A., Patrón, P., Hastie, H.F.: Explain yourself: a natural language interface for scrutable autonomous robots. CoRR arXiv:​abs/​1803.​02088 (2018)
21.
Zurück zum Zitat Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. 51(5), 93:1–93:42 (2018)CrossRef Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. 51(5), 93:1–93:42 (2018)CrossRef
23.
Zurück zum Zitat Hao, Z., Yao, L., Liu, B., Wang, Y.: Arguing prism: an argumentation based approach for collaborative classification in distributed environments. In: Decker, H., Lhotská, L., Link, S., Spies, M., Wagner, R.R. (eds.) DEXA 2014. LNCS, vol. 8645, pp. 34–41. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10085-2_3CrossRef Hao, Z., Yao, L., Liu, B., Wang, Y.: Arguing prism: an argumentation based approach for collaborative classification in distributed environments. In: Decker, H., Lhotská, L., Link, S., Spies, M., Wagner, R.R. (eds.) DEXA 2014. LNCS, vol. 8645, pp. 34–41. Springer, Cham (2014). https://​doi.​org/​10.​1007/​978-3-319-10085-2_​3CrossRef
24.
Zurück zum Zitat Harbers, M.: Self-explaining agents in virtual training. In: EC-TEL PROLEAN (2008) Harbers, M.: Self-explaining agents in virtual training. In: EC-TEL PROLEAN (2008)
26.
Zurück zum Zitat Johnson, W.L.: Agents that learn to explain themselves. In: Proceedings of the Twelfth National Conference on Artificial Intelligence, AAAI 1994, vol. 2, pp. 1257–1263. American Association for Artificial Intelligence, Menlo Park (1994) Johnson, W.L.: Agents that learn to explain themselves. In: Proceedings of the Twelfth National Conference on Artificial Intelligence, AAAI 1994, vol. 2, pp. 1257–1263. American Association for Artificial Intelligence, Menlo Park (1994)
28.
Zurück zum Zitat Kontarinis, D.: Debate in a multi-agent system: multiparty argumentation protocols (2014) Kontarinis, D.: Debate in a multi-agent system: multiparty argumentation protocols (2014)
29.
Zurück zum Zitat van Lent, M., Fisher, W., Mancuso, M.: An explainable artificial intelligence system for small-unit tactical behavior. In: Proceedings of the 16th Conference on Innovative Applications of Artificial Intelligence, IAAI 2004, pp. 900–907. AAAI Press (2004) van Lent, M., Fisher, W., Mancuso, M.: An explainable artificial intelligence system for small-unit tactical behavior. In: Proceedings of the 16th Conference on Innovative Applications of Artificial Intelligence, IAAI 2004, pp. 900–907. AAAI Press (2004)
32.
Zurück zum Zitat Sato, M., Tsukimoto, H.: Rule extraction from neural networks via decision tree induction. In: International Joint Conference on Neural Networks (IJCNN 2001), pp. 1870–1875 (2001) Sato, M., Tsukimoto, H.: Rule extraction from neural networks via decision tree induction. In: International Joint Conference on Neural Networks (IJCNN 2001), pp. 1870–1875 (2001)
33.
Zurück zum Zitat Marchant, I., et al.: Score should be preferred to Framingham to predict cardiovascular death in French population. Eur. J. Cardiovasc. Prev. Rehabil. 16, 609–615 (2009)CrossRef Marchant, I., et al.: Score should be preferred to Framingham to predict cardiovascular death in French population. Eur. J. Cardiovasc. Prev. Rehabil. 16, 609–615 (2009)CrossRef
34.
Zurück zum Zitat Mcburney, P., Parsons, S.: Dialogue games in multi-agent systems. Informal Logic 22, 2002 (2002) Mcburney, P., Parsons, S.: Dialogue games in multi-agent systems. Informal Logic 22, 2002 (2002)
35.
Zurück zum Zitat Molineaux, M., Dannenhauer, D., Aha, D.W.: Towards explainable NPCS: a relational exploration learning agent. In: AAAI Workshops (2018) Molineaux, M., Dannenhauer, D., Aha, D.W.: Towards explainable NPCS: a relational exploration learning agent. In: AAAI Workshops (2018)
36.
Zurück zum Zitat Re, M., Valentini, G.: Ensemble methods: a review, pp. 563–594 (2012) Re, M., Valentini, G.: Ensemble methods: a review, pp. 563–594 (2012)
37.
Zurück zum Zitat Reed, C.: Representing dialogic argumentation. Knowl.-Based Syst. 19, 22–31 (2006)CrossRef Reed, C.: Representing dialogic argumentation. Knowl.-Based Syst. 19, 22–31 (2006)CrossRef
38.
Zurück zum Zitat Sato, M., Tsukimoto, H.: Rule extraction from neural networks via decision tree induction. In: IJCNN 2001, vol. 3, pp. 1870–1875 (2001) Sato, M., Tsukimoto, H.: Rule extraction from neural networks via decision tree induction. In: IJCNN 2001, vol. 3, pp. 1870–1875 (2001)
39.
Zurück zum Zitat Searle, J.: Speech Acts. An Essay in the Philosophy of Language. Cambridge University Press, Cambridge (1969)CrossRef Searle, J.: Speech Acts. An Essay in the Philosophy of Language. Cambridge University Press, Cambridge (1969)CrossRef
41.
Zurück zum Zitat Tran, S.N., d’Avila Garcez, A.: Knowledge extraction from deep belief networks for images. In: IJCAI 2013 Workshop on Neural-Symbolic Learning and Reasoning (2013) Tran, S.N., d’Avila Garcez, A.: Knowledge extraction from deep belief networks for images. In: IJCAI 2013 Workshop on Neural-Symbolic Learning and Reasoning (2013)
42.
Zurück zum Zitat Wardeh, M., Bench-Capon, T., Coenen, F.: Arguing from experience using multiple groups of agents. Argument Comput. 2(1), 51–76 (2011)CrossRef Wardeh, M., Bench-Capon, T., Coenen, F.: Arguing from experience using multiple groups of agents. Argument Comput. 2(1), 51–76 (2011)CrossRef
Metadaten
Titel
Towards a Transparent Deep Ensemble Method Based on Multiagent Argumentation
verfasst von
Naziha Sendi
Nadia Abchiche-Mimouni
Farida Zehraoui
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-30391-4_1

Premium Partner