Skip to main content

2019 | OriginalPaper | Buchkapitel

Explainable Multi-Agent Systems Through Blockchain Technology

verfasst von : Davide Calvaresi, Yazan Mualla, Amro Najjar, Stéphane Galland, Michael Schumacher

Erschienen in: Explainable, Transparent Autonomous Agents and Multi-Agent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Advances in Artificial Intelligence (AI) are contributing to a broad set of domains. In particular, Multi-Agent Systems (MAS) are increasingly approaching critical areas such as medicine, autonomous vehicles, criminal justice, and financial markets. Such a trend is producing a growing AI-Human society entanglement. Thus, several concerns are raised around user acceptance of AI agents. Trust issues, mainly due to their lack of explainability, are the most relevant. In recent decades, the priority has been pursuing the optimal performance at the expenses of the interpretability. It led to remarkable achievements in fields such as computer vision, natural language processing, and decision-making systems. However, the crucial questions driven by the social reluctance to accept AI-based decisions may lead to entirely new dynamics and technologies fostering explainability, authenticity, and user-centricity. This paper proposes a joint approach employing both blockchain technology (BCT) and explainability in the decision-making process of MAS. By doing so, current opaque decision-making processes can be made more transparent and secure and thereby trustworthy from the human user standpoint. Moreover, several case studies involving Unmanned Aerial Vehicles (UAV) are discussed. Finally, the paper discusses roles, balance, and trade-offs between explainability and BCT in trust-dependent systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat ACM US: Public policy council: statement on algorithmic transparency and accountability (2017) ACM US: Public policy council: statement on algorithmic transparency and accountability (2017)
2.
Zurück zum Zitat Aesop: Aesop’s Fables. OUP, Oxford (2002) Aesop: Aesop’s Fables. OUP, Oxford (2002)
3.
Zurück zum Zitat Ali, M., Nelson, J.C., Shea, R., Freedman, M.J.: Blockstack: a global naming and storage system secured by blockchains. In: USENIX Annual Technical Conference, pp. 181–194 (2016) Ali, M., Nelson, J.C., Shea, R., Freedman, M.J.: Blockstack: a global naming and storage system secured by blockchains. In: USENIX Annual Technical Conference, pp. 181–194 (2016)
4.
Zurück zum Zitat Anjomshoae, S., Najjar, A., Calvaresi, D., Framling, K.: Explainable agents and robots: results from a systematic literature review. In: Proceedings of the 18th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) (2019) Anjomshoae, S., Najjar, A., Calvaresi, D., Framling, K.: Explainable agents and robots: results from a systematic literature review. In: Proceedings of the 18th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) (2019)
5.
Zurück zum Zitat Biran, O., Cotton, C.: Explanation and justification in machine learning: a survey. In: IJCAI 2017 Workshop on Explainable AI (XAI), p. 8 (2017) Biran, O., Cotton, C.: Explanation and justification in machine learning: a survey. In: IJCAI 2017 Workshop on Explainable AI (XAI), p. 8 (2017)
7.
Zurück zum Zitat Calvaresi, D., Cesarini, D., Sernani, P., Marinoni, M., Dragoni, A.F., Sturm, A.: Exploring the ambient assisted living domain: a systematic review. J. Ambient Intell. Humaniz. Comput. 8(2), 239–257 (2017)CrossRef Calvaresi, D., Cesarini, D., Sernani, P., Marinoni, M., Dragoni, A.F., Sturm, A.: Exploring the ambient assisted living domain: a systematic review. J. Ambient Intell. Humaniz. Comput. 8(2), 239–257 (2017)CrossRef
8.
Zurück zum Zitat Calvaresi, D., Dubovitskaya, A., Calbimonte, J.P., Taveter, K., Schumacher, M.: Multi-agent systems and blockchain: results from a systematic literature review. In: Demazeau, Y., An, B., Bajo, J., Fernández-Caballero, A. (eds.) PAAMS 2018. LNCS (LNAI), vol. 10978, pp. 110–126. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-94580-4_9 CrossRef Calvaresi, D., Dubovitskaya, A., Calbimonte, J.P., Taveter, K., Schumacher, M.: Multi-agent systems and blockchain: results from a systematic literature review. In: Demazeau, Y., An, B., Bajo, J., Fernández-Caballero, A. (eds.) PAAMS 2018. LNCS (LNAI), vol. 10978, pp. 110–126. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-94580-4_​9 CrossRef
9.
Zurück zum Zitat Calvaresi, D., Dubovitskaya, A., Retaggi, D., Dragoni, A., Schumacher, M.: Trusted registration, negotiation, and service evaluation in multi-agent systems throughout the blockchain technology. In: International Conference on Web Intelligence (2018) Calvaresi, D., Dubovitskaya, A., Retaggi, D., Dragoni, A., Schumacher, M.: Trusted registration, negotiation, and service evaluation in multi-agent systems throughout the blockchain technology. In: International Conference on Web Intelligence (2018)
10.
Zurück zum Zitat Calvaresi, D., Leis, M., Dubovitskaya, A., Schegg, R., Schumacher, M.: Trust in tourism via blockchain technology: results from a systematic review. In: Pesonen, J., Neidhardt, J. (eds.) Information and Communication Technologies in Tourism 2019, pp. 304–317. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05940-8_24CrossRef Calvaresi, D., Leis, M., Dubovitskaya, A., Schegg, R., Schumacher, M.: Trust in tourism via blockchain technology: results from a systematic review. In: Pesonen, J., Neidhardt, J. (eds.) Information and Communication Technologies in Tourism 2019, pp. 304–317. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-05940-8_​24CrossRef
11.
Zurück zum Zitat Calvaresi, D., Marinoni, M., Dragoni, A.F., Hilfiker, R., Schumacher, M.: Real-time multi-agent systems for telerehabilitation scenarios. Artif. Intell. Med. 96, 217–231 (2019)CrossRef Calvaresi, D., Marinoni, M., Dragoni, A.F., Hilfiker, R., Schumacher, M.: Real-time multi-agent systems for telerehabilitation scenarios. Artif. Intell. Med. 96, 217–231 (2019)CrossRef
12.
Zurück zum Zitat Calvaresi, D., Marinoni, M., Sturm, A., Schumacher, M., Buttazzo, G.C.: The challenge of real-time multi-agent systems for enabling IoT and CPS. In: Proceedings of the International Conference on Web Intelligence, Leipzig, Germany, 23–26 August 2017, pp. 356–364 (2017). https://doi.org/10.1145/3106426.3106518 Calvaresi, D., Marinoni, M., Sturm, A., Schumacher, M., Buttazzo, G.C.: The challenge of real-time multi-agent systems for enabling IoT and CPS. In: Proceedings of the International Conference on Web Intelligence, Leipzig, Germany, 23–26 August 2017, pp. 356–364 (2017). https://​doi.​org/​10.​1145/​3106426.​3106518
13.
Zurück zum Zitat Calvaresi, D., Mattioli, V., Dubovitskaya, A., Dragoni, A.F., Schumacher, M.: Reputation management in multi-agent systems using permissioned blockchain technology (2018) Calvaresi, D., Mattioli, V., Dubovitskaya, A., Dragoni, A.F., Schumacher, M.: Reputation management in multi-agent systems using permissioned blockchain technology (2018)
14.
Zurück zum Zitat Carey, P.: Data Protection: A Practical Guide to UK and EU law. Oxford University Press Inc., Oxford (2018) Carey, P.: Data Protection: A Practical Guide to UK and EU law. Oxford University Press Inc., Oxford (2018)
16.
Zurück zum Zitat Chandrasekaran, B., Tanner, M.C., Josephson, J.R.: Explaining control strategies in problem solving. IEEE Intell. Syst. 1, 9–15 (1989) Chandrasekaran, B., Tanner, M.C., Josephson, J.R.: Explaining control strategies in problem solving. IEEE Intell. Syst. 1, 9–15 (1989)
17.
Zurück zum Zitat Oxford English Dictionary: Compact Oxford English Dictionary. Oxford University Press, Oxford (1991) Oxford English Dictionary: Compact Oxford English Dictionary. Oxford University Press, Oxford (1991)
18.
Zurück zum Zitat Doran, D., Schulz, S., Besold, T.R.: What does explainable AI really mean? A new conceptualization of perspectives. arXiv preprint arXiv:1710.00794 (2017) Doran, D., Schulz, S., Besold, T.R.: What does explainable AI really mean? A new conceptualization of perspectives. arXiv preprint arXiv:​1710.​00794 (2017)
19.
Zurück zum Zitat Dragoni, A.F., Sernani, P., Calvaresi, D.: When rationality entered time and became a real agent in a cyber-society. In: Proceedings of the 3rd International Conference on Recent Trends and Applications in Computer Science and Information Technology, RTA-CSIT 2018, Tirana, Albania, 23rd–24th November 2018, pp. 167–171 (2018). http://ceur-ws.org/Vol-2280/paper-24.pdf Dragoni, A.F., Sernani, P., Calvaresi, D.: When rationality entered time and became a real agent in a cyber-society. In: Proceedings of the 3rd International Conference on Recent Trends and Applications in Computer Science and Information Technology, RTA-CSIT 2018, Tirana, Albania, 23rd–24th November 2018, pp. 167–171 (2018). http://​ceur-ws.​org/​Vol-2280/​paper-24.​pdf
21.
Zurück zum Zitat Forouzan, B.A.: Cryptography & Network Security, 1st edn. McGraw-Hill Inc., New York, NY, USA (2008) Forouzan, B.A.: Cryptography & Network Security, 1st edn. McGraw-Hill Inc., New York, NY, USA (2008)
22.
Zurück zum Zitat Fox, A., et al.: Above the clouds: a Berkeley view of cloud computing. Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Report UCB/EECS 28(13), 2009 (2009) Fox, A., et al.: Above the clouds: a Berkeley view of cloud computing. Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Report UCB/EECS 28(13), 2009 (2009)
23.
Zurück zum Zitat Gambetta, D., et al.: Can we trust trust. Trust: Making and breaking cooperative relations, vol. 13, pp. 213–237 (2000) Gambetta, D., et al.: Can we trust trust. Trust: Making and breaking cooperative relations, vol. 13, pp. 213–237 (2000)
24.
Zurück zum Zitat Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 93 (2018)CrossRef Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 93 (2018)CrossRef
25.
Zurück zum Zitat Gunning, D.: Explainable artificial intelligence (XAI). Defense Advanced Research Projects Agency (DARPA), ND Web (2017) Gunning, D.: Explainable artificial intelligence (XAI). Defense Advanced Research Projects Agency (DARPA), ND Web (2017)
26.
Zurück zum Zitat Hellström, T., Bensch, S.: Understandable robots-what, why, and how. Paladyn J. Behav. Robot. 9(1), 110–123 (2018)CrossRef Hellström, T., Bensch, S.: Understandable robots-what, why, and how. Paladyn J. Behav. Robot. 9(1), 110–123 (2018)CrossRef
27.
Zurück zum Zitat Kass, R., Finin, T., et al.: The need for user models in generating expert system explanations. Int. J. Expert Syst. 1(4), 345–375 (1988) Kass, R., Finin, T., et al.: The need for user models in generating expert system explanations. Int. J. Expert Syst. 1(4), 345–375 (1988)
28.
Zurück zum Zitat Kuzmin, A., Znak, E.: Blockchain-base structures for a secure and operate network of semi-autonomous unmanned aerial vehicles. In: 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), pp. 32–37. IEEE (2018) Kuzmin, A., Znak, E.: Blockchain-base structures for a secure and operate network of semi-autonomous unmanned aerial vehicles. In: 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), pp. 32–37. IEEE (2018)
29.
Zurück zum Zitat Miller, T.: Explanation in artificial intelligence: insights from the social sciences. Artif. Intell. 267, 1–38 (2018)MathSciNetCrossRef Miller, T.: Explanation in artificial intelligence: insights from the social sciences. Artif. Intell. 267, 1–38 (2018)MathSciNetCrossRef
30.
Zurück zum Zitat Mualla, Y., Bai, W., Galland, S., Nicolle, C.: Comparison of agent-based simulation frameworks for unmanned aerial transportation applications. Proc. Comput. Sci. 130(C), 791–796 (2018)CrossRef Mualla, Y., Bai, W., Galland, S., Nicolle, C.: Comparison of agent-based simulation frameworks for unmanned aerial transportation applications. Proc. Comput. Sci. 130(C), 791–796 (2018)CrossRef
31.
Zurück zum Zitat Mualla, Y., Najjar, A., Boissier, O., Galland, S., Tchappi, I., Vanet, R.: A cyber-physical system for semi-autonomous oil&gas drilling operations. In: 5th Workshop on Collaboration of Humans, Agents, Robots, Machines and Sensors. Third IEEE International Conference on Robotic Computing (2019) Mualla, Y., Najjar, A., Boissier, O., Galland, S., Tchappi, I., Vanet, R.: A cyber-physical system for semi-autonomous oil&gas drilling operations. In: 5th Workshop on Collaboration of Humans, Agents, Robots, Machines and Sensors. Third IEEE International Conference on Robotic Computing (2019)
32.
Zurück zum Zitat Mualla, Y., et al.: Between the megalopolis and the deep blue sky: challenges of transport with uavs in future smart cities. In: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems (2019) Mualla, Y., et al.: Between the megalopolis and the deep blue sky: challenges of transport with uavs in future smart cities. In: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems (2019)
33.
Zurück zum Zitat Najjar, A.: Multi-agent negotiation for QoE-aware cloud elasticity management. Ph.D. thesis, École nationale supérieure des mines de Saint-Étienne (2015) Najjar, A.: Multi-agent negotiation for QoE-aware cloud elasticity management. Ph.D. thesis, École nationale supérieure des mines de Saint-Étienne (2015)
35.
Zurück zum Zitat Najjar, A., Serpaggi, X., Gravier, C., Boissier, O.: Multi-agent systems for personalized QoE-management. In: 2016 28th International Teletraffic Congress (ITC 28), vol. 3, pp. 1–6. IEEE (2016) Najjar, A., Serpaggi, X., Gravier, C., Boissier, O.: Multi-agent systems for personalized QoE-management. In: 2016 28th International Teletraffic Congress (ITC 28), vol. 3, pp. 1–6. IEEE (2016)
37.
Zurück zum Zitat Nomura, T., Kawakami, K.: Relationships between robot’s self-disclosures and human’s anxiety toward robots. In: Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology-Volume 03, pp. 66–69. IEEE Computer Society (2011) Nomura, T., Kawakami, K.: Relationships between robot’s self-disclosures and human’s anxiety toward robots. In: Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology-Volume 03, pp. 66–69. IEEE Computer Society (2011)
38.
Zurück zum Zitat Parkes, D.C., Wellman, M.P.: Economic reasoning and artificial intelligence. Science 349(6245), 267–272 (2015)MathSciNetCrossRef Parkes, D.C., Wellman, M.P.: Economic reasoning and artificial intelligence. Science 349(6245), 267–272 (2015)MathSciNetCrossRef
40.
Zurück zum Zitat Sabater-Mir, J., Vercouter, L.: Trust and reputation in multiagent systems. In: Multiagent Systems, p. 381 (2013) Sabater-Mir, J., Vercouter, L.: Trust and reputation in multiagent systems. In: Multiagent Systems, p. 381 (2013)
41.
Zurück zum Zitat Samek, W., Wiegand, T., Müller, K.R.: Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296 (2017) Samek, W., Wiegand, T., Müller, K.R.: Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:​1708.​08296 (2017)
42.
Zurück zum Zitat Simon, J., et al.: Managing participation in a monitored system using blockchain technology. US Patent Application 15/881,715, 2 August 2018 Simon, J., et al.: Managing participation in a monitored system using blockchain technology. US Patent Application 15/881,715, 2 August 2018
43.
Zurück zum Zitat Swanson, T.: Consensus-as-a-service: a brief report on the emergence of permissioned, distributed ledger systems (2015) Swanson, T.: Consensus-as-a-service: a brief report on the emergence of permissioned, distributed ledger systems (2015)
45.
Zurück zum Zitat Talia, D.: Clouds meet agents: toward intelligent cloud services. IEEE Internet Comput. 16(2), 78–81 (2012)CrossRef Talia, D.: Clouds meet agents: toward intelligent cloud services. IEEE Internet Comput. 16(2), 78–81 (2012)CrossRef
47.
Zurück zum Zitat Wang, W., Niu, D., Li, B., Liang, B.: Dynamic cloud resource reservation via cloud brokerage. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems, pp. 400–409. IEEE (2013) Wang, W., Niu, D., Li, B., Liang, B.: Dynamic cloud resource reservation via cloud brokerage. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems, pp. 400–409. IEEE (2013)
48.
Zurück zum Zitat Zhang, Q., Zhu, S.C.: Visual interpretability for deep learning: a survey. Front. Inf. Technol. Electron. Eng. 19(1), 27–39 (2018)CrossRef Zhang, Q., Zhu, S.C.: Visual interpretability for deep learning: a survey. Front. Inf. Technol. Electron. Eng. 19(1), 27–39 (2018)CrossRef
Metadaten
Titel
Explainable Multi-Agent Systems Through Blockchain Technology
verfasst von
Davide Calvaresi
Yazan Mualla
Amro Najjar
Stéphane Galland
Michael Schumacher
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-30391-4_3