Skip to main content

2020 | OriginalPaper | Buchkapitel

Experiments with Heterogenous Automata-Based Multi-agent Systems

verfasst von : Franciszek Seredyński, Jakub Gąsior, Rolf Hoffmann, Dominique Désérable

Erschienen in: Parallel Processing and Applied Mathematics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a theoretical framework and an experimental tool to study behavior of heterogeneous multi-agent systems composed of the two classes of automata-based agents: Cellular Automata (CA) and Learning Automata (LA). Our general aim is to use this framework to solve global optimization problems in a distributed way using the collective behavior of agents. The common feature of CA and LA systems is the ability to show a collective behavior which, however, is understood differently. It is natural for LA-based agents that are able to learn and adapt, but for CA-based agents, extra features have to be used like the second–order CA. We create a theoretical framework of the system based on a spatial Prisoner’s Dilemma (PD) game in which both classes of players may participate. We introduce to the game some mechanisms like local profit sharing, mutation, and competition which stimulate the evolutionary process of developing collective behavior among players. We present some results of an experimental study showing the emergence of collective behavior in such systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Östberg, P.-O., Byrne, J., et al.: Reliable capacity provisioning for distributed Cloud/Edge/Fog computing applications. In: European Conference on Networks and Communications, EuCNC 2017, pp. 1–6 (2017) Östberg, P.-O., Byrne, J., et al.: Reliable capacity provisioning for distributed Cloud/Edge/Fog computing applications. In: European Conference on Networks and Communications, EuCNC 2017, pp. 1–6 (2017)
2.
Zurück zum Zitat Wolfram, S.: A New Kind of Science. Wolfram-Media, Champaign (2002)MATH Wolfram, S.: A New Kind of Science. Wolfram-Media, Champaign (2002)MATH
3.
Zurück zum Zitat Narendra, K.S., Thathachar, M.A.L.: Learning Automata: An Introduction. Printice-Hall Inc., Upper Saddle River (1989) Narendra, K.S., Thathachar, M.A.L.: Learning Automata: An Introduction. Printice-Hall Inc., Upper Saddle River (1989)
4.
Zurück zum Zitat Tsetlin, M.L.: Automaton Theory and Modeling of Biological Systems. Academic Press, New York (1973)MATH Tsetlin, M.L.: Automaton Theory and Modeling of Biological Systems. Academic Press, New York (1973)MATH
5.
Zurück zum Zitat Osborne, M.: Introduction to Game Theory. Oxford University Press, Oxford (2009) Osborne, M.: Introduction to Game Theory. Oxford University Press, Oxford (2009)
7.
Zurück zum Zitat Brambilla, M., Ferrante, E., Birattari, M., Dorigo, M.: Swarm robotics: a review from the swarm engineering perspective. Swarm Intell. 7(1), 1–41 (2013)CrossRef Brambilla, M., Ferrante, E., Birattari, M., Dorigo, M.: Swarm robotics: a review from the swarm engineering perspective. Swarm Intell. 7(1), 1–41 (2013)CrossRef
8.
Zurück zum Zitat Moniz Pereira, L., Lenaerts, T., Martinez-Vaquero, L.A., Anh Han, T.: Social manifestation of guilt leads to stable cooperation in multi-agent systems. In: Autonomous Agents and MultiAgent Systems, AAMAS 2017, Richland, SC, pp. 1422–1430 (2017) Moniz Pereira, L., Lenaerts, T., Martinez-Vaquero, L.A., Anh Han, T.: Social manifestation of guilt leads to stable cooperation in multi-agent systems. In: Autonomous Agents and MultiAgent Systems, AAMAS 2017, Richland, SC, pp. 1422–1430 (2017)
9.
Zurück zum Zitat Rossi, F., Bandyopadhyay, S., Wolf, M., Pavone, M.: Review of multi-agent algorithms for collective behavior: a structural taxonomy. IFAC-PapersOnLine 51(12), 112–117 (2018). IFAC Workshop on Networked & Autonomous Air & Space Systems NAASSCrossRef Rossi, F., Bandyopadhyay, S., Wolf, M., Pavone, M.: Review of multi-agent algorithms for collective behavior: a structural taxonomy. IFAC-PapersOnLine 51(12), 112–117 (2018). IFAC Workshop on Networked & Autonomous Air & Space Systems NAASSCrossRef
10.
Zurück zum Zitat Peleteiro, A., Burguillo, J.C., Bazzan, A.L.: Emerging cooperation in the spatial IPD with reinforcement learning and coalitions. In: Bouvry, P., González-Vélez, H., Kołodziej, J. (eds.) Intelligent Decision Systems in Large-Scale Distributed Environments. Studies in Computational Intelligence, vol. 362, pp. 187–206. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21271-0_9CrossRef Peleteiro, A., Burguillo, J.C., Bazzan, A.L.: Emerging cooperation in the spatial IPD with reinforcement learning and coalitions. In: Bouvry, P., González-Vélez, H., Kołodziej, J. (eds.) Intelligent Decision Systems in Large-Scale Distributed Environments. Studies in Computational Intelligence, vol. 362, pp. 187–206. Springer, Heidelberg (2011). https://​doi.​org/​10.​1007/​978-3-642-21271-0_​9CrossRef
11.
Zurück zum Zitat Axelrod, R.: The Evolution of Cooperation. Basic Books Publishing, New York (1984)MATH Axelrod, R.: The Evolution of Cooperation. Basic Books Publishing, New York (1984)MATH
12.
Zurück zum Zitat Axelrod, R.: The evolution of strategies in the iterated prisoner’s dilemma. In: The Dynamics of Norms (1987) Axelrod, R.: The evolution of strategies in the iterated prisoner’s dilemma. In: The Dynamics of Norms (1987)
14.
Zurück zum Zitat Seredynski, F.: Competitive coevolutionary multi-agent systems: the application to mapping and scheduling problems. J. Parallel Distrib. Comput. 47(1), 39–57 (1997)MathSciNetCrossRef Seredynski, F.: Competitive coevolutionary multi-agent systems: the application to mapping and scheduling problems. J. Parallel Distrib. Comput. 47(1), 39–57 (1997)MathSciNetCrossRef
15.
Zurück zum Zitat Nowak, M.A., May, R.M.: Evolutionary games and spatial chaos. Nature 359, 826–829 (1992)CrossRef Nowak, M.A., May, R.M.: Evolutionary games and spatial chaos. Nature 359, 826–829 (1992)CrossRef
16.
17.
18.
Zurück zum Zitat Ishibuchi, H., Namikawa, N.: Evolution of iterated prisoner’s dilemma game strategies in structured demes under random pairing in game playing. IEEE Trans. Evol. Comput. 9(6), 552–561 (2005)CrossRef Ishibuchi, H., Namikawa, N.: Evolution of iterated prisoner’s dilemma game strategies in structured demes under random pairing in game playing. IEEE Trans. Evol. Comput. 9(6), 552–561 (2005)CrossRef
19.
Zurück zum Zitat Howley, E., O’Riordan, C.: The emergence of cooperation among agents using simple fixed bias tagging. In: IEEE Congress on Evolutionary Computation, vol. 2, pp. 1011–1016 (2005) Howley, E., O’Riordan, C.: The emergence of cooperation among agents using simple fixed bias tagging. In: IEEE Congress on Evolutionary Computation, vol. 2, pp. 1011–1016 (2005)
20.
Zurück zum Zitat Seredyński, F., Gąsior, J.: Emergence of collective behavior in large cellular automata-based multi-agent systems. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds.) ICAISC 2019. LNCS (LNAI), vol. 11509, pp. 676–688. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20915-5_60CrossRef Seredyński, F., Gąsior, J.: Emergence of collective behavior in large cellular automata-based multi-agent systems. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds.) ICAISC 2019. LNCS (LNAI), vol. 11509, pp. 676–688. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-20915-5_​60CrossRef
21.
Zurück zum Zitat Warschawski, W.I.: Kollektives Verhalten von Automaten. Academic-Verlag, Berlin (1978)MATH Warschawski, W.I.: Kollektives Verhalten von Automaten. Academic-Verlag, Berlin (1978)MATH
23.
Zurück zum Zitat Gąsior, J., Seredyński, F., Hoffmann, R.: Towards self-organizing sensor networks: game-theoretic \(\epsilon \)-learning automata-based approach. In: Mauri, G., El Yacoubi, S., Dennunzio, A., Nishinari, K., Manzoni, L. (eds.) ACRI 2018. LNCS, vol. 11115, pp. 125–136. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99813-8_11CrossRef Gąsior, J., Seredyński, F., Hoffmann, R.: Towards self-organizing sensor networks: game-theoretic \(\epsilon \)-learning automata-based approach. In: Mauri, G., El Yacoubi, S., Dennunzio, A., Nishinari, K., Manzoni, L. (eds.) ACRI 2018. LNCS, vol. 11115, pp. 125–136. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-99813-8_​11CrossRef
Metadaten
Titel
Experiments with Heterogenous Automata-Based Multi-agent Systems
verfasst von
Franciszek Seredyński
Jakub Gąsior
Rolf Hoffmann
Dominique Désérable
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-43222-5_38