Skip to main content
Erschienen in: Swarm Intelligence 1/2022

22.11.2021

A machine education approach to swarm decision-making in best-of-n problems

verfasst von: Aya Hussein, Sondoss Elsawah, Eleni Petraki, Hussein A. Abbass

Erschienen in: Swarm Intelligence | Ausgabe 1/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In swarm decision making, hand-crafting agents’ rules that use local information to achieve desirable swarm-level behaviours is a non-trivial design problem. Instead of relying entirely on swarm experts for designing these local rules, machine learning (ML) algorithms can be utilised for learning some of the local rules by mapping an agent’s perception to an appropriate action. To facilitate this process, we propose the use of Machine Education (ME) as a systematic approach for designing a curriculum for teaching the agents the required skills to autonomously select appropriate behaviours. We study the use of ME in the context of decision-making in best-of-n problems. The proposed approach draws on swarm robotics expertise for identifying agents’ capabilities and limitations, the skills required for generating the desirable behaviours, and the corresponding performance measures. In addition, ME utilises ML expertise for the selection and development of the ML algorithms suitable for each skill. The results of the experimental evaluations demonstrate the superior efficacy of the ME-based approach over the state-of-the-art approaches with respect to speed and accuracy. In addition, our approach shows considerable robustness to changes in swarm size and to changes in sensing and communication noise. Our findings promote the use of ME for teaching swarm members the required skills for achieving complex swarm tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Abbass, H. A. (2015). Big-data-to-decisions red teaming systems. Computational red teaming (pp. 105–158). Cham: Springer. Abbass, H. A. (2015). Big-data-to-decisions red teaming systems. Computational red teaming (pp. 105–158). Cham: Springer.
Zurück zum Zitat Bartashevich, P., & Mostaghim, S. (2019a). Benchmarking collective perception: New task difficulty metrics for collective decision-making. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 699–711). Cham: Springer.CrossRef Bartashevich, P., & Mostaghim, S. (2019a). Benchmarking collective perception: New task difficulty metrics for collective decision-making. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 699–711). Cham: Springer.CrossRef
Zurück zum Zitat Bartashevich, P., & Mostaghim, S. (2019b). Ising model as a switch voting mechanism in collective perception. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 617–629). Cham: Springer.CrossRef Bartashevich, P., & Mostaghim, S. (2019b). Ising model as a switch voting mechanism in collective perception. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 617–629). Cham: Springer.CrossRef
Zurück zum Zitat Bounceur, A., Bezoui, M., Noreen, U., Euler, R., Lalem, F., Hammoudeh, M., & Jabbar, S. (2017). LOGO: A new distributed leader election algorithm in wsns with low energy consumption. International Conference on Future Internet Technologies and Trends (pp. 1–16). Springer. https://doi.org/10.1007/978-3-319-73712-6_1 Bounceur, A., Bezoui, M., Noreen, U., Euler, R., Lalem, F., Hammoudeh, M., & Jabbar, S. (2017). LOGO: A new distributed leader election algorithm in wsns with low energy consumption. International Conference on Future Internet Technologies and Trends (pp. 1–16). Springer. https://​doi.​org/​10.​1007/​978-3-319-73712-6_​1
Zurück zum Zitat Buşoniu, L., Babuška, R., & De Schutter, B. (2010). Multi-agent reinforcement learning: An overview. In D. Srinivasan & L. Jain (Eds.), Innovations in multi-agent systems and applications-1 (pp. 183–221). Berlin, Heidelberg: Springer.CrossRef Buşoniu, L., Babuška, R., & De Schutter, B. (2010). Multi-agent reinforcement learning: An overview. In D. Srinivasan & L. Jain (Eds.), Innovations in multi-agent systems and applications-1 (pp. 183–221). Berlin, Heidelberg: Springer.CrossRef
Zurück zum Zitat Dick, W., Carey, L., & Carey, J. O. (2009). The systematic design of instruction. Pearson. Dick, W., Carey, L., & Carey, J. O. (2009). The systematic design of instruction. Pearson.
Zurück zum Zitat Ebert, J. T., Gauci, M., & Nagpal, R. (2018). Multi-feature collective decision making in robot swarms. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, pages 1711–1719. International Foundation for Autonomous Agents and Multiagent Systems. https://doi.org/10.5555/3237383.3237953. Ebert, J. T., Gauci, M., & Nagpal, R. (2018). Multi-feature collective decision making in robot swarms. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, pages 1711–1719. International Foundation for Autonomous Agents and Multiagent Systems. https://​doi.​org/​10.​5555/​3237383.​3237953.
Zurück zum Zitat Giusti, A., Nagi, J., Gambardella, L. M., & Di Caro, G. A. (2012). Distributed consensus for interaction between humans and mobile robot swarms. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pages 1503–1504. International Foundation for Autonomous Agents and Multiagent Systems. https://doi.org/10.5555/2343896.2344082. Giusti, A., Nagi, J., Gambardella, L. M., & Di Caro, G. A. (2012). Distributed consensus for interaction between humans and mobile robot swarms. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pages 1503–1504. International Foundation for Autonomous Agents and Multiagent Systems. https://​doi.​org/​10.​5555/​2343896.​2344082.
Zurück zum Zitat Hussein, A., & Abbass, H. A. (2021). Stable belief estimation in shepherd-assisted swarm collective decision making. Shepherding UxVs for human-swarm teaming: An artificial intelligence approach to unmanned X Vehicles (pp. 165–185). New York: Springer.CrossRef Hussein, A., & Abbass, H. A. (2021). Stable belief estimation in shepherd-assisted swarm collective decision making. Shepherding UxVs for human-swarm teaming: An artificial intelligence approach to unmanned X Vehicles (pp. 165–185). New York: Springer.CrossRef
Zurück zum Zitat Khan, F., Mutlu, B., & Zhu, J. (2011). How do humans teach: On curriculum learning and teaching dimension. In International Conference on Neural Information Processing Systems, 24, 1449–1457. Khan, F., Mutlu, B., & Zhu, J. (2011). How do humans teach: On curriculum learning and teaching dimension. In International Conference on Neural Information Processing Systems, 24, 1449–1457.
Zurück zum Zitat Leu, G., Lakshika, E., Tang, J., Merrick, K., & Barlow, M. (2017). Machine education-the way forward for achieving trust-enabled machine agents. In NIPS’17 Workshop: Teaching Machines, Robots, and Humans. Leu, G., Lakshika, E., Tang, J., Merrick, K., & Barlow, M. (2017). Machine education-the way forward for achieving trust-enabled machine agents. In NIPS’17 Workshop: Teaching Machines, Robots, and Humans.
Zurück zum Zitat Meyer, K. A. (2014). Student Engagement Online: What Works and Why: ASHE Higher Education Report, Volume 40, Number 6. Wiley. Meyer, K. A. (2014). Student Engagement Online: What Works and Why: ASHE Higher Education Report, Volume 40, Number 6. Wiley.
Zurück zum Zitat Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2018). Curriculum design for machine learners in sequential decision tasks. In IEEE Transactions on Emerging Topics in Computational Intelligence, 2, 268–277. Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2018). Curriculum design for machine learners in sequential decision tasks. In IEEE Transactions on Emerging Topics in Computational Intelligence, 2, 268–277.
Zurück zum Zitat Prasetyo, J., De Masi, G., Ranjan, P., & Ferrante, E. (2018). The best-of-n problem with dynamic site qualities: Achieving adaptability with stubborn individuals. In International Conference on Swarm Intelligence, pages 239–251. Springer. 10.1007/978-3-030-00533-7\_19. Prasetyo, J., De Masi, G., Ranjan, P., & Ferrante, E. (2018). The best-of-n problem with dynamic site qualities: Achieving adaptability with stubborn individuals. In International Conference on Swarm Intelligence, pages 239–251. Springer. 10.1007/978-3-030-00533-7\_19.
Zurück zum Zitat Richards, J. C. (2017). Curriculum Development in Language Teaching. Cambridge Professional Learning: Cambridge University Press. Richards, J. C. (2017). Curriculum Development in Language Teaching. Cambridge Professional Learning: Cambridge University Press.
Zurück zum Zitat Rummery, G. A., & Niranjan, M. (1994). On-line Q-learning using connectionist systems (Vol. 37). UK: University of Cambridge. Rummery, G. A., & Niranjan, M. (1994). On-line Q-learning using connectionist systems (Vol. 37). UK: University of Cambridge.
Zurück zum Zitat Strobel, V., Castelló Ferrer, E., & Dorigo, M. (2018). Managing byzantine robots via blockchain technology in a swarm robotics collective decision making scenario. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, 541–549. Strobel, V., Castelló Ferrer, E., & Dorigo, M. (2018). Managing byzantine robots via blockchain technology in a swarm robotics collective decision making scenario. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, 541–549.
Zurück zum Zitat Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge: MIT press.MATH Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge: MIT press.MATH
Zurück zum Zitat Valentini, G., Hamann, H., & Dorigo, M. (2015). Efficient decision-making in a self-organizing robot swarm: On the speed versus accuracy trade-off. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, 1305–1314. Valentini, G., Hamann, H., & Dorigo, M. (2015). Efficient decision-making in a self-organizing robot swarm: On the speed versus accuracy trade-off. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, 1305–1314.
Zurück zum Zitat Zhu, X. (2015). Machine teaching: An inverse problem to machine learning and an approach toward optimal education. In Proceedings of the AAAI Conference on Artificial Intelligence, page 4083–4087. AAAI Press. Zhu, X. (2015). Machine teaching: An inverse problem to machine learning and an approach toward optimal education. In Proceedings of the AAAI Conference on Artificial Intelligence, page 4083–4087. AAAI Press.
Metadaten
Titel
A machine education approach to swarm decision-making in best-of-n problems
verfasst von
Aya Hussein
Sondoss Elsawah
Eleni Petraki
Hussein A. Abbass
Publikationsdatum
22.11.2021
Verlag
Springer US
Erschienen in
Swarm Intelligence / Ausgabe 1/2022
Print ISSN: 1935-3812
Elektronische ISSN: 1935-3820
DOI
https://doi.org/10.1007/s11721-021-00206-5

Premium Partner