Skip to main content
Top
Published in: Swarm Intelligence 1/2022

22-11-2021

A machine education approach to swarm decision-making in best-of-n problems

Authors: Aya Hussein, Sondoss Elsawah, Eleni Petraki, Hussein A. Abbass

Published in: Swarm Intelligence | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In swarm decision making, hand-crafting agents’ rules that use local information to achieve desirable swarm-level behaviours is a non-trivial design problem. Instead of relying entirely on swarm experts for designing these local rules, machine learning (ML) algorithms can be utilised for learning some of the local rules by mapping an agent’s perception to an appropriate action. To facilitate this process, we propose the use of Machine Education (ME) as a systematic approach for designing a curriculum for teaching the agents the required skills to autonomously select appropriate behaviours. We study the use of ME in the context of decision-making in best-of-n problems. The proposed approach draws on swarm robotics expertise for identifying agents’ capabilities and limitations, the skills required for generating the desirable behaviours, and the corresponding performance measures. In addition, ME utilises ML expertise for the selection and development of the ML algorithms suitable for each skill. The results of the experimental evaluations demonstrate the superior efficacy of the ME-based approach over the state-of-the-art approaches with respect to speed and accuracy. In addition, our approach shows considerable robustness to changes in swarm size and to changes in sensing and communication noise. Our findings promote the use of ME for teaching swarm members the required skills for achieving complex swarm tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Abbass, H. A. (2015). Big-data-to-decisions red teaming systems. Computational red teaming (pp. 105–158). Cham: Springer. Abbass, H. A. (2015). Big-data-to-decisions red teaming systems. Computational red teaming (pp. 105–158). Cham: Springer.
go back to reference Bartashevich, P., & Mostaghim, S. (2019a). Benchmarking collective perception: New task difficulty metrics for collective decision-making. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 699–711). Cham: Springer.CrossRef Bartashevich, P., & Mostaghim, S. (2019a). Benchmarking collective perception: New task difficulty metrics for collective decision-making. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 699–711). Cham: Springer.CrossRef
go back to reference Bartashevich, P., & Mostaghim, S. (2019b). Ising model as a switch voting mechanism in collective perception. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 617–629). Cham: Springer.CrossRef Bartashevich, P., & Mostaghim, S. (2019b). Ising model as a switch voting mechanism in collective perception. In P. Moura Oliveira, P. Novais, & L. P. Reis (Eds.), Progress in artificial intelligence (pp. 617–629). Cham: Springer.CrossRef
go back to reference Bounceur, A., Bezoui, M., Noreen, U., Euler, R., Lalem, F., Hammoudeh, M., & Jabbar, S. (2017). LOGO: A new distributed leader election algorithm in wsns with low energy consumption. International Conference on Future Internet Technologies and Trends (pp. 1–16). Springer. https://doi.org/10.1007/978-3-319-73712-6_1 Bounceur, A., Bezoui, M., Noreen, U., Euler, R., Lalem, F., Hammoudeh, M., & Jabbar, S. (2017). LOGO: A new distributed leader election algorithm in wsns with low energy consumption. International Conference on Future Internet Technologies and Trends (pp. 1–16). Springer. https://​doi.​org/​10.​1007/​978-3-319-73712-6_​1
go back to reference Buşoniu, L., Babuška, R., & De Schutter, B. (2010). Multi-agent reinforcement learning: An overview. In D. Srinivasan & L. Jain (Eds.), Innovations in multi-agent systems and applications-1 (pp. 183–221). Berlin, Heidelberg: Springer.CrossRef Buşoniu, L., Babuška, R., & De Schutter, B. (2010). Multi-agent reinforcement learning: An overview. In D. Srinivasan & L. Jain (Eds.), Innovations in multi-agent systems and applications-1 (pp. 183–221). Berlin, Heidelberg: Springer.CrossRef
go back to reference Dick, W., Carey, L., & Carey, J. O. (2009). The systematic design of instruction. Pearson. Dick, W., Carey, L., & Carey, J. O. (2009). The systematic design of instruction. Pearson.
go back to reference Ebert, J. T., Gauci, M., & Nagpal, R. (2018). Multi-feature collective decision making in robot swarms. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, pages 1711–1719. International Foundation for Autonomous Agents and Multiagent Systems. https://doi.org/10.5555/3237383.3237953. Ebert, J. T., Gauci, M., & Nagpal, R. (2018). Multi-feature collective decision making in robot swarms. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, pages 1711–1719. International Foundation for Autonomous Agents and Multiagent Systems. https://​doi.​org/​10.​5555/​3237383.​3237953.
go back to reference Giusti, A., Nagi, J., Gambardella, L. M., & Di Caro, G. A. (2012). Distributed consensus for interaction between humans and mobile robot swarms. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pages 1503–1504. International Foundation for Autonomous Agents and Multiagent Systems. https://doi.org/10.5555/2343896.2344082. Giusti, A., Nagi, J., Gambardella, L. M., & Di Caro, G. A. (2012). Distributed consensus for interaction between humans and mobile robot swarms. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pages 1503–1504. International Foundation for Autonomous Agents and Multiagent Systems. https://​doi.​org/​10.​5555/​2343896.​2344082.
go back to reference Hussein, A., & Abbass, H. A. (2021). Stable belief estimation in shepherd-assisted swarm collective decision making. Shepherding UxVs for human-swarm teaming: An artificial intelligence approach to unmanned X Vehicles (pp. 165–185). New York: Springer.CrossRef Hussein, A., & Abbass, H. A. (2021). Stable belief estimation in shepherd-assisted swarm collective decision making. Shepherding UxVs for human-swarm teaming: An artificial intelligence approach to unmanned X Vehicles (pp. 165–185). New York: Springer.CrossRef
go back to reference Khan, F., Mutlu, B., & Zhu, J. (2011). How do humans teach: On curriculum learning and teaching dimension. In International Conference on Neural Information Processing Systems, 24, 1449–1457. Khan, F., Mutlu, B., & Zhu, J. (2011). How do humans teach: On curriculum learning and teaching dimension. In International Conference on Neural Information Processing Systems, 24, 1449–1457.
go back to reference Leu, G., Lakshika, E., Tang, J., Merrick, K., & Barlow, M. (2017). Machine education-the way forward for achieving trust-enabled machine agents. In NIPS’17 Workshop: Teaching Machines, Robots, and Humans. Leu, G., Lakshika, E., Tang, J., Merrick, K., & Barlow, M. (2017). Machine education-the way forward for achieving trust-enabled machine agents. In NIPS’17 Workshop: Teaching Machines, Robots, and Humans.
go back to reference Meyer, K. A. (2014). Student Engagement Online: What Works and Why: ASHE Higher Education Report, Volume 40, Number 6. Wiley. Meyer, K. A. (2014). Student Engagement Online: What Works and Why: ASHE Higher Education Report, Volume 40, Number 6. Wiley.
go back to reference Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2018). Curriculum design for machine learners in sequential decision tasks. In IEEE Transactions on Emerging Topics in Computational Intelligence, 2, 268–277. Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2018). Curriculum design for machine learners in sequential decision tasks. In IEEE Transactions on Emerging Topics in Computational Intelligence, 2, 268–277.
go back to reference Prasetyo, J., De Masi, G., Ranjan, P., & Ferrante, E. (2018). The best-of-n problem with dynamic site qualities: Achieving adaptability with stubborn individuals. In International Conference on Swarm Intelligence, pages 239–251. Springer. 10.1007/978-3-030-00533-7\_19. Prasetyo, J., De Masi, G., Ranjan, P., & Ferrante, E. (2018). The best-of-n problem with dynamic site qualities: Achieving adaptability with stubborn individuals. In International Conference on Swarm Intelligence, pages 239–251. Springer. 10.1007/978-3-030-00533-7\_19.
go back to reference Richards, J. C. (2017). Curriculum Development in Language Teaching. Cambridge Professional Learning: Cambridge University Press. Richards, J. C. (2017). Curriculum Development in Language Teaching. Cambridge Professional Learning: Cambridge University Press.
go back to reference Rummery, G. A., & Niranjan, M. (1994). On-line Q-learning using connectionist systems (Vol. 37). UK: University of Cambridge. Rummery, G. A., & Niranjan, M. (1994). On-line Q-learning using connectionist systems (Vol. 37). UK: University of Cambridge.
go back to reference Strobel, V., Castelló Ferrer, E., & Dorigo, M. (2018). Managing byzantine robots via blockchain technology in a swarm robotics collective decision making scenario. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, 541–549. Strobel, V., Castelló Ferrer, E., & Dorigo, M. (2018). Managing byzantine robots via blockchain technology in a swarm robotics collective decision making scenario. In Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems, 541–549.
go back to reference Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge: MIT press.MATH Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge: MIT press.MATH
go back to reference Valentini, G., Hamann, H., & Dorigo, M. (2015). Efficient decision-making in a self-organizing robot swarm: On the speed versus accuracy trade-off. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, 1305–1314. Valentini, G., Hamann, H., & Dorigo, M. (2015). Efficient decision-making in a self-organizing robot swarm: On the speed versus accuracy trade-off. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, 1305–1314.
go back to reference Zhu, X. (2015). Machine teaching: An inverse problem to machine learning and an approach toward optimal education. In Proceedings of the AAAI Conference on Artificial Intelligence, page 4083–4087. AAAI Press. Zhu, X. (2015). Machine teaching: An inverse problem to machine learning and an approach toward optimal education. In Proceedings of the AAAI Conference on Artificial Intelligence, page 4083–4087. AAAI Press.
Metadata
Title
A machine education approach to swarm decision-making in best-of-n problems
Authors
Aya Hussein
Sondoss Elsawah
Eleni Petraki
Hussein A. Abbass
Publication date
22-11-2021
Publisher
Springer US
Published in
Swarm Intelligence / Issue 1/2022
Print ISSN: 1935-3812
Electronic ISSN: 1935-3820
DOI
https://doi.org/10.1007/s11721-021-00206-5

Premium Partner