Skip to main content
Top

2015 | OriginalPaper | Chapter

Measuring and Comparing Scalability of Agent-Based Simulation Frameworks

Authors : Fabian Lorig, Nils Dammenhayn, David-Johannes Müller, Ingo J. Timm

Published in: Multiagent System Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

While computer simulation gained importance as a technique for generating knowledge in various research disciplines, the size of simulation models representing real world scenarios is growing, too. In Social Simulation, e.g., there is a need to simulate a large number of humans using individual software agents for generating and analyzing human-like behavior in artificial societies. Nowadays, a variety of toolkits and frameworks exists providing functionalities for supporting implementation and execution of simulation experiments. Yet, the choice of a suitable framework is difficult as unforeseen scalability issues may arise when extending agent models. Therefore, this paper aims at providing a method for analyzing and comparing agent-based simulation frameworks regarding their ability to scale simulation models and experiments. Based on performance metrics, standardized experiments are conducted while altering internal and external scaling parameters. As part of the study, four Java-based agent frameworks are analyzed and compared: Aimpulse Spectrum, JADE, MASON, and Repast.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
2
http://​www.​flamegpu.​com (last visited Oct. 3, 2015).
 
3
http://​www.​anylogic.​com (last visited Oct. 3, 2015).
 
4
http://​www.​aimpulse.​com (last visited Oct. 3, 2015).
 
5
http://​jade.​tilab.​com (last visited Oct. 3, 2015).
 
8
A virtual machine (VM) emulates a real computer system. Doing so, hardware configurations can be adjusted easily and without physically modifying the system.
 
Literature
2.
go back to reference Conte, R., Gilbert, N., Sichman, J.S.: MAS and social simulation: a suitable commitment. In: Gilbert, N., Sichman, J.S., Conte, R. (eds.) MABS 1998. LNCS (LNAI), vol. 1534, pp. 1–9. Springer, Heidelberg (1998) CrossRef Conte, R., Gilbert, N., Sichman, J.S.: MAS and social simulation: a suitable commitment. In: Gilbert, N., Sichman, J.S., Conte, R. (eds.) MABS 1998. LNCS (LNAI), vol. 1534, pp. 1–9. Springer, Heidelberg (1998) CrossRef
3.
go back to reference Cortese, E., Quarta, F., Vitaglione, G., Vrba, P.: Scalability and performance of jade message transport system. In: AAMAS Workshop on AgentCities, Bologna, vol. 16 (2002) Cortese, E., Quarta, F., Vitaglione, G., Vrba, P.: Scalability and performance of jade message transport system. In: AAMAS Workshop on AgentCities, Bologna, vol. 16 (2002)
4.
go back to reference Davidsson, P.: Agent based social simulation: a computer science view. J. Artif. Soc. Soc. Simul. 5(1), 7 (2002) Davidsson, P.: Agent based social simulation: a computer science view. J. Artif. Soc. Soc. Simul. 5(1), 7 (2002)
5.
go back to reference Deters, R.: Scalability & multi-agent systems. In: 2nd International Workshop Infrastructure for Agents, MAS and Scalable MAS, 5th International Conference on Autonomous Agents (2001) Deters, R.: Scalability & multi-agent systems. In: 2nd International Workshop Infrastructure for Agents, MAS and Scalable MAS, 5th International Conference on Autonomous Agents (2001)
6.
go back to reference Di Caro, G.A.: Analysis of simulation environments for mobile ad hoc networks. Technical Report, Dalle Molle Institute for Artificial Intelligence (2003) Di Caro, G.A.: Analysis of simulation environments for mobile ad hoc networks. Technical Report, Dalle Molle Institute for Artificial Intelligence (2003)
7.
go back to reference Doran, J., Gilbert, N.: Simulating societies: an introduction. In: Simulating Societies: The Computer Simulation of Social Phenomena, pp. 1–18 (1994) Doran, J., Gilbert, N.: Simulating societies: an introduction. In: Simulating Societies: The Computer Simulation of Social Phenomena, pp. 1–18 (1994)
8.
go back to reference Gatti, M., Cavalin, P., Neto, S.B., Pinhanez, C., dos Santos, C., Gribel, D., Appel, A.P.: Large-scale multi-agent-based modeling and simulation of microblogging-based online social network. In: Alam, S.J., Van Dyke Parunak, H. (eds.) MABS 2013. LNCS, vol. 8235, pp. 17–33. Springer, Heidelberg (2014) CrossRef Gatti, M., Cavalin, P., Neto, S.B., Pinhanez, C., dos Santos, C., Gribel, D., Appel, A.P.: Large-scale multi-agent-based modeling and simulation of microblogging-based online social network. In: Alam, S.J., Van Dyke Parunak, H. (eds.) MABS 2013. LNCS, vol. 8235, pp. 17–33. Springer, Heidelberg (2014) CrossRef
9.
go back to reference Goldstein, J.: Emergence as a construct: History and issues. Emergence 1(1), 49–72 (1999)CrossRef Goldstein, J.: Emergence as a construct: History and issues. Emergence 1(1), 49–72 (1999)CrossRef
10.
go back to reference Hamida, E.B., Chelius, G., Gorce, J.M.: Impact of the physical layer modeling on the accuracy and scalability of wireless network simulation. Simulation 85, 574–588 (2009)CrossRef Hamida, E.B., Chelius, G., Gorce, J.M.: Impact of the physical layer modeling on the accuracy and scalability of wireless network simulation. Simulation 85, 574–588 (2009)CrossRef
11.
go back to reference Helsinger, A., Thome, M., Wright, T.: Cougaar: a scalable, distributed multi-agent architecture. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1910–1917. IEEE (2004) Helsinger, A., Thome, M., Wright, T.: Cougaar: a scalable, distributed multi-agent architecture. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1910–1917. IEEE (2004)
12.
go back to reference Hewitt, C., Bishop, P., Steiger, R.: A universal modular actor formalism for artificial intelligence. In: Proceedings of the 3rd International Joint Conference on Artificial Intelligence, pp. 235–245. Morgan Kaufmann Publishers Inc. (1973) Hewitt, C., Bishop, P., Steiger, R.: A universal modular actor formalism for artificial intelligence. In: Proceedings of the 3rd International Joint Conference on Artificial Intelligence, pp. 235–245. Morgan Kaufmann Publishers Inc. (1973)
13.
go back to reference Hill, M.D.: What is scalability? ACM SIGARCH Comput. Archit. News 18(4), 18–21 (1990)CrossRef Hill, M.D.: What is scalability? ACM SIGARCH Comput. Archit. News 18(4), 18–21 (1990)CrossRef
14.
go back to reference Horling, B., Mailler, R., Lesser, V.: Farm: a scalable environment for multi-agent development and evaluation. In: Lucena, C., Garcia, A., Romanovsky, A., Castro, J., Alencar, P.S.C. (eds.) SELMAS 2003. LNCS, vol. 2940, pp. 225–242. Springer, Heidelberg (2004) CrossRef Horling, B., Mailler, R., Lesser, V.: Farm: a scalable environment for multi-agent development and evaluation. In: Lucena, C., Garcia, A., Romanovsky, A., Castro, J., Alencar, P.S.C. (eds.) SELMAS 2003. LNCS, vol. 2940, pp. 225–242. Springer, Heidelberg (2004) CrossRef
15.
go back to reference Kiran, M., Richmond, P., Holcombe, M., Chin, L.S., Worth, D., Greenough, C.: Flame: simulating large populations of agents on parallel hardware architectures. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 1633–1636, International Foundation for Autonomous Agents and Multiagent Systems (2010) Kiran, M., Richmond, P., Holcombe, M., Chin, L.S., Worth, D., Greenough, C.: Flame: simulating large populations of agents on parallel hardware architectures. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 1633–1636, International Foundation for Autonomous Agents and Multiagent Systems (2010)
16.
go back to reference Kravari, K., Bassiliades, N.: A survey of agent platforms. J. Artif. Soc. Soc. Simul. 18(1), 11 (2015) Kravari, K., Bassiliades, N.: A survey of agent platforms. J. Artif. Soc. Soc. Simul. 18(1), 11 (2015)
17.
go back to reference Lee, L.C., Nwana, H.S., Ndumu, D.T., De Wilde, P.: The stability, scalability and performance of multi-agent systems. BT Tech. J. 16(3), 94–103 (1998)CrossRef Lee, L.C., Nwana, H.S., Ndumu, D.T., De Wilde, P.: The stability, scalability and performance of multi-agent systems. BT Tech. J. 16(3), 94–103 (1998)CrossRef
18.
go back to reference Liu, H.H.: Software Performance and Scalability: A Quantitative Approach, vol. 7. Wiley, New York (2011)CrossRef Liu, H.H.: Software Performance and Scalability: A Quantitative Approach, vol. 7. Wiley, New York (2011)CrossRef
19.
go back to reference Michael, M., Moreira, J.E., Shiloach, D., Wisniewski, R.W.: Scale-up x scale-out: a case study using nutch/lucene. In: Parallel and Distributed Processing Symposium, IPDPS 2007. IEEE International, pp. 1–8. IEEE (2007) Michael, M., Moreira, J.E., Shiloach, D., Wisniewski, R.W.: Scale-up x scale-out: a case study using nutch/lucene. In: Parallel and Distributed Processing Symposium, IPDPS 2007. IEEE International, pp. 1–8. IEEE (2007)
20.
go back to reference Müller, J.P., Fischer, K.: Application impact of multi-agent systems and technologies: a survey. In: Shehory, O., Sturm, A. (eds.) Agent-Oriented Software Engineering, pp. 27–53. Springer, Heidelberg (2014) Müller, J.P., Fischer, K.: Application impact of multi-agent systems and technologies: a survey. In: Shehory, O., Sturm, A. (eds.) Agent-Oriented Software Engineering, pp. 27–53. Springer, Heidelberg (2014)
21.
go back to reference Neuman, B.C.: Scale in distributed systems. ISI/USC (1994) Neuman, B.C.: Scale in distributed systems. ISI/USC (1994)
22.
go back to reference Pawlaszczyk, D., Strassburger, S.: Scalability in distributed simulations of agent-based models. In: Proceedings of the 2009 Winter Simulation Conference, pp. 1189–1200. IEEE (2009) Pawlaszczyk, D., Strassburger, S.: Scalability in distributed simulations of agent-based models. In: Proceedings of the 2009 Winter Simulation Conference, pp. 1189–1200. IEEE (2009)
23.
go back to reference Railsback, S.F., Lytinen, S.L., Jackson, S.K.: Agent-based simulation platforms: review and development recommendations. Simulation 82(9), 609–623 (2006)CrossRef Railsback, S.F., Lytinen, S.L., Jackson, S.K.: Agent-based simulation platforms: review and development recommendations. Simulation 82(9), 609–623 (2006)CrossRef
24.
go back to reference Rana, O.F., Stout, K.: What is scalability in multi-agent systems? In: Proceedings of the Fourth International Conference on Autonomous Agents, pp. 56–63. ACM (2000) Rana, O.F., Stout, K.: What is scalability in multi-agent systems? In: Proceedings of the Fourth International Conference on Autonomous Agents, pp. 56–63. ACM (2000)
26.
go back to reference Singhal, S.K., Cheriton, D.R.: Using projection aggregations to support scalability in distributed simulation. In: Proceedings of the 16th International Conference on Distributed Computing Systems, pp. 196–206. IEEE (1996) Singhal, S.K., Cheriton, D.R.: Using projection aggregations to support scalability in distributed simulation. In: Proceedings of the 16th International Conference on Distributed Computing Systems, pp. 196–206. IEEE (1996)
27.
go back to reference Song, R., Korba, L.: Modeling and simulating the scalability of a multi-agent application system. NRC/ERB-1097 (2002) Song, R., Korba, L.: Modeling and simulating the scalability of a multi-agent application system. NRC/ERB-1097 (2002)
28.
go back to reference Squazzoni, F., Jager, W., Edmonds, B.: Social simulation in the social sciences a brief overview. Soc. Sci. Comput. Rev. 32(3), 279–294 (2014)CrossRef Squazzoni, F., Jager, W., Edmonds, B.: Social simulation in the social sciences a brief overview. Soc. Sci. Comput. Rev. 32(3), 279–294 (2014)CrossRef
29.
go back to reference Timm, I.J., Pawlaszczyk, D.: Large scale multiagent simulation on the grid. In: IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005, vol. 1, pp. 334–341. IEEE (2005) Timm, I.J., Pawlaszczyk, D.: Large scale multiagent simulation on the grid. In: IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005, vol. 1, pp. 334–341. IEEE (2005)
30.
go back to reference Tobias, R., Hofmann, C.: Evaluation of free java-libraries for social-scientific agent based simulation. J. Artif. Soc. Soc. Simul. 7(1), 6 (2004) Tobias, R., Hofmann, C.: Evaluation of free java-libraries for social-scientific agent based simulation. J. Artif. Soc. Soc. Simul. 7(1), 6 (2004)
31.
go back to reference Tolbert, L.M., Qi, H., Peng, F.Z.: Scalable multi-agent system for real-time electric power management. In: Power Engineering Society Summer Meeting, vol. 3, pp. 1676–1679. IEEE (2001) Tolbert, L.M., Qi, H., Peng, F.Z.: Scalable multi-agent system for real-time electric power management. In: Power Engineering Society Summer Meeting, vol. 3, pp. 1676–1679. IEEE (2001)
32.
go back to reference Turner, P.J., Jennings, N.R.: Improving the scalability of multi-agent systems. In: Wagner, T.A., Rana, O.F. (eds.) AA-WS 2000. LNCS (LNAI), vol. 1887, pp. 246–262. Springer, Heidelberg (2001) CrossRef Turner, P.J., Jennings, N.R.: Improving the scalability of multi-agent systems. In: Wagner, T.A., Rana, O.F. (eds.) AA-WS 2000. LNCS (LNAI), vol. 1887, pp. 246–262. Springer, Heidelberg (2001) CrossRef
33.
go back to reference Warden, T., Porzel, R., Gehrke, J.D., Herzog, O., Langer, H., Malaka, R.: Towards ontology-based multiagent simulations: the plasma approach. In: ECMS, pp. 50–56 (2010) Warden, T., Porzel, R., Gehrke, J.D., Herzog, O., Langer, H., Malaka, R.: Towards ontology-based multiagent simulations: the plasma approach. In: ECMS, pp. 50–56 (2010)
34.
go back to reference Weinstock, C.B., Goodenough, J.B.: On system scalability. Technical report, DTIC Document Technical Note CMU/SEI-2006-TN-012 (2006) Weinstock, C.B., Goodenough, J.B.: On system scalability. Technical report, DTIC Document Technical Note CMU/SEI-2006-TN-012 (2006)
35.
go back to reference Wooldridge, M., Jennings, N.R.: Intelligent agents: theory and practice. Knowl. Eng. Rev. 10(02), 115–152 (1995)CrossRef Wooldridge, M., Jennings, N.R.: Intelligent agents: theory and practice. Knowl. Eng. Rev. 10(02), 115–152 (1995)CrossRef
Metadata
Title
Measuring and Comparing Scalability of Agent-Based Simulation Frameworks
Authors
Fabian Lorig
Nils Dammenhayn
David-Johannes Müller
Ingo J. Timm
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-27343-3_3

Premium Partner