Skip to main content

2015 | OriginalPaper | Buchkapitel

Measuring and Comparing Scalability of Agent-Based Simulation Frameworks

verfasst von : Fabian Lorig, Nils Dammenhayn, David-Johannes Müller, Ingo J. Timm

Erschienen in: Multiagent System Technologies

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

While computer simulation gained importance as a technique for generating knowledge in various research disciplines, the size of simulation models representing real world scenarios is growing, too. In Social Simulation, e.g., there is a need to simulate a large number of humans using individual software agents for generating and analyzing human-like behavior in artificial societies. Nowadays, a variety of toolkits and frameworks exists providing functionalities for supporting implementation and execution of simulation experiments. Yet, the choice of a suitable framework is difficult as unforeseen scalability issues may arise when extending agent models. Therefore, this paper aims at providing a method for analyzing and comparing agent-based simulation frameworks regarding their ability to scale simulation models and experiments. Based on performance metrics, standardized experiments are conducted while altering internal and external scaling parameters. As part of the study, four Java-based agent frameworks are analyzed and compared: Aimpulse Spectrum, JADE, MASON, and Repast.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
http://​www.​flamegpu.​com (last visited Oct. 3, 2015).
 
3
http://​www.​anylogic.​com (last visited Oct. 3, 2015).
 
4
http://​www.​aimpulse.​com (last visited Oct. 3, 2015).
 
5
http://​jade.​tilab.​com (last visited Oct. 3, 2015).
 
8
A virtual machine (VM) emulates a real computer system. Doing so, hardware configurations can be adjusted easily and without physically modifying the system.
 
Literatur
2.
Zurück zum Zitat Conte, R., Gilbert, N., Sichman, J.S.: MAS and social simulation: a suitable commitment. In: Gilbert, N., Sichman, J.S., Conte, R. (eds.) MABS 1998. LNCS (LNAI), vol. 1534, pp. 1–9. Springer, Heidelberg (1998) CrossRef Conte, R., Gilbert, N., Sichman, J.S.: MAS and social simulation: a suitable commitment. In: Gilbert, N., Sichman, J.S., Conte, R. (eds.) MABS 1998. LNCS (LNAI), vol. 1534, pp. 1–9. Springer, Heidelberg (1998) CrossRef
3.
Zurück zum Zitat Cortese, E., Quarta, F., Vitaglione, G., Vrba, P.: Scalability and performance of jade message transport system. In: AAMAS Workshop on AgentCities, Bologna, vol. 16 (2002) Cortese, E., Quarta, F., Vitaglione, G., Vrba, P.: Scalability and performance of jade message transport system. In: AAMAS Workshop on AgentCities, Bologna, vol. 16 (2002)
4.
Zurück zum Zitat Davidsson, P.: Agent based social simulation: a computer science view. J. Artif. Soc. Soc. Simul. 5(1), 7 (2002) Davidsson, P.: Agent based social simulation: a computer science view. J. Artif. Soc. Soc. Simul. 5(1), 7 (2002)
5.
Zurück zum Zitat Deters, R.: Scalability & multi-agent systems. In: 2nd International Workshop Infrastructure for Agents, MAS and Scalable MAS, 5th International Conference on Autonomous Agents (2001) Deters, R.: Scalability & multi-agent systems. In: 2nd International Workshop Infrastructure for Agents, MAS and Scalable MAS, 5th International Conference on Autonomous Agents (2001)
6.
Zurück zum Zitat Di Caro, G.A.: Analysis of simulation environments for mobile ad hoc networks. Technical Report, Dalle Molle Institute for Artificial Intelligence (2003) Di Caro, G.A.: Analysis of simulation environments for mobile ad hoc networks. Technical Report, Dalle Molle Institute for Artificial Intelligence (2003)
7.
Zurück zum Zitat Doran, J., Gilbert, N.: Simulating societies: an introduction. In: Simulating Societies: The Computer Simulation of Social Phenomena, pp. 1–18 (1994) Doran, J., Gilbert, N.: Simulating societies: an introduction. In: Simulating Societies: The Computer Simulation of Social Phenomena, pp. 1–18 (1994)
8.
Zurück zum Zitat Gatti, M., Cavalin, P., Neto, S.B., Pinhanez, C., dos Santos, C., Gribel, D., Appel, A.P.: Large-scale multi-agent-based modeling and simulation of microblogging-based online social network. In: Alam, S.J., Van Dyke Parunak, H. (eds.) MABS 2013. LNCS, vol. 8235, pp. 17–33. Springer, Heidelberg (2014) CrossRef Gatti, M., Cavalin, P., Neto, S.B., Pinhanez, C., dos Santos, C., Gribel, D., Appel, A.P.: Large-scale multi-agent-based modeling and simulation of microblogging-based online social network. In: Alam, S.J., Van Dyke Parunak, H. (eds.) MABS 2013. LNCS, vol. 8235, pp. 17–33. Springer, Heidelberg (2014) CrossRef
9.
Zurück zum Zitat Goldstein, J.: Emergence as a construct: History and issues. Emergence 1(1), 49–72 (1999)CrossRef Goldstein, J.: Emergence as a construct: History and issues. Emergence 1(1), 49–72 (1999)CrossRef
10.
Zurück zum Zitat Hamida, E.B., Chelius, G., Gorce, J.M.: Impact of the physical layer modeling on the accuracy and scalability of wireless network simulation. Simulation 85, 574–588 (2009)CrossRef Hamida, E.B., Chelius, G., Gorce, J.M.: Impact of the physical layer modeling on the accuracy and scalability of wireless network simulation. Simulation 85, 574–588 (2009)CrossRef
11.
Zurück zum Zitat Helsinger, A., Thome, M., Wright, T.: Cougaar: a scalable, distributed multi-agent architecture. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1910–1917. IEEE (2004) Helsinger, A., Thome, M., Wright, T.: Cougaar: a scalable, distributed multi-agent architecture. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1910–1917. IEEE (2004)
12.
Zurück zum Zitat Hewitt, C., Bishop, P., Steiger, R.: A universal modular actor formalism for artificial intelligence. In: Proceedings of the 3rd International Joint Conference on Artificial Intelligence, pp. 235–245. Morgan Kaufmann Publishers Inc. (1973) Hewitt, C., Bishop, P., Steiger, R.: A universal modular actor formalism for artificial intelligence. In: Proceedings of the 3rd International Joint Conference on Artificial Intelligence, pp. 235–245. Morgan Kaufmann Publishers Inc. (1973)
13.
Zurück zum Zitat Hill, M.D.: What is scalability? ACM SIGARCH Comput. Archit. News 18(4), 18–21 (1990)CrossRef Hill, M.D.: What is scalability? ACM SIGARCH Comput. Archit. News 18(4), 18–21 (1990)CrossRef
14.
Zurück zum Zitat Horling, B., Mailler, R., Lesser, V.: Farm: a scalable environment for multi-agent development and evaluation. In: Lucena, C., Garcia, A., Romanovsky, A., Castro, J., Alencar, P.S.C. (eds.) SELMAS 2003. LNCS, vol. 2940, pp. 225–242. Springer, Heidelberg (2004) CrossRef Horling, B., Mailler, R., Lesser, V.: Farm: a scalable environment for multi-agent development and evaluation. In: Lucena, C., Garcia, A., Romanovsky, A., Castro, J., Alencar, P.S.C. (eds.) SELMAS 2003. LNCS, vol. 2940, pp. 225–242. Springer, Heidelberg (2004) CrossRef
15.
Zurück zum Zitat Kiran, M., Richmond, P., Holcombe, M., Chin, L.S., Worth, D., Greenough, C.: Flame: simulating large populations of agents on parallel hardware architectures. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 1633–1636, International Foundation for Autonomous Agents and Multiagent Systems (2010) Kiran, M., Richmond, P., Holcombe, M., Chin, L.S., Worth, D., Greenough, C.: Flame: simulating large populations of agents on parallel hardware architectures. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 1633–1636, International Foundation for Autonomous Agents and Multiagent Systems (2010)
16.
Zurück zum Zitat Kravari, K., Bassiliades, N.: A survey of agent platforms. J. Artif. Soc. Soc. Simul. 18(1), 11 (2015) Kravari, K., Bassiliades, N.: A survey of agent platforms. J. Artif. Soc. Soc. Simul. 18(1), 11 (2015)
17.
Zurück zum Zitat Lee, L.C., Nwana, H.S., Ndumu, D.T., De Wilde, P.: The stability, scalability and performance of multi-agent systems. BT Tech. J. 16(3), 94–103 (1998)CrossRef Lee, L.C., Nwana, H.S., Ndumu, D.T., De Wilde, P.: The stability, scalability and performance of multi-agent systems. BT Tech. J. 16(3), 94–103 (1998)CrossRef
18.
Zurück zum Zitat Liu, H.H.: Software Performance and Scalability: A Quantitative Approach, vol. 7. Wiley, New York (2011)CrossRef Liu, H.H.: Software Performance and Scalability: A Quantitative Approach, vol. 7. Wiley, New York (2011)CrossRef
19.
Zurück zum Zitat Michael, M., Moreira, J.E., Shiloach, D., Wisniewski, R.W.: Scale-up x scale-out: a case study using nutch/lucene. In: Parallel and Distributed Processing Symposium, IPDPS 2007. IEEE International, pp. 1–8. IEEE (2007) Michael, M., Moreira, J.E., Shiloach, D., Wisniewski, R.W.: Scale-up x scale-out: a case study using nutch/lucene. In: Parallel and Distributed Processing Symposium, IPDPS 2007. IEEE International, pp. 1–8. IEEE (2007)
20.
Zurück zum Zitat Müller, J.P., Fischer, K.: Application impact of multi-agent systems and technologies: a survey. In: Shehory, O., Sturm, A. (eds.) Agent-Oriented Software Engineering, pp. 27–53. Springer, Heidelberg (2014) Müller, J.P., Fischer, K.: Application impact of multi-agent systems and technologies: a survey. In: Shehory, O., Sturm, A. (eds.) Agent-Oriented Software Engineering, pp. 27–53. Springer, Heidelberg (2014)
21.
Zurück zum Zitat Neuman, B.C.: Scale in distributed systems. ISI/USC (1994) Neuman, B.C.: Scale in distributed systems. ISI/USC (1994)
22.
Zurück zum Zitat Pawlaszczyk, D., Strassburger, S.: Scalability in distributed simulations of agent-based models. In: Proceedings of the 2009 Winter Simulation Conference, pp. 1189–1200. IEEE (2009) Pawlaszczyk, D., Strassburger, S.: Scalability in distributed simulations of agent-based models. In: Proceedings of the 2009 Winter Simulation Conference, pp. 1189–1200. IEEE (2009)
23.
Zurück zum Zitat Railsback, S.F., Lytinen, S.L., Jackson, S.K.: Agent-based simulation platforms: review and development recommendations. Simulation 82(9), 609–623 (2006)CrossRef Railsback, S.F., Lytinen, S.L., Jackson, S.K.: Agent-based simulation platforms: review and development recommendations. Simulation 82(9), 609–623 (2006)CrossRef
24.
Zurück zum Zitat Rana, O.F., Stout, K.: What is scalability in multi-agent systems? In: Proceedings of the Fourth International Conference on Autonomous Agents, pp. 56–63. ACM (2000) Rana, O.F., Stout, K.: What is scalability in multi-agent systems? In: Proceedings of the Fourth International Conference on Autonomous Agents, pp. 56–63. ACM (2000)
26.
Zurück zum Zitat Singhal, S.K., Cheriton, D.R.: Using projection aggregations to support scalability in distributed simulation. In: Proceedings of the 16th International Conference on Distributed Computing Systems, pp. 196–206. IEEE (1996) Singhal, S.K., Cheriton, D.R.: Using projection aggregations to support scalability in distributed simulation. In: Proceedings of the 16th International Conference on Distributed Computing Systems, pp. 196–206. IEEE (1996)
27.
Zurück zum Zitat Song, R., Korba, L.: Modeling and simulating the scalability of a multi-agent application system. NRC/ERB-1097 (2002) Song, R., Korba, L.: Modeling and simulating the scalability of a multi-agent application system. NRC/ERB-1097 (2002)
28.
Zurück zum Zitat Squazzoni, F., Jager, W., Edmonds, B.: Social simulation in the social sciences a brief overview. Soc. Sci. Comput. Rev. 32(3), 279–294 (2014)CrossRef Squazzoni, F., Jager, W., Edmonds, B.: Social simulation in the social sciences a brief overview. Soc. Sci. Comput. Rev. 32(3), 279–294 (2014)CrossRef
29.
Zurück zum Zitat Timm, I.J., Pawlaszczyk, D.: Large scale multiagent simulation on the grid. In: IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005, vol. 1, pp. 334–341. IEEE (2005) Timm, I.J., Pawlaszczyk, D.: Large scale multiagent simulation on the grid. In: IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005, vol. 1, pp. 334–341. IEEE (2005)
30.
Zurück zum Zitat Tobias, R., Hofmann, C.: Evaluation of free java-libraries for social-scientific agent based simulation. J. Artif. Soc. Soc. Simul. 7(1), 6 (2004) Tobias, R., Hofmann, C.: Evaluation of free java-libraries for social-scientific agent based simulation. J. Artif. Soc. Soc. Simul. 7(1), 6 (2004)
31.
Zurück zum Zitat Tolbert, L.M., Qi, H., Peng, F.Z.: Scalable multi-agent system for real-time electric power management. In: Power Engineering Society Summer Meeting, vol. 3, pp. 1676–1679. IEEE (2001) Tolbert, L.M., Qi, H., Peng, F.Z.: Scalable multi-agent system for real-time electric power management. In: Power Engineering Society Summer Meeting, vol. 3, pp. 1676–1679. IEEE (2001)
32.
Zurück zum Zitat Turner, P.J., Jennings, N.R.: Improving the scalability of multi-agent systems. In: Wagner, T.A., Rana, O.F. (eds.) AA-WS 2000. LNCS (LNAI), vol. 1887, pp. 246–262. Springer, Heidelberg (2001) CrossRef Turner, P.J., Jennings, N.R.: Improving the scalability of multi-agent systems. In: Wagner, T.A., Rana, O.F. (eds.) AA-WS 2000. LNCS (LNAI), vol. 1887, pp. 246–262. Springer, Heidelberg (2001) CrossRef
33.
Zurück zum Zitat Warden, T., Porzel, R., Gehrke, J.D., Herzog, O., Langer, H., Malaka, R.: Towards ontology-based multiagent simulations: the plasma approach. In: ECMS, pp. 50–56 (2010) Warden, T., Porzel, R., Gehrke, J.D., Herzog, O., Langer, H., Malaka, R.: Towards ontology-based multiagent simulations: the plasma approach. In: ECMS, pp. 50–56 (2010)
34.
Zurück zum Zitat Weinstock, C.B., Goodenough, J.B.: On system scalability. Technical report, DTIC Document Technical Note CMU/SEI-2006-TN-012 (2006) Weinstock, C.B., Goodenough, J.B.: On system scalability. Technical report, DTIC Document Technical Note CMU/SEI-2006-TN-012 (2006)
35.
Zurück zum Zitat Wooldridge, M., Jennings, N.R.: Intelligent agents: theory and practice. Knowl. Eng. Rev. 10(02), 115–152 (1995)CrossRef Wooldridge, M., Jennings, N.R.: Intelligent agents: theory and practice. Knowl. Eng. Rev. 10(02), 115–152 (1995)CrossRef
Metadaten
Titel
Measuring and Comparing Scalability of Agent-Based Simulation Frameworks
verfasst von
Fabian Lorig
Nils Dammenhayn
David-Johannes Müller
Ingo J. Timm
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-27343-3_3