Skip to main content
Top

2018 | OriginalPaper | Chapter

Measuring and Evaluating the Performance of Self-Organization Mechanisms Within Collective Adaptive Systems

Authors : Benedikt Eberhardinger, Hella Ponsar, Dominik Klumpp, Wolfgang Reif

Published in: Leveraging Applications of Formal Methods, Verification and Validation. Distributed Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

By restructuring and reconfiguring itself at run-time, a collective adaptive system (CAS) is able to fulfill its requirements under uncertain, ever-changing environmental conditions. Indeed, this process of self-organization (SO) is of utmost importance for the ability of the CAS to perform. However, it is hard to design high-performing SO mechanisms, because the environmental conditions are partially unpredictable at design time. Thus, a crucial aid for the development of SO mechanisms is a tool set enabling performance evaluations at design time in order to select the best-fitting mechanism and parametrize it. We present a metric for measuring the performance of an SO mechanism as well as a framework that enables evaluation of this metric. The proposed metric is evaluated for different kinds of SO mechanisms in two case studies: a smart energy management system and a self-organizing production cell.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We use the term “prosumer” to refer to producers as well as consumers.
 
Literature
1.
go back to reference Anders, G., Seebach, H., Nafz, F., Steghöfer, J.P., Reif, W.: Decentralized reconfiguration for self-organizing resource-flow systems based on local knowledge. In: Proceedings of the 8th IEEE International Conference and Workshops on Engineering of Autonomic and Autonomous Systems (EASe 2011), pp. 20–31. IEEE (2011) Anders, G., Seebach, H., Nafz, F., Steghöfer, J.P., Reif, W.: Decentralized reconfiguration for self-organizing resource-flow systems based on local knowledge. In: Proceedings of the 8th IEEE International Conference and Workshops on Engineering of Autonomic and Autonomous Systems (EASe 2011), pp. 20–31. IEEE (2011)
2.
go back to reference Anders, G., Siefert, F., Reif, W.: A particle swarm optimizer for solving the set partitioning problem in the presence of partitioning constraints. In: Proceedings of the 7th International Conference on Agents & AI (ICAART) (2015) Anders, G., Siefert, F., Reif, W.: A particle swarm optimizer for solving the set partitioning problem in the presence of partitioning constraints. In: Proceedings of the 7th International Conference on Agents & AI (ICAART) (2015)
3.
go back to reference Becker, M., Luckey, M., Becker, S.: Performance analysis of self-adaptive systems for requirements validation at design-time. In: 9th ACM SIGSOFT International Conference on Quality of Software Architectures (QoSA 2013). ACM (2013) Becker, M., Luckey, M., Becker, S.: Performance analysis of self-adaptive systems for requirements validation at design-time. In: 9th ACM SIGSOFT International Conference on Quality of Software Architectures (QoSA 2013). ACM (2013)
5.
go back to reference Eberhardinger, B., Anders, G., Seebach, H., Siefert, F., Knapp, A., Reif, W.: An approach for isolated testing of self-organization algorithms. In: de Lemos, R., Garlan, D., Ghezzi, C., Giese, H. (eds.) Software Engineering for Self-Adaptive Systems III. Assurances. LNCS, vol. 9640, pp. 188–222. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-74183-3_7CrossRef Eberhardinger, B., Anders, G., Seebach, H., Siefert, F., Knapp, A., Reif, W.: An approach for isolated testing of self-organization algorithms. In: de Lemos, R., Garlan, D., Ghezzi, C., Giese, H. (eds.) Software Engineering for Self-Adaptive Systems III. Assurances. LNCS, vol. 9640, pp. 188–222. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-74183-3_​7CrossRef
6.
go back to reference Eberhardinger, B., Anders, G., Seebach, H., Siefert, F., Reif, W.: A research overview and evaluation of performance metrics for self-organization algorithms. In: Proceedings of the 9th International Conference on Self-Adaptive and Self-Organizing Systems Workshops, pp. 122–127. IEEE (2015) Eberhardinger, B., Anders, G., Seebach, H., Siefert, F., Reif, W.: A research overview and evaluation of performance metrics for self-organization algorithms. In: Proceedings of the 9th International Conference on Self-Adaptive and Self-Organizing Systems Workshops, pp. 122–127. IEEE (2015)
8.
go back to reference Habermaier, A., Eberhardinger, B., Seebach, H., Leupolz, J., Reif, W.: Runtime model-based safety analysis of self-organizing systems with S#. In: 2015 IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops (SASOW), pp. 128–133. IEEE (2015) Habermaier, A., Eberhardinger, B., Seebach, H., Leupolz, J., Reif, W.: Runtime model-based safety analysis of self-organizing systems with S#. In: 2015 IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops (SASOW), pp. 128–133. IEEE (2015)
9.
go back to reference Kaddoum, E., Raibulet, C., Georgé, J., Picard, G., Gleizes, M.P.: Criteria for the evaluation of self-* systems. In: Proceedings of the 2010 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, pp. 29–38 (2010) Kaddoum, E., Raibulet, C., Georgé, J., Picard, G., Gleizes, M.P.: Criteria for the evaluation of self-* systems. In: Proceedings of the 2010 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, pp. 29–38 (2010)
10.
go back to reference Kantert, J., Tomforde, S., Müller-Schloer, C., Edenhofer, S., Sick, B.: Quantitative robustness - a generalised approach to compare the impact of disturbances in self-organising systems. In: Proceedings of the 9th International Conference on Agents and Artificial Intelligence, ICAART 2017, pp. 39–50 (2017) Kantert, J., Tomforde, S., Müller-Schloer, C., Edenhofer, S., Sick, B.: Quantitative robustness - a generalised approach to compare the impact of disturbances in self-organising systems. In: Proceedings of the 9th International Conference on Agents and Artificial Intelligence, ICAART 2017, pp. 39–50 (2017)
11.
go back to reference McGeoch, C.: A Guide to Experimental Algorithmics. Cambridge University Press, Cambridge (2012) McGeoch, C.: A Guide to Experimental Algorithmics. Cambridge University Press, Cambridge (2012)
12.
go back to reference Monostori, L.: Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17, 9–13 (2014)CrossRef Monostori, L.: Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17, 9–13 (2014)CrossRef
13.
go back to reference Musa, J.D.: A theory of software reliability and its application. IEEE Trans. Softw. Eng. 1(3), 312–327 (1975)CrossRef Musa, J.D.: A theory of software reliability and its application. IEEE Trans. Softw. Eng. 1(3), 312–327 (1975)CrossRef
14.
go back to reference Neyman, J.: Outline of a theory of statistical estimation based on the classical theory of probability. Phil. Trans. R. Soc. Lond. A 236(767), 333–380 (1937)CrossRef Neyman, J.: Outline of a theory of statistical estimation based on the classical theory of probability. Phil. Trans. R. Soc. Lond. A 236(767), 333–380 (1937)CrossRef
15.
go back to reference Parunak, H.V.D., Brueckner, S.A.: Software engineering for self-organizing systems. In: Proceedings of the 12th International Workshops on Agent-Oriented Software Engineering (AOSE 2011), pp. 1–22 (2011) Parunak, H.V.D., Brueckner, S.A.: Software engineering for self-organizing systems. In: Proceedings of the 12th International Workshops on Agent-Oriented Software Engineering (AOSE 2011), pp. 1–22 (2011)
16.
go back to reference Pitt, J., Busquets, D., Riveret, R.: Procedural justice and ‘Fitness for Purpose’ of self-organising electronic institutions. In: Boella, G., Elkind, E., Savarimuthu, B.T.R., Dignum, F., Purvis, M.K. (eds.) PRIMA 2013. LNCS (LNAI), vol. 8291, pp. 260–275. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-44927-7_18CrossRef Pitt, J., Busquets, D., Riveret, R.: Procedural justice and ‘Fitness for Purpose’ of self-organising electronic institutions. In: Boella, G., Elkind, E., Savarimuthu, B.T.R., Dignum, F., Purvis, M.K. (eds.) PRIMA 2013. LNCS (LNAI), vol. 8291, pp. 260–275. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-44927-7_​18CrossRef
17.
go back to reference Reinecke, P., Wolter, K., Van Moorsel, A.: Evaluating the adaptivity of computing systems. Perform. Eval. 67(8), 676–693 (2010)CrossRef Reinecke, P., Wolter, K., Van Moorsel, A.: Evaluating the adaptivity of computing systems. Perform. Eval. 67(8), 676–693 (2010)CrossRef
18.
go back to reference Steghöfer, J.P., Anders, G., Siefert, F., Reif, W.: A system of systems approach to the evolutionary transformation of power management systems. In: Proceedings of INFORMATIK - Workshops on Smart Grids. LNI. Köllen Verlag (2013) Steghöfer, J.P., Anders, G., Siefert, F., Reif, W.: A system of systems approach to the evolutionary transformation of power management systems. In: Proceedings of INFORMATIK - Workshops on Smart Grids. LNI. Köllen Verlag (2013)
19.
go back to reference Taranu, S., Tiemann, J.: On assessing self-adaptive systems. In: Proceedings of the 8th International Conference on Pervasive Computing and Communications Workshops, pp. 214–219. IEEE (2010) Taranu, S., Tiemann, J.: On assessing self-adaptive systems. In: Proceedings of the 8th International Conference on Pervasive Computing and Communications Workshops, pp. 214–219. IEEE (2010)
20.
go back to reference Villegas, N.M., Müller, H.A., Tamura, G., Duchien, L., Casallas, R.: A framework for evaluating quality-driven self-adaptive software systems. In: Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pp. 80–89. ACM (2011) Villegas, N.M., Müller, H.A., Tamura, G., Duchien, L., Casallas, R.: A framework for evaluating quality-driven self-adaptive software systems. In: Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pp. 80–89. ACM (2011)
Metadata
Title
Measuring and Evaluating the Performance of Self-Organization Mechanisms Within Collective Adaptive Systems
Authors
Benedikt Eberhardinger
Hella Ponsar
Dominik Klumpp
Wolfgang Reif
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-03424-5_14

Premium Partner