Skip to main content
Erschienen in: The Journal of Supercomputing 2/2018

13.09.2017

Large-scale simulation of a self-organizing self-management cloud computing framework

verfasst von: Christos K. Filelis-Papadopoulos, Konstantinos M. Giannoutakis, George A. Gravvanis, Dimitrios Tzovaras

Erschienen in: The Journal of Supercomputing | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A recently introduced cloud simulation framework is extended to support self-organizing and self-management local strategies in the cloud resource hierarchy. This dynamic hardware resource allocation system is evolving toward the goals defined by local strategies, which are determined as maximization of: energy efficiency of cloud infrastructures, task throughput, computational efficiency and resource management efficiency. Heterogeneous hardware resources are considered that are except from commodity CPU servers, hardware accelerators such as GPUs, MICs and FPGAs, thus forming a heterogeneous cloud infrastructure. Energy consumption and task execution models for the heterogeneous accelerators are also proposed, in order to demonstrate the energy efficiency of the proposed resource allocation system. Implementation details of the new functionalities on the parallel cloud simulation framework are discussed, while numerical results are given for the scalability and utilization of the cloud elements using the self-organization and self-management framework with two VM placement strategies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Barroso LA, Clidaras J, Hölzle U (2013) The datacenter as a computer: an introduction to the design of warehouse-scale machines. Synth Lect Comput Architect 8(3):1–154CrossRef Barroso LA, Clidaras J, Hölzle U (2013) The datacenter as a computer: an introduction to the design of warehouse-scale machines. Synth Lect Comput Architect 8(3):1–154CrossRef
2.
Zurück zum Zitat Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50CrossRef Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50CrossRef
4.
Zurück zum Zitat Chronopoulos A, Andonie R, Benche M, Grosu D (2001) A class of loop self-scheduling for heterogeneous clusters. In: Proceedings 42nd IEEE Symposium on Foundations of Computer Science, pp 282–291. doi:10.1109/CLUSTR.2001.959989 Chronopoulos A, Andonie R, Benche M, Grosu D (2001) A class of loop self-scheduling for heterogeneous clusters. In: Proceedings 42nd IEEE Symposium on Foundations of Computer Science, pp 282–291. doi:10.​1109/​CLUSTR.​2001.​959989
5.
Zurück zum Zitat Dagum L, Menon R (1998) Openmp: an industry-standard api for shared-memory programming. J IEEE Comput Sci Eng 5(1):46–55CrossRef Dagum L, Menon R (1998) Openmp: an industry-standard api for shared-memory programming. J IEEE Comput Sci Eng 5(1):46–55CrossRef
6.
Zurück zum Zitat Filelis-Papadopoulos C, Gravvanis G, Morrison J (2017) Cloudlightning simulation and evaluation roadmap. In: Proceedings of the 1st International Workshop on Next Generation of Cloud Architectures, cloudNG:17, pp 2:1–2:6. ACM, New York, NY. doi:10.1145/3068126.3068128 Filelis-Papadopoulos C, Gravvanis G, Morrison J (2017) Cloudlightning simulation and evaluation roadmap. In: Proceedings of the 1st International Workshop on Next Generation of Cloud Architectures, cloudNG:17, pp 2:1–2:6. ACM, New York, NY. doi:10.​1145/​3068126.​3068128
7.
Zurück zum Zitat Filelis-Papadopoulos C, Grylonakis E, Kyziropoulos P, Gravvanis G, Morrison J (2016) Characterization of hardware in self-managing self-organizing cloud environment. In: Proceedings of the 20th Pan-Hellenic Conference on Informatics, PCI ’16, pp 56:1–56:6. ACM, New York, NY. doi:10.1145/3003733.3003749 Filelis-Papadopoulos C, Grylonakis E, Kyziropoulos P, Gravvanis G, Morrison J (2016) Characterization of hardware in self-managing self-organizing cloud environment. In: Proceedings of the 20th Pan-Hellenic Conference on Informatics, PCI ’16, pp 56:1–56:6. ACM, New York, NY. doi:10.​1145/​3003733.​3003749
8.
Zurück zum Zitat Filelis-Papadopoulos C, Xiong H, Spătaru A, Castañé GG, Dong D, Gravvanis GA, Morrison JP (2017) A generic framework supporting self-organisation and self-management in hierarchical systems. In: International Symposium on Parallel and Distributed Computing 2017. ISPDC’17, to appear. IEEE Filelis-Papadopoulos C, Xiong H, Spătaru A, Castañé GG, Dong D, Gravvanis GA, Morrison JP (2017) A generic framework supporting self-organisation and self-management in hierarchical systems. In: International Symposium on Parallel and Distributed Computing 2017. ISPDC’17, to appear. IEEE
10.
Zurück zum Zitat Giannoutakis KM, Makaratzis AT, Tzovaras D, Filelis-Papadopoulos CK, Gravvanis GA (2017) On the power consumption modeling for the simulation of heterogeneous hpc clouds. In: Proceedings of the 1st International Workshop on Next Generation of Cloud Architectures, CloudNG:17, pp 1:1–1:6. ACM, New York, NY. doi:10.1145/3068126.3068127 Giannoutakis KM, Makaratzis AT, Tzovaras D, Filelis-Papadopoulos CK, Gravvanis GA (2017) On the power consumption modeling for the simulation of heterogeneous hpc clouds. In: Proceedings of the 1st International Workshop on Next Generation of Cloud Architectures, CloudNG:17, pp 1:1–1:6. ACM, New York, NY. doi:10.​1145/​3068126.​3068127
11.
Zurück zum Zitat Gupta A, Milojicic D (2011) Evaluation of hpc applications on cloud. In: Proceedings of the 2011 Sixth Open Cirrus Summit, OCS ’11, pp 22–26. IEEE Computer Society, Washington, DC Gupta A, Milojicic D (2011) Evaluation of hpc applications on cloud. In: Proceedings of the 2011 Sixth Open Cirrus Summit, OCS ’11, pp 22–26. IEEE Computer Society, Washington, DC
12.
Zurück zum Zitat Han Y, Chronopoulos AT (2013) A hierarchical distributed loop self-scheduling scheme for cloud systems. In: 2013 12th IEEE International Symposium on Network Computing and Applications (NCA), pp 7–10. IEEE Han Y, Chronopoulos AT (2013) A hierarchical distributed loop self-scheduling scheme for cloud systems. In: 2013 12th IEEE International Symposium on Network Computing and Applications (NCA), pp 7–10. IEEE
13.
Zurück zum Zitat Han Y, Chronopoulos AT (2014) A resilient hierarchical distributed loop self-scheduling scheme for cloud systems. In: 2014 IEEE 13th International Symposium on Network Computing and Applications, pp 80–84. doi:10.1109/NCA.2014.18 Han Y, Chronopoulos AT (2014) A resilient hierarchical distributed loop self-scheduling scheme for cloud systems. In: 2014 IEEE 13th International Symposium on Network Computing and Applications, pp 80–84. doi:10.​1109/​NCA.​2014.​18
14.
Zurück zum Zitat Hassani R, Aiatullah M, Luksch P. Improving hpc application performance in public cloud. IERI Proced 10 Hassani R, Aiatullah M, Luksch P. Improving hpc application performance in public cloud. IERI Proced 10
15.
Zurück zum Zitat He Q, Zhou S, Kobler B, Duffy D, McGlynn T (2010) Case study for running HPC applications in public clouds. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC ’10, pp 395–401. ACM, New York, NY (2010). doi:10.1145/1851476.1851535 He Q, Zhou S, Kobler B, Duffy D, McGlynn T (2010) Case study for running HPC applications in public clouds. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC ’10, pp 395–401. ACM, New York, NY (2010). doi:10.​1145/​1851476.​1851535
18.
Zurück zum Zitat Lusk E, Doss N, Skjellum A (1996) A high-performance, portable implementation of the mpi message passing interface standard. Parallel Comput 22:789–828CrossRefMATH Lusk E, Doss N, Skjellum A (1996) A high-performance, portable implementation of the mpi message passing interface standard. Parallel Comput 22:789–828CrossRefMATH
19.
Zurück zum Zitat Lynn T, Xiong H, Dong D, Momani B, Gravvanis G, Filelis-Papadopoulos C, Elster A, Khan MMZM, Tzovaras D, Giannoutakis K, Petcu D, Neagul M, Dragon I, Kuppudayar P, Natarajan S, McGrath M, Gaydadjiev G, Becker T, Gourinovitch A, Kenny D, Morrison J (2016) Cloudlightning: a framework for a self-organising and self-managing heterogeneous cloud. In: Proceedings of the 6th International Conference on Cloud Computing and Services Science, vol 1: CLOSER, pp 333–338. doi:10.5220/0005921503330338 Lynn T, Xiong H, Dong D, Momani B, Gravvanis G, Filelis-Papadopoulos C, Elster A, Khan MMZM, Tzovaras D, Giannoutakis K, Petcu D, Neagul M, Dragon I, Kuppudayar P, Natarajan S, McGrath M, Gaydadjiev G, Becker T, Gourinovitch A, Kenny D, Morrison J (2016) Cloudlightning: a framework for a self-organising and self-managing heterogeneous cloud. In: Proceedings of the 6th International Conference on Cloud Computing and Services Science, vol 1: CLOSER, pp 333–338. doi:10.​5220/​0005921503330338​
21.
Zurück zum Zitat Mehrotra P, Djomehri J, Heistand S, Hood R, Jin H, Lazanoff A, Saini S, Biswas R (2012) Performance evaluation of amazon ec2 for nasa HPC applications. In: Proceedings of the 3rd Workshop on Scientific Cloud Computing, ScienceCloud ’12, pp 41–50. ACM, New York, NY. doi:10.1145/2287036.2287045 Mehrotra P, Djomehri J, Heistand S, Hood R, Jin H, Lazanoff A, Saini S, Biswas R (2012) Performance evaluation of amazon ec2 for nasa HPC applications. In: Proceedings of the 3rd Workshop on Scientific Cloud Computing, ScienceCloud ’12, pp 41–50. ACM, New York, NY. doi:10.​1145/​2287036.​2287045
23.
Zurück zum Zitat Penmatsa S, Chronopoulos AT, Karonis NT, Toonen BR (2007) Implementation of distributed loop scheduling schemes on the teragrid. In: 2007 IEEE International Parallel and Distributed Processing Symposium, pp 1–8. doi:10.1109/IPDPS.2007.370551 Penmatsa S, Chronopoulos AT, Karonis NT, Toonen BR (2007) Implementation of distributed loop scheduling schemes on the teragrid. In: 2007 IEEE International Parallel and Distributed Processing Symposium, pp 1–8. doi:10.​1109/​IPDPS.​2007.​370551
24.
Zurück zum Zitat Rao J, Wang KAZXAXC (2013) Optimizing virtual machine scheduling in numa multicore systems. In: 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA), pp 306–317 Rao J, Wang KAZXAXC (2013) Optimizing virtual machine scheduling in numa multicore systems. In: 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA), pp 306–317
26.
Zurück zum Zitat Xi S, Li C, Lu C, Gill C, Xu M, Phan L, Lee I, Sokolsky O (2015) Rt-open stack: CPU resource management for real-time cloud computing. In: 2015 IEEE 8th International Conference on Cloud Computing, pp 179–186. doi:10.1109/CLOUD.2015.33 Xi S, Li C, Lu C, Gill C, Xu M, Phan L, Lee I, Sokolsky O (2015) Rt-open stack: CPU resource management for real-time cloud computing. In: 2015 IEEE 8th International Conference on Cloud Computing, pp 179–186. doi:10.​1109/​CLOUD.​2015.​33
Metadaten
Titel
Large-scale simulation of a self-organizing self-management cloud computing framework
verfasst von
Christos K. Filelis-Papadopoulos
Konstantinos M. Giannoutakis
George A. Gravvanis
Dimitrios Tzovaras
Publikationsdatum
13.09.2017
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 2/2018
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-017-2143-2

Weitere Artikel der Ausgabe 2/2018

The Journal of Supercomputing 2/2018 Zur Ausgabe