Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
The Journal of Supercomputing
Erschienen in: The Journal of Supercomputing 4/2021

10.09.2020

PerficientCloudSim: a tool to simulate large-scale computation in heterogeneous clouds

verfasst von: Muhammad Zakarya, Lee Gillam, Ayaz Ali Khan, Izaz Ur Rahman

Erschienen in: The Journal of Supercomputing | Ausgabe 4/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The major reason for using a simulator, instead of a real test-bed, is to enable repeatable evaluation of large-scale cloud systems. CloudSim, the most widely used simulator, enables users to implement resource provisioning, and management policies. However, CloudSim does not provide support for: (i) interactive online services; (ii) platform heterogeneities; (iii) virtual machine migration modelling; and (iv) other essential models to abstract a real datacenter. This paper describes modifications needed in the classical CloudSim to support realistic experimentations that closely match experimental outcomes in a real system. We extend, and partially re-factor CloudSim to “PerficientCloudSim” in order to provide support for large-scale computation over heterogeneous resources. In the classical CloudSim, we add several classes for workload performance variations due to: (a) CPU heterogeneities; (b) resource contention; and (c) service migration. Through plausible assumptions, our empirical evaluation, using real workload traces from Google and Microsoft Azure clusters, demonstrates that “PerficientCloudSim” can reasonably simulate large-scale heterogeneous datacenters in respect of resource allocation and migration policies, resource contention, and platform heterogeneities. We discuss statistical methods to measure the accuracy of the simulated outcomes.
Vorheriger Artikel Static and incremental dynamic approaches for multi-objective bitmap join indexes selection in data warehouses
Nächster Artikel Performance prediction of parallel applications: a systematic literature review

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
7
Personal correspondence with Gabor Kecskemeti, a Research Fellow in Laboratory of Parallel and Distributed Systems, MTA SZTAKI—https://​www.​lpds.​sztaki.​hu.
 
19
The host that cannot be allocated due to a single resource unavailability—enough CPU is available, but there is insufficient memory [58].
 
Literatur
1.
Calheiros RN, Ranjan R, Beloglazov A, De Rose CAF, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50
2.
Zakarya M, Gillam L (2019) Modelling resource heterogeneities in cloud simulations and quantifying their accuracy. Simul Model Pract Theory 94:43–65
3.
Zakarya M, Gillam L (2017) Energy and performance aware resource management in heterogeneous cloud datacenters. PhD thesis, University of Surrey
4.
Kecskemeti G (2015) Dissect-cf: a simulator to foster energy-aware scheduling in infrastructure clouds. Simul Model Pract Theory 58:188–218
5.
Kliazovich D, Bouvry P, Khan SU (2012) Greencloud: a packet-level simulator of energy-aware cloud computing data centers. J Supercomput 62(3):1263–1283
6.
Tighe M, Keller G, Bauer M, Lutfiyya H (2012) DCSim: a data centre simulation tool for evaluating dynamic virtualized resource management. In: 2012 8th International Conference on Network and Service Management (CNSM) and 2012 Workshop on Systems Virtualization Management (SVM), pp 385–392. IEEE
7.
Buyya R, Murshed M (2002) Gridsim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurr Comput Pract Exp 14(13–15):1175–1220MATH
8.
Beloglazov A, Abawajy J, Buyya R (2012) Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener Comput Syst 28(5):755–768
9.
O’Loughlin J (2018) A workload-specific performance brokerage for infrastructure clouds. PhD thesis, University of Surrey
10.
O’Loughlin J, Gillam L (2016) Sibling virtual machine co-location confirmation and avoidance tactics for public infrastructure clouds. J Supercomput 72(3):961–984
11.
Fei X, Liu F, Jin H (2016) Heterogeneity and interference-aware virtual machine provisioning for predictable performance in the cloud. IEEE Trans Comput 65(8):2470–2483MathSciNetMATH
12.
Zakarya M, Gillam L (2019) Managing energy, performance and cost in large scale heterogeneous datacenters using migrations. Future Gener Comput Syst 93:529–547
13.
Reiss C, Wilkes J, Hellerstein JL (2011) Google cluster-usage traces: format + schema. Google Inc., Mountain View, CA, USA, Technical Report
14.
Zakarya M, Gillam L (2016) An energy aware cost recovery approach for virtual machine migration. In: International Conference on the Economics of Grids, Clouds, Systems, and Services, pp 175–190. Springer
15.
Cortez E, Bonde A, Muzio A, Russinovich M, Fontoura M, Bianchini R (2017) Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. In: Proceedings of the 26th Symposium on Operating Systems Principles, pp 153–167. ACM
16.
Shai O, Shmueli E, Feitelson DG (2013) Heuristics for resource matching in intel’s compute farm. In: Workshop on Job Scheduling Strategies for Parallel Processing, pp 116–135. Springer
17.
Lebre A, Pastor J, Simonet A, Südholt M (2019) Putting the next 500 vm placement algorithms to the acid test: the infrastructure provider viewpoint. IEEE Trans Parallel Distrib Syst 30(1):204–217
18.
Sharkh MA, Kanso A, Shami A, Öhlén P (2016) Building a cloud on earth: a study of cloud computing data center simulators. Comput Netw 108:78–96
19.
Perez DA, Velasquez K, Curado M, Monteiro E (2019) A comparative analysis of simulators for the cloud to fog continuum. Simul Model Pract Theory 101:102029
20.
Fakhfakh F, Kacem HH, Kacem AH (2017) Simulation tools for cloud computing: a survey and comparative study. In: 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS), pp 221–226. IEEE
21.
Khan AA, Zakarya M, Khan R (2019) H2—a hybrid heterogeneity aware resource orchestrator for cloud platforms. IEEE Syst J 13(4):3873–3876
22.
Piraghaj SF, Dastjerdi AV, Calheiros RN, Buyya R (2017) Containercloudsim: an environment for modeling and simulation of containers in cloud data centers. Softw Pract Exp 47(4):505–521
23.
Beloglazov A, Buyya R (2015) Openstack neat: a framework for dynamic and energy-efficient consolidation of virtual machines in openstack clouds. Concurr Comput Pract Exp 27(5):1310–1333
24.
Núñez A, Vázquez-Poletti JL, Caminero AC, Castañé GG, Carretero J, Llorente IM (2012) icancloud: a flexible and scalable cloud infrastructure simulator. J Grid Comput 10(1):185–209
25.
Sonmez C, Ozgovde A, Ersoy C (2018) Edgecloudsim: an environment for performance evaluation of edge computing systems. Trans Emerg Telecommun Technol 29(11):e3493
26.
Gupta H, Dastjerdi AV, Ghosh SK, Buyya R (2017) ifogsim: a toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Softw Pract Exp 47(9):1275–1296
27.
Puliafito C, Gonçalves DM, Lopes MM, Martins LL, Madeira E, Mingozzi E, Rana O, Bittencourt LF (2020) Mobfogsim: simulation of mobility and migration for fog computing. Simul Model Pract Theory 101:102062
28.
Ostermann S, Plankensteiner K, Prodan R, Fahringer T (2010) Groudsim: an event-based simulation framework for computational grids and clouds. In: European Conference on Parallel Processing, pp 305–313. Springer
29.
Lim SH, Sharma B, Nam G, Kim EK, Das CR (2009) Mdcsim: a multi-tier data center simulation, platform. In: IEEE International Conference on Cluster Computing and Workshops, 2009. CLUSTER’09, pp 1–9. IEEE
30.
De Maio V, Kecskemeti G, Prodan R (2015) A workload-aware energy model for virtual machine migration. In: 2015 IEEE International Conference on Cluster Computing, pp 274–283. IEEE
31.
Lebre A, Pastor J, Südholt M (2015) Vmplaces: a generic tool to investigate and compare vm placement algorithms. In: European Conference on Parallel Processing, pp 317–329. Springer
32.
Cartlidge J, Cliff D (2013) Comparison of cloud middleware protocols and subscription network topologies using crest, the cloud research simulation toolkit-the three truths of cloud computing are: hardware fails, software has bugs, and people make mistakes. In: CLOSER, pp 58–68
33.
34.
Fernández-Cerero D, Fernández-Montes A, Jakobik A, Kołodziej J, Toro M (2018) Score: simulator for cloud optimization of resources and energy consumption. Simul Model Pract Theory 82:160–173
35.
Fernández-Cerero D, Jakóbik A, Fernández-Montes A, Kołodziej J (2019) Game-score: game-based energy-aware cloud scheduler and simulator for computational clouds. Simul Model Pract Theory 93:3–20
36.
Siavashi A, Momtazpour M (2019) Gpucloudsim: an extension of cloudsim for modeling and simulation of gpus in cloud data centers. J Supercomput 75(5):2535–2561
37.
Rahman UU, Bilal K, Erbad A, Khalid O, Khan SU (2019) Nutshell—simulation toolkit for modeling data center networks and cloud computing. IEEE Access 7:19922–19942
38.
Jscsc K (2020) Ecsnet++: a simulator for distributed stream processing on edge and cloud environments. Future Gener Comput Syst 111:401–418
39.
Tinini RI, dos Santos MRP, Figueiredo GB, Batista DM (2020) 5gpy: a simpy-based simulator for performance evaluations in 5g hybrid cloud-fog ran architectures. Simul Model Pract Theory 101:102030
40.
Das K (2011) Cloud computing simulation. PhD thesis, Indian Institute of Technology, Bombay Mumbai
41.
Di S, Cappello F (2015) Gloudsim: Google trace based cloud simulator with virtual machines. Softw Pract Exp 45(11):1571–1590
42.
Park KS, Pai VS (2006) Comon: a mostly-scalable monitoring system for planetlab. ACM SIGOPS Oper Syst Rev 40(1):65–74
43.
Zakarya M (2018) An extended energy-aware cost recovery approach for virtual machine migration. IEEE Syst J 13(2):1466–1477
44.
Huang Q, Gao F, Wang R, Qi Z (2011) Power consumption of virtual machine live migration in clouds. In: Proceedings—2011 3rd International Conference on Communications and Mobile Computing, CMC 2011, pp 122–125
45.
Alzamil I, Djemame K, Armstrong D, Kavanagh R (2015) Energy-aware profiling for cloud computing environments. Electron Notes Theor Comput Sci 318:91–108
46.
Alzamil I, Djemame K (2016) Energy prediction for cloud workload patterns. In: International Conference on the Economics of Grids, Clouds, Systems, and Services, pp 160–174. Springer
47.
Khan AA, Zakarya M, Khan R, Rahman IU, Khan M et al (2019) An energy, performance efficient resource consolidation scheme for heterogeneous cloud datacenters. J Netw Comput Appl 150:102497
48.
O’Loughlin J, Gillam L (2014) Performance evaluation for cost-efficient public infrastructure cloud use. In: International Conference on Grid Economics and Business Models, pp 133–145. Springer
49.
Jo C, Cho Y, Egger B (2017) A machine learning approach to live migration modeling. In: Proceedings of the 2017 Symposium on Cloud Computing, pp 351–364. ACM
50.
Wu Y, Zhao M (2011) Performance modeling of virtual machine live migration. In: 2011 IEEE 4th International Conference on Cloud Computing, pp 492–499. IEEE
51.
Liu H, Jin H, Cheng-Zhong X, Liao X (2013) Performance and energy modeling for live migration of virtual machines. Clust Comput 16(2):249–264
52.
Callau-Zori M, Samoila L, Orgerie A-C, Pierre G (2018) An experiment-driven energy consumption model for virtual machine management systems. Sustain Comput Inform Syst 18:163–174
53.
Ferreto TC, Netto MAS, Calheiros RN, De Rose CAF (2011) Server consolidation with migration control for virtualized data centers. Future Gener Comput Syst 27(8):1027–1034
54.
Zakarya M (2018) Energy, performance and cost efficient datacenters: a survey. Renew Sustain Energy Rev 94:363–385
55.
Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420
56.
Khan AA, Zakarya M, Khan R (2019) Energy-aware dynamic resource management in elastic cloud datacenters. Simul Model Pract Theory 92:82–99
57.
Quang-Hung N, Thoai N, Son NT (2014) EPOBF: energy efficient allocation of virtual machines in high performance computing cloud. In: Transactions on Large-Scale Data- and Knowledge-Centered Systems XVI, pp 71–86. Springer
58.
Verma A, Pedrosa L, Korupolu M, Oppenheimer D, Tune E, Wilkes J (2015) Large-scale cluster management at Google with Borg. In: Proceedings of the Tenth European Conference on Computer Systems—EuroSys ’15, pp 1–17
59.
60.
Zakarya M, Gillam L (2017) Energy efficient computing, clusters, grids and clouds: a taxonomy and survey. Sustain Comput Inform Syst 14:13–33
61.
Dabbagh M, Hamdaoui B, Guizani M, Rayes A (2014) Release-time aware VM placement. In: Globecom Workshops (GC Wkshps), 2014, pp 122–126. IEEE
62.
Guérout T, Monteil T, Da Costa G, Calheiros RN, Buyya R, Alexandru M (2013) Energy-aware simulation with DVFs. Simul Modell Pract Theory 39:76–91
63.
Garg SK, Buyya R (2011) Networkcloudsim: modelling parallel applications in cloud simulations. In: 2011 Fourth IEEE International Conference on Utility and Cloud Computing (UCC), pp 105–113. IEEE
64.
Calheiros RN, Netto MAS, De Rose CAF, Buyya R (2013) Emusim: an integrated emulation and simulation environment for modeling, evaluation, and validation of performance of cloud computing applications. Softw Pract Exp 43(5):595–612
65.
Frey S, Hasselbring W (2011) The cloudmig approach: model-based migration of software systems to cloud-optimized applications. Int J Adv Softw 4(3 and 4):342–353
66.
Beloglazov A, Buyya R, Lee YC, Zomaya A et al (2011) A taxonomy and survey of energy-efficient data centers and cloud computing systems. Adv Comput 82(2):47–111
67.
De Maio V, Kecskemeti G, Prodan R (2016) An improved model for live migration in data centre simulators. In: Proceedings of the 9th International Conference on Utility and Cloud Computing, pp 108–117. ACM
Metadaten
Titel
PerficientCloudSim: a tool to simulate large-scale computation in heterogeneous clouds
verfasst von
Muhammad Zakarya
Lee Gillam
Ayaz Ali Khan
Izaz Ur Rahman
Publikationsdatum
10.09.2020
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 4/2021
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03425-5

Weitere Artikel der Ausgabe 4/2021

The Journal of Supercomputing 4/2021 Zur Ausgabe

OriginalPaper

A semi-supervised approach in detecting sentiment and emotion based on digital payment reviews

OriginalPaper

On the use of many-core Marvell ThunderX2 processor for HPC workloads

OriginalPaper

A new method of abnormal behavior detection using LSTM network with temporal attention mechanism

OriginalPaper

A performance- and energy-oriented extended tuning process for time-step-based scientific applications

OriginalPaper

DNetUnet: a semi-supervised CNN of medical image segmentation for super-computing AI service

OriginalPaper

A novel enhanced region proposal network and modified loss function: threat object detection in secure screening using deep learning