Skip to main content
Erschienen in: The Journal of Supercomputing 1/2021

20.03.2020

On the classification and quantification of server consolidation overheads

verfasst von: Belen Bermejo, Carlos Juiz

Erschienen in: The Journal of Supercomputing | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Virtualization technology is important for servers that compose cloud data centers. The current trend is to consolidate servers to manage them easily and reduce hardware and power consumption in data centers. However, performance degradation is inherent to virtualization technology and is caused by the hypervisor and overhead due to the consolidation of several virtual servers inside a physical server. Several ways exist to virtualize a server; these methods are based mainly on virtual machines and containers. In this paper, we propose a general method to estimate the value of the consolidation overhead classes, regardless of the virtualization platform, server characteristics and workload type. We conducted several experiments in different scenarios to illustrate the usefulness of the proposed method. The results show the applicability of the proposed method and indicate that these inherent overheads are not negligible in many cases depending on, first, the type of hypervisor and, second, the hardware resources features of the physical server.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Agarwal K, Jain B, Porter DE (2015) Containing the hype. In: Proceedings of the 6th Asia-Pacific Workshop on Systems. ACM, p 8 Agarwal K, Jain B, Porter DE (2015) Containing the hype. In: Proceedings of the 6th Asia-Pacific Workshop on Systems. ACM, p 8
2.
Zurück zum Zitat Barik RK, Lenka RK, Rao KR, Ghose D (2016) Performance analysis of virtual machines and containers in cloud computing. In: 2016 International Conference on Computing, Communication and Automation (ICCCA). IEEE, pp 1204–1210 Barik RK, Lenka RK, Rao KR, Ghose D (2016) Performance analysis of virtual machines and containers in cloud computing. In: 2016 International Conference on Computing, Communication and Automation (ICCCA). IEEE, pp 1204–1210
4.
Zurück zum Zitat Bermejo B, Juiz C, Guerrero C (2019) Virtualization and consolidation: a systematic review of the past 10 years of research on energy and performance. J Supercomput 75(2):808–836CrossRef Bermejo B, Juiz C, Guerrero C (2019) Virtualization and consolidation: a systematic review of the past 10 years of research on energy and performance. J Supercomput 75(2):808–836CrossRef
5.
Zurück zum Zitat Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes, Oxford Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes, Oxford
6.
Zurück zum Zitat Calzarossa MC, Della Vedova ML, Massari L, Petcu D, Tabash MI, Tessera D (2016) Workloads in the clouds. In: Principles of performance and reliability modeling and evaluation. Springer, Cham, pp 525–550CrossRef Calzarossa MC, Della Vedova ML, Massari L, Petcu D, Tabash MI, Tessera D (2016) Workloads in the clouds. In: Principles of performance and reliability modeling and evaluation. Springer, Cham, pp 525–550CrossRef
8.
Zurück zum Zitat Celesti A, Mulfari D, Galletta A, Fazio M, Carnevale L, Villari M (2019) A study on container virtualization for guarantee quality of service in cloud-of-things. Future Gener Comput Syst 99:356–364CrossRef Celesti A, Mulfari D, Galletta A, Fazio M, Carnevale L, Villari M (2019) A study on container virtualization for guarantee quality of service in cloud-of-things. Future Gener Comput Syst 99:356–364CrossRef
9.
Zurück zum Zitat Cherkasova L, Gardner R (2005) Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In: USENIX Annual Technical Conference, General Track, vol 50 Cherkasova L, Gardner R (2005) Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In: USENIX Annual Technical Conference, General Track, vol 50
10.
Zurück zum Zitat Chung MT, Quang-Hung N, Nguyen MT, Thoai N (2016) Using docker in high performance computing applications. In: 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE). IEEE, pp 52–57 Chung MT, Quang-Hung N, Nguyen MT, Thoai N (2016) Using docker in high performance computing applications. In: 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE). IEEE, pp 52–57
11.
Zurück zum Zitat Dua R, Raja AR, Kakadia D (2014) Virtualization vs containerization to support PaaS. In: 2014 IEEE International Conference on Cloud Engineering. IEEE, pp 610–614 Dua R, Raja AR, Kakadia D (2014) Virtualization vs containerization to support PaaS. In: 2014 IEEE International Conference on Cloud Engineering. IEEE, pp 610–614
12.
Zurück zum Zitat Felter W, Ferreira A, Rajamony R, Rubio J (2015) An updated performance comparison of virtual machines and linux containers. In: 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS). IEEE, pp 171–172 Felter W, Ferreira A, Rajamony R, Rubio J (2015) An updated performance comparison of virtual machines and linux containers. In: 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS). IEEE, pp 171–172
13.
Zurück zum Zitat Graniszewski W, Arciszewski A (2016) Performance analysis of selected hypervisors (virtual machine monitors-VMMs). Int J Electron Telecommun 62(3):231–236CrossRef Graniszewski W, Arciszewski A (2016) Performance analysis of selected hypervisors (virtual machine monitors-VMMs). Int J Electron Telecommun 62(3):231–236CrossRef
14.
Zurück zum Zitat Huber N, von Quast M, Hauck M, Kounev S (2011) Evaluating and modeling virtualization performance overhead for cloud environments. In: CLOSER, pp 563–573 Huber N, von Quast M, Hauck M, Kounev S (2011) Evaluating and modeling virtualization performance overhead for cloud environments. In: CLOSER, pp 563–573
15.
Zurück zum Zitat Hussein MK, Mousa MH, Alqarni MA (2019) A placement architecture for a container as a service (CaaS) in a cloud environment. J Cloud Comput 8(1):7CrossRef Hussein MK, Mousa MH, Alqarni MA (2019) A placement architecture for a container as a service (CaaS) in a cloud environment. J Cloud Comput 8(1):7CrossRef
16.
Zurück zum Zitat Jha DN, Garg S, Jayaraman PP, Buyya R, Li Z, Ranjan R (2018) A holistic evaluation of docker containers for interfering microservices. In: 2018 IEEE International Conference on Services Computing (SCC). IEEE, pp 33–40 Jha DN, Garg S, Jayaraman PP, Buyya R, Li Z, Ranjan R (2018) A holistic evaluation of docker containers for interfering microservices. In: 2018 IEEE International Conference on Services Computing (SCC). IEEE, pp 33–40
18.
Zurück zum Zitat Kozhirbayev Z, Sinnott RO (2017) A performance comparison of container-based technologies for the cloud. Future Gener Comput Syst 68:175–182CrossRef Kozhirbayev Z, Sinnott RO (2017) A performance comparison of container-based technologies for the cloud. Future Gener Comput Syst 68:175–182CrossRef
19.
Zurück zum Zitat Li J, Wang Q, Jayasinghe D, Park J, Zhu T, Pu C (2013) Performance overhead among three hypervisors: an experimental study using hadoop benchmarks. In: 2013 IEEE International Congress on Big Data. IEEE, pp 9–16 Li J, Wang Q, Jayasinghe D, Park J, Zhu T, Pu C (2013) Performance overhead among three hypervisors: an experimental study using hadoop benchmarks. In: 2013 IEEE International Congress on Big Data. IEEE, pp 9–16
20.
Zurück zum Zitat Mazumdar S, Pranzo M (2017) Power efficient server consolidation for cloud data center. Future Gener Comput Syst 70:4–16CrossRef Mazumdar S, Pranzo M (2017) Power efficient server consolidation for cloud data center. Future Gener Comput Syst 70:4–16CrossRef
21.
Zurück zum Zitat Menon A, Santos JR, Turner Y, Janakiraman GJ, Zwaenepoel W (2005) Diagnosing performance overheads in the Xen virtual machine environment. In: Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments. ACM, pp 13–23 Menon A, Santos JR, Turner Y, Janakiraman GJ, Zwaenepoel W (2005) Diagnosing performance overheads in the Xen virtual machine environment. In: Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments. ACM, pp 13–23
22.
Zurück zum Zitat Molero X, Juiz C, Rodeño M (2004) Evaluación y modelado del rendimiento de los sistemas informáticos. Pearson Educación, London Molero X, Juiz C, Rodeño M (2004) Evaluación y modelado del rendimiento de los sistemas informáticos. Pearson Educación, London
23.
Zurück zum Zitat Padala P, Zhu X, Wang Z, Singhal S, Shin KG et al (2007) Performance evaluation of virtualization technologies for server consolidation. HP Labs technical report, vol 137 Padala P, Zhu X, Wang Z, Singhal S, Shin KG et al (2007) Performance evaluation of virtualization technologies for server consolidation. HP Labs technical report, vol 137
24.
Zurück zum Zitat Plauth M, Feinbube L, Polze A (2017) A performance evaluation of lightweight approaches to virtualization. Cloud Comput 2017:14 Plauth M, Feinbube L, Polze A (2017) A performance evaluation of lightweight approaches to virtualization. Cloud Comput 2017:14
25.
Zurück zum Zitat Pousa D, Rufino J (2017) Evaluation of type-1 hypervisors on desktop-class virtualization hosts. IADIS J Comput Sci Inf Syst 12(2):86–101 Pousa D, Rufino J (2017) Evaluation of type-1 hypervisors on desktop-class virtualization hosts. IADIS J Comput Sci Inf Syst 12(2):86–101
26.
Zurück zum Zitat Sandholm T, Lee D (2014) Notes on cloud computing principles. J Cloud Comput 3(1):21CrossRef Sandholm T, Lee D (2014) Notes on cloud computing principles. J Cloud Comput 3(1):21CrossRef
27.
Zurück zum Zitat Scheepers MJ (2014) Virtualization and containerization of application infrastructure: a comparison. In: 21st Twente Student Conference on IT, vol 1, pp 1–7 Scheepers MJ (2014) Virtualization and containerization of application infrastructure: a comparison. In: 21st Twente Student Conference on IT, vol 1, pp 1–7
28.
Zurück zum Zitat Sharma P, Chaufournier L, Shenoy P, Tay Y (2016) Containers and virtual machines at scale: a comparative study. In: Proceedings of the 17th International Middleware Conference. ACM, p 1 Sharma P, Chaufournier L, Shenoy P, Tay Y (2016) Containers and virtual machines at scale: a comparative study. In: Proceedings of the 17th International Middleware Conference. ACM, p 1
29.
Zurück zum Zitat Shetty J, Upadhaya S, Rajarajeshwari H, Shobha G, Chandra J (2017) An empirical performance evaluation of docker container, openstack virtual machine and bare metal server. Indones J Electr Eng Comput Sci 7(1):205–213CrossRef Shetty J, Upadhaya S, Rajarajeshwari H, Shobha G, Chandra J (2017) An empirical performance evaluation of docker container, openstack virtual machine and bare metal server. Indones J Electr Eng Comput Sci 7(1):205–213CrossRef
30.
Zurück zum Zitat Ward JS, Barker A (2014) Observing the clouds: a survey and taxonomy of cloud monitoring. J Cloud Comput 3(1):24CrossRef Ward JS, Barker A (2014) Observing the clouds: a survey and taxonomy of cloud monitoring. J Cloud Comput 3(1):24CrossRef
31.
Zurück zum Zitat Xavier MG, Neves MV, Rossi FD, Ferreto TC, Lange T, De Rose CA (2013) Performance evaluation of container-based virtualization for high performance computing environments. In: 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing. IEEE, pp 233–240 Xavier MG, Neves MV, Rossi FD, Ferreto TC, Lange T, De Rose CA (2013) Performance evaluation of container-based virtualization for high performance computing environments. In: 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing. IEEE, pp 233–240
32.
Zurück zum Zitat Zhang J, Lu X, Panda DK (2019) Performance characterization of hypervisor-and container-based virtualization for HPC on SR-IOV enabled infiniband clusters. In: 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). IEEE, pp 1777–1784 Zhang J, Lu X, Panda DK (2019) Performance characterization of hypervisor-and container-based virtualization for HPC on SR-IOV enabled infiniband clusters. In: 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). IEEE, pp 1777–1784
Metadaten
Titel
On the classification and quantification of server consolidation overheads
verfasst von
Belen Bermejo
Carlos Juiz
Publikationsdatum
20.03.2020
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 1/2021
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03258-2

Weitere Artikel der Ausgabe 1/2021

The Journal of Supercomputing 1/2021 Zur Ausgabe