Skip to main content
Top
Published in: The Journal of Supercomputing 6/2021

12-11-2020

A dynamic VM consolidation approach based on load balancing using Pearson correlation in cloud computing

Authors: Jean Pepe Buanga Mapetu, Lingfu Kong, Zhen Chen

Published in: The Journal of Supercomputing | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, cloud data centers are rapidly growing with a large number of finite heterogeneous resources to meet the ever-growing user demands with respect to the SLA (service level agreement). However, the potential growth in the number of large-scale data centers leads to large amounts of energy consumption, which is constantly a major challenge. In addition to this challenge, intensive number of VM (virtual machine) migrations can decrease the performance of cloud data centers. Thus, how to minimize energy consumption while satisfying SLA and minimizing the number of VM migrations becomes an important challenge classified as NP-hard optimization problem in data centers. Most VM scheduling schemes have been proposed for this problem, such as dynamic VM consolidation. However, most of them failed in low time complexity and optimal solution. Hence, this paper proposes a dynamic VM consolidation approach-based load balancing to minimize the trade-off between energy consumption, SLA violations and VM migrations while keeping minimum host shutdowns and low time complexity in heterogeneous environment. Specifically, the proposed approach consists of four methods which include: BPSO meta-heuristic-based load balancing to impact on energy consumption and number of host shutdowns, overloading host detection and VM placement-based Pearson correlation coefficient to impact on SLA, and VM selection based on imbalance degree to impact on number of VM migration. Moreover, Pearson correlation coefficient and imbalance degree correlate CPU, RAM and bandwidth, respectively, in each host and each VM. Through extensive analysis and simulation experiments using real PlanetLab and random workloads, the performance results demonstrate that the proposed approach exhibits excellent results for the NP-problem.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chaabouni T, Khemakhem M (2018) Energy management strategy in cloud computing: a perspective study. J Supercomput 74(12):6569–6597CrossRef Chaabouni T, Khemakhem M (2018) Energy management strategy in cloud computing: a perspective study. J Supercomput 74(12):6569–6597CrossRef
2.
go back to reference Makaratzis AT, Giannoutakis KM, Tzovaras D (2018) Energy modeling in cloud simulation frameworks. Future Gener Comput Syst 79(2):715–725CrossRef Makaratzis AT, Giannoutakis KM, Tzovaras D (2018) Energy modeling in cloud simulation frameworks. Future Gener Comput Syst 79(2):715–725CrossRef
3.
go back to reference Khalil SA, Al-Haddad SAR, Hashim F, Abdullah ABHJ, Yussof S (2017) An effective approach for managing power consumption in cloud computing infrastructure. J Comput Sci 21:349–360CrossRef Khalil SA, Al-Haddad SAR, Hashim F, Abdullah ABHJ, Yussof S (2017) An effective approach for managing power consumption in cloud computing infrastructure. J Comput Sci 21:349–360CrossRef
4.
go back to reference Al-Dulaimy A, Itani W, Zantout R, Zekri A (2018) Type-aware virtual machine management for energy efficient cloud data centers. Sustain Comput Inform Syst 19:185–203 Al-Dulaimy A, Itani W, Zantout R, Zekri A (2018) Type-aware virtual machine management for energy efficient cloud data centers. Sustain Comput Inform Syst 19:185–203
5.
go back to reference Fard SYZ, Ahmadi MR, Adabi S (2017) A dynamic VM consolidation technique for QoS and energy consumption in cloud environment. J Supercomput 73:4347–4368CrossRef Fard SYZ, Ahmadi MR, Adabi S (2017) A dynamic VM consolidation technique for QoS and energy consumption in cloud environment. J Supercomput 73:4347–4368CrossRef
6.
go back to reference Mapetu JPB, Chen Z, Kong L (2019) Low-time complexity and low-cost binary particle swarm optimization algorithm for task scheduling and load balancing in cloud computing. Appl Intell 49(9):3308–3330CrossRef Mapetu JPB, Chen Z, Kong L (2019) Low-time complexity and low-cost binary particle swarm optimization algorithm for task scheduling and load balancing in cloud computing. Appl Intell 49(9):3308–3330CrossRef
7.
go back to reference Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420CrossRef Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420CrossRef
8.
go back to reference Beloglazov A, Abawajyb J, Buyya R (2012) Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing. Future Gener Comput Syst 28(5):755–768CrossRef Beloglazov A, Abawajyb J, Buyya R (2012) Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing. Future Gener Comput Syst 28(5):755–768CrossRef
9.
go back to reference Gupta MK, Amgoth T (2018) Resource-aware virtual machine placement algorithm for IaaS cloud. J Supercomput 74(1):122–140CrossRef Gupta MK, Amgoth T (2018) Resource-aware virtual machine placement algorithm for IaaS cloud. J Supercomput 74(1):122–140CrossRef
10.
go back to reference Abdullah M, Lu K, Wieder P, Yahyapour R (2017) A heuristic-based Approach for dynamic VMs consolidation in cloud data centers. Arab J Sci Eng 42(8):3535–3549CrossRef Abdullah M, Lu K, Wieder P, Yahyapour R (2017) A heuristic-based Approach for dynamic VMs consolidation in cloud data centers. Arab J Sci Eng 42(8):3535–3549CrossRef
11.
go back to reference Xu X, Zhang X, Khan M, Dou W, Xue S, Yu S A balanced virtual machine scheduling method for energy-performance trade-offs in cyber-physical cloud systems. Future Gener Comput Syst, In press, Available online (September 2017). http://dx.doi.org/10.1016/j.future.2017.08.057 Xu X, Zhang X, Khan M, Dou W, Xue S, Yu S A balanced virtual machine scheduling method for energy-performance trade-offs in cyber-physical cloud systems. Future Gener Comput Syst, In press, Available online (September 2017). http://​dx.​doi.​org/​10.​1016/​j.​future.​2017.​08.​057
14.
go back to reference Arianyan E, Taheri H, Sharifian S (2015) Novel energy and SLA efficient resource management heuristics for consolidation of virtual machines in cloud data centers. Comput Electr Eng 47:222–240CrossRef Arianyan E, Taheri H, Sharifian S (2015) Novel energy and SLA efficient resource management heuristics for consolidation of virtual machines in cloud data centers. Comput Electr Eng 47:222–240CrossRef
15.
go back to reference He K, Li Z, Deng D, Chen Y (2017) Energy-efficient framework for virtual machine consolidation in cloud data centers. Netw Secur China Commun 14(10):192–201CrossRef He K, Li Z, Deng D, Chen Y (2017) Energy-efficient framework for virtual machine consolidation in cloud data centers. Netw Secur China Commun 14(10):192–201CrossRef
16.
go back to reference Minarolli D, Mazrekaj A, Freisleben B (2017) Tackling uncertainty in long-term predictions for host overload and underload detection in cloud computing. J Cloud Comput Adv Syst Appl 6(4):1–18 Minarolli D, Mazrekaj A, Freisleben B (2017) Tackling uncertainty in long-term predictions for host overload and underload detection in cloud computing. J Cloud Comput Adv Syst Appl 6(4):1–18
17.
go back to reference Bui DM, Yoonb Y, Huha EN, Jun S, Lee S (2017) Energy efficiency for cloud computing system based on predictive optimization. J Parallel Distrib Comput 102:103–114CrossRef Bui DM, Yoonb Y, Huha EN, Jun S, Lee S (2017) Energy efficiency for cloud computing system based on predictive optimization. J Parallel Distrib Comput 102:103–114CrossRef
18.
go back to reference Melhem SB, Agarwal A, Goel N, Zaman M (2018) Markov prediction model for host load detection and VM placement in live migration. IEEE Access J 6:7190–7205CrossRef Melhem SB, Agarwal A, Goel N, Zaman M (2018) Markov prediction model for host load detection and VM placement in live migration. IEEE Access J 6:7190–7205CrossRef
20.
go back to reference Maleklooa MH, Karaa N, Barachi ME (2018) An energy efficient and SLA compliant approach for resource allocation and consolidation in cloud computing environments. Sustain Comput Inform Syst 17:9–24 Maleklooa MH, Karaa N, Barachi ME (2018) An energy efficient and SLA compliant approach for resource allocation and consolidation in cloud computing environments. Sustain Comput Inform Syst 17:9–24
21.
go back to reference Mosa A, Paton NW (2016) Optimizing virtual machine placement for energy and SLA in clouds using utility functions. J Cloud Comput Adv Syst Appl 5(17):1–17 Mosa A, Paton NW (2016) Optimizing virtual machine placement for energy and SLA in clouds using utility functions. J Cloud Comput Adv Syst Appl 5(17):1–17
22.
go back to reference Fu X, Zhao Q, Wang J, Zhang L, Qiao L (2018) Energy-aware vm initial placement strategy based on BPSO in cloud computing. Sci Program, Article ID 9471356 Fu X, Zhao Q, Wang J, Zhang L, Qiao L (2018) Energy-aware vm initial placement strategy based on BPSO in cloud computing. Sci Program, Article ID 9471356
23.
go back to reference Duan H, Chen C, Min G, Wu Y (2017) Energy-aware scheduling of virtual machines in heterogeneous cloud computing systems. Future Gener Comput Syst 74:142–150CrossRef Duan H, Chen C, Min G, Wu Y (2017) Energy-aware scheduling of virtual machines in heterogeneous cloud computing systems. Future Gener Comput Syst 74:142–150CrossRef
24.
go back to reference Aryania A, Aghdasi HS, Khanli LM (2018) Energy-aware virtual machine consolidation algorithm based on ant colony system. J Grid Comput 16(3):477–491CrossRef Aryania A, Aghdasi HS, Khanli LM (2018) Energy-aware virtual machine consolidation algorithm based on ant colony system. J Grid Comput 16(3):477–491CrossRef
25.
go back to reference Kansal NJ, Chana I (2016) Energy-aware virtual machine migration for cloud computing-a firefly optimization approach. J Grid Comput 14(2):327–345CrossRef Kansal NJ, Chana I (2016) Energy-aware virtual machine migration for cloud computing-a firefly optimization approach. J Grid Comput 14(2):327–345CrossRef
26.
go back to reference Pascual JA, Botran TL, Alonso JM, Lozano JA (2015) Towards a greener cloud infrastructure management using optimized placement policies. J Grid Comput 13(3):375–389CrossRef Pascual JA, Botran TL, Alonso JM, Lozano JA (2015) Towards a greener cloud infrastructure management using optimized placement policies. J Grid Comput 13(3):375–389CrossRef
27.
go back to reference Feng L, Liao TW, Lin Z (2019) Two-level multi-task scheduling in a cloud manufacturing environment. Robot Comput Integr Manufact 56:127–139CrossRef Feng L, Liao TW, Lin Z (2019) Two-level multi-task scheduling in a cloud manufacturing environment. Robot Comput Integr Manufact 56:127–139CrossRef
28.
go back to reference Weiwei L, Chen L, Wang JZ, Buyya R (2014) Bandwidth-aware divisible task scheduling for cloud computing. Softw Pract Exp 44:163–174CrossRef Weiwei L, Chen L, Wang JZ, Buyya R (2014) Bandwidth-aware divisible task scheduling for cloud computing. Softw Pract Exp 44:163–174CrossRef
29.
go back to reference Fan X, Weber WD, Barroso LA (2007) Power provisioning for a warehouse-sized computer, Conference Proceedings Annual International Symposium on Computer Architecture, pp. 13–23, IEEE. Fan X, Weber WD, Barroso LA (2007) Power provisioning for a warehouse-sized computer, Conference Proceedings Annual International Symposium on Computer Architecture, pp. 13–23, IEEE.
30.
go back to reference Telenyk S, Zharikov E, Rolik O (2017) Consolidation of virtual machines using simulated annealing algorithm, Proceedings of the 2017 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), vol. 1, pp. 117–121, IEEE Telenyk S, Zharikov E, Rolik O (2017) Consolidation of virtual machines using simulated annealing algorithm, Proceedings of the 2017 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), vol. 1, pp. 117–121, IEEE
31.
go back to reference Rodriguez-Lujan I, Huerta R, Elkan C, Cruz CS (2010) Quadratic programming feature selection. J Mach Learn Res 11(2):1491–1516MathSciNetMATH Rodriguez-Lujan I, Huerta R, Elkan C, Cruz CS (2010) Quadratic programming feature selection. J Mach Learn Res 11(2):1491–1516MathSciNetMATH
32.
go back to reference Xu J, Tang B, He H, Man H (2016) Semi supervised feature selection based on relevance and redundancy criteria. IEEE Trans Neural Netw Learn Syst 28(9):1974–1984CrossRef Xu J, Tang B, He H, Man H (2016) Semi supervised feature selection based on relevance and redundancy criteria. IEEE Trans Neural Netw Learn Syst 28(9):1974–1984CrossRef
33.
go back to reference Calheiros RN, Ranjan R, Beloglazov A, De-rose CAF, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. ACM Softw Pract Exp 41:23–50CrossRef Calheiros RN, Ranjan R, Beloglazov A, De-rose CAF, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. ACM Softw Pract Exp 41:23–50CrossRef
34.
go back to reference Humane P, Varshapriya JN (2015) Simulation of cloud infrastructure using CloudSim simulator: A practical approach for researchers. International conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM), Controls, Energy and Materials, pp. 207–211, IEEE. Humane P, Varshapriya JN (2015) Simulation of cloud infrastructure using CloudSim simulator: A practical approach for researchers. International conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM), Controls, Energy and Materials, pp. 207–211, IEEE.
35.
go back to reference Park KS, Pai VS (2006) CoMon: a mostly-scalable monitoring system for PlanetLab. ACM SIGOPS Operat Syst Rev 40(1):47–65CrossRef Park KS, Pai VS (2006) CoMon: a mostly-scalable monitoring system for PlanetLab. ACM SIGOPS Operat Syst Rev 40(1):47–65CrossRef
36.
go back to reference Ullah A, Li J, Shen Y, Hussain A (2018) A control theoretical view of cloud elasticity: taxonomy, survey and challenges. Clust Comput 21:1735–1764CrossRef Ullah A, Li J, Shen Y, Hussain A (2018) A control theoretical view of cloud elasticity: taxonomy, survey and challenges. Clust Comput 21:1735–1764CrossRef
37.
go back to reference Beloglazov A, Buyya R (2015) OpenStack neat: a framework for dynamic and energy-efficient consolidation of virtual machines in Open-Stack clouds. Concurrency Comput Pract Exper 27(5):310–1333CrossRef Beloglazov A, Buyya R (2015) OpenStack neat: a framework for dynamic and energy-efficient consolidation of virtual machines in Open-Stack clouds. Concurrency Comput Pract Exper 27(5):310–1333CrossRef
Metadata
Title
A dynamic VM consolidation approach based on load balancing using Pearson correlation in cloud computing
Authors
Jean Pepe Buanga Mapetu
Lingfu Kong
Zhen Chen
Publication date
12-11-2020
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 6/2021
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03494-6

Other articles of this Issue 6/2021

The Journal of Supercomputing 6/2021 Go to the issue

Premium Partner