Top

The Journal of Supercomputing

Published in:

12-01-2018

Energy performance of heuristics and meta-heuristics for real-time joint resource scaling and consolidation in virtualized networked data centers

Authors: Michele Scarpiniti, Enzo Baccarelli, Paola G. Vinueza Naranjo, Aurelio Uncini

Published in: The Journal of Supercomputing | Issue 5/2018

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this paper, we explore on a comparative basis the performance suitability of meta-heuristic, sometime denoted as random search algorithms, and greedy-type heuristics for the energy-saving joint dynamic scaling and consolidation of the network-plus-computing resources hosted by networked virtualized data centers when the target is the support of real-time streaming-type applications. For this purpose, the energy and delay performances of Tabu Search (TS), Simulated Annealing (SA) and Evolutionary Strategy (ES) meta-heuristics are tested and compared with the corresponding ones of Best-Fit Decreasing-type heuristics, in order to give insight on the resulting performance-versus-implementation complexity trade-offs. In principle, the considered meta-heuristics and heuristics are general formal approaches that can be applied to large classes of (typically, non-convex and mixed integer) optimization problems. However, specially for the meta-heuristics, a main challenge is to design them to properly address the real-time joint computing-plus-networking resource consolidation and scaling optimization problem. To this purpose, the aim of this paper is: (i) introduce a novel Virtual Machine Allocation (VMA) scheme that aims at choosing a suitable set of possible Virtual Machine placements among the (possibly, non-homogeneous) set of available servers; (ii) propose a new class of random search algorithms (RSAs) denoted as consolidation meta-heuristic, considering the VMA problem in RSAs. In particular, the design of novel variants of meta-heuristics, namely TS-RSC, SA-RSC and ES-RSC, is particularized to the resource scaling and consolidation (RSC) problem; (iii) compare the results of the obtained new RSAs class against some state-of-the-art heuristic approaches. A set of experimental results, both simulated and real-world ones, support the effectiveness of the proposed approaches against the traditional ones.

previous article An LP-based hyperparameter optimization model for language modeling

next article Analysis of large deviations behavior of multi-GPU memory access in deep learning

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Data can be downloaded from: http://ita.ee.lbl.gov/html/contrib/WorldCup.html.

Wu C, Buyya R (2015) Cloud data centers and cost modeling. Morgan Kaufmann, Burlington

Khoshkholghi MA, Derahman MN, Abdullah A, Subramaniam S, Othman M (2017) Energy-efficient algorithms for dynamic virtual machine consolidation in cloud data centers. IEEE Access 5:10709–10722CrossRef

Koomey JG (2008) Worldwide electricity used in data centers. Environ Res Lett 3:1–8CrossRef

Zhou Z, Liu F, Xu Y, Zou R, Xu H, Lui J, Jin H (2013) Carbon-aware load balancing for geo-distributed cloud services. In: Proceedings of the IEEE International Symposium Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS2013), pp 232–241, San Francisco, CA, USA

Bari MF, Boutaba R, Esteves R, Zambenedetti Granville L, Podlesny M, Rabbani MG, Zhang Q, Zhani MF (2013) Data center network virtualization: a survey. IEEE Commun Surv Tutor 15(2):909–928 Second QuarterCrossRef

Abts D, Marty MR, Wells PM, Klausler P, Liu H (2010) Energy proportional datacenter networks. In: Proceedings of ACM International Symposium on Computer Architecture (ISCA2010), pp 338–347, Saint-Malo, France

Buyya R, Beloglazov A, Abawajy J (2010) Energy-efficient management of data center resources for cloud computing: a vision, architectural elements, and open challenges. In: Proceedings of the Internet Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA2010), pp 1–12

Varasteh A, Goudarzi M (2017) Server consolidation techniques in virtualized data centers: a survey. IEEE Syst J 11(2):772–783CrossRef

Rechenberg I (1973) Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann–Holzboog Verlag, Stuttgart

10.

Wood T, Shenoy P, Venkataramani A, Yousif M (2009) Sandpiper: black-box and gray-box resource management for virtual machines. Comput Netw 53(17):2923–2938CrossRefMATH

11.

Cao Z, Dong S (2014) An energy-aware heuristic framework for virtual machine consolidation in cloud computing. J Supercomput 69(1):429–451CrossRef

12.

Baccarelli E, Vinueza Naranjo PG, Shojafar M, Scarpiniti M, Scarpiniti M (2017) Q*: energy and delay-efficient dynamic queue management in TCP/IP virtualized data centers. Comput Commun 102:89–106CrossRef

13.

Mishra SK, Sahoo B, Sahoo KS, Jena SK (2017) Metaheuristic approaches to task consolidation problem in the cloud. In: Turuk AK, Sahoo B, Assya SK (eds) Resource management and efficiency in cloud computing environments. IGI Global, Hershey

14.

Feller E, Rilling L, Morin C (2011) Energy-aware ant colony based workload placement in clouds. In: Proceedings of the 2011 IEEE/ACM 12-th International Conference on Grid Computing, pp 26–33

15.

Theja PR, Babu SKK (2015) An evolutionary computing based energy efficient VM consolidation scheme for optimal resource utilization and QoS assurance. Indian J Sci Technol 8(26):1–11

16.

Larumbe F, Sanso B (2013) A tabu search algorithm for the location of data centers and software components in green cloud computing networks. IEEE Trans Cloud Comput 1(1):22–35CrossRef

17.

Nasim R, Kassier AJ (2017) A robust Tabu Search heuristic for VM consolidation under demand uncertainty in virtualized datacenters. In: Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp 170–180, Madrid, Spain, May 14–17

18.

Zeng B, Feng S, Zhang J (2010) Tabu search-based heuristic resource allocation algorithm for database web services in a enterprise organization. In: 2010 International Conference on Information Management, Innovation Management and Industrial Engineering (ICIII), Kunming, China, November 26–28

19.

Ferreto T, De Rose CA, Heiss HU (2011) Maximum migration time guarantees in dynamic server consolidation for virtualized data centers. In: Jeannot E, Namyst R, Roman J (eds) Euro-Par 2011 parallel processing, lecture notes in computer science, vol 6852. Springer, Berlin, pp 443–454CrossRef

20.

Marotta A, Avallone S (2015) A simulated annealing based approach for power efficient virtual machines consolidation. In: 2015 IEEE 8th International Conference on Cloud Computing, New York, NY, USA, 27 June–2 July

21.

Wu Y, Tang M, Fraser W (2012) A simulated annealing algorithm for energy efficient virtual machine placement. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC 2012), pp 1245–1250, Seoul, Corea, October, 14–17

22.

Tsakalozos K, Roussopoulos M, Delis A (2011) VM placement in non-homogeneous IaaS-clouds. In: Kappel G, Maamar Z, Motahari-Nezhad HR (eds) Service-oriented computing, lecture notes in computer science, vol 7084. Springer, Berlin, pp 172–187CrossRef

23.

Nakada H, Hirofuchi T, Ogawa H, Itoh S (2009) Toward virtual machine packing optimization based on genetic algorithm. In: Omatu S et al (eds) Distributed computing, artificial intelligence, bioinformatics, soft computing, and ambient assisted living. IWANN 2009. Lecture Notes in Computer Science, vol 5518. Springer, Berlin, Heidelberg, pp 651–654. https://doi.org/10.1007/978-3-642-02481-8_96

24.

Agrawal S, Bose SK, Sundarrajan S (2009) Grouping genetic algorithm for solving the server consolidation problem with conflicts. In: Proceedings of the First ACM/SIGEVO Summit on Genetic and Evolutionary Computation, pp 1–8, Shangai, China, June 12–14

25.

Wu G, Tang M, Tian Y-C, Li W (2012) Energy-efficient virtual machine placement in data centers by genetic algorithm. In: Huang T, Zeng Z, Li C, Leung CS (eds) International Conference on Neural Information Processing (ICONIP 2012), Lecture Notes in Computer Science, vol 7665. Springer, Berlin, pp 315–323

26.

Mark CCT, Niyato D, Chen-Khong T (2011) Evolutionary optimal virtual machine placement and demand forecaster for cloud computing. In: IEEE International Conference on Advanced Information Networking and Applications (AINA 2011), pp 348–355

27.

Xu J, Fortes JA (2010) Multi-objective virtual machine placement in virtualized data center environments. In: Proceedings of the 2010 IEEE/ACM International Conference on Green Computing and Communications (GreenCom) and International Conference on Cyber, Physical and Social Computing (CPSCom), pp 179–188, December 18–20

28.

Shrivastava V, Zerfos P, Lee KW, Jamjoom H, Liu YH, Banerjee S (2011) Application-aware virtual machine migration in data centers. In: 2011 Proceedings IEEE INFOCOM, pp 66–70, Shanghai, China, April 10–15

29.

Dong J, Jin X, Wang H, Li Y, Zhang P, Cheng S (2013) Energy-saving virtual machine placement in cloud data centers. In: 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp 618–624, Delft, Netherlands, May 13–16

30.

Messina F, Pappalardo G, Rosaci D, Sarné GM (2014) A trust-based, multi-agent architecture supporting inter-cloud VM migration in IaaS federations. In: International Conference on Internet and Distributed Computing Systems (IDCS 2014), pp 74–83, September 2014

31.

Portnoy M (2012) Virtualization essentials. Wiley, Hoboken

32.

Shojafar M, Cordeschi N, Baccarelli E (2016) Energy-efficient adaptive resource management for real-time vehicular cloud services. IEEE Trans Cloud Comput PP(99):1–1. https://doi.org/10.1109/TCC.2016.2551747

33.

Pham DT, Karaboga D (2000) Intelligent optimization techniques—genetic algorithms, Tabu Search, simulated annealing and neural networks. Springer, BerlinMATH

34.

El-Ghazabli T (2009) Metaheuristic—from design to implementation. Wiley, Hoboken

35.

Glover F (1986) Future paths for integer programming and links to artificial intelligence. Comput Oper Res 13:533–549MathSciNetCrossRefMATH

36.

Hansen P (1986) The steepest ascent mildest descent heuristic for combinatorial programming. In: Conference on Numerical Methods in Combinatorial Optimisation, Capri, Italy

37.

Kirkpatrick S, Gelatt CD Jr, Vecchi MP (1983) Optimization by simulated annealing. Science 220(4598):671–680MathSciNetCrossRefMATH

38.

Benvenuto N, Marchesi M, Uncini A (1992) Applications of simulated annealing for the design of special digital filters. IEEE Trans Signal Process 40(2):323–332CrossRef

39.

Holland JH (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor

40.

Beloglazov A, Abawajy J, Buyya R (2012) Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener Comput Syst 28(5):755–768CrossRef

41.

Gulati A, Merchant A, Varman PJ (2010) mClock: handling throughput variability for hypervisor IO scheduling. In: Proceedings of the USENIX Symposium on Networked System Design and Implementation (NSDI2010), pp 1–7, San Jose, CA, USA

42.

Guo C, Lu G, Wang HJ, Yang S, Kong C, Sun P, Wu W, Zhang Y (2010) Secondnet: a data center network virtualization architecture with bandwidth guarantees. In: Proceedings of the ACM Co-next, pp 15–26, Philadelphia, PA, USA

43.

Kansal A, Zhao F, Liu J, Kothari N, Bhattacharya AA (2010) Virtual machine power metering and provisioning. In: Proceedings of the ACM Symposium Cloud Computing (SoCC2010), pp 39–50, Indianapolis, IN, USA

44.

Li K (2008) Performance analysis of power-aware task scheduling algorithms on multiprocessor computers with dynamic voltage and speed. IEEE Trans Parallel Distrib Syst 19(11):1484–1497CrossRef

45.

Calheiros RN, Ranjan R, Beloglazov A, Rose FD, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50CrossRef

46.

Arlitt M, Jin T (2000) A workload characterization study of the 1998 World Cup web site. IEEE Netw 14(3):30–37CrossRef

47.

Eiben AE, Smit SK (2011) Evolutionary algorithm parameters and methods to tune them. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search. Springer, Berlin, pp 15–36CrossRef

48.

Traferro S, Uncini A (2000) Power-of-two adaptive filters using Tabu Search. IEEE Trans Circuits Syst II Analog Digital Sig Process 47(6):566–569CrossRef

Title: Energy performance of heuristics and meta-heuristics for real-time joint resource scaling and consolidation in virtualized networked data centers
Authors: Michele Scarpiniti
Enzo Baccarelli
Paola G. Vinueza Naranjo
Aurelio Uncini
Publication date: 12-01-2018
Publisher: Springer US
Published in: The Journal of Supercomputing / Issue 5/2018
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-018-2244-6

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 5/2018

Popularity-based covering sets for energy proportionality in shared-nothing clusters

Multiround Distributed Lifetime Coverage Optimization protocol in wireless sensor networks

Correction to: New algorithms for fixed-length approximate string matching and approximate circular string matching under the Hamming distance

Efficient sparse matrix-delayed vector multiplication for discretized neural field model

Preemptive cloud resource allocation modeling of processing jobs

Design of an accurate and high-speed binocular pupil tracking system based on GPGPUs

Premium Partner