Skip to main content

2019 | OriginalPaper | Buchkapitel

An Energy Efficient and Interference Aware Virtual Machine Consolidation Algorithm Using Workload Classification

verfasst von : Rachael Shaw, Enda Howley, Enda Barrett

Erschienen in: Service-Oriented Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Inefficient resource usage is one of the greatest causes of high energy consumption in cloud data centers. Virtual Machine (VM) consolidation is an effective method for improving energy related costs and environmental sustainability for modern data centers. While dynamic VM consolidation can improve energy efficiency, virtualisation technologies cannot guarantee performance isolation between co-located VMs resulting in interference issues. We address the problem by introducing a energy and interference aware VM consolidation algorithm. The proposed algorithm utilizes the predictive capabilities of a Machine Learning (ML) model in an attempt to classify VM workloads to make more informed consolidation decisions. Furthermore, using recent workload data from Microsoft Azure we present a comparative study of two popular classification algorithms and select the model with the best performance to incorporate into our proposed approach. Our empirical results demonstrate how our approach improves energy efficiency by 31% while also reducing service violations by 69%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Moreno, I.S., Yang, R., Xu, J., Wo, T.: Improved energy-efficiency in cloud datacenters with interference-aware virtual machine placement. In: 2013 IEEE Eleventh International Symposium on Autonomous Decentralized Systems (ISADS), pp. 1–8. IEEE (2013) Moreno, I.S., Yang, R., Xu, J., Wo, T.: Improved energy-efficiency in cloud datacenters with interference-aware virtual machine placement. In: 2013 IEEE Eleventh International Symposium on Autonomous Decentralized Systems (ISADS), pp. 1–8. IEEE (2013)
2.
Zurück zum Zitat Shaw, R., Howley, E., Barrett, E.: Predicting the available bandwidth on intra cloud network links for deadline constrained workflow scheduling in public clouds. In: Maximilien, M., Vallecillo, A., Wang, J., Oriol, M. (eds.) ICSOC 2017. LNCS, vol. 10601, pp. 221–228. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-69035-3_15CrossRef Shaw, R., Howley, E., Barrett, E.: Predicting the available bandwidth on intra cloud network links for deadline constrained workflow scheduling in public clouds. In: Maximilien, M., Vallecillo, A., Wang, J., Oriol, M. (eds.) ICSOC 2017. LNCS, vol. 10601, pp. 221–228. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-69035-3_​15CrossRef
3.
Zurück zum Zitat Whitney, J., Delforge, P.: Scaling up energy efficiency across the data center industry: evaluating key drivers and barriers. Technical report, Natural Resources Defense Council (2014) Whitney, J., Delforge, P.: Scaling up energy efficiency across the data center industry: evaluating key drivers and barriers. Technical report, Natural Resources Defense Council (2014)
4.
Zurück zum Zitat Lee, Y.C., Zomaya, A.Y.: Energy efficient utilisation of resources in cloud computing systems. J. Supercomput. 60, 268–280 (2012)CrossRef Lee, Y.C., Zomaya, A.Y.: Energy efficient utilisation of resources in cloud computing systems. J. Supercomput. 60, 268–280 (2012)CrossRef
6.
Zurück zum Zitat Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener. Comput. Syst. 28, 755–768 (2012)CrossRef Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener. Comput. Syst. 28, 755–768 (2012)CrossRef
7.
Zurück zum Zitat Shaw, R., Howley, E., Barrett, E.: An advanced reinforcement learning approach for energy-aware virtual machine consolidation in cloud data centers. In: Proceedings of the 12th International Conference for Internet Technology and Secured Transactions, pp. 61–66. IEEE, December 2017 Shaw, R., Howley, E., Barrett, E.: An advanced reinforcement learning approach for energy-aware virtual machine consolidation in cloud data centers. In: Proceedings of the 12th International Conference for Internet Technology and Secured Transactions, pp. 61–66. IEEE, December 2017
8.
Zurück zum Zitat Farahnakian, F., Pahikkala, T., Liljeberg, P., Plosila, J., Hieu, N.T., Tenhunen, H.: Energy-aware VM consolidation in cloud data centers using utilisation prediction model. IEEE Trans. Cloud Comput. 7, 524–536 (2016) CrossRef Farahnakian, F., Pahikkala, T., Liljeberg, P., Plosila, J., Hieu, N.T., Tenhunen, H.: Energy-aware VM consolidation in cloud data centers using utilisation prediction model. IEEE Trans. Cloud Comput. 7, 524–536 (2016) CrossRef
10.
Zurück zum Zitat Sampaio, A.M., Barbosa, J.G., Prodan, R.: PIASA: a power and interference aware resource management strategy for heterogeneous workloads in cloud data centers. Simul. Model. Pract. Theory 57, 142–160 (2015)CrossRef Sampaio, A.M., Barbosa, J.G., Prodan, R.: PIASA: a power and interference aware resource management strategy for heterogeneous workloads in cloud data centers. Simul. Model. Pract. Theory 57, 142–160 (2015)CrossRef
11.
Zurück zum Zitat Beloglazov, A., Buyya, R.: Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr. Comput. Pract. Exp. 24, 1397–1420 (2012)CrossRef Beloglazov, A., Buyya, R.: Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr. Comput. Pract. Exp. 24, 1397–1420 (2012)CrossRef
12.
Zurück zum Zitat Xu, F., Liu, F., Liu, L., Jin, H., Li, B., Li, B.: iAware: making live migration of virtual machines interference-aware in the cloud. IEEE Trans. Comput. 63, 3012–3025 (2014)MathSciNetCrossRef Xu, F., Liu, F., Liu, L., Jin, H., Li, B., Li, B.: iAware: making live migration of virtual machines interference-aware in the cloud. IEEE Trans. Comput. 63, 3012–3025 (2014)MathSciNetCrossRef
13.
Zurück zum Zitat Jersak, L.C., Ferreto, T.: Performance-aware server consolidation with adjustable interference levels. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, pp. 420–425. ACM, April 2016 Jersak, L.C., Ferreto, T.: Performance-aware server consolidation with adjustable interference levels. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, pp. 420–425. ACM, April 2016
14.
Zurück zum Zitat Verboven, S., Vanmechelen, K., Broeckhove, J.: Black box scheduling for resource intensive virtual machine workloads with interference models. Future Gener. Comput. Syst. 29(8), 1871–1884 (2013)CrossRef Verboven, S., Vanmechelen, K., Broeckhove, J.: Black box scheduling for resource intensive virtual machine workloads with interference models. Future Gener. Comput. Syst. 29(8), 1871–1884 (2013)CrossRef
16.
Zurück zum Zitat Zhang, J., Figueiredo, R.J.: Application classification through monitoring and learning of resource consumption patterns. In: 20th International Parallel and Distributed Processing Symposium, IPDPS 2006, pp. 10–20. IEEE (2006) Zhang, J., Figueiredo, R.J.: Application classification through monitoring and learning of resource consumption patterns. In: 20th International Parallel and Distributed Processing Symposium, IPDPS 2006, pp. 10–20. IEEE (2006)
17.
Zurück zum Zitat Nikravesh, A.Y., Ajila, S.A., Lung, C.H.: Towards an autonomic auto-scaling prediction system for cloud resource provisioning. In: Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pp. 35–45. IEEE (2015) Nikravesh, A.Y., Ajila, S.A., Lung, C.H.: Towards an autonomic auto-scaling prediction system for cloud resource provisioning. In: Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pp. 35–45. IEEE (2015)
18.
Zurück zum Zitat Mason, K., Duggan, J., Howley, E.: Evolving multi-objective neural networks using differential evolution for dynamic economic emission dispatch. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1287–1294. ACM, July 2017 Mason, K., Duggan, J., Howley, E.: Evolving multi-objective neural networks using differential evolution for dynamic economic emission dispatch. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1287–1294. ACM, July 2017
19.
Zurück zum Zitat Meyer, D., Leisch, F., Hornik, K.: The support vector machine under test. Neurocomputing 55(1–2), 169–186 (2003)CrossRef Meyer, D., Leisch, F., Hornik, K.: The support vector machine under test. Neurocomputing 55(1–2), 169–186 (2003)CrossRef
20.
Zurück zum Zitat Dixon, S.J., Brereton, R.G.: Comparison of performance of five common classifiers represented as boundary methods: Euclidean distance to centroids, linear discriminant analysis, quadratic discriminant analysis, learning vector quantization and support vector machines, as dependent on data structure. Chemometr. Intell. Lab. Syst. 95(1), 1–17 (2009)CrossRef Dixon, S.J., Brereton, R.G.: Comparison of performance of five common classifiers represented as boundary methods: Euclidean distance to centroids, linear discriminant analysis, quadratic discriminant analysis, learning vector quantization and support vector machines, as dependent on data structure. Chemometr. Intell. Lab. Syst. 95(1), 1–17 (2009)CrossRef
21.
Zurück zum Zitat Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., Bianchini, R.: Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. In: Proceedings of the 26th Symposium on Operating Systems Principles, pp. 153–167. ACM, October 2017 Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., Bianchini, R.: Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. In: Proceedings of the 26th Symposium on Operating Systems Principles, pp. 153–167. ACM, October 2017
Metadaten
Titel
An Energy Efficient and Interference Aware Virtual Machine Consolidation Algorithm Using Workload Classification
verfasst von
Rachael Shaw
Enda Howley
Enda Barrett
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-33702-5_20

Premium Partner