Skip to main content
Erschienen in: Cluster Computing 4/2020

16.03.2020

Bullfighting extreme scenarios in efficient hyper-scale cluster computing

verfasst von: Damián Fernández-Cerero, Francisco J. Ortega-Irizo, Alejandro Fernández-Montes, Francisco Velasco-Morente

Erschienen in: Cluster Computing | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Data centres are quickly evolving to support new demands for Cloud-Computing services. Extreme workload peaks represent a challenge for the maintenance of the performance and service level agreements, even more when operation costs need to be minimised. In this paper, we first present an extensive analysis of the impact of extreme workloads in large-scale realistic Cloud-Computing data centres, including a comparison between the most relevant centralised resource-managing models. Moreover, we extend our previous works by proposing a new energy-efficiency policy called Bullfighter which is able to keep performance key performance indicators while reducing energy consumption in extreme scenarios. This policy employs queue-theory distributions to foresee workload demands and adapt automatically to workload fluctuations even in extreme environments, while avoiding the fine-tuning required for other energy policies. Finally, it is shown through extensive simulation that Bullfighter can save more than 40% of energy in the aforementioned scenarios without exerting any noticeable impact on data-centre performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
3.
Zurück zum Zitat Benstock, D., Cegla, F.: Extreme value analysis (EVA) of inspection data and its uncertainties. NDT & E Int. 87, 68–77 (2017)CrossRef Benstock, D., Cegla, F.: Extreme value analysis (EVA) of inspection data and its uncertainties. NDT & E Int. 87, 68–77 (2017)CrossRef
4.
Zurück zum Zitat Burns, B., Grant, B., Oppenheimer, D., Brewer, E., Wilkes, J.: Borg, omega, and kubernetes. Commun. ACM 59(5), 50–57 (2016)CrossRef Burns, B., Grant, B., Oppenheimer, D., Brewer, E., Wilkes, J.: Borg, omega, and kubernetes. Commun. ACM 59(5), 50–57 (2016)CrossRef
6.
Zurück zum Zitat Coles, S.G., Tawn, J.A.: Statistical methods for multivariate extremes: an application to structural design. J. R. Stat. Soc. Ser. C (Appl. Stat.) 43(1), 1–31 (1994)MATH Coles, S.G., Tawn, J.A.: Statistical methods for multivariate extremes: an application to structural design. J. R. Stat. Soc. Ser. C (Appl. Stat.) 43(1), 1–31 (1994)MATH
7.
Zurück zum Zitat Duy, T.V.T., Sato, Y., Inoguchi, Y.: Performance evaluation of a green scheduling algorithm for energy savings in cloud computing. In: 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), pp. 1–8. IEEE, Piscataway (2010) Duy, T.V.T., Sato, Y., Inoguchi, Y.: Performance evaluation of a green scheduling algorithm for energy savings in cloud computing. In: 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), pp. 1–8. IEEE, Piscataway (2010)
8.
Zurück zum Zitat Embrechts, P., Klüppelberg, C., Mikosch, T.: Modelling Extremal Events: For Insurance and Finance, vol. 33. Springer, Berlin (2013)MATH Embrechts, P., Klüppelberg, C., Mikosch, T.: Modelling Extremal Events: For Insurance and Finance, vol. 33. Springer, Berlin (2013)MATH
9.
Zurück zum Zitat Fernández-Cerero, D., Fernández-Montes, A., Jakóbik, A., Kołodziej, J., Toro, M.: Score: simulator for cloud optimization of resources and energy consumption. Simul. Model. Pract. Theory 82, 160–173 (2018)CrossRef Fernández-Cerero, D., Fernández-Montes, A., Jakóbik, A., Kołodziej, J., Toro, M.: Score: simulator for cloud optimization of resources and energy consumption. Simul. Model. Pract. Theory 82, 160–173 (2018)CrossRef
11.
Zurück zum Zitat Fernández-Cerero, D., Jakóbik, A., Fernández-Montes, A., Kołodziej, J.: Game-score: game-based energy-aware cloud scheduler and simulator for computational clouds. Simul. Model. Pract. Theory 93, 3–20 (2019)CrossRef Fernández-Cerero, D., Jakóbik, A., Fernández-Montes, A., Kołodziej, J.: Game-score: game-based energy-aware cloud scheduler and simulator for computational clouds. Simul. Model. Pract. Theory 93, 3–20 (2019)CrossRef
12.
Zurück zum Zitat Gumbel, E.J.: Statistics of Extremes. Courier Corporation, North Chelmsford (2012)MATH Gumbel, E.J.: Statistics of Extremes. Courier Corporation, North Chelmsford (2012)MATH
13.
Zurück zum Zitat Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A.D., Katz, R.H., Shenker, S., Stoica, I.: Mesos: a platform for fine-grained resource sharing in the data center. NSDI 11, 22–22 (2011) Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A.D., Katz, R.H., Shenker, S., Stoica, I.: Mesos: a platform for fine-grained resource sharing in the data center. NSDI 11, 22–22 (2011)
14.
Zurück zum Zitat Hüsler, J., Li, D.: Statistical analysis of extreme values with applications to insurance, finance, hydrology and other fields. In: Reiss, R.D., Thomas, M. (eds.) Statistical Analysis of Extreme Values with Applications to Insurance, Finance, Hydrology and Other Fields, pp. 144–151. Birkhäuser, Boston (2007) Hüsler, J., Li, D.: Statistical analysis of extreme values with applications to insurance, finance, hydrology and other fields. In: Reiss, R.D., Thomas, M. (eds.) Statistical Analysis of Extreme Values with Applications to Insurance, Finance, Hydrology and Other Fields, pp. 144–151. Birkhäuser, Boston (2007)
15.
Zurück zum Zitat Juarez, F., Ejarque, J., Badia, R.M.: Dynamic energy-aware scheduling for parallel task-based application in cloud computing. Fut. Gen. Comput. Syst. 78, 257–271 (2016)CrossRef Juarez, F., Ejarque, J., Badia, R.M.: Dynamic energy-aware scheduling for parallel task-based application in cloud computing. Fut. Gen. Comput. Syst. 78, 257–271 (2016)CrossRef
16.
Zurück zum Zitat Kalid, S., Syed, A., Mohammad, A., Halgamuge, M.N.: Big-data NOSQL databases: a comparison and analysis of “big-table”, “dynamodb”, and “cassandra”. In: 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), pp. 89–93 (2017). https://doi.org/10.1109/ICBDA.2017.8078782 Kalid, S., Syed, A., Mohammad, A., Halgamuge, M.N.: Big-data NOSQL databases: a comparison and analysis of “big-table”, “dynamodb”, and “cassandra”. In: 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), pp. 89–93 (2017). https://​doi.​org/​10.​1109/​ICBDA.​2017.​8078782
17.
Zurück zum Zitat Katz, R.W.: Statistics of extremes in climate change. Clim. Change 100(1), 71–76 (2010)CrossRef Katz, R.W.: Statistics of extremes in climate change. Clim. Change 100(1), 71–76 (2010)CrossRef
18.
Zurück zum Zitat Kotz, S., Balakrishnan, N., Johnson, N.L.: Continuous Multivariate Distributions: Models and Applications, vol. 1. Wiley, New York (2004)CrossRef Kotz, S., Balakrishnan, N., Johnson, N.L.: Continuous Multivariate Distributions: Models and Applications, vol. 1. Wiley, New York (2004)CrossRef
19.
Zurück zum Zitat Lee, Y.C., Zomaya, A.Y.: Energy efficient utilization of resources in cloud computing systems. J. Supercomput. 60(2), 268–280 (2012)CrossRef Lee, Y.C., Zomaya, A.Y.: Energy efficient utilization of resources in cloud computing systems. J. Supercomput. 60(2), 268–280 (2012)CrossRef
20.
Zurück zum Zitat Reiss, C., Tumanov, A., Ganger, G.R., Katz, R.H., Kozuch, M.A.: Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In: Proceedings of the Third ACM Symposium on Cloud Computing, p. 7. ACM, New York (2012) Reiss, C., Tumanov, A., Ganger, G.R., Katz, R.H., Kozuch, M.A.: Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In: Proceedings of the Third ACM Symposium on Cloud Computing, p. 7. ACM, New York (2012)
21.
Zurück zum Zitat Resnick, S.I., et al.: Heavy tail modeling and teletraffic data: special invited paper. Ann. Stat. 25(5), 1805–1869 (1997)CrossRef Resnick, S.I., et al.: Heavy tail modeling and teletraffic data: special invited paper. Ann. Stat. 25(5), 1805–1869 (1997)CrossRef
22.
Zurück zum Zitat Ricciardi, S., Careglio, D., Sole-Pareta, J., Fiore, U., Palmieri, F., et al.: Saving energy in data center infrastructures. In: 2011 First International Conference on Data Compression, Communications and Processing (CCP), pp. 265–270. IEEE, Piscataway (2011) Ricciardi, S., Careglio, D., Sole-Pareta, J., Fiore, U., Palmieri, F., et al.: Saving energy in data center infrastructures. In: 2011 First International Conference on Data Compression, Communications and Processing (CCP), pp. 265–270. IEEE, Piscataway (2011)
23.
Zurück zum Zitat Schwarzkopf, M., Konwinski, A., Abd-El-Malek, M., Wilkes, J.: Omega: flexible, scalable schedulers for large compute clusters. In: Proceedings of the 8th ACM European Conference on Computer Systems, pp. 351–364. ACM, New York (2013) Schwarzkopf, M., Konwinski, A., Abd-El-Malek, M., Wilkes, J.: Omega: flexible, scalable schedulers for large compute clusters. In: Proceedings of the 8th ACM European Conference on Computer Systems, pp. 351–364. ACM, New York (2013)
24.
Zurück zum Zitat Shehabi, A., Smith, S.J., Sartor, D.A., Brown, R.E., Herrlin, M., Koomey, J.G., Masanet, E.R., Horner, N., Azevedo, I.L., Lintner, W.: United states data center energy usage report. Tech. Rep. (2016) Shehabi, A., Smith, S.J., Sartor, D.A., Brown, R.E., Herrlin, M., Koomey, J.G., Masanet, E.R., Horner, N., Azevedo, I.L., Lintner, W.: United states data center energy usage report. Tech. Rep. (2016)
25.
Zurück zum Zitat Sohrabi, S., Tang, A., Moser, I., Aleti, A.: Adaptive virtual machine migration mechanism for energy efficiency. In: Proceedings of the 5th International Workshop on Green and Sustainable Software, pp. 8–14. ACM, New York (2016) Sohrabi, S., Tang, A., Moser, I., Aleti, A.: Adaptive virtual machine migration mechanism for energy efficiency. In: Proceedings of the 5th International Workshop on Green and Sustainable Software, pp. 8–14. ACM, New York (2016)
26.
Zurück zum Zitat Van Heddeghem, W., Lambert, S., Lannoo, B., Colle, D., Pickavet, M., Demeester, P.: Trends in worldwide ICT electricity consumption from 2007 to 2012. Comput. Commun. 50, 64–76 (2014)CrossRef Van Heddeghem, W., Lambert, S., Lannoo, B., Colle, D., Pickavet, M., Demeester, P.: Trends in worldwide ICT electricity consumption from 2007 to 2012. Comput. Commun. 50, 64–76 (2014)CrossRef
27.
Zurück zum Zitat Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., Wilkes, J.: Large-scale cluster management at Google with Borg. In: Proceedings of the Tenth European Conference on Computer Systems, p. 18. ACM, New York (2015) Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., Wilkes, J.: Large-scale cluster management at Google with Borg. In: Proceedings of the Tenth European Conference on Computer Systems, p. 18. ACM, New York (2015)
Metadaten
Titel
Bullfighting extreme scenarios in efficient hyper-scale cluster computing
verfasst von
Damián Fernández-Cerero
Francisco J. Ortega-Irizo
Alejandro Fernández-Montes
Francisco Velasco-Morente
Publikationsdatum
16.03.2020
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 4/2020
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-020-03094-2

Weitere Artikel der Ausgabe 4/2020

Cluster Computing 4/2020 Zur Ausgabe

Premium Partner