Skip to main content
Erschienen in: Cluster Computing 3/2013

01.09.2013

A Pareto-based metaheuristic for scheduling HPC applications on a geographically distributed cloud federation

verfasst von: Yacine Kessaci, Nouredine Melab, El-Ghazali Talbi

Erschienen in: Cluster Computing | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Reducing energy consumption is an increasingly important issue in cloud computing, more specifically when dealing with High Performance Computing (HPC). Minimizing energy consumption can significantly reduce the amount of energy bills and then increase the provider’s profit. In addition, the reduction of energy decreases greenhouse gas emissions. Therefore, many researches are carried out to develop new methods in order to make HPC applications consuming less energy. In this paper, we present a multi-objective genetic algorithm (MO-GA) that optimizes the energy consumption, CO2 emissions and the generated profit of a geographically distributed cloud computing infrastructure. We also propose a greedy heuristic that aims to maximize the number of scheduled applications in order to compare it with the MO-GA. The two approaches have been experimented using realistic workload traces from Feitelson’s PWA Parallel Workload Archive. The results show that MO-GA outperforms the greedy heuristic by a significant margin in terms of energy consumption and CO2 emissions. In addition, MO-GA is also proved to be slightly better in terms of profit while scheduling more applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Burge, J., Ranganathan, P., Wiener, J.: Cost-aware scheduling for heterogeneous enterprise machines (CASH EM). In: Cluster Computing, pp. 481–487 (2007) Burge, J., Ranganathan, P., Wiener, J.: Cost-aware scheduling for heterogeneous enterprise machines (CASH EM). In: Cluster Computing, pp. 481–487 (2007)
3.
Zurück zum Zitat Campbell, R., Gupta, I., et al., HP Labs, I.I.R.K.U. and Yahoo!: Open Cirrus TM cloud computing testbed: federated data centers for open source systems and services research (2009) Campbell, R., Gupta, I., et al., HP Labs, I.I.R.K.U. and Yahoo!: Open Cirrus TM cloud computing testbed: federated data centers for open source systems and services research (2009)
5.
Zurück zum Zitat Freeh, V.W., Kappiah, N., Lowenthal, D.K., Bletsch, T.K.: Just-in-time dynamic voltage scaling: exploiting inter-node slack to save energy in MPI programs. J. Parallel Distrib. Comput. 68, 1175–1185 (2008) CrossRef Freeh, V.W., Kappiah, N., Lowenthal, D.K., Bletsch, T.K.: Just-in-time dynamic voltage scaling: exploiting inter-node slack to save energy in MPI programs. J. Parallel Distrib. Comput. 68, 1175–1185 (2008) CrossRef
6.
Zurück zum Zitat Garey, M.R., Johnson, D.S.: Computers and Intractability: a Guide to the Theory of NP-Completeness. Freeman, New York (1979) MATH Garey, M.R., Johnson, D.S.: Computers and Intractability: a Guide to the Theory of NP-Completeness. Freeman, New York (1979) MATH
7.
Zurück zum Zitat Garg, S., Konugurthi, P., Buyya, R.: A linear programming driven genetic algorithm for meta-scheduling on utility grids. In: Advanced Computing and Communications,(ADCOM 2008), pp. 19–26 (2008) Garg, S., Konugurthi, P., Buyya, R.: A linear programming driven genetic algorithm for meta-scheduling on utility grids. In: Advanced Computing and Communications,(ADCOM 2008), pp. 19–26 (2008)
8.
Zurück zum Zitat Garg, S.K., Yeo, C.S., Anandasivam, A., Buyya, R.: Environment-conscious scheduling of hpc applications on distributed cloud-oriented data centers. Journal of Parallel and Distributed Computing 71(6), 732–749 (2011) MATHCrossRef Garg, S.K., Yeo, C.S., Anandasivam, A., Buyya, R.: Environment-conscious scheduling of hpc applications on distributed cloud-oriented data centers. Journal of Parallel and Distributed Computing 71(6), 732–749 (2011) MATHCrossRef
10.
Zurück zum Zitat Greenberg, S., Mills, E., Tschudi, B., Rumsey, P., Myatt, B.: Best practices for data centers: results from benchmarking 22 data centers. In: Proceedings of the 2006 ACEEE Summer Study on Energy Efficiency in Buildings, Pacific Grove, USA (2006) Greenberg, S., Mills, E., Tschudi, B., Rumsey, P., Myatt, B.: Best practices for data centers: results from benchmarking 22 data centers. In: Proceedings of the 2006 ACEEE Summer Study on Energy Efficiency in Buildings, Pacific Grove, USA (2006)
11.
Zurück zum Zitat Hamilton, J.: Cooperative expendable micro-slice servers (CEMS): low cost, low power servers for internet-scale services. In: Proceedings of 4th Biennial Conference on Innovative Date Systems Research (CIDR). Asilomar Press, Pacific Grove (2009) Hamilton, J.: Cooperative expendable micro-slice servers (CEMS): low cost, low power servers for internet-scale services. In: Proceedings of 4th Biennial Conference on Innovative Date Systems Research (CIDR). Asilomar Press, Pacific Grove (2009)
12.
Zurück zum Zitat Hotta, Y., Sato, M., Kimura, H., Matsuoka, S., Boku, T., Takahashi, D.: Profile-based optimization of power performance by using dynamic voltage scaling on a PC cluster. In: 20th International Parallel and Distributed Processing Symposium, 2006, IPDPS 2006 (2006). 8 pp. Hotta, Y., Sato, M., Kimura, H., Matsuoka, S., Boku, T., Takahashi, D.: Profile-based optimization of power performance by using dynamic voltage scaling on a PC cluster. In: 20th International Parallel and Distributed Processing Symposium, 2006, IPDPS 2006 (2006). 8 pp.
13.
Zurück zum Zitat Kessaci, Y., Melab, N., Talbi, E.-G.: A Pareto-based GA for scheduling HPC applications on distributed cloud infrastructures. In: International Conference on High Performance Computing and Simulation (HPCS), 2011, pp. 456–462 (2011) Kessaci, Y., Melab, N., Talbi, E.-G.: A Pareto-based GA for scheduling HPC applications on distributed cloud infrastructures. In: International Conference on High Performance Computing and Simulation (HPCS), 2011, pp. 456–462 (2011)
16.
Zurück zum Zitat Lee, Y.C., Zomaya, A.Y.: Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. In: CCGRID’09: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 92–99 (2009) CrossRef Lee, Y.C., Zomaya, A.Y.: Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. In: CCGRID’09: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 92–99 (2009) CrossRef
18.
Zurück zum Zitat Lee, Y.C., Wang, C., Zomaya, A.Y., Zhou, B.B.: Profit-driven service request scheduling in clouds. In: Cluster, Cloud and Grid Computing (CCGRID), pp. 15–24 (2010) Lee, Y.C., Wang, C., Zomaya, A.Y., Zhou, B.B.: Profit-driven service request scheduling in clouds. In: Cluster, Cloud and Grid Computing (CCGRID), pp. 15–24 (2010)
19.
Zurück zum Zitat Lin, M., Ding, C.: Parallel genetic algorithms for dvs scheduling of distributed embedded systems. In: Perrott, R., Chapman, B., Subhlok, J., de Mello, R., Yang, L. (eds.) High Performance Computing and Communications. Lecture Notes in Computer Science, vol. 4782, pp. 180–191. Springer, Berlin (2007). doi:10.1007/978-3-540-75444-222 CrossRef Lin, M., Ding, C.: Parallel genetic algorithms for dvs scheduling of distributed embedded systems. In: Perrott, R., Chapman, B., Subhlok, J., de Mello, R., Yang, L. (eds.) High Performance Computing and Communications. Lecture Notes in Computer Science, vol. 4782, pp. 180–191. Springer, Berlin (2007). doi:10.​1007/​978-3-540-75444-222 CrossRef
20.
Zurück zum Zitat Mezmaz, M., Melab, N., Kessaci, Y., Lee, Y., Talbi, E.-G., Zomaya, A., Tuyttens, D.: A parallel bi-objective hybrid metaheuristic for energy-aware scheduling for cloud computing systems. Journal of Parallel and Distributed Computing 71(11), 1497–1508 (2011) CrossRef Mezmaz, M., Melab, N., Kessaci, Y., Lee, Y., Talbi, E.-G., Zomaya, A., Tuyttens, D.: A parallel bi-objective hybrid metaheuristic for energy-aware scheduling for cloud computing systems. Journal of Parallel and Distributed Computing 71(11), 1497–1508 (2011) CrossRef
21.
Zurück zum Zitat Orgerie, A.-C., Lefevre, L., Gelas, J.-P.: Save watts in your grid: green strategies for energy-aware framework in large scale distributed systems. In: Parallel and Distributed Systems, ICPADS’08, pp. 171–178 (2008) Orgerie, A.-C., Lefevre, L., Gelas, J.-P.: Save watts in your grid: green strategies for energy-aware framework in large scale distributed systems. In: Parallel and Distributed Systems, ICPADS’08, pp. 171–178 (2008)
22.
Zurück zum Zitat Rizvandi, N.B., Taheri, J., Zomaya, A.Y., Lee, Y.C.: Linear combinations of dvfs-enabled processor frequencies to modify the energy-aware scheduling algorithms. In: Cluster Computing and the Grid, pp. 388–397 (2010) Rizvandi, N.B., Taheri, J., Zomaya, A.Y., Lee, Y.C.: Linear combinations of dvfs-enabled processor frequencies to modify the energy-aware scheduling algorithms. In: Cluster Computing and the Grid, pp. 388–397 (2010)
23.
Zurück zum Zitat Springer, R., Lowenthal, D.K., Rountree, B., Freeh, V.W.: Minimizing execution time in mpi programs on an energy-constrained, power-scalable cluster. In: Proceedings of the Eleventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP’06, pp. 230–238. ACM, New York (2006) CrossRef Springer, R., Lowenthal, D.K., Rountree, B., Freeh, V.W.: Minimizing execution time in mpi programs on an energy-constrained, power-scalable cluster. In: Proceedings of the Eleventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP’06, pp. 230–238. ACM, New York (2006) CrossRef
25.
Zurück zum Zitat Talbi, E.-G.: Metaheuristics: From Design to Implementation. Wiley, New York (2009) Talbi, E.-G.: Metaheuristics: From Design to Implementation. Wiley, New York (2009)
26.
Zurück zum Zitat Tesauro, G., Das, R., Chan, H., Kephart, J.O., Levine, D.W., Rawson, F., Lefurgy, C.: Managing power consumption and performance of computing systems using reinforcement learning In: NIPS 2007 (2007) Tesauro, G., Das, R., Chan, H., Kephart, J.O., Levine, D.W., Rawson, F., Lefurgy, C.: Managing power consumption and performance of computing systems using reinforcement learning In: NIPS 2007 (2007)
29.
Zurück zum Zitat Venugopal, S., Chu, X., Buyya, R.: A negotiation mechanism for advance resource reservations using the alternate offers protocol. In: Quality of Service, IWQoS 2008, pp. 40–49 (2008) Venugopal, S., Chu, X., Buyya, R.: A negotiation mechanism for advance resource reservations using the alternate offers protocol. In: Quality of Service, IWQoS 2008, pp. 40–49 (2008)
30.
Zurück zum Zitat Yu, J., Buyya, R.: Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Scientific Programming 14(3–4), 217–230 (2006) Yu, J., Buyya, R.: Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Scientific Programming 14(3–4), 217–230 (2006)
Metadaten
Titel
A Pareto-based metaheuristic for scheduling HPC applications on a geographically distributed cloud federation
verfasst von
Yacine Kessaci
Nouredine Melab
El-Ghazali Talbi
Publikationsdatum
01.09.2013
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2013
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-012-0210-2

Weitere Artikel der Ausgabe 3/2013

Cluster Computing 3/2013 Zur Ausgabe