Skip to main content
Erschienen in: The Journal of Supercomputing 6/2018

14.03.2018

A new rule-based power-aware job scheduler for supercomputers

verfasst von: Jun Wang, Dezhi Han, Ruijun Wang

Erschienen in: The Journal of Supercomputing | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The fast processing speeds of the current generation of supercomputers provide a great convenience to scientists dealing with extremely large data sets. The next generation of exascale supercomputers could provide accurate simulation results for the automobile industry, aerospace industry, and even nuclear fusion reactors for the very first time. However, the energy cost of super-computing is extremely high, with a total electricity bill of 9 million dollars per year. Thus, conserving energy and increasing the energy efficiency of supercomputers have become critical in recent years. Many researchers have studied this problem and are trying to conserve energy by incorporating the dynamic voltage frequency scaling technique into their methods. However, this approach is limited, especially when the workload is high. In this paper, we developed a power-aware job scheduler by applying a rule-based control method and taking into consideration real-world power and speedup profiles to improve power efficiency while adhering to predetermined power constraints. The intensive simulation results showed that our proposed method is able to achieve the maximum utilization of computing resources as compared to baseline scheduling algorithms while keeping the energy cost under the threshold. Moreover, by introducing a power performance factor based on the real-world power and speedup profiles, we are able to increase the power efficiency by up to 75%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Niu S, Zhai J, Ma X, Liu M, Zhai Y, Chen W, Zheng W (2013) Employing checkpoint to improve job scheduling in large-scale systems. In: Job Scheduling Strategies for Parallel Processing. Springer, pp 36–55 Niu S, Zhai J, Ma X, Liu M, Zhai Y, Chen W, Zheng W (2013) Employing checkpoint to improve job scheduling in large-scale systems. In: Job Scheduling Strategies for Parallel Processing. Springer, pp 36–55
5.
Zurück zum Zitat Wang Y, Lu P (2013) DDS: a deadlock detection-based scheduling algorithm for workflow computations in HPC systems with storage constraints. Parallel Comput 39(8):291–305CrossRef Wang Y, Lu P (2013) DDS: a deadlock detection-based scheduling algorithm for workflow computations in HPC systems with storage constraints. Parallel Comput 39(8):291–305CrossRef
6.
Zurück zum Zitat Chan H-L, Chan W-T, Lam T-W, Lee L-K, Mak K-S, Wong PW (2007) Energy efficient online deadline scheduling. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp 795–804 Chan H-L, Chan W-T, Lam T-W, Lee L-K, Mak K-S, Wong PW (2007) Energy efficient online deadline scheduling. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp 795–804
7.
Zurück zum Zitat Wang X, Wang Y, Zhu H (2012) Energy-efficient task scheduling model based on mapreduce for cloud computing using genetic algorithm. J Comput 7(12):2962–2970CrossRef Wang X, Wang Y, Zhu H (2012) Energy-efficient task scheduling model based on mapreduce for cloud computing using genetic algorithm. J Comput 7(12):2962–2970CrossRef
8.
Zurück zum Zitat Deore SS, Patil AN (2013) Energy-efficient job scheduling and allocation scheme for virtual machines in private clouds. Energy 5(1):56–60 Deore SS, Patil AN (2013) Energy-efficient job scheduling and allocation scheme for virtual machines in private clouds. Energy 5(1):56–60
9.
Zurück zum Zitat Varsamopoulos G, Banerjee A, Gupta SK (2009) Energy efficiency of thermal-aware job scheduling algorithms under various cooling models. In: Contemporary Computing. Springer, pp 568–580 Varsamopoulos G, Banerjee A, Gupta SK (2009) Energy efficiency of thermal-aware job scheduling algorithms under various cooling models. In: Contemporary Computing. Springer, pp 568–580
10.
Zurück zum Zitat Wang L-X (1999) A course in fuzzy systems. Prentice-Hall press, Upper Saddle River Wang L-X (1999) A course in fuzzy systems. Prentice-Hall press, Upper Saddle River
11.
Zurück zum Zitat Shaocheng T, Changying L, Yongming L (2009) Fuzzy adaptive observer backstepping control for mimo nonlinear systems. Fuzzy Sets Syst 160(19):2755–2775MathSciNetCrossRefMATH Shaocheng T, Changying L, Yongming L (2009) Fuzzy adaptive observer backstepping control for mimo nonlinear systems. Fuzzy Sets Syst 160(19):2755–2775MathSciNetCrossRefMATH
12.
Zurück zum Zitat Tong S, Li Y (2009) Observer-based fuzzy adaptive control for strict-feedback nonlinear systems. Fuzzy Sets Syst 160(12):1749–1764MathSciNetCrossRefMATH Tong S, Li Y (2009) Observer-based fuzzy adaptive control for strict-feedback nonlinear systems. Fuzzy Sets Syst 160(12):1749–1764MathSciNetCrossRefMATH
17.
Zurück zum Zitat Jackson D, Snell Q, Clement M (2001) Core algorithms of the maui scheduler. In: Job Scheduling Strategies for Parallel Processing. Springer, pp 87–102 Jackson D, Snell Q, Clement M (2001) Core algorithms of the maui scheduler. In: Job Scheduling Strategies for Parallel Processing. Springer, pp 87–102
19.
Zurück zum Zitat Schroeder B, Harchol-Balter M (2004) Evaluation of task assignment policies for supercomputing servers: the case for load unbalancing and fairness. Clust Comput 7(2):151–161CrossRef Schroeder B, Harchol-Balter M (2004) Evaluation of task assignment policies for supercomputing servers: the case for load unbalancing and fairness. Clust Comput 7(2):151–161CrossRef
20.
Zurück zum Zitat Chandio AA, Bilal K, Tziritas N, Yu Z, Jiang Q, Khan SU, Xu C-Z (2014) A comparative study on resource allocation and energy efficient job scheduling strategies in large-scale parallel computing systems. Clust Comput 17(4):1349–1367CrossRef Chandio AA, Bilal K, Tziritas N, Yu Z, Jiang Q, Khan SU, Xu C-Z (2014) A comparative study on resource allocation and energy efficient job scheduling strategies in large-scale parallel computing systems. Clust Comput 17(4):1349–1367CrossRef
21.
Zurück zum Zitat Mämmelä O, Majanen M, Basmadjian R, De Meer H, Giesler A, Homberg W (2012) Energy-aware job scheduler for high-performance computing. Comput Sci Res Dev 27(4):265–275CrossRef Mämmelä O, Majanen M, Basmadjian R, De Meer H, Giesler A, Homberg W (2012) Energy-aware job scheduler for high-performance computing. Comput Sci Res Dev 27(4):265–275CrossRef
22.
Zurück zum Zitat Liu C, Qin X, Kulkarni S, Wang C, Li S, Manzanares A, Baskiyar S (2008) Distributed energy-efficient scheduling for data-intensive applications with deadline constraints on data grids. In: Performance, Computing and Communications Conference, 2008. IPCCC 2008. IEEE International. IEEE, pp 26–33 Liu C, Qin X, Kulkarni S, Wang C, Li S, Manzanares A, Baskiyar S (2008) Distributed energy-efficient scheduling for data-intensive applications with deadline constraints on data grids. In: Performance, Computing and Communications Conference, 2008. IPCCC 2008. IEEE International. IEEE, pp 26–33
23.
Zurück zum Zitat Zhang Y, Duan L, Li B, Peng L, Sadagopan S (2014) Energy efficient job scheduling in single-isa heterogeneous chip-multiprocessors. In: 2014 15th International Symposium on Quality Electronic Design (ISQED). IEEE, pp 660–666 Zhang Y, Duan L, Li B, Peng L, Sadagopan S (2014) Energy efficient job scheduling in single-isa heterogeneous chip-multiprocessors. In: 2014 15th International Symposium on Quality Electronic Design (ISQED). IEEE, pp 660–666
24.
Zurück zum Zitat Chen J-J, Kuo T-W (2005) Energy-efficient scheduling of periodic real-time tasks over homogeneous multiprocessors. PARC 1:30–35 Chen J-J, Kuo T-W (2005) Energy-efficient scheduling of periodic real-time tasks over homogeneous multiprocessors. PARC 1:30–35
25.
Zurück zum Zitat Fox K, Im S, Moseley B (2013) Energy efficient scheduling of parallelizable jobs. In: Proceedings of the Twenty-Fourth Annual ACM-SIAM Symposium on Discrete Algorithms. SIAM, pp 948–957 Fox K, Im S, Moseley B (2013) Energy efficient scheduling of parallelizable jobs. In: Proceedings of the Twenty-Fourth Annual ACM-SIAM Symposium on Discrete Algorithms. SIAM, pp 948–957
26.
Zurück zum Zitat Khuller S, Li J, Saha B (2010) Energy efficient scheduling via partial shutdown. In: Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp 1360–1372 Khuller S, Li J, Saha B (2010) Energy efficient scheduling via partial shutdown. In: Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms. Society for Industrial and Applied Mathematics, pp 1360–1372
Metadaten
Titel
A new rule-based power-aware job scheduler for supercomputers
verfasst von
Jun Wang
Dezhi Han
Ruijun Wang
Publikationsdatum
14.03.2018
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 6/2018
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-018-2281-1

Weitere Artikel der Ausgabe 6/2018

The Journal of Supercomputing 6/2018 Zur Ausgabe

Premium Partner