Top

Cluster Computing

Published in:

27-04-2019

MILP formulations for spatio-temporal thermal-aware scheduling in Cloud and HPC datacenters

Authors: Jean-Marc Pierson, Patricia Stolf, Hongyang Sun, Henri Casanova

Published in: Cluster Computing | Issue 2/2020

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper focuses on scheduling problems related to the execution of computational jobs in datacenters with thermal constraints. Mixed integer linear programming (MILP) formulations are proposed that encompass both spatial and temporal aspects of the temperature evolution under a unified model. This model takes into account the dynamics of heat production and dissipation in order to schedule jobs at appropriate times on appropriate machines. The proposed MILP formulations are applicable to both high-performance computing (HPC) and Cloud settings, and can target several objectives including energy and makespan minimization, while incorporating the cooling costs and dynamic voltage and frequency scaling capabilities of servers. The applicability and usefulness of our formulations are demonstrated via several HPC and Cloud case-studies.

previous article Entropy-based outlier detection using spark

next article Hybrid dual-objective parallel genetic algorithm for heterogeneous multiprocessor scheduling

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Bai, Y., Gu, L., Qi, X.: Comparative study of energy performance between chip and inlet temperature-aware workload allocation in air-cooled data center. Energies 11(3), 669 (2018)CrossRef

Bansal, N., Kimbrel, T., Pruhs, K.: Speed scaling to manage energy and temperature. J. ACM 54(1), 3:1–3:39 (2007)

Barkat, A., Capone, A.: Effective management of green cloud data centers using energy storage technologies. In: Proceedings of the 23rd International Conference on Software, Telecommunications and Computer Networks (SoftCOM) (2015)

BlueTool. http://impact.asu.edu/BlueTool/

Borgetto, D., Casanova, H., Da Costa, G., Pierson, J.M.: Energy-aware service allocation. Future Gener. Comput. Syst. 28(5), 94–125769–779 (2012)CrossRef

Brooks, D.M., Bose, P., Schuster, S.E., Jacobson, H., Kudva, P.N., Buyuktosunoglu, A., Wellman, J.-D., Zyuban, V., Gupta, M., Cook, P.W.: Power-aware microarchitecture: design and modeling challenges for next-generation microprocessors. IEEE Micro 20(6), 26–44 (2000)CrossRef

Chaudhry, M.T., Ling, T.C., Manzoor, A., Hussain, S.A., Kim, J.: Thermal-aware scheduling in green data centers. ACM Comput. Surv. 47(3), 39:1–39:48 (2015)CrossRef

Ebrahimi, K., Jones, G.F., Fleischer, A.S.: A review of data center cooling technology, operating conditions and the corresponding low-grade waste heat recovery opportunities. Renew. Sustain. Energy Rev. 31(C), 622–638 (2014)CrossRef

Gu, C., Zhang, L., He, Z., Huang, H., Jia, X.: Minimizing energy cost for green cloud data centers by using ESDs. In: Proceedings of the 34th IEEE International Performance Computing and Communications Conference (2015)

10.

Haque, M.E., Goiri, I., Bianchini, R., Nguyen, T.D.: GreenPar: Scheduling parallel high performance applications in green datacenters In: Proceedings of the 29th ACM International Conference on Supercomputing (ICS) (2015)

11.

Herzog, C., Pierson, J.: A generic learning multi-agent-system approach for spatio-temporal-, thermal- and energy-aware scheduling. In: Proceedings of the Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP) (2018)

12.

Kantarci, B., Foschini, L., Corradi, A., Mouftah, H.T.: Inter-and-intra data center VM-placement for energy-efficient large-scale cloud systems. In: Proceedings of the First International workshop on Management and Security technologies for Cloud Computing (2012)

13.

Liu, H., Liu, B., Yang, L.T., Lin, M., Deng, Y., Bilal, K., Khan, S.U.: Thermal-aware and DVFS-enabled big data task scheduling for data centers. IEEE Trans. Big Data 2(4), 177–190 (2018)CrossRef

14.

Meijer, G.I.: Cooling energy-hungry data centers. Science 5976(328), 318–319 (2010)CrossRef

15.

Metwally, K., Jarray, A., Karmouch, A.: MILP-based approach for efficient Cloud IAAS Resource Allocation. In: Proceedings of the IEEE 8th International Conference on Cloud Computing (2015)

16.

Mhedheb, Y., Streit, A.: Energy-efficient task scheduling in data centers. In: Proceedings of the 6th International Conference on Cloud Computing and Services Science (2016)

17.

Mukherjee, T., Banerjee, A., Varsamopoulos, G., Gupta, S.K.S., Rungta, S.: Spatio-temporal thermal-aware job scheduling to minimize energy consumption in virtualized heterogeneous data centers. Comput. Netw. 53(17), 2888–2904 (2009)CrossRef

18.

Mohammad Ali, H.M., El-Gorashi, T.E.H., Lawey, A.O., Elmirghani, J.M.H.: Future energy efficient data centers with disaggregated servers. J Lightwave Technol 35(24), 5361–5380 (2017)CrossRef

19.

Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling “cool”: temperature-aware workload placement in data centers. In: USENIX Conference (2005)

20.

Mukherjee, K., Khuller, S., Deshpande, A.: Algorithms for the thermal scheduling problem. In: Proceedings of the IEEE International Parallel & Distributed Processing Symposium (IPDPS) (2013)

21.

Nada, S.A., Said, M.A.: Effect of CRAC units layout on thermal management of data center. Appl. Therm. Eng. 118, 339–344 (2017)CrossRef

22.

Pakbaznia, E., Pedram, M.: Minimizing data center cooling and server power costs. In: Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design (ISLPED) (2009)

23.

Rajan, D., Yu, P.S.: Temperature-aware scheduling: when is system-throttling good enough? In: Proceedings of the International Conference on Web-Age Information Management (WAIM) (2008)

24.

Ramos, L., Bianchini, R.: C-Oracle: predictive thermal management for data centers. In: Proceedings of the IEEE International Symposium on High Performance Computer Architecture (HPCA) (2008)

25.

Sansottera, A., Cremonesi, P.: Cooling-aware workload placement with performance constraints. Perform. Eval. 68(11), 1232–1246 (2011)CrossRef

26.

Sharrock, R., Monteil, T., Stolf, P., Brun, O.: Autonomic computing to manage green Core networks with Quality of Service. In: Proceedings of the Energy Efficiency in Large Scale Distributed Systems Conference (EE-LSDS) (2013)

27.

Sarood, O., Miller, P., Totoni, E., Kale, L.V.: “Cool” load balancing for high performance computing data centers. IEEE Trans. Comput. 61(12), 1752–1764 (2012)MathSciNetCrossRef

28.

Skadron, K., Abdelzaher, T., Stan, M.R.: Control-theoretic techniques and thermal-RC modeling for accurate and localized dynamic thermal management. In: Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA) (2002)

29.

Skadron, K., Stan, M.R., Sankaranarayanan, K., Huang, W., Velusamy, S., Tarjan, D.: Temperature-aware microarchitecture: modeling and implementation. ACM Trans. Archit. Code Optim. 1(1), 94–125 (2004)CrossRef

30.

Stillwell, M., Schanzenbach, D., Vivien, F., Casanova, H.: Resource allocation algorithms for virtualized service hosting platforms. J. Parallel Distrib. Comput. 70(9), 962–974 (2010)CrossRef

31.

Sun, H., Stolf, P., Pierson, J.-M., Da Costa, G.: Energy-efficient and thermal-aware resource management for heterogeneous datacenters. Sustain. Comput.: Inform. Syst. 4(4), 292–306 (2014)

32.

Sun, H., Stolf, P., Pierson, J.-M.: Spatio-temporal thermal-aware scheduling for homogeneous high-performance computing datacenters. Future Gener. Comput. Syst. 71C, 157–170 (2017)CrossRef

33.

Tang, Q., Gupta, S.K.S., Varsamopoulos, G.: Energy-efficient thermal-aware task scheduling for homogeneous high-performance computing data centers: a cyber-physical approach. IEEE Trans. Parallel Distrib. Syst. 19(11), 1458–1472 (2008)CrossRef

34.

Tang, Q., Mukherjee, T., Gupta, S.K.S., Cayton, P.: Sensor-based fast thermal evaluation model for energy efficient high-performance datacenters. In: Proceedings of the Fourth International Conference on Intelligent Sensing and Information Processing (ICISIP) (2006)

35.

Villebonnet, V., Da Costa, G., Lefevre, L., Pierson, J.M., Stolf, P.: Dynamically building energy proportional data centers with heterogeneous computing resources (short paper). In: IEEE International Conference On Cluster Computing (CLUSTER 2016), Taipei, Taiwan (2016)

36.

Van Damme, T., De Persis, C., Tesi, P.: Optimized thermal-aware job scheduling and control of data centers. IFAC-PapersOnLine 50(1), 8244–8249 (2017)CrossRef

37.

Wang, L., Khan, S.U., Dayal, J.: Thermal aware workload placement with task-temperature profiles in a data center. J. Supercomput. 61(3), 780–803 (2012)CrossRef

38.

Yang, J., Zhou, X., Chrobak, M., Zhang, Y., Jin, L.: Dynamic thermal management through task scheduling. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) (2008)

39.

Yao, F., Demers, A., Shenker, S.: A scheduling model for reduced CPU energy. In: Proceedings of the Annual Symposium on Foundations of Computer Science (FOCS) (1995)

40.

Zhang, S., Chatha, K.S.: Approximation algorithm for the temperature-aware scheduling problem. In: Proceedings of the IEEE/ACM International Conference on Computer-Aided Design (ICCAD) (2007)

Title: MILP formulations for spatio-temporal thermal-aware scheduling in Cloud and HPC datacenters
Authors: Jean-Marc Pierson
Patricia Stolf
Hongyang Sun
Henri Casanova
Publication date: 27-04-2019
Publisher: Springer US
Published in: Cluster Computing / Issue 2/2020
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI: https://doi.org/10.1007/s10586-019-02931-3

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 2/2020

Cloud datacenter workload estimation using error preventive time series forecasting models

Exploring the parallel capabilities of GPU: Berlekamp-Massey algorithm case study

Stochastic QoE-aware optimization of multisource multimedia content delivery for mobile cloud

Gossip based fault tolerant protocol in distributed transactional memory using quorum based replication system

KPN-based parallelization of Wu–Manber algorithm on multi-core machines

AutoBahn: a concurrency control framework for non-volatile file buffer

Premium Partner