Skip to main content
Erschienen in: Cluster Computing 3/2018

26.02.2018

Energy efficient job scheduling with workload prediction on cloud data center

verfasst von: Xiaoyong Tang, Xiaoyi Liao, Jie Zheng, Xiaopan Yang

Erschienen in: Cluster Computing | Ausgabe 3/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Data centers are the backbone of cloud infrastructure platform to support large-scale data processing and storage. More and more business-to-consumer and enterprise applications are based on cloud data center. However, the amount of data center energy consumption is inevitably lead to high operation costs. The aim of this paper is to comprehensive reduce energy consumption of cloud data center servers, network, and cooling systems. We first build an energy efficient cloud data center system including its architecture, job and power consumption model. Then, we combine the linear regression and wavelet neural network techniques into a prediction method, which we call MLWNN, to forecast the cloud data center short-term workload. Third, we propose a heuristic energy efficient job scheduling with workload prediction solution, which is divided into resource management strategy and online energy efficient job scheduling algorithm. Our extensive simulation performance evaluation results clearly demonstrate that our proposed solution has good performance and is very suitable for low workload cloud data center.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bezawada, B., Liu, A.X., Jayaraman, B., Wang, A.L., Rui, L.: Privacy preserving string matching for cloud computing. In: IEEE 35th International Conference on Distributed Computing Systems, ICDCS 2015, pp. 609–618 Bezawada, B., Liu, A.X., Jayaraman, B., Wang, A.L., Rui, L.: Privacy preserving string matching for cloud computing. In: IEEE 35th International Conference on Distributed Computing Systems, ICDCS 2015, pp. 609–618
2.
Zurück zum Zitat Boru, D., Kliazovich, D., Granelli, F., Bouvry, P., Zomaya, A.Y.: Energy-efficient data replication in cloud computing datacenters. Clust. Comput. 18(1), 385–402 (2015)CrossRef Boru, D., Kliazovich, D., Granelli, F., Bouvry, P., Zomaya, A.Y.: Energy-efficient data replication in cloud computing datacenters. Clust. Comput. 18(1), 385–402 (2015)CrossRef
3.
Zurück zum Zitat Kliazovich, D., Bouvry, P., Khan, S.U.: GreenCloud: a packet-level simulator of energy-aware cloud computing data centers. J. Supercomput. 62(3), 1263–1283 (2012)CrossRef Kliazovich, D., Bouvry, P., Khan, S.U.: GreenCloud: a packet-level simulator of energy-aware cloud computing data centers. J. Supercomput. 62(3), 1263–1283 (2012)CrossRef
6.
Zurück zum Zitat Haque, M.A., Aydin, H., Zhu, D.: On reliability management of energy-aware real-time systems through task replication. IEEE Trans. Parallel Distrib. Syst. 28(3), 813–825 (2017)CrossRef Haque, M.A., Aydin, H., Zhu, D.: On reliability management of energy-aware real-time systems through task replication. IEEE Trans. Parallel Distrib. Syst. 28(3), 813–825 (2017)CrossRef
7.
Zurück zum Zitat Awan, M.A., Nelissen, G., Yomsi, P.M., Petters, S.M.: Online slack consolidation in global-EDF for energy consumption minimisation. J. Syst. Archit. 63, 1–15 (2016)CrossRef Awan, M.A., Nelissen, G., Yomsi, P.M., Petters, S.M.: Online slack consolidation in global-EDF for energy consumption minimisation. J. Syst. Archit. 63, 1–15 (2016)CrossRef
8.
Zurück zum Zitat Li, K.: Improving multicore server performance and reducing energy consumption by workload dependent dynamic power management. IEEE Trans. Cloud Comput. 4(2), 122–137 (2016)CrossRef Li, K.: Improving multicore server performance and reducing energy consumption by workload dependent dynamic power management. IEEE Trans. Cloud Comput. 4(2), 122–137 (2016)CrossRef
9.
Zurück zum Zitat Gao, Y., Guan, H., Qi, Z., Hou, Y., Liu, L.: A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J. Comput. Syst. Sci. 79(8), 1230–1242 (2013)MathSciNetCrossRef Gao, Y., Guan, H., Qi, Z., Hou, Y., Liu, L.: A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J. Comput. Syst. Sci. 79(8), 1230–1242 (2013)MathSciNetCrossRef
10.
Zurück zum Zitat Hieu, N., Francesco, M., Yl\(\ddot{a}\)-J\(\ddot{a}\ddot{a}\)ski, A.: Virtual machine consolidation with usage prediction for energy-efficient cloud data centers. In: 2015 IEEE 8th International Conference on Cloud Computing, pp. 750–757 (2015) Hieu, N., Francesco, M., Yl\(\ddot{a}\)-J\(\ddot{a}\ddot{a}\)ski, A.: Virtual machine consolidation with usage prediction for energy-efficient cloud data centers. In: 2015 IEEE 8th International Conference on Cloud Computing, pp. 750–757 (2015)
11.
Zurück zum Zitat Li, D., Chen, C., Guan, J., Zhang, Y., Zhu, J., Yu, R.: DCloud: deadline-aware resource allocation for cloud computing jobs. IEEE Trans. Parallel Distrib. Syst. 27(8), 2248–2260 (2016)CrossRef Li, D., Chen, C., Guan, J., Zhang, Y., Zhu, J., Yu, R.: DCloud: deadline-aware resource allocation for cloud computing jobs. IEEE Trans. Parallel Distrib. Syst. 27(8), 2248–2260 (2016)CrossRef
12.
Zurück zum Zitat Uddin, M., Darabidarabkhani, Y., Shah, A., Memond, J.: Evaluating power efficient algorithms for efficiency and carbon emissions in cloud data centers: a review. Renew. Sustain. Energy Rev. 51, 1553–1563 (2015)CrossRef Uddin, M., Darabidarabkhani, Y., Shah, A., Memond, J.: Evaluating power efficient algorithms for efficiency and carbon emissions in cloud data centers: a review. Renew. Sustain. Energy Rev. 51, 1553–1563 (2015)CrossRef
13.
Zurück zum Zitat Guan, X., Choi, B., Song, S.: Energy efficient virtual network embedding for green data centers using data center topology and future migration. Comput. Commun. 69, 50–59 (2015)CrossRef Guan, X., Choi, B., Song, S.: Energy efficient virtual network embedding for green data centers using data center topology and future migration. Comput. Commun. 69, 50–59 (2015)CrossRef
14.
Zurück zum Zitat Hao, Y., Liu, G.: Evaluation of nine heuristic algorithms with data-intensive jobs and computing-intensive jobs in a dynamic environment. IET Softw. 9(1), 7–16 (2015)MathSciNetCrossRef Hao, Y., Liu, G.: Evaluation of nine heuristic algorithms with data-intensive jobs and computing-intensive jobs in a dynamic environment. IET Softw. 9(1), 7–16 (2015)MathSciNetCrossRef
15.
Zurück zum Zitat Li, K., Tang, X., Veeravalli, B., Li, K.: Scheduling precedence constrained stochastic tasks on heterogeneous cluster systems. IEEE Trans. Comput. 64(1), 191–204 (2015)MathSciNetCrossRef Li, K., Tang, X., Veeravalli, B., Li, K.: Scheduling precedence constrained stochastic tasks on heterogeneous cluster systems. IEEE Trans. Comput. 64(1), 191–204 (2015)MathSciNetCrossRef
16.
Zurück zum Zitat Li, J., Qiu, M., Ming, Z., Quan, G., Qin, X., Gu, Z.: Online optimization for scheduling preemptable tasks on IaaS cloud system. J. Parallel Distrib. Comput. 72(3), 666–677 (2012)CrossRef Li, J., Qiu, M., Ming, Z., Quan, G., Qin, X., Gu, Z.: Online optimization for scheduling preemptable tasks on IaaS cloud system. J. Parallel Distrib. Comput. 72(3), 666–677 (2012)CrossRef
17.
Zurück zum Zitat Maguluri, S., Srikant, R.: Scheduling jobs with unknown duration in clouds. In: Proceedings IEEE INFOCOM, pp. 1887–1895 (2013) Maguluri, S., Srikant, R.: Scheduling jobs with unknown duration in clouds. In: Proceedings IEEE INFOCOM, pp. 1887–1895 (2013)
18.
Zurück zum Zitat Tang, X., Li, K., Liao, G., Fang, K., Wu, F.: A stochastic scheduling algorithm for precedence constrained tasks on grid. Future Gener. Comput. Syst. 27, 1083–1091 (2011)CrossRef Tang, X., Li, K., Liao, G., Fang, K., Wu, F.: A stochastic scheduling algorithm for precedence constrained tasks on grid. Future Gener. Comput. Syst. 27, 1083–1091 (2011)CrossRef
19.
Zurück zum Zitat Gerards, M.E.T., Hurink, J.L., Kuper, J.: On the interplay between Global DVFS and scheduling tasks with precedence constraints. IEEE Trans. Comput. 64(6), 1742–1754 (2015)MathSciNetMATH Gerards, M.E.T., Hurink, J.L., Kuper, J.: On the interplay between Global DVFS and scheduling tasks with precedence constraints. IEEE Trans. Comput. 64(6), 1742–1754 (2015)MathSciNetMATH
20.
Zurück zum Zitat Rizvandi, N., Taheri, J., Zomaya, A.: Some observations on optimal frequency selection in DVFS-based power consumption minimization. J. Parallel Distrib. Comput. 71(8), 1154–1164 (2011)CrossRef Rizvandi, N., Taheri, J., Zomaya, A.: Some observations on optimal frequency selection in DVFS-based power consumption minimization. J. Parallel Distrib. Comput. 71(8), 1154–1164 (2011)CrossRef
21.
Zurück zum Zitat Li, K., Tang, X., Li, Keqin: Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans. Parallel Distrib. Syst. 25(11), 2867–2876 (2014)CrossRef Li, K., Tang, X., Li, Keqin: Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans. Parallel Distrib. Syst. 25(11), 2867–2876 (2014)CrossRef
22.
Zurück zum Zitat Huai, W., Huang, W., Jin, S., Qian, Z.: Towards energy efficient scheduling for online tasks in cloud data centers based on DVFS. In: The 9th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing, IMIS 2015, pp. 225–232 Huai, W., Huang, W., Jin, S., Qian, Z.: Towards energy efficient scheduling for online tasks in cloud data centers based on DVFS. In: The 9th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing, IMIS 2015, pp. 225–232
23.
Zurück zum Zitat Barroso, L., Hölzle, U.: The case for energy proportional computing. Computer 40(12), 33–37 (2007)CrossRef Barroso, L., Hölzle, U.: The case for energy proportional computing. Computer 40(12), 33–37 (2007)CrossRef
24.
Zurück zum Zitat Guan, X., Choi, B., Song, S.: Topology and migration-aware energy efficient virtual network embedding for green data centers. In: 23rd International Conference on Computer Communication and Networks (ICCCN), pp. 1–8 (2014) Guan, X., Choi, B., Song, S.: Topology and migration-aware energy efficient virtual network embedding for green data centers. In: 23rd International Conference on Computer Communication and Networks (ICCCN), pp. 1–8 (2014)
25.
Zurück zum Zitat Lee, S., Chung, B.D., Jeon, H.W., Chang, J.: A dynamic control approach for energy-efficient production scheduling on a single machine under time-varying electricity pricing. J. Clean. Prod. 165, 552–563 (2017)CrossRef Lee, S., Chung, B.D., Jeon, H.W., Chang, J.: A dynamic control approach for energy-efficient production scheduling on a single machine under time-varying electricity pricing. J. Clean. Prod. 165, 552–563 (2017)CrossRef
26.
Zurück zum Zitat Attia, K.M., El-Hosseini, M.A., Hesham, A.: Dynamic power management techniques in multi-core architectures: a survey study. Ain Shams Eng. J. 8(3), 445–456 (2017)CrossRef Attia, K.M., El-Hosseini, M.A., Hesham, A.: Dynamic power management techniques in multi-core architectures: a survey study. Ain Shams Eng. J. 8(3), 445–456 (2017)CrossRef
27.
Zurück zum Zitat Tian, W., Zhao, Y., Xu, M., Zhong, Y., Sun, X.: A toolkit for modeling and simulation of real-time virtual machine allocation in a cloud data center. IEEE Rrans. Autom. Sci. Eng. 12(1), 153–161 (2015)CrossRef Tian, W., Zhao, Y., Xu, M., Zhong, Y., Sun, X.: A toolkit for modeling and simulation of real-time virtual machine allocation in a cloud data center. IEEE Rrans. Autom. Sci. Eng. 12(1), 153–161 (2015)CrossRef
28.
Zurück zum Zitat Zhu, W., Zhuang, Y., Zhang, L.: A three-dimensional virtual resource scheduling method for energy saving in cloud computing. Future Gener. Comput. Syst. 69, 66–74 (2017)CrossRef Zhu, W., Zhuang, Y., Zhang, L.: A three-dimensional virtual resource scheduling method for energy saving in cloud computing. Future Gener. Comput. Syst. 69, 66–74 (2017)CrossRef
29.
Zurück zum Zitat Rao, K., Thilagam, P.: Heuristics based server consolidation with residual resource defragmentation in cloud data centers. Future Gener. Comput. Syst. 50, 87–98 (2015)CrossRef Rao, K., Thilagam, P.: Heuristics based server consolidation with residual resource defragmentation in cloud data centers. Future Gener. Comput. Syst. 50, 87–98 (2015)CrossRef
30.
Zurück zum Zitat Wang, Y., Wang, X.: Performance-controlled server consolidation for virtualized datacenters with multi-tier applications. Sustain. Comput. 4, 52–65 (2014) Wang, Y., Wang, X.: Performance-controlled server consolidation for virtualized datacenters with multi-tier applications. Sustain. Comput. 4, 52–65 (2014)
31.
Zurück zum Zitat Menarini, M., Seracini, F., Zhang, X., Rosing, T., Kr\(\ddot{u}\)er, I.: Green web services: improving energy efficiency in data centers via workload predictions. In: The 2013 2nd International Workshop on Green and Sustainable Software (GREENS), pp. 8–15 (2013) Menarini, M., Seracini, F., Zhang, X., Rosing, T., Kr\(\ddot{u}\)er, I.: Green web services: improving energy efficiency in data centers via workload predictions. In: The 2013 2nd International Workshop on Green and Sustainable Software (GREENS), pp. 8–15 (2013)
32.
Zurück zum Zitat Rahmanian, A.A., Ghobaei-Arani, M., Tofighy, S.: A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment. Future Gener. Comput. Syst. 79, 54–71 (2018)CrossRef Rahmanian, A.A., Ghobaei-Arani, M., Tofighy, S.: A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment. Future Gener. Comput. Syst. 79, 54–71 (2018)CrossRef
33.
Zurück zum Zitat Liu, B., Lin, Y., Chen, Y.: Quantitative workload analysis and prediction using Google cluster traces. In: IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) 2016, pp. 935–940 (2016) Liu, B., Lin, Y., Chen, Y.: Quantitative workload analysis and prediction using Google cluster traces. In: IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) 2016, pp. 935–940 (2016)
34.
Zurück zum Zitat Alexandridis, A., Zapranis, A.: Wavelet neural networks: a practical guide. Neural Netw. 42(1), 1–27 (2013)CrossRef Alexandridis, A., Zapranis, A.: Wavelet neural networks: a practical guide. Neural Netw. 42(1), 1–27 (2013)CrossRef
35.
Zurück zum Zitat Moschakis, I., Karatza, H.: A meta-heuristic optimization approach to the scheduling of bag-of-tasks applications on heterogeneous clouds with multi-level arrivals and critical jobs. Simul. Model. Pract. Theory 57, 1–25 (2015)CrossRef Moschakis, I., Karatza, H.: A meta-heuristic optimization approach to the scheduling of bag-of-tasks applications on heterogeneous clouds with multi-level arrivals and critical jobs. Simul. Model. Pract. Theory 57, 1–25 (2015)CrossRef
36.
Zurück zum Zitat Zhu, D., Aydin, H.: Reliability-aware energy management for periodic real-time tasks. IEEE Trans. Comput. 58(10), 1382–1397 (2009)MathSciNetCrossRef Zhu, D., Aydin, H.: Reliability-aware energy management for periodic real-time tasks. IEEE Trans. Comput. 58(10), 1382–1397 (2009)MathSciNetCrossRef
37.
Zurück zum Zitat Shi, X., Dong, J., Djouadi, S.M., Wang, Y., Ma, X., Feng, Y.: Power-efficient resource management for co-located virtualized web servers: a stochastic control approach. In: International Green Computing Conference, pp. 1–9 (2014) Shi, X., Dong, J., Djouadi, S.M., Wang, Y., Ma, X., Feng, Y.: Power-efficient resource management for co-located virtualized web servers: a stochastic control approach. In: International Green Computing Conference, pp. 1–9 (2014)
38.
Zurück zum Zitat Serackis, A., Plonis, D., Krukonis, A., Katkevicius, A.: The prediction of cut-off frequencies of models of gyroelectric waveguides using artificial neural networks. In: IEEE 4th Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), pp. 1–5 (2016) Serackis, A., Plonis, D., Krukonis, A., Katkevicius, A.: The prediction of cut-off frequencies of models of gyroelectric waveguides using artificial neural networks. In: IEEE 4th Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), pp. 1–5 (2016)
39.
Zurück zum Zitat Lui, A., Najmi, A.: Time-frequency decomposition of signals in a current disruption event. Geophys. Res. Lett. 24(24), 3157–3160 (1997)CrossRef Lui, A., Najmi, A.: Time-frequency decomposition of signals in a current disruption event. Geophys. Res. Lett. 24(24), 3157–3160 (1997)CrossRef
Metadaten
Titel
Energy efficient job scheduling with workload prediction on cloud data center
verfasst von
Xiaoyong Tang
Xiaoyi Liao
Jie Zheng
Xiaopan Yang
Publikationsdatum
26.02.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2018
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2154-7

Weitere Artikel der Ausgabe 3/2018

Cluster Computing 3/2018 Zur Ausgabe

Premium Partner