Skip to main content
Top
Published in: The Journal of Supercomputing 3/2020

30-12-2017

An adaption scheduling based on dynamic weighted random forests for load demand forecasting

Authors: Mincheng Chen, Jingling Yuan, Dongling Liu, Tao Li

Published in: The Journal of Supercomputing | Issue 3/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the development of cloud computing, energy consumption has become a major and costly problem in data centers. To improve the energy efficiency of data centers, we analyze the influence factors of energy consumption and discover that reducing the idle servers can effectively cut down the energy consumption of data centers. Then the load demand forecasting algorithm using weighted random forests is proposed. And time factor matching coefficient obtained by considering the day type and the time span is employed to calculate the weights. To enhance the forecasting performance, an error correction strategy is also introduced into the forecasting model. The experimental results show that these strategies further improve the prediction accuracy, and the root-mean-square error is 2.6–4.1% lower than other forecasting algorithms. We finally design an adaptive scheduling technology that utilizes short-term prediction of load demand. This technology adaptively adjusts the scale of the data center cluster based on the forecast results. The simulation results indicate that the technology can reduce 12.5% energy consumption while ensuring the service quality.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bankole AA, Ajila SA (2013) Predicting cloud resource provisioning using machine learning techniques. In: 2013 26th Annual IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), IEEE, pp 1–4 Bankole AA, Ajila SA (2013) Predicting cloud resource provisioning using machine learning techniques. In: 2013 26th Annual IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), IEEE, pp 1–4
2.
go back to reference Batalla JM, Sienkiewicz K, Latoszek W, Krawiec P, Mavromoustakis CX, Mastorakis G (2016) Validation of virtualization platforms for i-iot purposes. J Supercomput 1–15 Batalla JM, Sienkiewicz K, Latoszek W, Krawiec P, Mavromoustakis CX, Mastorakis G (2016) Validation of virtualization platforms for i-iot purposes. J Supercomput 1–15
3.
go back to reference Beitelmal A, Fabris D (2014) Servers and data centers energy performance metrics. Energy Build 80:562–569CrossRef Beitelmal A, Fabris D (2014) Servers and data centers energy performance metrics. Energy Build 80:562–569CrossRef
4.
go back to reference Boru D, Kliazovich D, Granelli F, Bouvry P, Zomaya AY (2015) Energy-efficient data replication in cloud computing datacenters. Clust Comput 18(1):385–402CrossRef Boru D, Kliazovich D, Granelli F, Bouvry P, Zomaya AY (2015) Energy-efficient data replication in cloud computing datacenters. Clust Comput 18(1):385–402CrossRef
5.
go back to reference Calheiros RN, Vecchiola C, Karunamoorthy D, Buyya R (2012) The aneka platform and QoS-driven resource provisioning for elastic applications on hybrid clouds. Future Gener Comput Syst 28(6):861–870CrossRef Calheiros RN, Vecchiola C, Karunamoorthy D, Buyya R (2012) The aneka platform and QoS-driven resource provisioning for elastic applications on hybrid clouds. Future Gener Comput Syst 28(6):861–870CrossRef
6.
go back to reference Chiang RCL, Hwang J, Huang HH, Wood T (2014) Matrix: achieving predictable virtual machine performance in the clouds. In: ICAC, pp 45–56 Chiang RCL, Hwang J, Huang HH, Wood T (2014) Matrix: achieving predictable virtual machine performance in the clouds. In: ICAC, pp 45–56
8.
go back to reference Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794CrossRef Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794CrossRef
9.
go back to reference Di S, Kondo D, Cirne W (2012) Host load prediction in a google compute cloud with a Bayesian model. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society Press, Washington, p 21 Di S, Kondo D, Cirne W (2012) Host load prediction in a google compute cloud with a Bayesian model. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society Press, Washington, p 21
10.
go back to reference Duy TVT, Sato Y, Inoguchi Y (2010) Performance evaluation of a green scheduling algorithm for energy savings in cloud computing. In: 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), IEEE, pp 1–8 Duy TVT, Sato Y, Inoguchi Y (2010) Performance evaluation of a green scheduling algorithm for energy savings in cloud computing. In: 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), IEEE, pp 1–8
11.
go back to reference Duy TVT, Sato Y, Inoguchi Y (2011) A prediction-based green scheduler for datacenters in clouds. IEICE Trans Inf Syst 94(9):1731–1741CrossRef Duy TVT, Sato Y, Inoguchi Y (2011) A prediction-based green scheduler for datacenters in clouds. IEICE Trans Inf Syst 94(9):1731–1741CrossRef
12.
go back to reference Farahnakian F, Liljeberg P, Plosila J (2013) Lircup: linear regression based CPU usage prediction algorithm for live migration of virtual machines in data centers. In: 2013 39th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), IEEE, pp 357–364 Farahnakian F, Liljeberg P, Plosila J (2013) Lircup: linear regression based CPU usage prediction algorithm for live migration of virtual machines in data centers. In: 2013 39th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), IEEE, pp 357–364
14.
go back to reference Islam S, Keung J, Lee K, Liu A (2012) Empirical prediction models for adaptive resource provisioning in the cloud. Future Gener Comput Syst 28(1):155–162CrossRef Islam S, Keung J, Lee K, Liu A (2012) Empirical prediction models for adaptive resource provisioning in the cloud. Future Gener Comput Syst 28(1):155–162CrossRef
15.
go back to reference Javadi B, Abawajy J, Buyya R (2012) Failure-aware resource provisioning for hybrid cloud infrastructure. J Parallel Distrib Comput 72(10):1318–1331CrossRef Javadi B, Abawajy J, Buyya R (2012) Failure-aware resource provisioning for hybrid cloud infrastructure. J Parallel Distrib Comput 72(10):1318–1331CrossRef
16.
go back to reference Jheng JJ, Tseng FH, Chao HC, Chou LD (2014) A novel VM workload prediction using grey forecasting model in cloud data center. In: 2014 International Conference on Information Networking (ICOIN), IEEE, pp 40–45 Jheng JJ, Tseng FH, Chao HC, Chou LD (2014) A novel VM workload prediction using grey forecasting model in cloud data center. In: 2014 International Conference on Information Networking (ICOIN), IEEE, pp 40–45
17.
go back to reference Lai Z, Lam KT, Wang CL, Su J (2015) Latency-aware DVFS for efficient power state transitions on many-core architectures. J Supercomput 71(7):2720–2747CrossRef Lai Z, Lam KT, Wang CL, Su J (2015) Latency-aware DVFS for efficient power state transitions on many-core architectures. J Supercomput 71(7):2720–2747CrossRef
18.
go back to reference Lei H, Zhang T, Liu Y, Zha Y, Zhu X (2015) SGEESS: smart green energy-efficient scheduling strategy with dynamic electricity price for data center. J Syst Softw 108:23–38CrossRef Lei H, Zhang T, Liu Y, Zha Y, Zhu X (2015) SGEESS: smart green energy-efficient scheduling strategy with dynamic electricity price for data center. J Syst Softw 108:23–38CrossRef
19.
go back to reference Liang Q, Zhang J, Zhang Yh, Jm Liang (2014) The placement method of resources and applications based on request prediction in cloud data center. Inf Sci 279:735–745CrossRef Liang Q, Zhang J, Zhang Yh, Jm Liang (2014) The placement method of resources and applications based on request prediction in cloud data center. Inf Sci 279:735–745CrossRef
20.
go back to reference Liao JS, Chang CC, Hsu YL, Zhang XW, Lai KC, Hsu CH (2012) Energy-efficient resource provisioning with SLA consideration on cloud computing. In: 2012 41st International Conference on Parallel Processing Workshops (ICPPW), IEEE, pp 206–211 Liao JS, Chang CC, Hsu YL, Zhang XW, Lai KC, Hsu CH (2012) Energy-efficient resource provisioning with SLA consideration on cloud computing. In: 2012 41st International Conference on Parallel Processing Workshops (ICPPW), IEEE, pp 206–211
21.
go back to reference Liu J, Zhao F, Liu X, He W (2009) Challenges towards elastic power management in internet data centers. In: 29th IEEE International Conference on Distributed Computing Systems Workshops, 2009. ICDCS Workshops’ 09. IEEE, pp 65–72 Liu J, Zhao F, Liu X, He W (2009) Challenges towards elastic power management in internet data centers. In: 29th IEEE International Conference on Distributed Computing Systems Workshops, 2009. ICDCS Workshops’ 09. IEEE, pp 65–72
22.
go back to reference Luo L, Wu W, Zhang F (2014) Energy modeling based on cloud data center. J Softw 25(7):1371–1387 Luo L, Wu W, Zhang F (2014) Energy modeling based on cloud data center. J Softw 25(7):1371–1387
23.
go back to reference Meisner D, Gold BT, Wenisch TF (2011) The powernap server architecture. ACM Trans Comput Syst (TOCS) 29(1):3CrossRef Meisner D, Gold BT, Wenisch TF (2011) The powernap server architecture. ACM Trans Comput Syst (TOCS) 29(1):3CrossRef
24.
go back to reference Prevost JJ, Nagothu K, Kelley B, Jamshidi M (2011) Prediction of cloud data center networks loads using stochastic and neural models. In: 2011 6th International Conference on System of Systems Engineering (SoSE), IEEE, pp 276–281 Prevost JJ, Nagothu K, Kelley B, Jamshidi M (2011) Prediction of cloud data center networks loads using stochastic and neural models. In: 2011 6th International Conference on System of Systems Engineering (SoSE), IEEE, pp 276–281
25.
go back to reference Prevost JJ, Nagothu K, Jamshidi M, Kelley B (2015) Energy aware load prediction for cloud data centers. In: Control and Systems Engineering. Springer, New York, pp 153–174 Prevost JJ, Nagothu K, Jamshidi M, Kelley B (2015) Energy aware load prediction for cloud data centers. In: Control and Systems Engineering. Springer, New York, pp 153–174
26.
go back to reference Rittinghouse JW, Ransome JF (2016) Cloud computing: implementation, management, and security. CRC Press, Boca Raton Rittinghouse JW, Ransome JF (2016) Cloud computing: implementation, management, and security. CRC Press, Boca Raton
27.
go back to reference Simao J, Veiga L (2013) Flexible slas in the cloud with a partial utility-driven scheduling architecture. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, vol 1, pp 274–281 Simao J, Veiga L (2013) Flexible slas in the cloud with a partial utility-driven scheduling architecture. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, vol 1, pp 274–281
28.
go back to reference Singh S, Chana I (2016) Resource provisioning and scheduling in clouds: Qos perspective. J Supercomput 72(3):926–960CrossRef Singh S, Chana I (2016) Resource provisioning and scheduling in clouds: Qos perspective. J Supercomput 72(3):926–960CrossRef
30.
go back to reference Van Heddeghem W, Lambert S, Lannoo B, Colle D, Pickavet M, Demeester P (2014) Trends in worldwide ict electricity consumption from 2007 to 2012. Comput Commun 50:64–76CrossRef Van Heddeghem W, Lambert S, Lannoo B, Colle D, Pickavet M, Demeester P (2014) Trends in worldwide ict electricity consumption from 2007 to 2012. Comput Commun 50:64–76CrossRef
31.
go back to reference Xiong Z, Zeng S, Lu H (2014) Desdsim: a dynamic energy-saving deployment simulation platform for web server cluster. In: 2014 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), IEEE, pp 477–482 Xiong Z, Zeng S, Lu H (2014) Desdsim: a dynamic energy-saving deployment simulation platform for web server cluster. In: 2014 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), IEEE, pp 477–482
32.
go back to reference Xu X, Dou W, Zhang X, Chen J (2016) Enreal: an energy-aware resource allocation method for scientific workflow executions in cloud environment. IEEE Trans Cloud Comput 4(2):166–179CrossRef Xu X, Dou W, Zhang X, Chen J (2016) Enreal: an energy-aware resource allocation method for scientific workflow executions in cloud environment. IEEE Trans Cloud Comput 4(2):166–179CrossRef
33.
go back to reference Yoon MS, Kamal AE, Zhu Z (2016) Requests prediction in cloud with a cyclic window learning algorithm. In: Globecom Workshops (GC Wkshps), 2016 IEEE. IEEE, pp 1–6 Yoon MS, Kamal AE, Zhu Z (2016) Requests prediction in cloud with a cyclic window learning algorithm. In: Globecom Workshops (GC Wkshps), 2016 IEEE. IEEE, pp 1–6
34.
go back to reference Yoon MS, Kamal AE, Zhu Z (2017) Adaptive data center activation with user request prediction. Comput Netw 122:191–204CrossRef Yoon MS, Kamal AE, Zhu Z (2017) Adaptive data center activation with user request prediction. Comput Netw 122:191–204CrossRef
35.
go back to reference Zhang Q, Zhani MF, Boutaba R, Hellerstein JL (2013) Harmony: dynamic heterogeneity-aware resource provisioning in the cloud. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems (ICDCS). IEEE, pp 510–519 Zhang Q, Zhani MF, Boutaba R, Hellerstein JL (2013) Harmony: dynamic heterogeneity-aware resource provisioning in the cloud. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems (ICDCS). IEEE, pp 510–519
36.
go back to reference Zhang S, Zhao B, Wang F, Zhang D (2015) Short-term power load forecasting based on big data. Proc CSEE 1:37–42 Zhang S, Zhao B, Wang F, Zhang D (2015) Short-term power load forecasting based on big data. Proc CSEE 1:37–42
Metadata
Title
An adaption scheduling based on dynamic weighted random forests for load demand forecasting
Authors
Mincheng Chen
Jingling Yuan
Dongling Liu
Tao Li
Publication date
30-12-2017
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 3/2020
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-017-2223-3

Other articles of this Issue 3/2020

The Journal of Supercomputing 3/2020 Go to the issue

Premium Partner