Skip to main content
Erschienen in: The Journal of Supercomputing 8/2015

01.08.2015

Multi-step-ahead host load prediction using autoencoder and echo state networks in cloud computing

verfasst von: Qiangpeng Yang, Yu Zhou, Yao Yu, Jie Yuan, Xianglei Xing, Sidan Du

Erschienen in: The Journal of Supercomputing | Ausgabe 8/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction. There are many proposals for resource management approaches for cloud infrastructures, but effective resource management is still a major challenge for the leading cloud infrastructure operators (e.g., Amazon, Microsoft, Google), because the details of the underlying workloads and the real-world operational demands are too complex. Among those proposals, accurate host load prediction is one of the most effective measures to address this challenge. In this paper, we proposed a new method for host load prediction, which uses an autoencoder as the pre-recurrent feature layer of the echo state networks. The aim of our proposed method is to predict the host load in the future interval based on Google cluster usage dataset. Experiments performed on Google load traces show that our proposed method achieves higher accuracy than the state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Akioka S, Muraoka Y (2004) Extended forecast of cpu and network load on computational grid. In: IEEE international symposium on cluster computing and the grid, 2004. CCGrid 2004. IEEE, pp 765–772 Akioka S, Muraoka Y (2004) Extended forecast of cpu and network load on computational grid. In: IEEE international symposium on cluster computing and the grid, 2004. CCGrid 2004. IEEE, pp 765–772
2.
Zurück zum Zitat Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166CrossRef Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166CrossRef
3.
Zurück zum Zitat Bengio Y (2009) Learning deep architectures for ai. Found Trends\(^{\textregistered }\) Mach Learn 2(1):1–127 Bengio Y (2009) Learning deep architectures for ai. Found Trends\(^{\textregistered }\) Mach Learn 2(1):1–127
4.
Zurück zum Zitat Di S, Kondo D, Cirne W (2012) Characterization and comparison of cloud versus grid workloads. In: 2012 IEEE international conference on cluster computing (CLUSTER). IEEE, pp 230–238 Di S, Kondo D, Cirne W (2012) Characterization and comparison of cloud versus grid workloads. In: 2012 IEEE international conference on cluster computing (CLUSTER). IEEE, pp 230–238
5.
Zurück zum Zitat Di S, Kondo D, Cirne W (2012) Host load prediction in a google compute cloud with a bayesian model. In: Proceedings of the international conference on high performance computing, networking, storage and analysis. IEEE Computer Society Press, p 21 Di S, Kondo D, Cirne W (2012) Host load prediction in a google compute cloud with a bayesian model. In: Proceedings of the international conference on high performance computing, networking, storage and analysis. IEEE Computer Society Press, p 21
6.
Zurück zum Zitat Duy TVT, Sato Y, Inoguchi Y (2011) Improving accuracy of host load predictions on computational grids by artificial neural networks. Int J Parallel Emerg Distrib Syst 26(4):275–290CrossRef Duy TVT, Sato Y, Inoguchi Y (2011) Improving accuracy of host load predictions on computational grids by artificial neural networks. Int J Parallel Emerg Distrib Syst 26(4):275–290CrossRef
8.
Zurück zum Zitat Guenter B, Jain N, Williams C (2011) Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning. In: INFOCOM, 2011 Proceedings IEEE. IEEE, pp 1332–1340 Guenter B, Jain N, Williams C (2011) Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning. In: INFOCOM, 2011 Proceedings IEEE. IEEE, pp 1332–1340
9.
10.
Zurück zum Zitat Hinton G, Deng L, Yu D, Dahl GE, Mohamed Ar, Jaitl N, Senior A, Vanhoucke V, Nguyen P, Sainath TN et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97CrossRef Hinton G, Deng L, Yu D, Dahl GE, Mohamed Ar, Jaitl N, Senior A, Vanhoucke V, Nguyen P, Sainath TN et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97CrossRef
11.
Zurück zum Zitat Hochreiter S (1991) Untersuchungen zu dynamischen neuronalen netzen. Master’s thesis, Institut fur Informatik, Technische Universitat, Munchen Hochreiter S (1991) Untersuchungen zu dynamischen neuronalen netzen. Master’s thesis, Institut fur Informatik, Technische Universitat, Munchen
12.
Zurück zum Zitat Jaeger H (2001) The echo state approach to analysing and training recurrent neural networks-with an erratum note. Bonn Ger Ger Natl Res Cent Inf Technol GMD Tech Rep 148:34 Jaeger H (2001) The echo state approach to analysing and training recurrent neural networks-with an erratum note. Bonn Ger Ger Natl Res Cent Inf Technol GMD Tech Rep 148:34
13.
Zurück zum Zitat Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667):78–80CrossRef Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667):78–80CrossRef
14.
Zurück zum Zitat Kang M, Kang DI, Crago SP, Park GL, Lee J (2011) Design and development of a run-time monitor for multi-core architectures in cloud computing. Sensors 11(4):3595–3610CrossRef Kang M, Kang DI, Crago SP, Park GL, Lee J (2011) Design and development of a run-time monitor for multi-core architectures in cloud computing. Sensors 11(4):3595–3610CrossRef
16.
Zurück zum Zitat Lukoševičius M (2012) A practical guide to applying echo state networks. In: Neural networks: tricks of the trade. Springer, Berlin, pp 659–686 Lukoševičius M (2012) A practical guide to applying echo state networks. In: Neural networks: tricks of the trade. Springer, Berlin, pp 659–686
17.
Zurück zum Zitat Maass W, Natschläger T, Markram H (2002) Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput 14(11):2531–2560CrossRef Maass W, Natschläger T, Markram H (2002) Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput 14(11):2531–2560CrossRef
18.
Zurück zum Zitat Mell P, Grance T (2009) The nist definition of cloud computing. Natl Inst Stand Technol 53(6):50 Mell P, Grance T (2009) The nist definition of cloud computing. Natl Inst Stand Technol 53(6):50
19.
Zurück zum Zitat Osman S, Subhraveti D, Su G, Nieh J (2002) The design and implementation of zap: a system for migrating computing environments. ACM SIGOPS Opera Syst Rev 36(SI):361–376CrossRef Osman S, Subhraveti D, Su G, Nieh J (2002) The design and implementation of zap: a system for migrating computing environments. ACM SIGOPS Opera Syst Rev 36(SI):361–376CrossRef
20.
Zurück zum Zitat Reiss C, Tumanov A, Ganger GR, Katz RH, Kozuch MA (2012) Heterogeneity and dynamicity of clouds at scale: google trace analysis. In: Proceedings of the third ACM symposium on cloud computing. ACM, p 7 Reiss C, Tumanov A, Ganger GR, Katz RH, Kozuch MA (2012) Heterogeneity and dynamicity of clouds at scale: google trace analysis. In: Proceedings of the third ACM symposium on cloud computing. ACM, p 7
21.
Zurück zum Zitat Spratling MW (2006) Learning image components for object recognition. J Mach Learn Res 7:793–815MathSciNetMATH Spratling MW (2006) Learning image components for object recognition. J Mach Learn Res 7:793–815MathSciNetMATH
22.
Zurück zum Zitat Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. In: Proceedings of the 30th international conference on machine learning (ICML-13), pp 1139–1147 Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. In: Proceedings of the 30th international conference on machine learning (ICML-13), pp 1139–1147
23.
Zurück zum Zitat Urgaonkar B, Shenoy P, Chandra A, Goyal P (2005) Dynamic provisioning of multi-tier internet applications. In: Second international conference on autonomic computing, 2005. ICAC 2005. Proceedings. IEEE, pp 217–228 Urgaonkar B, Shenoy P, Chandra A, Goyal P (2005) Dynamic provisioning of multi-tier internet applications. In: Second international conference on autonomic computing, 2005. ICAC 2005. Proceedings. IEEE, pp 217–228
24.
Zurück zum Zitat Werbos PJ (1990) Backpropagation through time: what it does and how to do it. Proc IEEE 78(10):1550–1560CrossRefMATH Werbos PJ (1990) Backpropagation through time: what it does and how to do it. Proc IEEE 78(10):1550–1560CrossRefMATH
25.
Zurück zum Zitat Wu Y, Yuan Y, Yang G, Zheng W (2007) Load prediction using hybrid model for computational grid. In: 2007 8th IEEE/ACM international conference on grid computing. IEEE, pp 235–242 Wu Y, Yuan Y, Yang G, Zheng W (2007) Load prediction using hybrid model for computational grid. In: 2007 8th IEEE/ACM international conference on grid computing. IEEE, pp 235–242
26.
Zurück zum Zitat Yang L, Foster I, Schopf JM (2003) Homeostatic and tendency-based cpu load predictions. In: International parallel and distributed processing symposium, 2003. Proceedings. IEEE, p 9 Yang L, Foster I, Schopf JM (2003) Homeostatic and tendency-based cpu load predictions. In: International parallel and distributed processing symposium, 2003. Proceedings. IEEE, p 9
27.
Zurück zum Zitat Yang Q, Peng C, Zhao H, Yu Y, Zhou Y, Wang Z, Du S (2014) A new method based on psr and ea-gmdh for host load prediction in cloud computing system. J Supercomput 68(3):1402–1417CrossRef Yang Q, Peng C, Zhao H, Yu Y, Zhou Y, Wang Z, Du S (2014) A new method based on psr and ea-gmdh for host load prediction in cloud computing system. J Supercomput 68(3):1402–1417CrossRef
28.
Zurück zum Zitat Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRef Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRef
29.
Zurück zum Zitat Zhang Q, Zhani MF, Zhang S, Zhu Q, Boutaba R, Hellerstein JL (2012) Dynamic energy-aware capacity provisioning for cloud computing environments. In: Proceedings of the 9th international conference on autonomic computing. ACM, pp 145–154 Zhang Q, Zhani MF, Zhang S, Zhu Q, Boutaba R, Hellerstein JL (2012) Dynamic energy-aware capacity provisioning for cloud computing environments. In: Proceedings of the 9th international conference on autonomic computing. ACM, pp 145–154
Metadaten
Titel
Multi-step-ahead host load prediction using autoencoder and echo state networks in cloud computing
verfasst von
Qiangpeng Yang
Yu Zhou
Yao Yu
Jie Yuan
Xianglei Xing
Sidan Du
Publikationsdatum
01.08.2015
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 8/2015
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-015-1426-8

Weitere Artikel der Ausgabe 8/2015

The Journal of Supercomputing 8/2015 Zur Ausgabe

Premium Partner