Skip to main content
Top

2020 | OriginalPaper | Chapter

ANN-Assisted Multi-cloud Scheduling Recommender

Authors : Amirmohammad Pasdar, Tahereh Hassanzadeh, Young Choon Lee, Bernard Mans

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Cloud computing has been widely adopted, in the forms of public clouds and private clouds, for many benefits, such as availability and cost-efficiency. In this paper, we address the problem of scheduling jobs across multiple clouds, including a private cloud, to optimize cost efficiency explicitly taking into account data privacy. In particular, the problem in this study concerns several factors, such as data privacy of job, varying electricity prices of private cloud, and different billing policies/cycles of public clouds, that most, if not all, existing scheduling algorithms do not ‘collectively’ consider. Hence, we design an ANN-assisted Multi-Cloud Scheduling Recommender (MCSR) framework that consists of a novel scheduling algorithm and an ANN-based recommender. While the former scheduling algorithm can be used to schedule jobs on its own, their output schedules are also used as training data for the latter recommender. The experiments using both real-world Facebook workload data and larger scale synthetic data demonstrate that our ANN-based recommender cost-efficiently schedules jobs respecting privacy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
5.
go back to reference Adam, O., Lee, Y.C., Zomaya, A.Y.: Stochastic resource provisioning for containerized multi-tier web services in clouds. IEEE Trans. Parallel Distrib. Syst. 28(7), 2060–2073 (2017)CrossRef Adam, O., Lee, Y.C., Zomaya, A.Y.: Stochastic resource provisioning for containerized multi-tier web services in clouds. IEEE Trans. Parallel Distrib. Syst. 28(7), 2060–2073 (2017)CrossRef
6.
go back to reference den Bossche, R.V., Vanmechelen, K., Broeckhove, J.: Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds. Fut. Gener. Comput. Syst. 29(4), 973–985 (2013)CrossRef den Bossche, R.V., Vanmechelen, K., Broeckhove, J.: Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds. Fut. Gener. Comput. Syst. 29(4), 973–985 (2013)CrossRef
9.
go back to reference Charrada, F.B., Tata, S.: An efficient algorithm for the bursting of service-based applications in hybrid clouds. IEEE Trans. Serv. Comput. 9(3), 357–367 (2016)CrossRef Charrada, F.B., Tata, S.: An efficient algorithm for the bursting of service-based applications in hybrid clouds. IEEE Trans. Serv. Comput. 9(3), 357–367 (2016)CrossRef
10.
go back to reference Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., Bianchini, R.: Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. In: Proceedings of the 26th Symposium on Operating Systems Principles (SOSP), pp. 153–167 (2017) Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., Bianchini, R.: Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. In: Proceedings of the 26th Symposium on Operating Systems Principles (SOSP), pp. 153–167 (2017)
12.
go back to reference Farahabady, M.R.H., Lee, Y.C., Zomaya, A.Y.: Pareto-optimal cloud bursting. IEEE Trans. Parallel Distrib. Syst. 25(10), 2670–2682 (2014)CrossRef Farahabady, M.R.H., Lee, Y.C., Zomaya, A.Y.: Pareto-optimal cloud bursting. IEEE Trans. Parallel Distrib. Syst. 25(10), 2670–2682 (2014)CrossRef
13.
go back to reference Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2008)CrossRef Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2008)CrossRef
14.
go back to reference Lee, Y., Lian, B.: Cloud bursting scheduler for cost efficiency. In: 10th IEEE International Conference on Cloud Computing, pp. 774–777. IEEE (2017) Lee, Y., Lian, B.: Cloud bursting scheduler for cost efficiency. In: 10th IEEE International Conference on Cloud Computing, pp. 774–777. IEEE (2017)
15.
go back to reference Zhu, J., Li, X., Ruiz, R., Xu, X.: Scheduling stochastic multi-stage jobs to elastic hybrid cloud resources. IEEE Trans. Parallel Distrib. Syst. 29(6), 1401–1415 (2018)CrossRef Zhu, J., Li, X., Ruiz, R., Xu, X.: Scheduling stochastic multi-stage jobs to elastic hybrid cloud resources. IEEE Trans. Parallel Distrib. Syst. 29(6), 1401–1415 (2018)CrossRef
Metadata
Title
ANN-Assisted Multi-cloud Scheduling Recommender
Authors
Amirmohammad Pasdar
Tahereh Hassanzadeh
Young Choon Lee
Bernard Mans
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-63820-7_84

Premium Partner