Skip to main content
Top
Published in: Cluster Computing 4/2018

25-08-2018

Towards operational cost minimization for cloud bursting with deadline constraints in hybrid clouds

Authors: Chunlin Li, Jianhang Tang, Youlong Luo

Published in: Cluster Computing | Issue 4/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In hybrid clouds, there is a technique named cloud bursting which can allow companies to expand their capacity to meet the demands of peak workloads in a low-priced manner. In this work, a cost-aware job scheduling approach based on queueing theory in hybrid clouds is proposed. The job scheduling problem in the private cloud is modeled as a queueing model. A genetic algorithm is applied to achieve optimal queues for jobs to improve the utilization rate of the private cloud. Then, the task execution time is predicted by back propagation neural network. The max–min strategy is applied to schedule tasks according to the prediction results in hybrid clouds. Experiments show that our cost-aware job scheduling algorithm can reduce the average job waiting time and average job response time in the private cloud. In additional, our proposed job scheduling algorithm can improve the system throughput of the private cloud. It also can reduce the average task waiting time, average task response time and total costs in hybrid clouds.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ro, C.: Modeling and analysis of memory virtualization in cloud computing. Clust. Comput. 18(1), 177–185 (2015)CrossRef Ro, C.: Modeling and analysis of memory virtualization in cloud computing. Clust. Comput. 18(1), 177–185 (2015)CrossRef
2.
go back to reference Kaur, T., Chana, I.: Energy aware scheduling of deadline-constrained tasks in cloud computing. Clust. Comput. 19(2), 679–698 (2016)CrossRef Kaur, T., Chana, I.: Energy aware scheduling of deadline-constrained tasks in cloud computing. Clust. Comput. 19(2), 679–698 (2016)CrossRef
3.
go back to reference Kailasam, S., Gnanasambandam, N., Dharanipragada, J., et al.: Optimizing ordered throughput using autonomic cloud bursting schedulers. IEEE Trans. Softw. Eng. 39(11), 1564–1581 (2013)CrossRef Kailasam, S., Gnanasambandam, N., Dharanipragada, J., et al.: Optimizing ordered throughput using autonomic cloud bursting schedulers. IEEE Trans. Softw. Eng. 39(11), 1564–1581 (2013)CrossRef
4.
go back to reference Guo, T., Sharma, U., Shenoy, P., et al.: Cost-aware cloud bursting for enterprise applications. ACM Trans. Internet Technol. 13(3), 1–24 (2014)CrossRef Guo, T., Sharma, U., Shenoy, P., et al.: Cost-aware cloud bursting for enterprise applications. ACM Trans. Internet Technol. 13(3), 1–24 (2014)CrossRef
5.
go back to reference Chopra, N., Singh, S.: Deadline and cost based workflow scheduling in hybrid cloud. In: 2013 2nd International Conference on Advances in Computing, Communications and Informatics, pp. 840–846. IEEE (2013) Chopra, N., Singh, S.: Deadline and cost based workflow scheduling in hybrid cloud. In: 2013 2nd International Conference on Advances in Computing, Communications and Informatics, pp. 840–846. IEEE (2013)
8.
go back to reference Toosi, A.N., Sinnott, R.O., Buyya, R.: Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka. Future Gener. Comput. Syst. 79, 765–775 (2018)CrossRef Toosi, A.N., Sinnott, R.O., Buyya, R.: Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka. Future Gener. Comput. Syst. 79, 765–775 (2018)CrossRef
9.
go back to reference Loreti, D., Ciampolini, A.: A hybrid cloud infrastructure for big data applications. In: 2015 IEEE 17th International Conference on High Performance Computing and Communications, pp. 1713–1718. IEEE (2015) Loreti, D., Ciampolini, A.: A hybrid cloud infrastructure for big data applications. In: 2015 IEEE 17th International Conference on High Performance Computing and Communications, pp. 1713–1718. IEEE (2015)
10.
go back to reference Acs, S., Kozlovszky, M., Kacsuk, P.: A novel cloud bursting technique. In: 2014 9th IEEE International Symposium on Applied Computational Intelligence and Informatics, pp. 135–138. IEEE (2014) Acs, S., Kozlovszky, M., Kacsuk, P.: A novel cloud bursting technique. In: 2014 9th IEEE International Symposium on Applied Computational Intelligence and Informatics, pp. 135–138. IEEE (2014)
11.
go back to reference Farahabady, M.R.H., Lee, Y.C., Zomaya, A.Y.: Pareto-optimal cloud bursting. IEEE Trans. Parallel Distrib. Syst. 25(10), 2670–2682 (2014)CrossRef Farahabady, M.R.H., Lee, Y.C., Zomaya, A.Y.: Pareto-optimal cloud bursting. IEEE Trans. Parallel Distrib. Syst. 25(10), 2670–2682 (2014)CrossRef
12.
go back to reference Farokhi, S., Jamshidi, P., Lakew, E.B., et al.: A hybrid cloud controller for vertical memory elasticity: a control-theoretic approach. Future Gener. Comput. Syst. 65, 57–72 (2016)CrossRef Farokhi, S., Jamshidi, P., Lakew, E.B., et al.: A hybrid cloud controller for vertical memory elasticity: a control-theoretic approach. Future Gener. Comput. Syst. 65, 57–72 (2016)CrossRef
13.
go back to reference Clemente-Castelló, F.J., Nicolae, B., Rafique, M.M., et al.: Evaluation of data locality strategies for hybrid cloud bursting of iterative MapReduce. In: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 181–185. IEEE (2017) Clemente-Castelló, F.J., Nicolae, B., Rafique, M.M., et al.: Evaluation of data locality strategies for hybrid cloud bursting of iterative MapReduce. In: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 181–185. IEEE (2017)
14.
go back to reference Lee, Y.C., Lian, B.: Cloud bursting scheduler for cost efficiency. In: 2017 IEEE 10th IEEE International Conference on Cloud Computing, pp. 774–777. IEEE (2017) Lee, Y.C., Lian, B.: Cloud bursting scheduler for cost efficiency. In: 2017 IEEE 10th IEEE International Conference on Cloud Computing, pp. 774–777. IEEE (2017)
15.
go back to reference Charrada, F.B., Tata, S.: An efficient algorithm for the bursting of service-based applications in hybrid Clouds. IEEE Trans. Serv. Comput. 9(3), 357–367 (2016)CrossRef Charrada, F.B., Tata, S.: An efficient algorithm for the bursting of service-based applications in hybrid Clouds. IEEE Trans. Serv. Comput. 9(3), 357–367 (2016)CrossRef
16.
go back to reference Zhang, Y., Sun, J., Wu, Z.: An heuristic for Bag-of-Tasks scheduling problems with resource demands and budget constraints to minimize makespan on hybrid clouds. In: 2017 5th International Conference on Advanced Cloud and Big Data, pp. 39–44. IEEE (2017) Zhang, Y., Sun, J., Wu, Z.: An heuristic for Bag-of-Tasks scheduling problems with resource demands and budget constraints to minimize makespan on hybrid clouds. In: 2017 5th International Conference on Advanced Cloud and Big Data, pp. 39–44. IEEE (2017)
17.
go back to reference Daniel, D., Raviraj, P.: Distributed hybrid cloud for profit driven content provisioning using user requirements and content popularity. Clust. Comput. 20(1), 525–538 (2017)CrossRef Daniel, D., Raviraj, P.: Distributed hybrid cloud for profit driven content provisioning using user requirements and content popularity. Clust. Comput. 20(1), 525–538 (2017)CrossRef
20.
go back to reference Zuo, L., Shu, L., Dong, S., et al.: A multi-objective hybrid cloud resource scheduling method based on deadline and cost constraints. IEEE Access 5, 22067–22080 (2017)CrossRef Zuo, L., Shu, L., Dong, S., et al.: A multi-objective hybrid cloud resource scheduling method based on deadline and cost constraints. IEEE Access 5, 22067–22080 (2017)CrossRef
21.
go back to reference Champati, J.P., Liang, B.: One-restart algorithm for scheduling and offloading in a hybrid cloud. In: 2015 23rd IEEE International Symposium on Quality of Service, pp. 31–40. IEEE (2015) Champati, J.P., Liang, B.: One-restart algorithm for scheduling and offloading in a hybrid cloud. In: 2015 23rd IEEE International Symposium on Quality of Service, pp. 31–40. IEEE (2015)
23.
go back to reference Zhang, S., Pan, L., Liu, S., et al.: Profit based two-step job scheduling in clouds. Lect. Notes Comput. Sci. 9659, 481–492 (2016)CrossRef Zhang, S., Pan, L., Liu, S., et al.: Profit based two-step job scheduling in clouds. Lect. Notes Comput. Sci. 9659, 481–492 (2016)CrossRef
24.
go back to reference Hung, C.C., Golubchik, L., Yu, M.: Scheduling jobs across geo-distributed datacenters. In: 2015 6th ACM Symposium on Cloud Computing, pp. 111–124. ACM (2015) Hung, C.C., Golubchik, L., Yu, M.: Scheduling jobs across geo-distributed datacenters. In: 2015 6th ACM Symposium on Cloud Computing, pp. 111–124. ACM (2015)
25.
go back to reference Wang, W.J., Chang, Y.S., Lo, W.T., et al.: Adaptive scheduling for parallel tasks with QoS satisfaction for hybrid cloud environments. J. Supercomput. 66(2), 783–811 (2013)CrossRef Wang, W.J., Chang, Y.S., Lo, W.T., et al.: Adaptive scheduling for parallel tasks with QoS satisfaction for hybrid cloud environments. J. Supercomput. 66(2), 783–811 (2013)CrossRef
Metadata
Title
Towards operational cost minimization for cloud bursting with deadline constraints in hybrid clouds
Authors
Chunlin Li
Jianhang Tang
Youlong Luo
Publication date
25-08-2018
Publisher
Springer US
Published in
Cluster Computing / Issue 4/2018
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2841-4

Other articles of this Issue 4/2018

Cluster Computing 4/2018 Go to the issue

Premium Partner