Skip to main content
Erschienen in: The Journal of Supercomputing 11/2017

03.05.2017

Real-time workflows oriented online scheduling in uncertain cloud environment

verfasst von: Huangke Chen, Jianghan Zhu, Zhenshi Zhang, Manhao Ma, Xin Shen

Erschienen in: The Journal of Supercomputing | Ausgabe 11/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Workflow scheduling has become one of the hottest topics in cloud environments, and efficient scheduling approaches show promising ways to maximize the profit of cloud providers via minimizing their cost, while guaranteeing the QoS for users’ applications. However, existing scheduling approaches are inadequate for dynamic workflows with uncertain task execution times running in cloud environments, because those approaches assume that cloud computing environments are deterministic and pre-computed schedule decisions will be statically followed during schedule execution. To cover the above issue, we introduce an uncertainty-aware scheduling architecture to mitigate the impact of uncertain factors on the workflow scheduling quality. Based on this architecture, we present a scheduling algorithm, incorporating both event-driven and periodic rolling strategies (EDPRS), for scheduling dynamic workflows. Lastly, we conduct extensive experiments to compare EDPRS with two typical baseline algorithms using real-world workflow traces. The experimental results show that EDPRS performs better than those algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I et al (2010) A view of cloud computing. Commun ACM 53(4):50–58CrossRef Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I et al (2010) A view of cloud computing. Commun ACM 53(4):50–58CrossRef
2.
Zurück zum Zitat Mell P, Grance T (2011) The nist definition of cloud computing (draft). NIST Spec Publ 800:145 Mell P, Grance T (2011) The nist definition of cloud computing (draft). NIST Spec Publ 800:145
3.
Zurück zum Zitat Chen H, Zhu X, Qiu D, Liu L (2016) Uncertainty-aware real-time workflow scheduling in the cloud. In: Proceeding of the 9th International Conference on Cloud Computing, IEEE, pp 577–584 Chen H, Zhu X, Qiu D, Liu L (2016) Uncertainty-aware real-time workflow scheduling in the cloud. In: Proceeding of the 9th International Conference on Cloud Computing, IEEE, pp 577–584
4.
Zurück zum Zitat Zhu X, Wang J, Guo H, Zhu D, Yang LT, Liu L (2016) Fault-tolerant scheduling for real-time scientific workflows with elastic resource provisioning in virtualized clouds. IEEE Trans Parallel Distrib Syst 27(12):3501–3517CrossRef Zhu X, Wang J, Guo H, Zhu D, Yang LT, Liu L (2016) Fault-tolerant scheduling for real-time scientific workflows with elastic resource provisioning in virtualized clouds. IEEE Trans Parallel Distrib Syst 27(12):3501–3517CrossRef
5.
Zurück zum Zitat Zeng L, Veeravalli B, Li X (2015) Saba: a security-aware and budget-aware workflow scheduling strategy in clouds. J Parallel Distrib Comput 75:141–151CrossRef Zeng L, Veeravalli B, Li X (2015) Saba: a security-aware and budget-aware workflow scheduling strategy in clouds. J Parallel Distrib Comput 75:141–151CrossRef
7.
Zurück zum Zitat Chen H, Zhu X, Qiu D, Liu L, Du Z (2017) Scheduling for workflows with security-sensitive intermediate data by selective tasks duplication in clouds. IEEE Trans Parallel Distrib Syst. doi:10.1109/TPDS.2017.2678507 Chen H, Zhu X, Qiu D, Liu L, Du Z (2017) Scheduling for workflows with security-sensitive intermediate data by selective tasks duplication in clouds. IEEE Trans Parallel Distrib Syst. doi:10.​1109/​TPDS.​2017.​2678507
8.
Zurück zum Zitat Hamid F, Radu P, Thomas F (2013) A truthful dynamic workflow scheduling mechanism for commercial multicloud environments. IEEE Trans Parallel Distrib Syst 24(6):1203–1213CrossRef Hamid F, Radu P, Thomas F (2013) A truthful dynamic workflow scheduling mechanism for commercial multicloud environments. IEEE Trans Parallel Distrib Syst 24(6):1203–1213CrossRef
9.
Zurück zum Zitat Lee YC, Zomaya AY (2013) Stretch out and compact: workflow scheduling with resource abundance. In: Proceedings of the 2013 International Symposium on Cluster Cloud and the Grid (CCGRID), IEEE, pp 367–381 Lee YC, Zomaya AY (2013) Stretch out and compact: workflow scheduling with resource abundance. In: Proceedings of the 2013 International Symposium on Cluster Cloud and the Grid (CCGRID), IEEE, pp 367–381
10.
Zurück zum Zitat Zhang Q, Zhani MF, Boutaba R, Hellerstein JL (2013) Harmony: dynamic heterogeneity-aware resource provisioning in the cloud. In: IEEE 33rd International Conference on Distributed Computing Systems (ICDCS), IEEE, pp 510–519 Zhang Q, Zhani MF, Boutaba R, Hellerstein JL (2013) Harmony: dynamic heterogeneity-aware resource provisioning in the cloud. In: IEEE 33rd International Conference on Distributed Computing Systems (ICDCS), IEEE, pp 510–519
11.
Zurück zum Zitat Gideon J, Ann C, Ewa D, Shishir B, Gaurang M, Karan V (2013) Characterizing and profiling scientific workflows. Futur Gener Comput Syst 29:682–692CrossRef Gideon J, Ann C, Ewa D, Shishir B, Gaurang M, Karan V (2013) Characterizing and profiling scientific workflows. Futur Gener Comput Syst 29:682–692CrossRef
12.
Zurück zum Zitat Tang X, Li K, Liao G, Fang K, Wu F (2011) A stochastic scheduling algorithm for precedence constrained tasks on grid. Futur Gener Comput Syst 27(8):1083–1091CrossRef Tang X, Li K, Liao G, Fang K, Wu F (2011) A stochastic scheduling algorithm for precedence constrained tasks on grid. Futur Gener Comput Syst 27(8):1083–1091CrossRef
13.
Zurück zum Zitat Qiu M, Sha EH-M (2009) Cost minimization while satisfying hard/soft timing constraints for heterogeneous embedded systems. ACM Trans Des Autom Electron Syst (TODAES) 14(2):25 Qiu M, Sha EH-M (2009) Cost minimization while satisfying hard/soft timing constraints for heterogeneous embedded systems. ACM Trans Des Autom Electron Syst (TODAES) 14(2):25
14.
Zurück zum Zitat Kong X, Lin C, Jiang Y, Yan W, Chu X (2011) Efficient dynamic task scheduling in virtualized data centers with fuzzy prediction. J Netw Comput Appl 34(4):1068–1077CrossRef Kong X, Lin C, Jiang Y, Yan W, Chu X (2011) Efficient dynamic task scheduling in virtualized data centers with fuzzy prediction. J Netw Comput Appl 34(4):1068–1077CrossRef
15.
Zurück zum Zitat Chen H, Zhu X, Guo H, Zhu J, Qin X, Wu J (2015) Towards energy-efficient scheduling for real-time tasks under uncertain cloud computing environment. J Syst Softw 99:20–35CrossRef Chen H, Zhu X, Guo H, Zhu J, Qin X, Wu J (2015) Towards energy-efficient scheduling for real-time tasks under uncertain cloud computing environment. J Syst Softw 99:20–35CrossRef
16.
Zurück zum Zitat Poola D, Garg SK, Buyya R, Yang Y, Ramamohanarao K (2014) Robust scheduling of scientific workflows with deadline and budget constraints in clouds. In: IEEE 28th International Conference on Advanced Information Networking and Applications (AINA), IEEE, pp 858–865 Poola D, Garg SK, Buyya R, Yang Y, Ramamohanarao K (2014) Robust scheduling of scientific workflows with deadline and budget constraints in clouds. In: IEEE 28th International Conference on Advanced Information Networking and Applications (AINA), IEEE, pp 858–865
17.
Zurück zum Zitat Dejun J, Pierre G, Chi C-H (2010) EC2 performance analysis for resource provisioning of service-oriented applications. In: ICSOC/ServiceWave 2009 Workshops Service-Oriented Computing, Springer, pp 197–207 Dejun J, Pierre G, Chi C-H (2010) EC2 performance analysis for resource provisioning of service-oriented applications. In: ICSOC/ServiceWave 2009 Workshops Service-Oriented Computing, Springer, pp 197–207
18.
Zurück zum Zitat Xu Y, Li K, Hu J, Li K (2014) A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues. Inf Sci 270:255–287CrossRefMATHMathSciNet Xu Y, Li K, Hu J, Li K (2014) A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues. Inf Sci 270:255–287CrossRefMATHMathSciNet
19.
Zurück zum Zitat Jing C, Zhu Y, Li M (2013) Energy-efficient scheduling on multi-FPGA reconfigurable systems. Microprocess Microsyst 37(6):590–600CrossRef Jing C, Zhu Y, Li M (2013) Energy-efficient scheduling on multi-FPGA reconfigurable systems. Microprocess Microsyst 37(6):590–600CrossRef
20.
Zurück zum Zitat Durillo JJ, Nae V, Prodan R (2014) Multi-objective energy-efficient workflow scheduling using list-based heuristics. Futur Gener Comput Syst 36:221–236CrossRef Durillo JJ, Nae V, Prodan R (2014) Multi-objective energy-efficient workflow scheduling using list-based heuristics. Futur Gener Comput Syst 36:221–236CrossRef
21.
Zurück zum Zitat Mei J, Li K, Hu J, Yin S, Sha EH-M (2013) Energy-aware preemptive scheduling algorithm for sporadic tasks on DVS platform. Microprocess Microsyst 37(1):99–112CrossRef Mei J, Li K, Hu J, Yin S, Sha EH-M (2013) Energy-aware preemptive scheduling algorithm for sporadic tasks on DVS platform. Microprocess Microsyst 37(1):99–112CrossRef
22.
Zurück zum Zitat Abrishami S, Naghibzadeh M, Epema D (2012) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414CrossRef Abrishami S, Naghibzadeh M, Epema D (2012) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414CrossRef
23.
Zurück zum Zitat Zhang F, Cao J, Li K, Khan SU, Hwang K (2014) Multi-objective scheduling of many tasks in cloud platforms. Futur Gener Comput Syst 37:309–320CrossRef Zhang F, Cao J, Li K, Khan SU, Hwang K (2014) Multi-objective scheduling of many tasks in cloud platforms. Futur Gener Comput Syst 37:309–320CrossRef
24.
Zurück zum Zitat Li K, Tang X, Li K (2014) Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans Parallel Distrib Syst 25(11):2867–2876CrossRef Li K, Tang X, Li K (2014) Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans Parallel Distrib Syst 25(11):2867–2876CrossRef
25.
Zurück zum Zitat Scharbrodt M, Schickinger T, Steger A (2006) A new average case analysis for completion time scheduling. J ACM 53(1):121–146CrossRefMATHMathSciNet Scharbrodt M, Schickinger T, Steger A (2006) A new average case analysis for completion time scheduling. J ACM 53(1):121–146CrossRefMATHMathSciNet
26.
27.
Zurück zum Zitat Van de Vonder S, Demeulemeester E, Herroelen W (2008) Proactive heuristic procedures for robust project scheduling: an experimental analysis. Eur J Oper Res 189(3):723–733CrossRefMATH Van de Vonder S, Demeulemeester E, Herroelen W (2008) Proactive heuristic procedures for robust project scheduling: an experimental analysis. Eur J Oper Res 189(3):723–733CrossRefMATH
28.
Zurück zum Zitat Rodriguez Sossa M, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235CrossRef Rodriguez Sossa M, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235CrossRef
29.
Zurück zum Zitat Calheiros R N, Ranjan R, Beloglazov A, De Rose C A, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50CrossRef Calheiros R N, Ranjan R, Beloglazov A, De Rose C A, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50CrossRef
31.
Zurück zum Zitat Mao M, Humphrey M (2013) Scaling and scheduling to maximize application performance within budget constraints in cloud workflows. In: IEEE 27th International Symposium on Parallel and Distributed Processing (IPDPS), IEEE, pp 67–78 Mao M, Humphrey M (2013) Scaling and scheduling to maximize application performance within budget constraints in cloud workflows. In: IEEE 27th International Symposium on Parallel and Distributed Processing (IPDPS), IEEE, pp 67–78
32.
Zurück zum Zitat Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Futur Gener Comput Syst 29(1):158–169CrossRef Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Futur Gener Comput Syst 29(1):158–169CrossRef
33.
Zurück zum Zitat Abrishami S, Naghibzadeh M, Epema DH (2012) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414CrossRef Abrishami S, Naghibzadeh M, Epema DH (2012) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414CrossRef
Metadaten
Titel
Real-time workflows oriented online scheduling in uncertain cloud environment
verfasst von
Huangke Chen
Jianghan Zhu
Zhenshi Zhang
Manhao Ma
Xin Shen
Publikationsdatum
03.05.2017
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 11/2017
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-017-2060-4

Weitere Artikel der Ausgabe 11/2017

The Journal of Supercomputing 11/2017 Zur Ausgabe