Skip to main content
Erschienen in: The Journal of Supercomputing 11/2021

20.04.2021

PSO+LOA: hybrid constrained optimization for scheduling scientific workflows in the cloud

verfasst von: Huifang Li, Danjing Wang, Julio Ruben Cañizares Abreu, Qing Zhao, Orlando Bonilla Pineda

Erschienen in: The Journal of Supercomputing | Ausgabe 11/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud computing provides a cost-effective deploying environment for hosting and executing workflows as its elasticity, scalability and pay-per-use model. Scientific applications are normally compute- or resource-intensive, and how to run them in the cloud while both meeting QoS of users and guaranteeing the benefits of cloud service providers (CSPs) is still a challenge and depends mainly on workflow scheduling. In this article, we propose a hybrid optimization approach, PSO+LOA, i.e., a combination of particle swarm optimization (PSO) and lion optimization algorithm (LOA) for scheduling workflows in the cloud to minimize the total execution time under budget constraints. The main contributions of our work are: (1) A Euclidean distance (ED) aware particle reposition strategy is defined for two close particles, so as to separate them away from each other, hence enhancing the capability of escaping from local optima. (2) To improve the search and convergence efficiency of original PSO, we modify the velocity update equation by introducing adaptive parameters. (3) Inspired by the multiple-swarm co-evolutionary mechanism of LOA, we integrate PSO with LOA to make a good balance between exploration and exploitation during the whole optimization process. Extensive experiments are conducted over well-known scientific workflows with different sizes and types through WorkflowSim. The experimental results demonstrate that in most cases, PSO+LOA outperforms the existing algorithms in the extent of budget constraint satisfiability, solution quality, i.e., it can generate much better solutions which meet the needs of different budget constraints, especially for large-scale applications, such as the average relative deviation index for PSO+LOA and genetic algorithm (GA) are 0.03% and 0.20%, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Gener Comput Syst 25(6):599–616CrossRef Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Gener Comput Syst 25(6):599–616CrossRef
2.
Zurück zum Zitat Aziza H, Krichen S (2020) A hybrid genetic algorithm for scientific workflow scheduling in cloud environment. Neural Comput Appl 32(18):1433–3058CrossRef Aziza H, Krichen S (2020) A hybrid genetic algorithm for scientific workflow scheduling in cloud environment. Neural Comput Appl 32(18):1433–3058CrossRef
3.
Zurück zum Zitat Chen Z, Zhan Z, Lin Y, Gong Y, Gu T, Zhao F, Yuan H, Chen X, Li Q, Zhang J (2019) Multiobjective cloud workflow scheduling: a multiple populations ant colony system approach. IEEE Trans Cybern 49(8):2912–2926CrossRef Chen Z, Zhan Z, Lin Y, Gong Y, Gu T, Zhao F, Yuan H, Chen X, Li Q, Zhang J (2019) Multiobjective cloud workflow scheduling: a multiple populations ant colony system approach. IEEE Trans Cybern 49(8):2912–2926CrossRef
4.
Zurück zum Zitat Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235CrossRef Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235CrossRef
5.
Zurück zum Zitat Yazdani M, Jolai F (2016) Lion optimization algorithm (loa): a nature-inspired metaheuristic algorithm. J Comput Design Eng 3(1):24–36CrossRef Yazdani M, Jolai F (2016) Lion optimization algorithm (loa): a nature-inspired metaheuristic algorithm. J Comput Design Eng 3(1):24–36CrossRef
6.
Zurück zum Zitat Ilavarasan E, Thambidurai P (2007) Low complexity performance effective task scheduling algorithm for heterogeneous computing environments. J Comput Sci 3(2):94–103CrossRef Ilavarasan E, Thambidurai P (2007) Low complexity performance effective task scheduling algorithm for heterogeneous computing environments. J Comput Sci 3(2):94–103CrossRef
7.
Zurück zum Zitat Kwok YK, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef Kwok YK, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef
9.
Zurück zum Zitat Abrishami S, Naghibzadeh M, Epema DH (2011) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414CrossRef Abrishami S, Naghibzadeh M, Epema DH (2011) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414CrossRef
10.
Zurück zum Zitat Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gener Comput Syst 29(1):158–169CrossRef Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gener Comput Syst 29(1):158–169CrossRef
11.
Zurück zum Zitat Arabnejad H, Barbosa JG, Prodan R (2016) Low-time complexity budget-deadline constrained workflow scheduling on heterogeneous resources. Future Gener Comput Syst 55:29–40CrossRef Arabnejad H, Barbosa JG, Prodan R (2016) Low-time complexity budget-deadline constrained workflow scheduling on heterogeneous resources. Future Gener Comput Syst 55:29–40CrossRef
12.
Zurück zum Zitat Arabnejad V, Bubendorfer K, Ng B (2019) Budget and deadline aware e-science workflow scheduling in clouds. IEEE Trans Parallel Distrib Syst 30(1):29–44CrossRef Arabnejad V, Bubendorfer K, Ng B (2019) Budget and deadline aware e-science workflow scheduling in clouds. IEEE Trans Parallel Distrib Syst 30(1):29–44CrossRef
14.
Zurück zum Zitat Kalyan Chakravarthi SLVVK (2020) Budget aware scheduling algorithm for workflow applications in iaas clouds. Clust Comput 23(4):3405–3419CrossRef Kalyan Chakravarthi SLVVK (2020) Budget aware scheduling algorithm for workflow applications in iaas clouds. Clust Comput 23(4):3405–3419CrossRef
15.
Zurück zum Zitat Jain R (2020) Eaco: an enhanced ant colony optimization algorithm for task scheduling in cloud computing. Int J Sec Appl 13:91–100 (10.33832/ijsia.2019.13.4.09) Jain R (2020) Eaco: an enhanced ant colony optimization algorithm for task scheduling in cloud computing. Int J Sec Appl 13:91–100 (10.33832/ijsia.2019.13.4.09)
16.
Zurück zum Zitat Li F, Zhang L, Liao TW, Liu Y (2019) Multi-objective optimisation of multi-task scheduling in cloud manufacturing. Int J Prod Res 57(11–12):3847–3863CrossRef Li F, Zhang L, Liao TW, Liu Y (2019) Multi-objective optimisation of multi-task scheduling in cloud manufacturing. Int J Prod Res 57(11–12):3847–3863CrossRef
17.
Zurück zum Zitat Netjinda N, Sirinaovakul B, Achalakul T (2014) Cost optimal scheduling in iaas for dependent workload with particle swarm optimization. J Supercomput 68(3):1579–1603CrossRef Netjinda N, Sirinaovakul B, Achalakul T (2014) Cost optimal scheduling in iaas for dependent workload with particle swarm optimization. J Supercomput 68(3):1579–1603CrossRef
18.
Zurück zum Zitat Ambursa FU, Latip R, Abdullah A, Subramaniam S (2017) A particle swarm optimization and min-max-based workflow scheduling algorithm with qos satisfaction for service-oriented grids. J Supercomput 73(5):2018–2051CrossRef Ambursa FU, Latip R, Abdullah A, Subramaniam S (2017) A particle swarm optimization and min-max-based workflow scheduling algorithm with qos satisfaction for service-oriented grids. J Supercomput 73(5):2018–2051CrossRef
19.
Zurück zum Zitat Wang P, Lei Y, Agbedanu PR, Zhang Z (2020) Makespan-driven workflow scheduling in clouds using immune-based pso algorithm. IEEE Access 8:1CrossRef Wang P, Lei Y, Agbedanu PR, Zhang Z (2020) Makespan-driven workflow scheduling in clouds using immune-based pso algorithm. IEEE Access 8:1CrossRef
22.
Zurück zum Zitat Ramadhan M, Latip R, Hussin M, Asilawati N (2020) A survey on qos requirements based on particle swarm optimization scheduling techniques for workflow scheduling in cloud computing. Symmetry 12:551CrossRef Ramadhan M, Latip R, Hussin M, Asilawati N (2020) A survey on qos requirements based on particle swarm optimization scheduling techniques for workflow scheduling in cloud computing. Symmetry 12:551CrossRef
23.
Zurück zum Zitat Hosseinzadeh M, Ghafour MY, Hama HK, Vo B, Khoshnevis A (2020) Multi-objective task and workflow scheduling approaches in cloud computing: a comprehensive review. J Grid Comput 18(3):327–356CrossRef Hosseinzadeh M, Ghafour MY, Hama HK, Vo B, Khoshnevis A (2020) Multi-objective task and workflow scheduling approaches in cloud computing: a comprehensive review. J Grid Comput 18(3):327–356CrossRef
24.
Zurück zum Zitat Almezeini N, Hafez A (2017) Task scheduling in cloud computing using lion optimization algorithm. Int J Adv Comput Sci Appl 8(11):77–83 Almezeini N, Hafez A (2017) Task scheduling in cloud computing using lion optimization algorithm. Int J Adv Comput Sci Appl 8(11):77–83
25.
Zurück zum Zitat Manikandan N, Pravin A (2019) Lgsa: hybrid task scheduling in multi objective functionality in cloud computing environment. 3D Res 10(2):12CrossRef Manikandan N, Pravin A (2019) Lgsa: hybrid task scheduling in multi objective functionality in cloud computing environment. 3D Res 10(2):12CrossRef
26.
Zurück zum Zitat Wu F, Wu Q, Tan Y (2015) Workflow scheduling in cloud: a survey. J Supercomput 71(9):3373–3418CrossRef Wu F, Wu Q, Tan Y (2015) Workflow scheduling in cloud: a survey. J Supercomput 71(9):3373–3418CrossRef
28.
Zurück zum Zitat Chen K, Zhou F, Yin L, Wang S, Wang Y, Wan F (2018) A hybrid particle swarm optimizer with sine cosine acceleration coefficients. Inform Sci 422:218–241MathSciNetCrossRef Chen K, Zhou F, Yin L, Wang S, Wang Y, Wan F (2018) A hybrid particle swarm optimizer with sine cosine acceleration coefficients. Inform Sci 422:218–241MathSciNetCrossRef
30.
Zurück zum Zitat Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Future Gener Comput Syst 29(3):682–692CrossRef Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Future Gener Comput Syst 29(3):682–692CrossRef
31.
32.
Zurück zum Zitat Li X, Cai Z (2015) Elastic resource provisioning for cloud workflow applications. IEEE Trans Autom Sci Eng 14(2):1195–1210CrossRef Li X, Cai Z (2015) Elastic resource provisioning for cloud workflow applications. IEEE Trans Autom Sci Eng 14(2):1195–1210CrossRef
Metadaten
Titel
PSO+LOA: hybrid constrained optimization for scheduling scientific workflows in the cloud
verfasst von
Huifang Li
Danjing Wang
Julio Ruben Cañizares Abreu
Qing Zhao
Orlando Bonilla Pineda
Publikationsdatum
20.04.2021
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 11/2021
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-021-03755-y

Weitere Artikel der Ausgabe 11/2021

The Journal of Supercomputing 11/2021 Zur Ausgabe

Premium Partner