Skip to main content
Top
Published in: The Journal of Supercomputing 2/2023

02-08-2022

A cost and makespan aware scheduling algorithm for dynamic multi-workflow in cloud environment

Authors: Yuanqing Xia, Yufeng Zhan, Li Dai, Yuehong Chen

Published in: The Journal of Supercomputing | Issue 2/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the development of cloud computing, a growing number of workflows are deployed on cloud platform that can dynamically provides cloud resources on demand for users. In clouds, one basic problem is how to schedule workflow for minimizing the execution cost and the workflow completion time. Aiming at the problem that the maximum completion time and cost of multiple workflows are too high, this paper proposes a model of dynamic multi-workflow scheduling in cloud environment and a new scheduling algorithm which is named as MT (multi-workflow scheduling technology). In MT, the heterogeneity of resources is considered when calculating the priority of tasks. Then, the technique for order of preference by similarity to ideal solution (TOPSIS) method is used to rank the resources when selecting resources for tasks. Finally, MT takes the estimated minimum completion time of the workflow and the cost of the task as two attribute indexes in TOPSIS decision matrix. Also, it uses a fixed reference point instead of calculating ideal solution, which ensures the uniqueness of the evaluation criteria when there is a change in the number of resources. Simulation experiments are illustrated to verify the effectiveness of the proposed algorithm in reducing the maximum completion time and cost of multiple workflows. Compared with the state-of-the-art methods, the maximum completion time and cost can be reduced by at most 17 and \(9\%\), respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Footnotes
1
The Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) is a multi-criteria decision analysis method, it is based on the concept that the chosen alternative should have the shortest geometric distance from the positive ideal solution and the longest geometric distance from the negative ideal solution [10].
 
Literature
2.
go back to reference Xia Y, Yan C, Wang X (2019) Intelligent transportation cyber-physical cloud control systems. Acta Autom Sinica 45(1):132–142MATH Xia Y, Yan C, Wang X (2019) Intelligent transportation cyber-physical cloud control systems. Acta Autom Sinica 45(1):132–142MATH
3.
go back to reference Atmaca T, Begin T, Brandwajn A, Casteltaleb H (2016) Performance evaluation of cloud computing centers with general arrivals and service. IEEE Trans Parallel Distrib Syst 27(8):2341–2348CrossRef Atmaca T, Begin T, Brandwajn A, Casteltaleb H (2016) Performance evaluation of cloud computing centers with general arrivals and service. IEEE Trans Parallel Distrib Syst 27(8):2341–2348CrossRef
4.
go back to reference Xie G, Chen Y, Li R, Li K (2018) Hardware cost design optimization for functional safety-critical parallel applications on heterogeneous distributed embedded systems. IEEE Trans Industr Inf 14(6):2418–2431CrossRef Xie G, Chen Y, Li R, Li K (2018) Hardware cost design optimization for functional safety-critical parallel applications on heterogeneous distributed embedded systems. IEEE Trans Industr Inf 14(6):2418–2431CrossRef
5.
go back to reference Yassir S, Mostapha Z, Claude T (2017) Workflow scheduling issues and techniques in cloud computing: a systematic literature review. In: Proceedings of the International Conference of Cloud Computing Technologies and Applications, pp. 241– 263 . Springer Yassir S, Mostapha Z, Claude T (2017) Workflow scheduling issues and techniques in cloud computing: a systematic literature review. In: Proceedings of the International Conference of Cloud Computing Technologies and Applications, pp. 241– 263 . Springer
6.
go back to reference Bardsiri AK, Hashemi SM (2012) A review of workflow scheduling in cloud computing environment. Int J Comput Sci Manag Res 1(3):348–351 Bardsiri AK, Hashemi SM (2012) A review of workflow scheduling in cloud computing environment. Int J Comput Sci Manag Res 1(3):348–351
7.
go back to reference Topcuoglu H, Hariri S, Wu M-y (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260–274CrossRef Topcuoglu H, Hariri S, Wu M-y (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260–274CrossRef
8.
go back to reference Braun TD, Siegel HJ, Beck N, Bölöni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B, Hensgen D et al (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810–837CrossRefMATH Braun TD, Siegel HJ, Beck N, Bölöni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B, Hensgen D et al (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810–837CrossRefMATH
9.
go back to reference Sakellariou R, Zhao H, Tsiakkouri E, Dikaiakos MD (2007) Scheduling workflows with budget constraints, 189–202 Sakellariou R, Zhao H, Tsiakkouri E, Dikaiakos MD (2007) Scheduling workflows with budget constraints, 189–202
10.
go back to reference Assari A, Mahesh T, Assari E (2012) Role of public participation in sustainability of historical city: usage of topsis method. Indian J Sci Technol 5(3):2289–2294CrossRef Assari A, Mahesh T, Assari E (2012) Role of public participation in sustainability of historical city: usage of topsis method. Indian J Sci Technol 5(3):2289–2294CrossRef
11.
go back to reference Lin C, Lu S ( 2011) Scheduling scientific workflows elastically for cloud computing. In: Proceedings of the 4th IEEE International Conference on Cloud Computing, pp. 746– 747 . IEEE Lin C, Lu S ( 2011) Scheduling scientific workflows elastically for cloud computing. In: Proceedings of the 4th IEEE International Conference on Cloud Computing, pp. 746– 747 . IEEE
12.
go back to reference Rodriguez MA, Buyya R (2014) Deadline based resource provisioningand scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235CrossRef Rodriguez MA, Buyya R (2014) Deadline based resource provisioningand scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235CrossRef
13.
go back to reference Chen Z-G, Zhan Z-H, Li H-H, Du K-J, Zhong J-H, Foo YW, Li Y, Zhang J (2015) Deadline constrained cloud computing resources scheduling through an ant colony system approach. In: 2015 International Conference on Cloud Computing Research and Innovation, pp. 112– 119 . IEEE Chen Z-G, Zhan Z-H, Li H-H, Du K-J, Zhong J-H, Foo YW, Li Y, Zhang J (2015) Deadline constrained cloud computing resources scheduling through an ant colony system approach. In: 2015 International Conference on Cloud Computing Research and Innovation, pp. 112– 119 . IEEE
14.
go back to reference Su S, Li J, Huang Q, Huang X, Shuang K, Wang J (2013) Cost-efficient task scheduling for executing large programs in the cloud. Parallel Comput 39(4–5):177–188CrossRef Su S, Li J, Huang Q, Huang X, Shuang K, Wang J (2013) Cost-efficient task scheduling for executing large programs in the cloud. Parallel Comput 39(4–5):177–188CrossRef
16.
go back to reference Chen Z-G, Zhan Z-H, Lin Y, Gong Y-J, Gu T-L, Zhao F, Yuan H-Q, Zhang J (2019) Multiobjective cloud workflow scheduling: a multiple populations ant colony system approach. IEEE Trans Cybern 49(8):2912–2926CrossRef Chen Z-G, Zhan Z-H, Lin Y, Gong Y-J, Gu T-L, Zhao F, Yuan H-Q, Zhang J (2019) Multiobjective cloud workflow scheduling: a multiple populations ant colony system approach. IEEE Trans Cybern 49(8):2912–2926CrossRef
17.
go back to reference Zhu Z, Zhang G, Li M, Liu X (2016) Evolutionary multi-objective workflow scheduling in cloud. IEEE Trans Parallel Distrib Syst 27(5):1344–1357CrossRef Zhu Z, Zhang G, Li M, Liu X (2016) Evolutionary multi-objective workflow scheduling in cloud. IEEE Trans Parallel Distrib Syst 27(5):1344–1357CrossRef
18.
go back to reference Garg R, Singh AK ( 2011) Multi-objective workflow grid scheduling based on discrete particle swarm optimization. In: International Conference on Swarm, Evolutionary, and Memetic Computing, pp. 183– 190 . Springer Garg R, Singh AK ( 2011) Multi-objective workflow grid scheduling based on discrete particle swarm optimization. In: International Conference on Swarm, Evolutionary, and Memetic Computing, pp. 183– 190 . Springer
19.
go back to reference Hsu C-C, Huang K-C, Wang F-J (2011) Online scheduling of workflow applications in grid environments. Futur Gener Comput Syst 27(6):860–870CrossRef Hsu C-C, Huang K-C, Wang F-J (2011) Online scheduling of workflow applications in grid environments. Futur Gener Comput Syst 27(6):860–870CrossRef
20.
Metadata
Title
A cost and makespan aware scheduling algorithm for dynamic multi-workflow in cloud environment
Authors
Yuanqing Xia
Yufeng Zhan
Li Dai
Yuehong Chen
Publication date
02-08-2022
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 2/2023
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-022-04681-3

Other articles of this Issue 2/2023

The Journal of Supercomputing 2/2023 Go to the issue

Premium Partner