Skip to main content
Top
Published in: Soft Computing 1/2020

02-11-2019 | Methodologies and Application

A modified shuffled frog leaping algorithm for scientific workflow scheduling using clustering techniques

Authors: M. Karpagam, K. Geetha, C. Rajan

Published in: Soft Computing | Issue 1/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The scientific workflows in the field of science like biology and astronomy are essential in facilitating and automating the scientific data of high volumes and their processing especially in a computing structure that is large. Owing to the large need for resources, a public heterogeneous cloud tends to play a major role in the completion of tasks. The traditional researches falling into the scheduling workflows in cloud applications were focusing on the problems that have a quality of service that is not sufficient for the competitive environment that exists today. There are scientific workflows that consist of several granular tasks which are intensive in terms of data. For a computational granularity that is efficient, the task clustering has a major role to play in reducing the length of the schedule and the utilization of resources. The workflow scheduling is a prominent issue in cloud computing, and this makes an attempt to map workflow tasks to VMs on the basis of various functional needs. The very popular approaches to this are either the static or the dynamic scheduling algorithms that have been based on various heuristics like the Opportunistic Load Balancing (OLB). But, in the case of workflow scheduling, this becomes a non-deterministic polynomial-hard optimization and is a challenge to achieve within an optimal schedule. The proposed work is a vertical node partition that makes use the vertical node partition that make use of a heuristic and novel shuffled frog leaping algorithm (SFLA) technique of clustering for optimal scheduling of scientific workflow. The results of the technique have shown that the SFLA proposed along with the method of clustering has achieved better performance (in terms of makespan and utilization of resources) compared to the SFLA and the OLB without clustering.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Adhikari M, Nandy S, Amgoth T (2019) Meta heuristic-based task deployment mechanism for load balancing in IaaS cloud. J Netw Comput Appl 128:64–77CrossRef Adhikari M, Nandy S, Amgoth T (2019) Meta heuristic-based task deployment mechanism for load balancing in IaaS cloud. J Netw Comput Appl 128:64–77CrossRef
go back to reference Amiri B, Fathian M, Maroosi A (2009) Application of shuffled frog-leaping algorithm on clustering. Int J Adv Manuf Technol 45(1–2):199–209CrossRef Amiri B, Fathian M, Maroosi A (2009) Application of shuffled frog-leaping algorithm on clustering. Int J Adv Manuf Technol 45(1–2):199–209CrossRef
go back to reference Angayarkanni G (2017) A survey on load balancing in cloud computing using various algorithms. Int J Adv Netw Appl (IJANA) 8(5):67–71 Angayarkanni G (2017) A survey on load balancing in cloud computing using various algorithms. Int J Adv Netw Appl (IJANA) 8(5):67–71
go back to reference Arjmand S, Adibnia F (2016) Job scheduling in cloud environment based on shuffled frog leaping algorithm. Int J Human Cult Stud (IJHCS) 1(1):290–302 Arjmand S, Adibnia F (2016) Job scheduling in cloud environment based on shuffled frog leaping algorithm. Int J Human Cult Stud (IJHCS) 1(1):290–302
go back to reference Bilgaiyan S, Sagnika S, Das M (2014) Workflow scheduling in cloud computing environment using cat swarm optimization. In: 2014 IEEE international advance computing conference (IACC). IEEE, pp 680–685 Bilgaiyan S, Sagnika S, Das M (2014) Workflow scheduling in cloud computing environment using cat swarm optimization. In: 2014 IEEE international advance computing conference (IACC). IEEE, pp 680–685
go back to reference Bittencourt LF, Madeira ERM (2011) HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds. J Internet Serv Appl 2(3):207–227CrossRef Bittencourt LF, Madeira ERM (2011) HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds. J Internet Serv Appl 2(3):207–227CrossRef
go back to reference Chen W, Deelman E (2012) Workflowsim: a toolkit for simulating scientific workflows in distributed environments. In: 2012 IEEE 8th international conference on e-science. IEEE, pp 1–8 Chen W, Deelman E (2012) Workflowsim: a toolkit for simulating scientific workflows in distributed environments. In: 2012 IEEE 8th international conference on e-science. IEEE, pp 1–8
go back to reference Guo X (2018) Research on optimization strategy of virtual resource scheduling based on improved frog leaping algorithm. In: 2017 international conference advanced engineering and technology research (AETR 2017). Atlantis Press Guo X (2018) Research on optimization strategy of virtual resource scheduling based on improved frog leaping algorithm. In: 2017 international conference advanced engineering and technology research (AETR 2017). Atlantis Press
go back to reference Hu X (2015) Adaptive optimization of cloud security resource dispatching SFLA algorithm. Int J Eng Sci (IJES) 4(3):39–43 Hu X (2015) Adaptive optimization of cloud security resource dispatching SFLA algorithm. Int J Eng Sci (IJES) 4(3):39–43
go back to reference Kashyap D, Viradiya J (2014) A survey of various load balancing algorithms in cloud computing. Int J Sci Technol Res 3(11):115–119 Kashyap D, Viradiya J (2014) A survey of various load balancing algorithms in cloud computing. Int J Sci Technol Res 3(11):115–119
go back to reference Kaur R, Luthra P (2013) Load balancing in cloud computing. Int J Netw Security 1–11 Kaur R, Luthra P (2013) Load balancing in cloud computing. Int J Netw Security 1–11
go back to reference Kaur P, Mehta S (2017) Resource provisioning and work flow scheduling in clouds using augmented Shuffled Frog Leaping Algorithm. J Parallel Distrib Comput 101:41–50CrossRef Kaur P, Mehta S (2017) Resource provisioning and work flow scheduling in clouds using augmented Shuffled Frog Leaping Algorithm. J Parallel Distrib Comput 101:41–50CrossRef
go back to reference Krishna MV (2018) An effective analysis of Metaheuristic optimization algorithms for scheduling in Cloud Computing. Int J Manag Technol Eng 8(12):2677–2687 Krishna MV (2018) An effective analysis of Metaheuristic optimization algorithms for scheduling in Cloud Computing. Int J Manag Technol Eng 8(12):2677–2687
go back to reference Latiff MSA, Madni SHH, Abdullahi M (2018) Fault tolerance aware scheduling technique for cloud computing environment using dynamic clustering algorithm. Neural Comput Appl 29(1):279–293CrossRef Latiff MSA, Madni SHH, Abdullahi M (2018) Fault tolerance aware scheduling technique for cloud computing environment using dynamic clustering algorithm. Neural Comput Appl 29(1):279–293CrossRef
go back to reference Masdari M, ValiKardan S, Shahi Z, Azar SI (2016) Towards workflow scheduling in cloud computing: a comprehensive analysis. J Netw Comput Appl 66:64–82CrossRef Masdari M, ValiKardan S, Shahi Z, Azar SI (2016) Towards workflow scheduling in cloud computing: a comprehensive analysis. J Netw Comput Appl 66:64–82CrossRef
go back to reference Moharana SS, Ramesh RD, Powar D (2013) Analysis of load balancers in cloud computing. Int J Comput Sci Eng (IJCSE) 2(2):101–108 Moharana SS, Ramesh RD, Powar D (2013) Analysis of load balancers in cloud computing. Int J Comput Sci Eng (IJCSE) 2(2):101–108
go back to reference Nema L, Sharma A, Jain S (2016) Load balancing algorithms in cloud computing: an extensive survey. Int J Eng Sci Comput 6(6):7463–7468 Nema L, Sharma A, Jain S (2016) Load balancing algorithms in cloud computing: an extensive survey. Int J Eng Sci Comput 6(6):7463–7468
go back to reference Pandey S, Wu L, Guru SM, Buyya R (2010) A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 2010 24th IEEE international conference on advanced information networking and applications. IEEE, pp 400–407 Pandey S, Wu L, Guru SM, Buyya R (2010) A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 2010 24th IEEE international conference on advanced information networking and applications. IEEE, pp 400–407
go back to reference Saleh H, Nashaat H, Saber W, Harb HM (2019) IPSO task scheduling algorithm for large scale data in cloud computing environment. IEEE Access 7:5412–5420CrossRef Saleh H, Nashaat H, Saber W, Harb HM (2019) IPSO task scheduling algorithm for large scale data in cloud computing environment. IEEE Access 7:5412–5420CrossRef
go back to reference Shaw SB, Singh AK (2014) A survey on scheduling and load balancing techniques in cloud computing environment. In: 2014 international conference on computer and communication technology (ICCCT). IEEE, pp 87–95 Shaw SB, Singh AK (2014) A survey on scheduling and load balancing techniques in cloud computing environment. In: 2014 international conference on computer and communication technology (ICCCT). IEEE, pp 87–95
go back to reference Singh V, Gupta I, Jana PK (2018) A novel cost-efficient approach for deadline-constrained workflow scheduling by dynamic provisioning of resources. Future Gener Comput Syst 79:95–110CrossRef Singh V, Gupta I, Jana PK (2018) A novel cost-efficient approach for deadline-constrained workflow scheduling by dynamic provisioning of resources. Future Gener Comput Syst 79:95–110CrossRef
go back to reference Sumathi D, Poongodi P (2015) An improved scheduling strategy in cloud using trust based mechanism. Int J Comput Electr Autom Control Inf Eng 9(2):637–641 Sumathi D, Poongodi P (2015) An improved scheduling strategy in cloud using trust based mechanism. Int J Comput Electr Autom Control Inf Eng 9(2):637–641
go back to reference Swarnkar N, Singh APAK, Shankar R (2013) A survey of load balancing techniques in cloud computing. Int J Eng Res Technol (IJERT) 2(8):800–804 Swarnkar N, Singh APAK, Shankar R (2013) A survey of load balancing techniques in cloud computing. Int J Eng Res Technol (IJERT) 2(8):800–804
go back to reference Thant PT, Powell C, Schlueter M, Munetomo M (2017a) Multiobjective level-wise scientific workflow optimization in IaaS public cloud environment. In: Scientific programming, 2017 Thant PT, Powell C, Schlueter M, Munetomo M (2017a) Multiobjective level-wise scientific workflow optimization in IaaS public cloud environment. In: Scientific programming, 2017
go back to reference Thant PT, Powell C, Schlueter M, Munetomo M (2017b) Constrained multi-objective scientific workflow execution optimization with NSGA-III in the Cloud. IJCSIS 15(10) Thant PT, Powell C, Schlueter M, Munetomo M (2017b) Constrained multi-objective scientific workflow execution optimization with NSGA-III in the Cloud. IJCSIS 15(10)
go back to reference Thant PT, Powell C, Schlueter M, Munetomo M (2017c) A level-wise load balanced scientific workflow execution optimization using NSGA-II. In: 2017 17th IEEE/ACM international symposium on cluster, cloud and grid computing (CCGRID). IEEE, pp 882–889 Thant PT, Powell C, Schlueter M, Munetomo M (2017c) A level-wise load balanced scientific workflow execution optimization using NSGA-II. In: 2017 17th IEEE/ACM international symposium on cluster, cloud and grid computing (CCGRID). IEEE, pp 882–889
go back to reference Wu Z, Ni Z, Gu L, Liu X (2010) A revised discrete particle swarm optimization for cloud workflow scheduling. In: 2010 international conference on computational intelligence and security. IEEE, pp 184–188 Wu Z, Ni Z, Gu L, Liu X (2010) A revised discrete particle swarm optimization for cloud workflow scheduling. In: 2010 international conference on computational intelligence and security. IEEE, pp 184–188
go back to reference Yang M, Gao X, Cao Y, Liu Y, Li Y (2015) Resource scheduling of workflow multi-instance migration based on the shuffled leapfrog algorithm. J Ind Eng Manag (JIEM) 8(1):217–232 Yang M, Gao X, Cao Y, Liu Y, Li Y (2015) Resource scheduling of workflow multi-instance migration based on the shuffled leapfrog algorithm. J Ind Eng Manag (JIEM) 8(1):217–232
Metadata
Title
A modified shuffled frog leaping algorithm for scientific workflow scheduling using clustering techniques
Authors
M. Karpagam
K. Geetha
C. Rajan
Publication date
02-11-2019
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 1/2020
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-019-04484-4

Other articles of this Issue 1/2020

Soft Computing 1/2020 Go to the issue

Premium Partner