Skip to main content
Top
Published in: Natural Computing 4/2012

01-12-2012

A bio-inspired distributed algorithm to improve scheduling performance of multi-broker grids

Authors: Antonella Di Stefano, Giovanni Morana

Published in: Natural Computing | Issue 4/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The scheduling in grids is known to be a NP-hard problem. The distributed deployment of nodes, their heterogeneity and their fluctuations in terms of workload and availability make the design of an effective scheduling algorithm a very complex issue. The scientific literature has proposed several heuristics able to tackle this kind of optimization problem using techniques and strategies inspired by nature. The algorithms belonging to ant colony optimization (ACO) paradigm represent an example of these techniques: each one of these algorithms uses strategies inspired by the self-organization ability of real ants for building effective grid schedulers. In this paper, the authors propose an on line, non-clairvoyant, distributed scheduling solution for multi-broker grid based on the alienated ant algorithm (AAA), a new ACO inspired technique exploiting a “non natural” behavior of ants and an inverse interpretation of pheromone trails. The paper introduces the proposed algorithm, explains the differences with other classical ACO approaches, and compares AAA with two different algorithms. The results of simulations show that the AAA guarantees good performance in terms of makespan, average queue waiting time and load balancing capability.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Usually, if it is not differently specified in JDL (Pacini) files, each UI refers to a specific “default” RB.
 
2
In terms of previous submitted jobs.
 
3
Inversely proportional to the quantity of pheromone.
 
4
In these systems several RBs can submit their jobs to the same CEs.
 
Literature
go back to reference Aggarwal M, Kent RD, Ngom A (2005) Genetic algorithm based scheduler for computational grids. In: Proceedings of 19th international symposium on high performance computing systems and applications, Los Alamitos, pp 209–215 Aggarwal M, Kent RD, Ngom A (2005) Genetic algorithm based scheduler for computational grids. In: Proceedings of 19th international symposium on high performance computing systems and applications, Los Alamitos, pp 209–215
go back to reference Andrieux A, Berry D, Garibaldi J, Jarvis S, MacLaren J, Ouelhadj D, Snelling D (2003) Open issues in grid scheduling UK e-Science. Technical report series ISSN 1751-5971 Andrieux A, Berry D, Garibaldi J, Jarvis S, MacLaren J, Ouelhadj D, Snelling D (2003) Open issues in grid scheduling UK e-Science. Technical report series ISSN 1751-5971
go back to reference Bandieramonte M, Di Stefano A, Morana G (2008) An ACO inspired strategy to improve jobs scheduling in a grid environment. In: Proceedings of ICA3 PP. Springer, Berlin, pp 30–41 Bandieramonte M, Di Stefano A, Morana G (2008) An ACO inspired strategy to improve jobs scheduling in a grid environment. In: Proceedings of ICA3 PP. Springer, Berlin, pp 30–41
go back to reference Bandieramonte M, Di Stefano A, Morana G (2010a) Grid jobs scheduling: the alienated ant algorithm solution. Multiagent Grid Syst 6(3):225–243MATH Bandieramonte M, Di Stefano A, Morana G (2010a) Grid jobs scheduling: the alienated ant algorithm solution. Multiagent Grid Syst 6(3):225–243MATH
go back to reference Bandieramonte M, Di Stefano A, Morana G (2010b) Pheromone impact on ants-based algorithms pheromones: theories, types and uses. Nova Publisher, New York, pp 283–300 Bandieramonte M, Di Stefano A, Morana G (2010b) Pheromone impact on ants-based algorithms pheromones: theories, types and uses. Nova Publisher, New York, pp 283–300
go back to reference Blum C, Roli A (2003) Metaheuristics in combinatorial optimization: overview and conceptual comparison. ACM Comput Surv 35(3):268–308CrossRef Blum C, Roli A (2003) Metaheuristics in combinatorial optimization: overview and conceptual comparison. ACM Comput Surv 35(3):268–308CrossRef
go back to reference Blum C, Sampels M (2002) Ant colony optimization for fop shop scheduling: a case study on different pheromone representations. In: Proceedings of the 2002 congress on evolutionary computing, Honolulu, pp 1558–1563 Blum C, Sampels M (2002) Ant colony optimization for fop shop scheduling: a case study on different pheromone representations. In: Proceedings of the 2002 congress on evolutionary computing, Honolulu, pp 1558–1563
go back to reference Blum C, Sampels M (2004) An ant colony optimization algorithm for shop scheduling problems. J Math Model Algorithms 3:285– 308 Blum C, Sampels M (2004) An ant colony optimization algorithm for shop scheduling problems. J Math Model Algorithms 3:285– 308
go back to reference Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B, Hensgen D, Freund RF (2006) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810–837CrossRef Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B, Hensgen D, Freund RF (2006) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810–837CrossRef
go back to reference Cao J, Spooner DP, Jarvis SA, Nudd GR (2005) Grid load balancing using intelligent agents. Futur Gener Comput Syst 21:135–149CrossRef Cao J, Spooner DP, Jarvis SA, Nudd GR (2005) Grid load balancing using intelligent agents. Futur Gener Comput Syst 21:135–149CrossRef
go back to reference Chang R-S, Chang J-S, Lin P-S (2009) An ant algorithm for balanced job scheduling in grids. Futur Gener Comput Syst 25:20–27CrossRef Chang R-S, Chang J-S, Lin P-S (2009) An ant algorithm for balanced job scheduling in grids. Futur Gener Comput Syst 25:20–27CrossRef
go back to reference Chiang C-W, Lee Y-C, Lee C-N, Chou T-Y (2006) Ant colony optimization for task matching and scheduling. IEE Proc 153:373–380 Chiang C-W, Lee Y-C, Lee C-N, Chou T-Y (2006) Ant colony optimization for task matching and scheduling. IEE Proc 153:373–380
go back to reference den Besten ML, Stutzle T, Dorigo M (2001) Design of iterated local search algorithms: an example application to the single machine total weighted tardiness problem. In: Proceedings of EvoStim01, lecture notes in computer science, Springer, Berlin, pp 441–452, den Besten ML, Stutzle T, Dorigo M (2001) Design of iterated local search algorithms: an example application to the single machine total weighted tardiness problem. In: Proceedings of EvoStim01, lecture notes in computer science, Springer, Berlin, pp 441–452,
go back to reference Di Caro G, Dorigo M (1999) AntNet: distributed stigmergetic control for communications networks. J Artif Intell Res 9:317–365 Di Caro G, Dorigo M (1999) AntNet: distributed stigmergetic control for communications networks. J Artif Intell Res 9:317–365
go back to reference Dong F, Akl Selim G (2006) Scheduling algorithms for grid computing: state of the art and open problems. Technical report No. 2006-504 Dong F, Akl Selim G (2006) Scheduling algorithms for grid computing: state of the art and open problems. Technical report No. 2006-504
go back to reference Dorigo M, Gambardella LM (1997) Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans Evol Comput 1:53–66CrossRef Dorigo M, Gambardella LM (1997) Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans Evol Comput 1:53–66CrossRef
go back to reference Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B 26(1):29–41CrossRef Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B 26(1):29–41CrossRef
go back to reference Ducatelle F, Di Caro G, Gambardella LM (2010) Principles and applications of swarm intelligence for adaptive routing in telecommunications networks. Swarm Intell 4(3):173–198. doi:10.1007/s11721-010-0040-x Ducatelle F, Di Caro G, Gambardella LM (2010) Principles and applications of swarm intelligence for adaptive routing in telecommunications networks. Swarm Intell 4(3):173–198. doi:10.​1007/​s11721-010-0040-x
go back to reference Farooq M, Di Caro G (2008) Routing protocols for next-generation intelligent networks inspired by collective behaviors of insect societies. In: Blum C, Merkle D (eds) Swarm intelligence: introduction and applications, natural computing series. Springer, Berlin, pp 101–160 Farooq M, Di Caro G (2008) Routing protocols for next-generation intelligent networks inspired by collective behaviors of insect societies. In: Blum C, Merkle D (eds) Swarm intelligence: introduction and applications, natural computing series. Springer, Berlin, pp 101–160
go back to reference Fernandez-Baca D (1989) Allocating modules to processors in a distributed system. IEEE Trans Softw Eng 15(11):1427–1436CrossRef Fernandez-Baca D (1989) Allocating modules to processors in a distributed system. IEEE Trans Softw Eng 15(11):1427–1436CrossRef
go back to reference Fidanova S (2006) Simulated annealing for grid scheduling problem. In: IEEE John Vincent Atanasoff 2006 international symposium on modern computing, Sofia, pp 41–45 Fidanova S (2006) Simulated annealing for grid scheduling problem. In: IEEE John Vincent Atanasoff 2006 international symposium on modern computing, Sofia, pp 41–45
go back to reference Fidanova S, Durchova M (2006) Ant algorithm for grid scheduling problem. Large scale computing, Lecture notes in computer science No. 3743, Springer, pp 405–412 Fidanova S, Durchova M (2006) Ant algorithm for grid scheduling problem. Large scale computing, Lecture notes in computer science No. 3743, Springer, pp 405–412
go back to reference Foster I, Kesselman C (1999) The grid: blueprint for a new computing infrastructure. Morgan Kaufmann Publishers, San Francisco (ISBN:1-558660-475-8) Foster I, Kesselman C (1999) The grid: blueprint for a new computing infrastructure. Morgan Kaufmann Publishers, San Francisco (ISBN:1-558660-475-8)
go back to reference Gagliardi F, Jones B, Grey F, Begin ME, Heikkurinen M (2005) Building an infrastructure for scientific grid computing: status and goals of the EGEE project. Phil Trans R Soc A 363(1833):1729–1742. doi:10.1098/rsta.2005.1603 CrossRef Gagliardi F, Jones B, Grey F, Begin ME, Heikkurinen M (2005) Building an infrastructure for scientific grid computing: status and goals of the EGEE project. Phil Trans R Soc A 363(1833):1729–1742. doi:10.​1098/​rsta.​2005.​1603 CrossRef
go back to reference Gao Y, Rong H, Huang JZ (2005) Adaptive grid job scheduling with genetic algorithms. Futur Gener Comput Syst 21:151–161CrossRef Gao Y, Rong H, Huang JZ (2005) Adaptive grid job scheduling with genetic algorithms. Futur Gener Comput Syst 21:151–161CrossRef
go back to reference Gambardella LM, Dorigo M (2000) Ant colony system hybridized with a new local search for the sequential ordering problem. INFORMS J Comput 12:237–255MathSciNetMATHCrossRef Gambardella LM, Dorigo M (2000) Ant colony system hybridized with a new local search for the sequential ordering problem. INFORMS J Comput 12:237–255MathSciNetMATHCrossRef
go back to reference Jian Y, Liu Y (2007) The state of the art in grid scheduling systems third international conference on natural computation. Haikou Jian Y, Liu Y (2007) The state of the art in grid scheduling systems third international conference on natural computation. Haikou
go back to reference Kesselman C, Foster I, Tuecke S (2001) The anatomy of the grid—enabling scalable virtual organizations. Int J High Perform Comput Appl 15(3):200–222CrossRef Kesselman C, Foster I, Tuecke S (2001) The anatomy of the grid—enabling scalable virtual organizations. Int J High Perform Comput Appl 15(3):200–222CrossRef
go back to reference Kousalya K, Balasubramanie P (2007) Resource scheduling in computational grid using ANT algorithm. In: Proceedings of the international conference on computer control and communications, Karachi Kousalya K, Balasubramanie P (2007) Resource scheduling in computational grid using ANT algorithm. In: Proceedings of the international conference on computer control and communications, Karachi
go back to reference Kousalya K, Balasubramanie P (2008a) Ant algorithm for grid scheduling powered by local search. Int J Open Problems Comput Math 1(3) Kousalya K, Balasubramanie P (2008a) Ant algorithm for grid scheduling powered by local search. Int J Open Problems Comput Math 1(3)
go back to reference Kousalya K, Balasubramanie P (2008b) An enhanced ant algorithm for grid scheduling problem. Int J Comput Sci Netw Secur 8(4):262–271 Kousalya K, Balasubramanie P (2008b) An enhanced ant algorithm for grid scheduling problem. Int J Comput Sci Netw Secur 8(4):262–271
go back to reference Merkle D, Middendorf M, Schmeck H (2003) Ant colony optimization for resource-constrained project scheduling. IEEE Trans Evol Comput 6(4):333–346 Merkle D, Middendorf M, Schmeck H (2003) Ant colony optimization for resource-constrained project scheduling. IEEE Trans Evol Comput 6(4):333–346
go back to reference Pavani GS, Waldman H (2006) Grid resource management by means of ant colony optimization. In: Proceedings of 3rd international conference on broadband communications, networks and systems. BROADNETS 2006. San José, Print ISBN:978-1-4244-0425-4 Pavani GS, Waldman H (2006) Grid resource management by means of ant colony optimization. In: Proceedings of 3rd international conference on broadband communications, networks and systems. BROADNETS 2006. San José, Print ISBN:978-1-4244-0425-4
go back to reference Ramírez-Alcaraz JM, Tchernykh A, Yahyapour R, Schwiegelshohn U, Quezada-Pina A, González-García JL, Hirales-Carbajal A (2011) Job allocation strategies with user run time estimates for online scheduling in hierarchical grids. J Grid Comput 9(1):95–116CrossRef Ramírez-Alcaraz JM, Tchernykh A, Yahyapour R, Schwiegelshohn U, Quezada-Pina A, González-García JL, Hirales-Carbajal A (2011) Job allocation strategies with user run time estimates for online scheduling in hierarchical grids. J Grid Comput 9(1):95–116CrossRef
go back to reference Reimann M, Doerner K, Hartl RF (2004) D-ants: savings based ants divide and conquer the vehicle routing problems. Comput Oper Res 31:563–591MATHCrossRef Reimann M, Doerner K, Hartl RF (2004) D-ants: savings based ants divide and conquer the vehicle routing problems. Comput Oper Res 31:563–591MATHCrossRef
go back to reference Schoonderwoerd R, Holland O, Bruten J (1997) Ant-like agents for load balancing. In: telecommunications networks proceedings of the first international conference on autonomous agents. Marina del Rey Schoonderwoerd R, Holland O, Bruten J (1997) Ant-like agents for load balancing. In: telecommunications networks proceedings of the first international conference on autonomous agents. Marina del Rey
go back to reference Shan H, Oliker L, Smith W, Biswas R (1998) High-performance schedulers chapter in the grid: blueprint for a future computing infrastructure. Morgan Kaufmann Publishers, San Francisco Shan H, Oliker L, Smith W, Biswas R (1998) High-performance schedulers chapter in the grid: blueprint for a future computing infrastructure. Morgan Kaufmann Publishers, San Francisco
go back to reference Sim KM, Sun WH (2003) Ant colony optimization for routing and load-balancing: survey and new directions systems. Man Cybern Part A 33:560–572CrossRef Sim KM, Sun WH (2003) Ant colony optimization for routing and load-balancing: survey and new directions systems. Man Cybern Part A 33:560–572CrossRef
go back to reference Spooner DP, Jarvis SA, Cao J, Saini S, Nudd 1221 GR (2003) Local grid scheduling techniques using performance prediction. IEE Proc E 150:87–96 Spooner DP, Jarvis SA, Cao J, Saini S, Nudd 1221 GR (2003) Local grid scheduling techniques using performance prediction. IEE Proc E 150:87–96
go back to reference Stutzle T (1998) An ant approach to the flow shop problem. In: Proceedings of the 6th European congress on intelligent techniques & soft computing, Orlando Stutzle T (1998) An ant approach to the flow shop problem. In: Proceedings of the 6th European congress on intelligent techniques & soft computing, Orlando
go back to reference Stützle T, Dorigo M (1999) ACO algorithms for the quadratic assignment problem, New ideas in optimization, ISBN:0-07-709506-5, McGraw-Hill Ltd., London, pp 33–50 Stützle T, Dorigo M (1999) ACO algorithms for the quadratic assignment problem, New ideas in optimization, ISBN:0-07-709506-5, McGraw-Hill Ltd., London, pp 33–50
go back to reference Thomas S, Holger HH (2000) MAX–MIN ant system. Futur Gener Comput Syst 16(9):889–914 Thomas S, Holger HH (2000) MAX–MIN ant system. Futur Gener Comput Syst 16(9):889–914
go back to reference Tsafrir D, Etsion Y, Feitelson DG (2006) Modeling user runtime estimates. In: Proceedings of 11th workshop on job scheduling strategies for parallel processing LNCS, vol 3834. Springer, Cambridge, pp 1–35 Tsafrir D, Etsion Y, Feitelson DG (2006) Modeling user runtime estimates. In: Proceedings of 11th workshop on job scheduling strategies for parallel processing LNCS, vol 3834. Springer, Cambridge, pp 1–35
go back to reference Tsafrir D, Etsion Y, Feitelson DG (2007) Backfilling using system-generated predictions rather than user run-time estimates. IEEE Trans Parallel Distrib Syst 18:789–803 Tsafrir D, Etsion Y, Feitelson DG (2007) Backfilling using system-generated predictions rather than user run-time estimates. IEEE Trans Parallel Distrib Syst 18:789–803
go back to reference Volker H, Uwe S, Achim S, Ramin Y (2000) Evaluation of job-scheduling strategies for grid computing. In: Proceedings lecture notes in computer science, Berlin, pp 1611–3349 (ISSN 0302-9743) Volker H, Uwe S, Achim S, Ramin Y (2000) Evaluation of job-scheduling strategies for grid computing. In: Proceedings lecture notes in computer science, Berlin, pp 1611–3349 (ISSN 0302-9743)
go back to reference Yan H, Shen X-Q, Li X, Wu M-H (2005) An improved ant algorithm for job scheduling. In: Grid computing proceedings of the fourth international conference on machine learning and cybernetics, Guangzhou Yan H, Shen X-Q, Li X, Wu M-H (2005) An improved ant algorithm for job scheduling. In: Grid computing proceedings of the fourth international conference on machine learning and cybernetics, Guangzhou
go back to reference Yang L, Schopf JM, Foster I (2003) Conservative sched-1224 uling: using predicted variance to improve scheduling decisions in dynamic environments. In: Proceedings of the 2003 ACM/IEEE conference on supercomputing, Phoenix, pp 31–47 Yang L, Schopf JM, Foster I (2003) Conservative sched-1224 uling: using predicted variance to improve scheduling decisions in dynamic environments. In: Proceedings of the 2003 ACM/IEEE conference on supercomputing, Phoenix, pp 31–47
go back to reference Zhang L, Chen Y, Sun R, Jing S, Yang B (2008) A task scheduling algorithm based on PSO for grid computing. Int J Comput Intell Res 4(1):37–43 Zhang L, Chen Y, Sun R, Jing S, Yang B (2008) A task scheduling algorithm based on PSO for grid computing. Int J Comput Intell Res 4(1):37–43
go back to reference Zhong L, Long Z, Zhang J, Song H (2011) An efficient memetic algorithm for job scheduling in computing grid information and automation, communications in computer and information science, vol 86. Springer, Berlin, pp 650–656 Zhong L, Long Z, Zhang J, Song H (2011) An efficient memetic algorithm for job scheduling in computing grid information and automation, communications in computer and information science, vol 86. Springer, Berlin, pp 650–656
Metadata
Title
A bio-inspired distributed algorithm to improve scheduling performance of multi-broker grids
Authors
Antonella Di Stefano
Giovanni Morana
Publication date
01-12-2012
Publisher
Springer Netherlands
Published in
Natural Computing / Issue 4/2012
Print ISSN: 1567-7818
Electronic ISSN: 1572-9796
DOI
https://doi.org/10.1007/s11047-012-9319-8

Other articles of this Issue 4/2012

Natural Computing 4/2012 Go to the issue

OriginalPaper

Preface

Premium Partner