Skip to main content
Erschienen in: The Journal of Supercomputing 4/2015

01.04.2015

A hyper-heuristic approach for resource provisioning-based scheduling in grid environment

verfasst von: Rajni Aron, Inderveer Chana, Ajith Abraham

Erschienen in: The Journal of Supercomputing | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Grid computing being immensely based on the concept of resource sharing has always been closely associated with a lot many challenges. Growth of Resource provisioning-based scheduling in large-scale distributed environments like Grid computing brings in new requirement challenges that are not being considered in traditional distributed computing environments. Resources being the backbone of the system, their efficient management plays quite an important role in its execution environment. Many constraints such as heterogeneity and dynamic nature of resources need to be taken care as steps toward managing Grid resources efficiently. The most important challenge in Grids being the job–resource mapping as per the users’ requirement in the most secure way. The mapping of the jobs to appropriate resources for execution of the applications in Grid computing is found to be an NP-complete problem. Novel algorithm is required to schedule the jobs on the resources to provide reduced execution time, increased security and reliability. The main aim of this paper is to present an efficient strategy for secure scheduling of jobs on appropriate resources. A novel particle swarm optimization-based hyper-heuristic resource scheduling algorithm has been designed and used to schedule jobs effectively on available resources without violating any of the security norms. Performance of the proposed algorithm has also been evaluated through the GridSim toolkit. We have compared our resource scheduling algorithm with existing common heuristic-based scheduling algorithms experimentally. The results thus obtained have shown a better performance by our algorithm than the existing algorithms, in terms of giving more reduced cost and makespan of user’s application being submitted to the Grids.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Fußnoten
1
More information about the real trace used can be obtained from the Grid Workload Archive at http://​gwa.​ewi.​tudelft.​nl/​pmwiki/​.
 
Literatur
1.
Zurück zum Zitat Foster I, Kesselman C (2004) The Grid: blueprint for a future computing infrastructure. Morgan Kaufmann Publishers, USA Foster I, Kesselman C (2004) The Grid: blueprint for a future computing infrastructure. Morgan Kaufmann Publishers, USA
2.
Zurück zum Zitat Aron R, Chana I (2010) Resource provisioning and scheduling in Grids: issues, challenges and future directions. In: Proceeding of IEEE International Conference on Computer and Communication Technology. MNNIT, Allahabad Aron R, Chana I (2010) Resource provisioning and scheduling in Grids: issues, challenges and future directions. In: Proceeding of IEEE International Conference on Computer and Communication Technology. MNNIT, Allahabad
3.
Zurück zum Zitat Aron R, Chana I (2011) Resource provisioning for Grid: a policy perspective. In: Proceeding of Springer International Conference on Contemporary Computing (IC31). JP University, Noida Aron R, Chana I (2011) Resource provisioning for Grid: a policy perspective. In: Proceeding of Springer International Conference on Contemporary Computing (IC31). JP University, Noida
4.
Zurück zum Zitat Khateeb AA, Abdullah R, Rashid AN (2009) Job type approach for deciding job scheduling in Grid computing systems. J Comput Sci 5(10):745–750CrossRef Khateeb AA, Abdullah R, Rashid AN (2009) Job type approach for deciding job scheduling in Grid computing systems. J Comput Sci 5(10):745–750CrossRef
5.
Zurück zum Zitat Burke EK, Hyde M, Kendall G, Ochoa G, Ozcan E, Qu R (2009) Hyper-heuristics: a survey of the State of the Art. University of Nottingham, technical report Burke EK, Hyde M, Kendall G, Ochoa G, Ozcan E, Qu R (2009) Hyper-heuristics: a survey of the State of the Art. University of Nottingham, technical report
6.
Zurück zum Zitat Bhanu SMS, Gopalan NP (2008) A hyper-heuristic approach for efficient resource scheduling in Grid. Int J Comput Commun Control 3(3):249–258 Bhanu SMS, Gopalan NP (2008) A hyper-heuristic approach for efficient resource scheduling in Grid. Int J Comput Commun Control 3(3):249–258
7.
Zurück zum Zitat Abraham A, Buyya R, Nath B (2000) Nature’s heuristics for scheduling jobs on computational Grids. In: The 8th IEEE Conference on Advanced Computing and Communications. Cochin, India Abraham A, Buyya R, Nath B (2000) Nature’s heuristics for scheduling jobs on computational Grids. In: The 8th IEEE Conference on Advanced Computing and Communications. Cochin, India
8.
Zurück zum Zitat Gonzalez JA, Serna M, Xhafa F (2007) A hyper-heuristic for scheduling independent jobs in computational Grids. In: International conference on software and data technologies, ICSOFT Gonzalez JA, Serna M, Xhafa F (2007) A hyper-heuristic for scheduling independent jobs in computational Grids. In: International conference on software and data technologies, ICSOFT
9.
Zurück zum Zitat Garg S, Konugurthi P, Buyya R (2008) A linear programming driven genetic algorithm for meta-scheduling on utility Grids. In: Proceedings of the 16th International Conference on Advanced Computing and Communication (ADCOM 2008, IEEE Press, New York, USA). Chennai, India Garg S, Konugurthi P, Buyya R (2008) A linear programming driven genetic algorithm for meta-scheduling on utility Grids. In: Proceedings of the 16th International Conference on Advanced Computing and Communication (ADCOM 2008, IEEE Press, New York, USA). Chennai, India
10.
Zurück zum Zitat Garg SK, Buyya R, Siegel HJ (2010) Time and cost trade-off management for scheduling parallel applications on utility grids. Future Gener Comput Syst 26(8):1344–1355 (ISSN: 0167–739X, Elsevier Science, Amsterdam, The Netherlands)CrossRef Garg SK, Buyya R, Siegel HJ (2010) Time and cost trade-off management for scheduling parallel applications on utility grids. Future Gener Comput Syst 26(8):1344–1355 (ISSN: 0167–739X, Elsevier Science, Amsterdam, The Netherlands)CrossRef
11.
Zurück zum Zitat Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP et al (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810837CrossRef Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP et al (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810837CrossRef
12.
Zurück zum Zitat Jun L, Chunlin L, Qingqing L (2010) A research about independent tasks scheduling on tree-based grid computing platforms, 2nd International Workshop on Intelligent Systems and Applications. Institute of Computer Science. Wuhan University of Technology, Wuhan, pp 1–4 Jun L, Chunlin L, Qingqing L (2010) A research about independent tasks scheduling on tree-based grid computing platforms, 2nd International Workshop on Intelligent Systems and Applications. Institute of Computer Science. Wuhan University of Technology, Wuhan, pp 1–4
13.
Zurück zum Zitat Gaoa Y, Rongb H, Huangc JZ (2005) Adaptive Grid job scheduling with genetic algorithms. J Future Gener Comput Syst 21(1) Gaoa Y, Rongb H, Huangc JZ (2005) Adaptive Grid job scheduling with genetic algorithms. J Future Gener Comput Syst 21(1)
14.
Zurück zum Zitat Xhafa F, Abraham A (2010) Computational models and heuristics methods for Grid scheduling problems. FGCS 26:608–621CrossRef Xhafa F, Abraham A (2010) Computational models and heuristics methods for Grid scheduling problems. FGCS 26:608–621CrossRef
15.
Zurück zum Zitat Kim S, Weissman JB (2004) A genetic algorithm based approach for scheduling decomposable data Grid applications. In: International Conference on Parallel Processing. pp 406–413 Kim S, Weissman JB (2004) A genetic algorithm based approach for scheduling decomposable data Grid applications. In: International Conference on Parallel Processing. pp 406–413
16.
Zurück zum Zitat Konugurthi PK, Ramakrishnan K, Buyya R (2007) A heuristic genetic algorithm based scheduler for clearing house grid broker, Technical Report, GRIDS-TR-2007-22. Grid Computing and Distributed Systems Laboratory. The University of Melbourne, Australia Konugurthi PK, Ramakrishnan K, Buyya R (2007) A heuristic genetic algorithm based scheduler for clearing house grid broker, Technical Report, GRIDS-TR-2007-22. Grid Computing and Distributed Systems Laboratory. The University of Melbourne, Australia
17.
Zurück zum Zitat Golconda K, Ozguner F (2004) A comparison of static QoS-based scheduling heuristics for a meta-task with multiple QoS dimensions in heterogeneous computing. Proceedings of 18th International Symposium on Parallel and Distributed Processing Golconda K, Ozguner F (2004) A comparison of static QoS-based scheduling heuristics for a meta-task with multiple QoS dimensions in heterogeneous computing. Proceedings of 18th International Symposium on Parallel and Distributed Processing
18.
Zurück zum Zitat Chakhlevitch K, Cowling P (2008) Hyperheurictics: recent developments. In: Cotta C, Sevaux M, Sorensen K (eds) Adaptive and multilevel metaheuristics, studies in computational intelligence, vol 136. Springer, pp 3–29 Chakhlevitch K, Cowling P (2008) Hyperheurictics: recent developments. In: Cotta C, Sevaux M, Sorensen K (eds) Adaptive and multilevel metaheuristics, studies in computational intelligence, vol 136. Springer, pp 3–29
19.
Zurück zum Zitat Dueck G (2002) New optimisation heuristics for the great deluge algorithm and the record-to-record travel. J Comput Phys 104:86–92 (Systems Magazine, pp 52–67)CrossRef Dueck G (2002) New optimisation heuristics for the great deluge algorithm and the record-to-record travel. J Comput Phys 104:86–92 (Systems Magazine, pp 52–67)CrossRef
20.
Zurück zum Zitat Martino VD (2004) Sub-optimal scheduling in a Grid using genetic algorithms. In: Parallel and nature-inspired computational paradigms and applications. Elsevier Science Publishers, pp 553–565 Martino VD (2004) Sub-optimal scheduling in a Grid using genetic algorithms. In: Parallel and nature-inspired computational paradigms and applications. Elsevier Science Publishers, pp 553–565
21.
Zurück zum Zitat Carretero J, Xhafa F (2006) Use of genetic algorithms for scheduling jobs in large scale Grid applications. Technol Econ Dev Econ 12(1):11–17 Carretero J, Xhafa F (2006) Use of genetic algorithms for scheduling jobs in large scale Grid applications. Technol Econ Dev Econ 12(1):11–17
22.
Zurück zum Zitat Cowling P, Kendall G, Han L (2002) An investigation of a hyperheuristic genetic algorithm applied to a trainer scheduling problem. In: Proceedings of the IEEE Congress on Evolutionary Computation. pp 1185–1190 Cowling P, Kendall G, Han L (2002) An investigation of a hyperheuristic genetic algorithm applied to a trainer scheduling problem. In: Proceedings of the IEEE Congress on Evolutionary Computation. pp 1185–1190
23.
Zurück zum Zitat Aron R, Chana I (2012) Formal QoS policy based Grid resource provisioning framework. J Grid Comput Aron R, Chana I (2012) Formal QoS policy based Grid resource provisioning framework. J Grid Comput
24.
Zurück zum Zitat Buyya R, Murshed M (2002) GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing, concurrency and computation: practice and experience (CCPE), vol 14. Wiley Press, New York, pp 1175–1220, ISSN: 1532–0626 Buyya R, Murshed M (2002) GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing, concurrency and computation: practice and experience (CCPE), vol 14. Wiley Press, New York, pp 1175–1220, ISSN: 1532–0626
26.
Zurück zum Zitat Cowling P, Kendall G, Soubeiga E (2001) A hyper-heuristic approach to scheduling a sales summit, selected papers of proceedings of the 3rd International Conference on the Practice and Theory of Automated Timetabling, vol. 2079. Springer LNCS, pp 176–190 Cowling P, Kendall G, Soubeiga E (2001) A hyper-heuristic approach to scheduling a sales summit, selected papers of proceedings of the 3rd International Conference on the Practice and Theory of Automated Timetabling, vol. 2079. Springer LNCS, pp 176–190
27.
Zurück zum Zitat Burke EK, Kendall G, Landa Silva JD O’Brien R, Soubeiga E (2005) An ant algorithm hyperheuristic for the project presentation scheduling problem, proceedings of the 2005 IEEE Congress on Evolutionary Computation (CEC). Edinburgh, UK, pp 2263–2270 Burke EK, Kendall G, Landa Silva JD O’Brien R, Soubeiga E (2005) An ant algorithm hyperheuristic for the project presentation scheduling problem, proceedings of the 2005 IEEE Congress on Evolutionary Computation (CEC). Edinburgh, UK, pp 2263–2270
28.
Zurück zum Zitat Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks. IV. pp 1942–1948 Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks. IV. pp 1942–1948
29.
Zurück zum Zitat Tao F, Zhao D, Hu Y, Zhou Z (2008) Resource service composition and its optimal-selection based on particle swarm optimization in manufacturing Grid system. In: IEEE Transactions on industrial informatics, vol. 4, no. 4 Tao F, Zhao D, Hu Y, Zhou Z (2008) Resource service composition and its optimal-selection based on particle swarm optimization in manufacturing Grid system. In: IEEE Transactions on industrial informatics, vol. 4, no. 4
31.
Zurück zum Zitat Kolodziej J, Xhafa F (2012) Integration of task abortion and security requirements in GA-based meta-heuristics for independent batch grid scheduling. In: Computers and mathematics with applications, Elsevier. doi:10.1016/j.camwa.2011.07.038, 63 350364 Kolodziej J, Xhafa F (2012) Integration of task abortion and security requirements in GA-based meta-heuristics for independent batch grid scheduling. In: Computers and mathematics with applications, Elsevier. doi:10.​1016/​j.​camwa.​2011.​07.​038, 63 350364
33.
Zurück zum Zitat Menasce DA, Casalicchio E (2004) QoS in Grid computing. IEEE Internet Comput J 8(4) Menasce DA, Casalicchio E (2004) QoS in Grid computing. IEEE Internet Comput J 8(4)
34.
Zurück zum Zitat Song S, Hwang K, Kwok YK (2006) Risk-resilient heuristics and genetic algorithms for security-assured grid scheduling. IEEE Trans Comput 55:703–719CrossRef Song S, Hwang K, Kwok YK (2006) Risk-resilient heuristics and genetic algorithms for security-assured grid scheduling. IEEE Trans Comput 55:703–719CrossRef
35.
Zurück zum Zitat Ali S, Siegel HJ, Maheswaran M, Hensgen D, Ali S (2000) Representing task and machine heterogeneities for heterogeneous computing systems. Tamkang J Sci Eng 3(3):195–207 Ali S, Siegel HJ, Maheswaran M, Hensgen D, Ali S (2000) Representing task and machine heterogeneities for heterogeneous computing systems. Tamkang J Sci Eng 3(3):195–207
36.
Zurück zum Zitat Lublin U, Feitelson D (2003) The workload on parallel supercomputers: modeling the characteristics of rigid jobs. J Parallel Distrib Comput 63(11):1105–1122CrossRefMATH Lublin U, Feitelson D (2003) The workload on parallel supercomputers: modeling the characteristics of rigid jobs. J Parallel Distrib Comput 63(11):1105–1122CrossRefMATH
38.
Zurück zum Zitat Chen J (2010) Economic Grid resource scheduling based on utility optimization. IITSI, pp 522–525 Chen J (2010) Economic Grid resource scheduling based on utility optimization. IITSI, pp 522–525
39.
Zurück zum Zitat He X, Sun X, Laszewski G (2003) A QoS Guided Min-Min Heuristic for Grid Task Scheduling. J Comput Sci Technol 18(4):442–451CrossRefMATH He X, Sun X, Laszewski G (2003) A QoS Guided Min-Min Heuristic for Grid Task Scheduling. J Comput Sci Technol 18(4):442–451CrossRefMATH
40.
Zurück zum Zitat Izakian H et al. (2009) A novel particle swarm optimization approach for grid job scheduling. Information Systems, Technology and Management. pp 100–109 Izakian H et al. (2009) A novel particle swarm optimization approach for grid job scheduling. Information Systems, Technology and Management. pp 100–109
41.
Zurück zum Zitat Abraham A, Liu H, Zhang W, Chang TG (2006) Scheduling jobs on computational Grids using fuzzy particle swarm algorithm. In: Proceedings of 10th International Conference on Knowledge-Based & Intelligent Information & Engineering Systems. England, pp 500–507 Abraham A, Liu H, Zhang W, Chang TG (2006) Scheduling jobs on computational Grids using fuzzy particle swarm algorithm. In: Proceedings of 10th International Conference on Knowledge-Based & Intelligent Information & Engineering Systems. England, pp 500–507
42.
Zurück zum Zitat Zhou Z, Deng W, Lu L (2009) A fuzzy reputation based ant algorithm for Grid scheduling, cso. International Joint Conference on Computational Sciences and Optimization, vol. 1. pp 102–104 Zhou Z, Deng W, Lu L (2009) A fuzzy reputation based ant algorithm for Grid scheduling, cso. International Joint Conference on Computational Sciences and Optimization, vol. 1. pp 102–104
43.
Zurück zum Zitat Zhao L, Ren Y, Li M, Sakurai K (2010) SPSE: a flexible QoS-based service scheduling algorithm for service-oriented Grid. In: 24th IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2010. Atlanta, Georgia, pp 1–8 Zhao L, Ren Y, Li M, Sakurai K (2010) SPSE: a flexible QoS-based service scheduling algorithm for service-oriented Grid. In: 24th IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2010. Atlanta, Georgia, pp 1–8
44.
Zurück zum Zitat Kolodiej J, Khan SU, Gelenbe E, Talbi EG (2013) Scalable optimization in grid, cloud, and intelligent network computing. Concurr Comput 25(12):1719–1721CrossRef Kolodiej J, Khan SU, Gelenbe E, Talbi EG (2013) Scalable optimization in grid, cloud, and intelligent network computing. Concurr Comput 25(12):1719–1721CrossRef
45.
Zurück zum Zitat Liu Z, Qu W, Liu W, Li Z, Xu Y (2014) Resource preprocessing and optimal task scheduling in cloud computing environments. In: Practice and Experience, Concurrency and Computation Liu Z, Qu W, Liu W, Li Z, Xu Y (2014) Resource preprocessing and optimal task scheduling in cloud computing environments. In: Practice and Experience, Concurrency and Computation
46.
Zurück zum Zitat Buyya R, Abramson D, Giddy J, Stockinger H (2002) Economic models for resource management and scheduling in grid computing. Concurr Comput 14(13–15):1507–1542CrossRefMATH Buyya R, Abramson D, Giddy J, Stockinger H (2002) Economic models for resource management and scheduling in grid computing. Concurr Comput 14(13–15):1507–1542CrossRefMATH
Metadaten
Titel
A hyper-heuristic approach for resource provisioning-based scheduling in grid environment
verfasst von
Rajni Aron
Inderveer Chana
Ajith Abraham
Publikationsdatum
01.04.2015
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 4/2015
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-014-1373-9

Weitere Artikel der Ausgabe 4/2015

The Journal of Supercomputing 4/2015 Zur Ausgabe

Premium Partner