Top

Soft Computing

Published in:

27-03-2019 | Focus

Computational grid scheduling architecture using MapReduce model-based non-dominated sorting genetic algorithm

Authors: D. Rajeswari, M. Prakash, J. Suresh

Published in: Soft Computing | Issue 18/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Computational grid (CG) environment has a group of autonomous dissimilar distributed computing systems to provide service to user tasks. To attain the auspicious usefulness of CG resources, basically best scheduling algorithms are important. The CG service users are very cautious in time needed for task completion. To meet multiple requirements of the user, the job allocation problem in CG is designed as a multi-objective problem. Evolutionary algorithms have an efficient meta-heuristic technique for optimization problem solving. This work introduces a MapReduce model for non-dominated sorting genetic algorithm (NSGA-II) for independent job scheduling in a CG. This research work attempts to find the optimal schedules by considering makespan and flowtime minimization. A fuzzy membership function is used to analyze the efficiency of the schedule. Set of benchmark instances is used to test the algorithm. Experimental results show that MapReduce model-based NSGA-II generated finer solutions in less time than the MapReduce model-based weighted sum multi-objective genetic algorithm (WMOGA) which is also implemented in this paper.

previous article Special issue on evolutionary computing and intelligent sustainable systems

next article Performance analysis on feature extraction using dorsal hand vein image

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Abraham A, Buyya R, Nath B (2000) Nature’s heuristics for scheduling jobs on computational grids. In: The 8th IEEE international conference on advanced computing and communications (ADCOM 2000), pp 14–16

Abraham A, Liu H, Zhang W, Chang TG (2006) Scheduling jobs on computational grids using fuzzy particle swarm algorithm. Springer, Berlin, pp 500–507

Abraham A, Liu H, Grosan C, Xhafa F (2008) Nature inspired meta-heuristics for grid scheduling: single and multi-objective optimization approaches. Stud Comput Intell 146:247–272MATH

Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parall Distrib Comput 61(6):810–837CrossRefMATH

Carretero J, Xhafa F, Abraham A (2007) Genetic algorithm based schedulers for grid computing systems. Int J Innov Comput Inf Control 3(6):1–19

Chao J, Christian V, Buyya R (2008) MRPGA: an extension of MapReduce for parallelizing genetic algorithms. In: Proceedings of the 4th international conference on e-science, USA, pp 214–221

Deb K (2002) Multi-objective optimization using evolutionary algorithms. Wiley, LondonMATH

Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6:182–197CrossRef

Dhole Poonam B, Gunjal Baisa L (2013) Survey paper on traditional hadoop and pipelined map reduce. Int J Comput Eng Res 3(12):32–36

Durillo JJ, Nebro AJ, Luna F, Alba E (2008) A study of master–slave approaches to parallelize NSGA-II. In: Proceedings of the 22nd IEEE international symposium on parallel and distributed processing, USA, pp 1–8

Guzek Mateusz, Pecero Johnatan E, Dorronsoro Bernabe, Bouvry Pascal (2014) Multi-objective evolutionary algorithm for energy-aware scheduling on distributed computing systems. Appl Soft Comput 24:432–446CrossRef

http://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html. Accessed 06 May 2018

Izakian H, Abraham A, Snasel V (2009) Comparison of heuristics for scheduling independent tasks on heterogeneous distributed environments. In: Proceedings of international joint conference on computational sciences and optimization, pp 8–12

Izakian H, Tork Ladani B, Zamanifar K, Abraham A (2009) A novel particle swarm optimization approach for grid job scheduling. In: Proceedings of the 3rd international conference on information systems, technology and management, pp 100–110

Kaiwartya O, Prakash S, Abdullah AH, Hassan AN (2015) Minimizing energy consumption in scheduling of dependent tasks using genetic algorithm in computational grid. KSII Trans Interent Inf Syst 9(8):2821–2839

Keerthika P, Suresh P (2015) A multiconstrained grid scheduling algorithm with load balancing and fault tolerance. Sci World J 2015:1–10. https://doi.org/10.1155/2015/349576 CrossRef

Li Jun-Qing, Pan Quan-ke (2014) Solving the large-scale hybrid flow shop scheduling problem with limited buffers by a hybrid artificial bee colony algorithm. Inf Sci 316:487–502CrossRef

Lim D, Ong Y-S, Jin Y, Sendhoff B, Lee B-S (2007) Efficient hierarchical parallel genetic algorithms using grid computing. Fut Gener Comput Syst 23:658–670CrossRef

Malarvizhi N, Uthariaraj VR (2009) A minimum time to release job scheduling algorithm in computational grid environment. In: Proceedings of the 5th international joint conference on INC, IMS, and IDC (NCM’09), pp 13–18

Maseli M, Twala B (2017) An adaptive Cuckoo Search algorithm for optimization. Appl Comput Inform 14:107–115

Nandhagopal M, Uthariaraj VR (2010) Fault tolerant scheduling strategy for computational grid environment. Int J Eng Sci Technol 2(9):4361–4372

Niimura T, Nakashima T (2003) Multi-objective tradeoff analysis of deregulated electricity transactions. Int J Electr Power Energy Syst 25:179–185CrossRef

Page A, Naughton J (2005) Framework for task scheduling in heterogeneous distributed computing using genetic algorithms. Artif Intell 24:415–429CrossRef

Parsa S, Maleki RE (2009) RASA: a new grid task scheduling algorithm. World Appl Sci J 7:152–160

Subashini G, Bhuvaneswari MC (2011) Non dominated particle swarm optimization for scheduling independent tasks on heterogeneous distributed environments. Int J Adv Soft Comput Appl 3(1):1–17

Subhashini G, Bhuvaneswari MC (2010) A fast and elitist bi-objective evolutionary algorithm for scheduling independent tasks on heterogeneous systems. ICTACT J Soft Comput 01:9–17CrossRef

Verma A, Llora X, Goldberg DE, Campbell RH (2009) Scaling genetic algorithms using MapReduce. In: Proceedings of the 9th international conference on intelligent systems design and applications, USA, pp 13–18

Wang F, Qiu J, Yang J, Dong B, Li X, Li Y (2009) Hadoop high availability through metadata replication. In: Cloud DB 2009: proceedings of the first international workshop on cloud data management

Wang L, Wang Z, Hu S, Liu L (2015) Ant colony optimization for task allocation in multi-agent systems. China Commun 10(3):125–132CrossRef

Yarkhan A, Dongarra J (2002) Experiments with scheduling using simulated annealing in a grid environment. In: Proceedings of the 3rd international workshop on grid computing (GRID2002), pp 232–242

Yuan Hao, Wang Yong, Chen Long (2010) An availability-aware task scheduling for heterogeneous systems using quantum-behaved particle swarm optimization. Lect Notes Comput Sci 6145:120–127CrossRef

Zhang Q, Li Z (2010) Design of grid resource management system based on information service. J Comput 5(5):687–694MathSciNet

Title: Computational grid scheduling architecture using MapReduce model-based non-dominated sorting genetic algorithm
Authors: D. Rajeswari
M. Prakash
J. Suresh
Publication date: 27-03-2019
Publisher: Springer Berlin Heidelberg
Published in: Soft Computing / Issue 18/2019
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-019-03946-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 18/2019

A hybrid Elman recurrent neural network, group search optimization, and refined VMD-based framework for multi-step ahead electricity price forecasting

An improved global-best-driven flower pollination algorithm for optimal design of two-dimensional FIR filter

Patent data analysis using functional count data model

A novel hidden Markov model-based adaptive dynamic time warping (HMDTW) gait analysis for identifying physically challenged persons

A novel linear SVM-based compressive collaborative spectrum sensing (CCSS) scheme for IoT cognitive 5G network

Artificial bee colony clustering with self-adaptive crossover and stepwise search for brain functional parcellation in fMRI data

Premium Partner