Skip to main content
Top
Published in: The Journal of Supercomputing 1/2015

01-01-2015

Task ranking and allocation in list-based workflow scheduling on parallel computing platform

Authors: Kuo -Chan Huang, Ying -Lin Tsai, Hsiao -Ching Liu

Published in: The Journal of Supercomputing | Issue 1/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

List-based workflow scheduling has received much research attention and been implemented in many existing workflow computing systems as more and more scientific and engineering applications need to exploit task parallelism for performance improvement. In this paper, we propose two task-ranking mechanisms and one task allocation method for the two major steps in list-based workflow scheduling. The proposed task-ranking approaches are based on innovative ideas of remaining workload and hybrid ranking, in contrast to the single path-oriented concept widely used in existing methods. The investigation of task allocation points out an important aspect, amount of available resources, which was not considered seriously in previous research. The proposed approaches were evaluated extensively with a series of simulation experiments and compared to existing widely used task-ranking and allocation methods. The experimental results show that our approaches has potential to outperform existing methods significantly in many cases, but no one single method can always achieve the best performance, which indicates a promising direction for future research work.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bittencourt LF, Sakellariou R, Madeira ERM (2010) DAG scheduling using a lookahead variant of the heterogeneous earliest finish time algorithm. In: Proceedings of the 18th euromicro conference on parallel, distributed and network-based processing. pp 27–34 Bittencourt LF, Sakellariou R, Madeira ERM (2010) DAG scheduling using a lookahead variant of the heterogeneous earliest finish time algorithm. In: Proceedings of the 18th euromicro conference on parallel, distributed and network-based processing. pp 27–34
2.
go back to reference Gary MR, Johnson DS (1979) Computers and intractability: a guide to the theory of NP-Completeness. W.H. Freeman and Co., San Francisco Gary MR, Johnson DS (1979) Computers and intractability: a guide to the theory of NP-Completeness. W.H. Freeman and Co., San Francisco
3.
go back to reference Bittencourt LF, Madeira ERM (2008) A performance-oriented adaptive scheduler for dependent tasks on grids. J Concurr Comput Pract Exp 20(9):1029–1049CrossRef Bittencourt LF, Madeira ERM (2008) A performance-oriented adaptive scheduler for dependent tasks on grids. J Concurr Comput Pract Exp 20(9):1029–1049CrossRef
8.
go back to reference Wieczorek M, Prodan R, Fahringer T (2005) Scheduling of scientific workflows in the askalon grid environment. ACM SIGMOD Record 34(3):56–62CrossRef Wieczorek M, Prodan R, Fahringer T (2005) Scheduling of scientific workflows in the askalon grid environment. ACM SIGMOD Record 34(3):56–62CrossRef
9.
go back to reference Topcuoglu H, Hariri S, Wu MY (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 2(13):247–260 Topcuoglu H, Hariri S, Wu MY (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 2(13):247–260
10.
go back to reference Wieczorek M, Prodan R, Hoheisel A, Wieczorek M, Prodan R, Hoheisel A (2008) Taxonomies of the multi-criteria grid workflow scheduling problem. In: Grid middleware and services. pp 237–264 Wieczorek M, Prodan R, Hoheisel A, Wieczorek M, Prodan R, Hoheisel A (2008) Taxonomies of the multi-criteria grid workflow scheduling problem. In: Grid middleware and services. pp 237–264
11.
go back to reference Mandal A, Kennedy K, Koelbel C, Marin G, Mellor-Crummey J, Liu B, Johnsson L (2005) Scheduling strategies for mapping application workflows onto the grid. In: Proceedings of the 14th IEEE symposium on high performance distributed computing. pp 125–134 Mandal A, Kennedy K, Koelbel C, Marin G, Mellor-Crummey J, Liu B, Johnsson L (2005) Scheduling strategies for mapping application workflows onto the grid. In: Proceedings of the 14th IEEE symposium on high performance distributed computing. pp 125–134
12.
go back to reference Wu Z, Liu X, Ni Z, Yuan D, Yang Y (2013) A market-oriented hierarchical scheduling strategy in cloud workflow systems. J Supercomput 63(1):256–293CrossRef Wu Z, Liu X, Ni Z, Yuan D, Yang Y (2013) A market-oriented hierarchical scheduling strategy in cloud workflow systems. J Supercomput 63(1):256–293CrossRef
13.
go back to reference Javadi B, Thulasiraman P, Buyya R (2012) Enhancing genetic algorithms for dependent job scheduling in grid computing environments. J Supercomput 62(1):290–314CrossRef Javadi B, Thulasiraman P, Buyya R (2012) Enhancing genetic algorithms for dependent job scheduling in grid computing environments. J Supercomput 62(1):290–314CrossRef
14.
go back to reference Deelman E, Singh G, Kesselman C (2005) Optimizing grid-based workflow execution. J Grid Comput 3(3):201–219 Deelman E, Singh G, Kesselman C (2005) Optimizing grid-based workflow execution. J Grid Comput 3(3):201–219
15.
go back to reference Falzon G, Li M (2012) Enhancing list scheduling heuristics for dependent job scheduling in grid computing environments. J Supercomput 59(1):104–130CrossRef Falzon G, Li M (2012) Enhancing list scheduling heuristics for dependent job scheduling in grid computing environments. J Supercomput 59(1):104–130CrossRef
16.
go back to reference Sih GC, Lee EA (1993) A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures. IEEE Trans Parallel Distrib Syst 4(2):175–186CrossRef Sih GC, Lee EA (1993) A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures. IEEE Trans Parallel Distrib Syst 4(2):175–186CrossRef
17.
go back to reference EI-Rewini H, Lewis TG (1990) Scheduling parallel program tasks onto arbitrary target machines. J Parallel Distrib Comput 9(2):138–153CrossRef EI-Rewini H, Lewis TG (1990) Scheduling parallel program tasks onto arbitrary target machines. J Parallel Distrib Comput 9(2):138–153CrossRef
18.
go back to reference Kwok Y, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multi-processors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef Kwok Y, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multi-processors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef
19.
go back to reference Hsu CH, Hsieh CW, Yang CT (2007) A generalized critical task anticipation technique for DAG scheduling. In: Proceedings of ICA3PP 2007. pp 493–505 Hsu CH, Hsieh CW, Yang CT (2007) A generalized critical task anticipation technique for DAG scheduling. In: Proceedings of ICA3PP 2007. pp 493–505
20.
go back to reference Sinnen O (2007) Task Scheduling for Parallel Systems. John Wiley, New York Sinnen O (2007) Task Scheduling for Parallel Systems. John Wiley, New York
21.
go back to reference Kim SJ, Browne JC (1988) A general approach to mapping of parallel computation upon multiprocessor architectures. In: Proceedings of international conference on parallel processing. pp 1–8 Kim SJ, Browne JC (1988) A general approach to mapping of parallel computation upon multiprocessor architectures. In: Proceedings of international conference on parallel processing. pp 1–8
22.
go back to reference Yang T, Gerasoulis A (1994) DSC: scheduling parallel tasks on an unbounded number of processors. IEEE Trans Parallel Distrib Syst 5(9):951–967CrossRef Yang T, Gerasoulis A (1994) DSC: scheduling parallel tasks on an unbounded number of processors. IEEE Trans Parallel Distrib Syst 5(9):951–967CrossRef
23.
go back to reference Liou J, Palis MA (1996) An efficient clustering heuristic for scheduling DAGs on multiprocessors. In: Proceedings of the 8th symposium on parallel and distributed processing Liou J, Palis MA (1996) An efficient clustering heuristic for scheduling DAGs on multiprocessors. In: Proceedings of the 8th symposium on parallel and distributed processing
24.
go back to reference Bittencourt LF, Madeira ERM (2009) Towards the scheduling of multiple workflows on computational grids. J Grid Comput 1(8):419–441 Bittencourt LF, Madeira ERM (2009) Towards the scheduling of multiple workflows on computational grids. J Grid Comput 1(8):419–441
25.
go back to reference Park G, Shirazi B, Marquis J (1997) DFRN: a new approach for duplication based scheduling for distributed memory multi-processor systems. In: Proceedings of international conference on parallel processing. pp 157–166 Park G, Shirazi B, Marquis J (1997) DFRN: a new approach for duplication based scheduling for distributed memory multi-processor systems. In: Proceedings of international conference on parallel processing. pp 157–166
26.
go back to reference Zhao H, Sakellarious R (2006) Scheduling multiple DAGs onto heterogeneous systems. In: Proceedings of the 20th international conference on parallel and distributed processing Zhao H, Sakellarious R (2006) Scheduling multiple DAGs onto heterogeneous systems. In: Proceedings of the 20th international conference on parallel and distributed processing
27.
go back to reference Yu Z, Shi W (2008) A planner-guided scheduling strategy for multiple workflow applications. In: Proceedings of the 37th international conference on parallel processing. pp 8–12 Yu Z, Shi W (2008) A planner-guided scheduling strategy for multiple workflow applications. In: Proceedings of the 37th international conference on parallel processing. pp 8–12
28.
go back to reference N’takpé T, Suter F (2007) A comparison of scheduling approaches for mixed-parallel applications on heterogeneous platforms. In: Proceedings of the 6th international symposium on parallel and distributed computing N’takpé T, Suter F (2007) A comparison of scheduling approaches for mixed-parallel applications on heterogeneous platforms. In: Proceedings of the 6th international symposium on parallel and distributed computing
30.
go back to reference Cicerre FRL, Madeira ERM, Buzato LE (2006) A hierarchical process execution support for grid computing. J Concurr Comput Pract Exp 18(6):581–594CrossRef Cicerre FRL, Madeira ERM, Buzato LE (2006) A hierarchical process execution support for grid computing. J Concurr Comput Pract Exp 18(6):581–594CrossRef
31.
go back to reference Ramakrishnan A, Singh G, Zhao H, Deelman E, Sakellariou R, Vahi K, Blackburn K, Meyers D, Samidi M (2007) Scheduling data-intensive workflows onto storage-constrained distributed resources. In: Proceedings of the seventh IEEE international symposium on cluster computing and the grid. pp 401–409 Ramakrishnan A, Singh G, Zhao H, Deelman E, Sakellariou R, Vahi K, Blackburn K, Meyers D, Samidi M (2007) Scheduling data-intensive workflows onto storage-constrained distributed resources. In: Proceedings of the seventh IEEE international symposium on cluster computing and the grid. pp 401–409
Metadata
Title
Task ranking and allocation in list-based workflow scheduling on parallel computing platform
Authors
Kuo -Chan Huang
Ying -Lin Tsai
Hsiao -Ching Liu
Publication date
01-01-2015
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 1/2015
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-014-1294-7

Other articles of this Issue 1/2015

The Journal of Supercomputing 1/2015 Go to the issue

Premium Partner