Skip to main content
Erschienen in: The Journal of Supercomputing 1/2015

01.01.2015

Task ranking and allocation in list-based workflow scheduling on parallel computing platform

Erschienen in: The Journal of Supercomputing | Ausgabe 1/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

List-based workflow scheduling has received much research attention and been implemented in many existing workflow computing systems as more and more scientific and engineering applications need to exploit task parallelism for performance improvement. In this paper, we propose two task-ranking mechanisms and one task allocation method for the two major steps in list-based workflow scheduling. The proposed task-ranking approaches are based on innovative ideas of remaining workload and hybrid ranking, in contrast to the single path-oriented concept widely used in existing methods. The investigation of task allocation points out an important aspect, amount of available resources, which was not considered seriously in previous research. The proposed approaches were evaluated extensively with a series of simulation experiments and compared to existing widely used task-ranking and allocation methods. The experimental results show that our approaches has potential to outperform existing methods significantly in many cases, but no one single method can always achieve the best performance, which indicates a promising direction for future research work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bittencourt LF, Sakellariou R, Madeira ERM (2010) DAG scheduling using a lookahead variant of the heterogeneous earliest finish time algorithm. In: Proceedings of the 18th euromicro conference on parallel, distributed and network-based processing. pp 27–34 Bittencourt LF, Sakellariou R, Madeira ERM (2010) DAG scheduling using a lookahead variant of the heterogeneous earliest finish time algorithm. In: Proceedings of the 18th euromicro conference on parallel, distributed and network-based processing. pp 27–34
2.
Zurück zum Zitat Gary MR, Johnson DS (1979) Computers and intractability: a guide to the theory of NP-Completeness. W.H. Freeman and Co., San Francisco Gary MR, Johnson DS (1979) Computers and intractability: a guide to the theory of NP-Completeness. W.H. Freeman and Co., San Francisco
3.
Zurück zum Zitat Bittencourt LF, Madeira ERM (2008) A performance-oriented adaptive scheduler for dependent tasks on grids. J Concurr Comput Pract Exp 20(9):1029–1049CrossRef Bittencourt LF, Madeira ERM (2008) A performance-oriented adaptive scheduler for dependent tasks on grids. J Concurr Comput Pract Exp 20(9):1029–1049CrossRef
8.
Zurück zum Zitat Wieczorek M, Prodan R, Fahringer T (2005) Scheduling of scientific workflows in the askalon grid environment. ACM SIGMOD Record 34(3):56–62CrossRef Wieczorek M, Prodan R, Fahringer T (2005) Scheduling of scientific workflows in the askalon grid environment. ACM SIGMOD Record 34(3):56–62CrossRef
9.
Zurück zum Zitat Topcuoglu H, Hariri S, Wu MY (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 2(13):247–260 Topcuoglu H, Hariri S, Wu MY (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 2(13):247–260
10.
Zurück zum Zitat Wieczorek M, Prodan R, Hoheisel A, Wieczorek M, Prodan R, Hoheisel A (2008) Taxonomies of the multi-criteria grid workflow scheduling problem. In: Grid middleware and services. pp 237–264 Wieczorek M, Prodan R, Hoheisel A, Wieczorek M, Prodan R, Hoheisel A (2008) Taxonomies of the multi-criteria grid workflow scheduling problem. In: Grid middleware and services. pp 237–264
11.
Zurück zum Zitat Mandal A, Kennedy K, Koelbel C, Marin G, Mellor-Crummey J, Liu B, Johnsson L (2005) Scheduling strategies for mapping application workflows onto the grid. In: Proceedings of the 14th IEEE symposium on high performance distributed computing. pp 125–134 Mandal A, Kennedy K, Koelbel C, Marin G, Mellor-Crummey J, Liu B, Johnsson L (2005) Scheduling strategies for mapping application workflows onto the grid. In: Proceedings of the 14th IEEE symposium on high performance distributed computing. pp 125–134
12.
Zurück zum Zitat Wu Z, Liu X, Ni Z, Yuan D, Yang Y (2013) A market-oriented hierarchical scheduling strategy in cloud workflow systems. J Supercomput 63(1):256–293CrossRef Wu Z, Liu X, Ni Z, Yuan D, Yang Y (2013) A market-oriented hierarchical scheduling strategy in cloud workflow systems. J Supercomput 63(1):256–293CrossRef
13.
Zurück zum Zitat Javadi B, Thulasiraman P, Buyya R (2012) Enhancing genetic algorithms for dependent job scheduling in grid computing environments. J Supercomput 62(1):290–314CrossRef Javadi B, Thulasiraman P, Buyya R (2012) Enhancing genetic algorithms for dependent job scheduling in grid computing environments. J Supercomput 62(1):290–314CrossRef
14.
Zurück zum Zitat Deelman E, Singh G, Kesselman C (2005) Optimizing grid-based workflow execution. J Grid Comput 3(3):201–219 Deelman E, Singh G, Kesselman C (2005) Optimizing grid-based workflow execution. J Grid Comput 3(3):201–219
15.
Zurück zum Zitat Falzon G, Li M (2012) Enhancing list scheduling heuristics for dependent job scheduling in grid computing environments. J Supercomput 59(1):104–130CrossRef Falzon G, Li M (2012) Enhancing list scheduling heuristics for dependent job scheduling in grid computing environments. J Supercomput 59(1):104–130CrossRef
16.
Zurück zum Zitat Sih GC, Lee EA (1993) A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures. IEEE Trans Parallel Distrib Syst 4(2):175–186CrossRef Sih GC, Lee EA (1993) A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures. IEEE Trans Parallel Distrib Syst 4(2):175–186CrossRef
17.
Zurück zum Zitat EI-Rewini H, Lewis TG (1990) Scheduling parallel program tasks onto arbitrary target machines. J Parallel Distrib Comput 9(2):138–153CrossRef EI-Rewini H, Lewis TG (1990) Scheduling parallel program tasks onto arbitrary target machines. J Parallel Distrib Comput 9(2):138–153CrossRef
18.
Zurück zum Zitat Kwok Y, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multi-processors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef Kwok Y, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multi-processors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef
19.
Zurück zum Zitat Hsu CH, Hsieh CW, Yang CT (2007) A generalized critical task anticipation technique for DAG scheduling. In: Proceedings of ICA3PP 2007. pp 493–505 Hsu CH, Hsieh CW, Yang CT (2007) A generalized critical task anticipation technique for DAG scheduling. In: Proceedings of ICA3PP 2007. pp 493–505
20.
Zurück zum Zitat Sinnen O (2007) Task Scheduling for Parallel Systems. John Wiley, New York Sinnen O (2007) Task Scheduling for Parallel Systems. John Wiley, New York
21.
Zurück zum Zitat Kim SJ, Browne JC (1988) A general approach to mapping of parallel computation upon multiprocessor architectures. In: Proceedings of international conference on parallel processing. pp 1–8 Kim SJ, Browne JC (1988) A general approach to mapping of parallel computation upon multiprocessor architectures. In: Proceedings of international conference on parallel processing. pp 1–8
22.
Zurück zum Zitat Yang T, Gerasoulis A (1994) DSC: scheduling parallel tasks on an unbounded number of processors. IEEE Trans Parallel Distrib Syst 5(9):951–967CrossRef Yang T, Gerasoulis A (1994) DSC: scheduling parallel tasks on an unbounded number of processors. IEEE Trans Parallel Distrib Syst 5(9):951–967CrossRef
23.
Zurück zum Zitat Liou J, Palis MA (1996) An efficient clustering heuristic for scheduling DAGs on multiprocessors. In: Proceedings of the 8th symposium on parallel and distributed processing Liou J, Palis MA (1996) An efficient clustering heuristic for scheduling DAGs on multiprocessors. In: Proceedings of the 8th symposium on parallel and distributed processing
24.
Zurück zum Zitat Bittencourt LF, Madeira ERM (2009) Towards the scheduling of multiple workflows on computational grids. J Grid Comput 1(8):419–441 Bittencourt LF, Madeira ERM (2009) Towards the scheduling of multiple workflows on computational grids. J Grid Comput 1(8):419–441
25.
Zurück zum Zitat Park G, Shirazi B, Marquis J (1997) DFRN: a new approach for duplication based scheduling for distributed memory multi-processor systems. In: Proceedings of international conference on parallel processing. pp 157–166 Park G, Shirazi B, Marquis J (1997) DFRN: a new approach for duplication based scheduling for distributed memory multi-processor systems. In: Proceedings of international conference on parallel processing. pp 157–166
26.
Zurück zum Zitat Zhao H, Sakellarious R (2006) Scheduling multiple DAGs onto heterogeneous systems. In: Proceedings of the 20th international conference on parallel and distributed processing Zhao H, Sakellarious R (2006) Scheduling multiple DAGs onto heterogeneous systems. In: Proceedings of the 20th international conference on parallel and distributed processing
27.
Zurück zum Zitat Yu Z, Shi W (2008) A planner-guided scheduling strategy for multiple workflow applications. In: Proceedings of the 37th international conference on parallel processing. pp 8–12 Yu Z, Shi W (2008) A planner-guided scheduling strategy for multiple workflow applications. In: Proceedings of the 37th international conference on parallel processing. pp 8–12
28.
Zurück zum Zitat N’takpé T, Suter F (2007) A comparison of scheduling approaches for mixed-parallel applications on heterogeneous platforms. In: Proceedings of the 6th international symposium on parallel and distributed computing N’takpé T, Suter F (2007) A comparison of scheduling approaches for mixed-parallel applications on heterogeneous platforms. In: Proceedings of the 6th international symposium on parallel and distributed computing
30.
Zurück zum Zitat Cicerre FRL, Madeira ERM, Buzato LE (2006) A hierarchical process execution support for grid computing. J Concurr Comput Pract Exp 18(6):581–594CrossRef Cicerre FRL, Madeira ERM, Buzato LE (2006) A hierarchical process execution support for grid computing. J Concurr Comput Pract Exp 18(6):581–594CrossRef
31.
Zurück zum Zitat Ramakrishnan A, Singh G, Zhao H, Deelman E, Sakellariou R, Vahi K, Blackburn K, Meyers D, Samidi M (2007) Scheduling data-intensive workflows onto storage-constrained distributed resources. In: Proceedings of the seventh IEEE international symposium on cluster computing and the grid. pp 401–409 Ramakrishnan A, Singh G, Zhao H, Deelman E, Sakellariou R, Vahi K, Blackburn K, Meyers D, Samidi M (2007) Scheduling data-intensive workflows onto storage-constrained distributed resources. In: Proceedings of the seventh IEEE international symposium on cluster computing and the grid. pp 401–409
Metadaten
Titel
Task ranking and allocation in list-based workflow scheduling on parallel computing platform
Publikationsdatum
01.01.2015
Erschienen in
The Journal of Supercomputing / Ausgabe 1/2015
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-014-1294-7

Weitere Artikel der Ausgabe 1/2015

The Journal of Supercomputing 1/2015 Zur Ausgabe