Skip to main content
Erschienen in: Cluster Computing 3/2016

01.09.2016

Ant colony based constrained workflow scheduling for heterogeneous computing systems

verfasst von: Somayeh Kianpisheh, Nasrolah Moghadam Charkari, Mehdi Kargahi

Erschienen in: Cluster Computing | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The problem of constrained workflow scheduling on heterogeneous computing systems has been of major interest in the recent years. The user requirements are described by defining constraints on the workflow makespan and/or its execution cost. The uncertainty in the activity execution path and the dynamicity in the resource workload may cause some run-time changes of the makespan or cost. To prohibit run-time constraint violation, the system needs robust schedules. In this paper, probability of violation (POV) of constraints is proposed as a criterion for the schedule robustness. An ant colony system is then used to minimize an aggregation of violation of constraints and the POV. Simulation results on real world workflows show the effectiveness of the proposed method in finding feasible schedules. The results also indicate that the proposed method decreases the POV, as well as the expected penalty at run-time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Note that larger workflows may require more computations. Therefore, the lower/upper bounds of makespan and cost becomes greater. Thus, according to (5), for a specific tightness coefficient, higher deadline and budget are assigned.
 
2
Resource contention is the situation that several activities on the critical path be mapped to the same resource.
 
Literatur
1.
Zurück zum Zitat Xu, Y., Li, K., Hu, J., Li, K.: A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues. Inf. Sci. 270, 255–287 (2014)MathSciNetCrossRefMATH Xu, Y., Li, K., Hu, J., Li, K.: A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues. Inf. Sci. 270, 255–287 (2014)MathSciNetCrossRefMATH
2.
Zurück zum Zitat Khokhar, A., Prasanna, V.K., Shaaban, M., Wang, C.L.: Heterogeneous computing: challenges and opportunities. Computer 26, 18–27 (1993)CrossRef Khokhar, A., Prasanna, V.K., Shaaban, M., Wang, C.L.: Heterogeneous computing: challenges and opportunities. Computer 26, 18–27 (1993)CrossRef
3.
Zurück zum Zitat Hagras, T., Janecek, J.: A high performance, low complexity algorithm for compile-time task scheduling in heterogeneous systems. Parallel Comput. 31, 653–670 (2005)CrossRefMATH Hagras, T., Janecek, J.: A high performance, low complexity algorithm for compile-time task scheduling in heterogeneous systems. Parallel Comput. 31, 653–670 (2005)CrossRefMATH
4.
Zurück zum Zitat Tan, M., Siegel, H.J., Antonio, J.K., Alexander, Y.: Minimizing the application execution time through scheduling of subtasks and communication traffic in a heterogeneous computing system. IEEE Trans. Parallel Distrib. Syst. 8, 857–871 (1997)CrossRef Tan, M., Siegel, H.J., Antonio, J.K., Alexander, Y.: Minimizing the application execution time through scheduling of subtasks and communication traffic in a heterogeneous computing system. IEEE Trans. Parallel Distrib. Syst. 8, 857–871 (1997)CrossRef
5.
Zurück zum Zitat Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. J. Grid Comput. 3, 171–200 (2005)CrossRef Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. J. Grid Comput. 3, 171–200 (2005)CrossRef
6.
Zurück zum Zitat Kwok, Y.K., Ishfaq, A.: Static scheduling algorithms for allocating directed task graphs to multiprocessrs. ACM Comput. Surv. 31, 406–471 (1999)CrossRef Kwok, Y.K., Ishfaq, A.: Static scheduling algorithms for allocating directed task graphs to multiprocessrs. ACM Comput. Surv. 31, 406–471 (1999)CrossRef
7.
Zurück zum Zitat Garey, M.R., Johnson, D.S.: Computers and Intractability: A Guide to the Theory of NP-Completeness. Freeman, New York (1979)MATH Garey, M.R., Johnson, D.S.: Computers and Intractability: A Guide to the Theory of NP-Completeness. Freeman, New York (1979)MATH
8.
Zurück zum Zitat Delavar, A.G., Aryan, Y.: HSGA: a hybrid heuristic algorithm for workflow scheduling in cloud systems. J. Clust. Comput. 17, 129–137 (2014)CrossRef Delavar, A.G., Aryan, Y.: HSGA: a hybrid heuristic algorithm for workflow scheduling in cloud systems. J. Clust. Comput. 17, 129–137 (2014)CrossRef
9.
Zurück zum Zitat Durillo, J.J., Prodan, R.: Multi-objective workflow scheduling in Amazon EC2. J. Clust. Comput. 17, 169–189 (2014)CrossRef Durillo, J.J., Prodan, R.: Multi-objective workflow scheduling in Amazon EC2. J. Clust. Comput. 17, 169–189 (2014)CrossRef
10.
Zurück zum Zitat Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13, 260–274 (2002)CrossRef Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13, 260–274 (2002)CrossRef
11.
Zurück zum Zitat Yu, Z., Wang, C., Shi, W.: Failure-aware workflow scheduling in cluster environments. J. Clust. Comput. 13, 421–434 (2010)CrossRef Yu, Z., Wang, C., Shi, W.: Failure-aware workflow scheduling in cluster environments. J. Clust. Comput. 13, 421–434 (2010)CrossRef
12.
Zurück zum Zitat Cao, H., Jin, H., Wu, X., Wu, S., Shi, X.: DAGMap: efficient and dependable scheduling of DAG workflow job in Grid. J. Supercomput. 51, 201–223 (2010)CrossRef Cao, H., Jin, H., Wu, X., Wu, S., Shi, X.: DAGMap: efficient and dependable scheduling of DAG workflow job in Grid. J. Supercomput. 51, 201–223 (2010)CrossRef
13.
Zurück zum Zitat Yuan, Y., Li, X., Wang, Q., Zhu, X.: Deadline division-based heuristic for cost optimization in workflow scheduling. Inf. Sci. 179, 2562–2575 (2009)CrossRefMATH Yuan, Y., Li, X., Wang, Q., Zhu, X.: Deadline division-based heuristic for cost optimization in workflow scheduling. Inf. Sci. 179, 2562–2575 (2009)CrossRefMATH
14.
Zurück zum Zitat Abrishami, S., Naghibzadeh, M., Epema, D.H.J.: Deadline-constrained workflow scheduling algorithms for infrastructure as a Service Clouds. Future Gener. Comput. Syst. 29, 158–169 (2013)CrossRef Abrishami, S., Naghibzadeh, M., Epema, D.H.J.: Deadline-constrained workflow scheduling algorithms for infrastructure as a Service Clouds. Future Gener. Comput. Syst. 29, 158–169 (2013)CrossRef
15.
Zurück zum Zitat Ramakrishnan, L., Reed, D.A.: Predictable quality of service atop degradable distributed systems. J. Clust. Comput. 16, 321–334 (2013)CrossRef Ramakrishnan, L., Reed, D.A.: Predictable quality of service atop degradable distributed systems. J. Clust. Comput. 16, 321–334 (2013)CrossRef
16.
Zurück zum Zitat Tsiakkouri, E., Sakellariou, R.: Scheduling workflows with budget constraints. In: Workshop on Integrated research in Grid Computing, pp. 189–202 (2005) Tsiakkouri, E., Sakellariou, R.: Scheduling workflows with budget constraints. In: Workshop on Integrated research in Grid Computing, pp. 189–202 (2005)
17.
Zurück zum Zitat Fard, H.M., Prodan, R., Fahringer, T.: Multi-objective list scheduling of workflow applications in distributed computing infrastructures. J. Parallel Distrib. Comput. 74, 2152–2165 (2014)CrossRefMATH Fard, H.M., Prodan, R., Fahringer, T.: Multi-objective list scheduling of workflow applications in distributed computing infrastructures. J. Parallel Distrib. Comput. 74, 2152–2165 (2014)CrossRefMATH
18.
Zurück zum Zitat Chen, W.N., Zhang, J.: An ant colony optimization approach to a grid workflow scheduling problem with various QoS requirements. IEEE Trans. Syst. Man Cybern. 39, 29–43 (2009)CrossRef Chen, W.N., Zhang, J.: An ant colony optimization approach to a grid workflow scheduling problem with various QoS requirements. IEEE Trans. Syst. Man Cybern. 39, 29–43 (2009)CrossRef
19.
Zurück zum Zitat Liu, X., Ni, Z., Wu, Z., Yuan, D., Chen, J., Yang, Y.: A novel general framework for automatic and cost-effective handling of recoverable temporal violations in scientific workflow systems. Syst. Softw. 84, 492–509 (2011)CrossRef Liu, X., Ni, Z., Wu, Z., Yuan, D., Chen, J., Yang, Y.: A novel general framework for automatic and cost-effective handling of recoverable temporal violations in scientific workflow systems. Syst. Softw. 84, 492–509 (2011)CrossRef
20.
Zurück zum Zitat Zeng, L., Veeravalli, B., Li, X.: ScaleStar: budget conscious scheduling precedence-constrained many-task workflow applications in cloud. In: International Conference on Advanced Information Networking and Applications, pp. 534–541 (2012) Zeng, L., Veeravalli, B., Li, X.: ScaleStar: budget conscious scheduling precedence-constrained many-task workflow applications in cloud. In: International Conference on Advanced Information Networking and Applications, pp. 534–541 (2012)
21.
Zurück zum Zitat Canon, L.C., Jeannot, E.: Evaluation and optimization of the robustness of DAG schedules in heterogeneous environments. IEEE Trans. Parallel Distrib. Syst. 21, 532–546 (2010)CrossRef Canon, L.C., Jeannot, E.: Evaluation and optimization of the robustness of DAG schedules in heterogeneous environments. IEEE Trans. Parallel Distrib. Syst. 21, 532–546 (2010)CrossRef
22.
Zurück zum Zitat Adyanthaya, S., Zhang, Z., Geilen, M., Voeten, J.: Robustness analysis of multiprocessor schedules. In: International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation, pp. 9–17 (2014) Adyanthaya, S., Zhang, Z., Geilen, M., Voeten, J.: Robustness analysis of multiprocessor schedules. In: International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation, pp. 9–17 (2014)
23.
Zurück zum Zitat Sugavanam, P., Siegel, H.J., Maciejewski, A.A., Oltikar, M., Mehta, A., Pichel, R.: Robust static allocation of resources for independent tasks under makespan and dollar cost constraints. J. Parallel Distrib. Comput. 67, 400–416 (2007)CrossRefMATH Sugavanam, P., Siegel, H.J., Maciejewski, A.A., Oltikar, M., Mehta, A., Pichel, R.: Robust static allocation of resources for independent tasks under makespan and dollar cost constraints. J. Parallel Distrib. Comput. 67, 400–416 (2007)CrossRefMATH
24.
Zurück zum Zitat Ferguson, A.D., Bodik, P., Kandula, S., Boutin, E., Fonseca, R.: Jockey: guaranteed job latency in data parallel clusters. In: ACM European Conference on Computer Systems, pp. 99–112 (2012) Ferguson, A.D., Bodik, P., Kandula, S., Boutin, E., Fonseca, R.: Jockey: guaranteed job latency in data parallel clusters. In: ACM European Conference on Computer Systems, pp. 99–112 (2012)
25.
Zurück zum Zitat Kianpisheh, S., Charkari, N.M.: A grid workflow quality-of-service estimation based on resource availability prediction. J. Supercomput. 67, 496–527 (2014)CrossRef Kianpisheh, S., Charkari, N.M.: A grid workflow quality-of-service estimation based on resource availability prediction. J. Supercomput. 67, 496–527 (2014)CrossRef
26.
Zurück zum Zitat Briceño, L.D., Smith, J., Siegel, H.J., Maciejewski, A.A., Maxwell, P., Wakefield, R.: Robust static resource allocation of DAGs in a heterogeneous multicore system. J. Parallel Distrib. Comput. 73, 1705–1717 (2013)CrossRef Briceño, L.D., Smith, J., Siegel, H.J., Maciejewski, A.A., Maxwell, P., Wakefield, R.: Robust static resource allocation of DAGs in a heterogeneous multicore system. J. Parallel Distrib. Comput. 73, 1705–1717 (2013)CrossRef
27.
Zurück zum Zitat Boloor, K., Chirkova, R., Salo, T., Viniotis, Y.: Analysis of response time percentile service level agreements in SOA-based applications. In: Global Telecommunications Conference, pp. 1–6 (2011) Boloor, K., Chirkova, R., Salo, T., Viniotis, Y.: Analysis of response time percentile service level agreements in SOA-based applications. In: Global Telecommunications Conference, pp. 1–6 (2011)
28.
Zurück zum Zitat Banachowski, S., Wu, J., Brandt, S.A.: Missed deadline notification in best-effort schedulers. In: Electronic Imaging, pp. 123–135 (2004) Banachowski, S., Wu, J., Brandt, S.A.: Missed deadline notification in best-effort schedulers. In: Electronic Imaging, pp. 123–135 (2004)
29.
Zurück zum Zitat Xiao, Z., Ming, Z.: A method of workflow scheduling based on colored Petri nets. Data Knowl. Eng. 70, 230–247 (2011)CrossRef Xiao, Z., Ming, Z.: A method of workflow scheduling based on colored Petri nets. Data Knowl. Eng. 70, 230–247 (2011)CrossRef
30.
Zurück zum Zitat Wu, Z., Liu, X., Ni, Z., Yuan, D., Yang, Y.: A market-oriented hierarchical scheduling strategy in cloud workflow systems. J. Supercomput. 63, 256–293 (2013)CrossRef Wu, Z., Liu, X., Ni, Z., Yuan, D., Yang, Y.: A market-oriented hierarchical scheduling strategy in cloud workflow systems. J. Supercomput. 63, 256–293 (2013)CrossRef
31.
Zurück zum Zitat Lin, M., Ding, C.: Parallel genetic algorithms for dvs scheduling of distributed embedded systems. In: High Performance Computing and Communications, pp. 180–191. Springer, Berlin (2007) Lin, M., Ding, C.: Parallel genetic algorithms for dvs scheduling of distributed embedded systems. In: High Performance Computing and Communications, pp. 180–191. Springer, Berlin (2007)
32.
Zurück zum Zitat Yu, J., Buyya, R., Tham, C.K.: Cost-based scheduling of scientific workflow applications on utility grids. In: International Conference on e-Science and Grid Computing, pp. 140–147 (2005) Yu, J., Buyya, R., Tham, C.K.: Cost-based scheduling of scientific workflow applications on utility grids. In: International Conference on e-Science and Grid Computing, pp. 140–147 (2005)
33.
Zurück zum Zitat Menasce, D.A., Casalicchio, E.: A framework for resource allocation in grid computing. In: International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, pp. 259–267 (2004) Menasce, D.A., Casalicchio, E.: A framework for resource allocation in grid computing. In: International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, pp. 259–267 (2004)
34.
Zurück zum Zitat Yu, J., Buyya, R.: Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci. Program. 14, 217–230 (2006) Yu, J., Buyya, R.: Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci. Program. 14, 217–230 (2006)
35.
Zurück zum Zitat Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., et al.: Mapping abstract complex workflows onto grid environments. Grid Comput. 1, 25–39 (2003)CrossRef Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., et al.: Mapping abstract complex workflows onto grid environments. Grid Comput. 1, 25–39 (2003)CrossRef
36.
Zurück zum Zitat Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: Symposium on High Performance Distributed Computing, pp. 181–194 (2001) Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: Symposium on High Performance Distributed Computing, pp. 181–194 (2001)
37.
Zurück zum Zitat Smith, W., Foster, I., Taylor, V.: Scheduling with advanced reservations. In: Symposium on Parallel and Distributed Processing, pp. 127–132 (2000) Smith, W., Foster, I., Taylor, V.: Scheduling with advanced reservations. In: Symposium on Parallel and Distributed Processing, pp. 127–132 (2000)
38.
Zurück zum Zitat Dorigo, M., Gambardella, L.M.: Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans Evol. Comput. 1, 53–66 (1997)CrossRef Dorigo, M., Gambardella, L.M.: Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans Evol. Comput. 1, 53–66 (1997)CrossRef
39.
Zurück zum Zitat Chang, D.-H., Son, J.H., Kim, M.H.: Critical path identification in the context of a workflow. Inform. Softw. Technol. 44, 405–417 (2002)CrossRef Chang, D.-H., Son, J.H., Kim, M.H.: Critical path identification in the context of a workflow. Inform. Softw. Technol. 44, 405–417 (2002)CrossRef
40.
Zurück zum Zitat Abrishami, S., Naghibzadeh, M., Epema, D.H.J.: Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans. Parallel Distrib. Syst. 23, 1400–1414 (2011)CrossRef Abrishami, S., Naghibzadeh, M., Epema, D.H.J.: Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans. Parallel Distrib. Syst. 23, 1400–1414 (2011)CrossRef
41.
42.
Zurück zum Zitat Pedemonte, M., Nesmachnow, S., Cancela, H.: A survey on parallel ant colony optimization. Appl. Soft Comput. 11, 5181–5197 (2011)CrossRef Pedemonte, M., Nesmachnow, S., Cancela, H.: A survey on parallel ant colony optimization. Appl. Soft Comput. 11, 5181–5197 (2011)CrossRef
44.
Zurück zum Zitat Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. future Gener. Comput. Syst. 29, 682–692 (2013)CrossRef Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. future Gener. Comput. Syst. 29, 682–692 (2013)CrossRef
45.
Zurück zum Zitat Ramakrishnan, L., Gannon, D.: A survey of distributed workflow characteristics and resource requirements. Indiana University Technical Report TR671 (2008) Ramakrishnan, L., Gannon, D.: A survey of distributed workflow characteristics and resource requirements. Indiana University Technical Report TR671 (2008)
Metadaten
Titel
Ant colony based constrained workflow scheduling for heterogeneous computing systems
verfasst von
Somayeh Kianpisheh
Nasrolah Moghadam Charkari
Mehdi Kargahi
Publikationsdatum
01.09.2016
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2016
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-016-0575-8

Weitere Artikel der Ausgabe 3/2016

Cluster Computing 3/2016 Zur Ausgabe