Skip to main content
Erschienen in: The Journal of Supercomputing 4/2015

01.04.2015

Efficient task scheduling algorithms for heterogeneous multi-cloud environment

verfasst von: Sanjaya K. Panda, Prasanta K. Jana

Erschienen in: The Journal of Supercomputing | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud Computing has grown exponentially in the business and research community over the last few years. It is now an emerging field and becomes more popular due to recent advances in virtualization technology. In Cloud Computing, various applications are submitted to the datacenters to obtain some services on pay-per-use basis. However, due to limited resources, some workloads are transferred to other data centers to handle peak client demands. Therefore, scheduling workloads in heterogeneous multi-cloud environment is a hot topic and very challenging due to heterogeneity of the cloud resources with varying capacities and functionalities. In this paper, we present three task scheduling algorithms, called MCC, MEMAX and CMMN for heterogeneous multi-cloud environment, which aim to minimize the makespan and maximize the average cloud utilization. The proposed MCC algorithm is a single-phase scheduling whereas rests are two-phase scheduling. We perform rigorous experiments on the proposed algorithms using various benchmark as well as synthetic datasets. Their performances are evaluated in terms of makespan and average cloud utilization and experimental results are compared with that of existing single-phase and two-phase scheduling algorithms to demonstrate the efficacy of the proposed algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype and reality for delivering computing as the 5th utility. Future Gen Comput Syst Elsevier 25:599–616CrossRef Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype and reality for delivering computing as the 5th utility. Future Gen Comput Syst Elsevier 25:599–616CrossRef
2.
Zurück zum Zitat Durao F, Carvalho JFS, Fonseka A, Garcia VC (2014) A systematic review on cloud computing. J Supercomput 68(3):1321–1346CrossRef Durao F, Carvalho JFS, Fonseka A, Garcia VC (2014) A systematic review on cloud computing. J Supercomput 68(3):1321–1346CrossRef
3.
Zurück zum Zitat Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. Fifth international joint conference on INC, IMS and IDC, pp 44–51 Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. Fifth international joint conference on INC, IMS and IDC, pp 44–51
4.
Zurück zum Zitat Tsai J, Fang J, Chou J (2013) Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm. Comput Oper Res Elsevier 40(12):3045–3055CrossRef Tsai J, Fang J, Chou J (2013) Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm. Comput Oper Res Elsevier 40(12):3045–3055CrossRef
6.
Zurück zum Zitat Begnum K (2012) Simplified cloud-oriented virtual machine management with MLN. J Supercomput 61(2):251–266CrossRef Begnum K (2012) Simplified cloud-oriented virtual machine management with MLN. J Supercomput 61(2):251–266CrossRef
8.
Zurück zum Zitat Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B, Hensgen D, Freund RF (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810–837CrossRef Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B, Hensgen D, Freund RF (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parallel Distrib Comput 61(6):810–837CrossRef
9.
Zurück zum Zitat Maheswaran M, Ali S, Siegel HJ, Hensgen D, Freund RF (1999) Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. J Parallel Distrib Comput 59:107–131CrossRef Maheswaran M, Ali S, Siegel HJ, Hensgen D, Freund RF (1999) Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. J Parallel Distrib Comput 59:107–131CrossRef
10.
Zurück zum Zitat Ibarra OH, Kim CE (1977) Heuristic algorithms for scheduling independent tasks on nonidentical processors. J Assoc Comput Mach 24(2):280–289CrossRefMATHMathSciNet Ibarra OH, Kim CE (1977) Heuristic algorithms for scheduling independent tasks on nonidentical processors. J Assoc Comput Mach 24(2):280–289CrossRefMATHMathSciNet
11.
Zurück zum Zitat Armstrong R, Hensgen D, Kidd T (1998) The relative performance of various mapping algorithms is independent of sizable variances in run-time predictions. 7th IEEE heterogeneous computing workshop. pp 79–87 Armstrong R, Hensgen D, Kidd T (1998) The relative performance of various mapping algorithms is independent of sizable variances in run-time predictions. 7th IEEE heterogeneous computing workshop. pp 79–87
12.
Zurück zum Zitat Freund RF, Gherrity M, Ambrosius S, Campbell M, Halderman M, Hensgen D, Keith E, Kidd T, Kussow M, Lima JD, Mirabile F, Moore L, Rust B, Siegel HJ (1998) Scheduling resources in multi-user, heterogeneous, computing environments with smartNet. 7th IEEE heterogeneous computing workshop. pp 184–199 Freund RF, Gherrity M, Ambrosius S, Campbell M, Halderman M, Hensgen D, Keith E, Kidd T, Kussow M, Lima JD, Mirabile F, Moore L, Rust B, Siegel HJ (1998) Scheduling resources in multi-user, heterogeneous, computing environments with smartNet. 7th IEEE heterogeneous computing workshop. pp 184–199
13.
Zurück zum Zitat Kwok Y, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef Kwok Y, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans Parallel Distrib Syst 7(5):506–521CrossRef
14.
Zurück zum Zitat Topcuoglu H, Hariri S, Wu M (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260–274CrossRef Topcuoglu H, Hariri S, Wu M (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260–274CrossRef
15.
Zurück zum Zitat Bajaj R, Agrawal DP (2004) Improving scheduling of tasks in a heterogeneous environment. IEEE Trans Parallel Distrib Syst 15(2):107–118CrossRef Bajaj R, Agrawal DP (2004) Improving scheduling of tasks in a heterogeneous environment. IEEE Trans Parallel Distrib Syst 15(2):107–118CrossRef
16.
Zurück zum Zitat Li J, Qiu M, Ming Z, Quan G, Qin X, Gu Z (2012) Online optimization for scheduling preemptable tasks on IaaS cloud system. J Parallel Distrib Comput Elsevier 72:666–677CrossRef Li J, Qiu M, Ming Z, Quan G, Qin X, Gu Z (2012) Online optimization for scheduling preemptable tasks on IaaS cloud system. J Parallel Distrib Comput Elsevier 72:666–677CrossRef
17.
Zurück zum Zitat Li J, Qiu M, Niu JW, Chen Y, Ming Z (2010) Adaptive resource allocation for preemptable jobs in cloud systems (2010) 10th IEEE international conference on intelligent systems design and applications. pp 31–36 Li J, Qiu M, Niu JW, Chen Y, Ming Z (2010) Adaptive resource allocation for preemptable jobs in cloud systems (2010) 10th IEEE international conference on intelligent systems design and applications. pp 31–36
18.
Zurück zum Zitat Wen H, Hai-ying Z, Chuang L, Yang Y (2011) Effective load balancing for cloud-based multimedia system (2011) International conference on electronic and mechanical engineering and information technology, pp 165–168 Wen H, Hai-ying Z, Chuang L, Yang Y (2011) Effective load balancing for cloud-based multimedia system (2011) International conference on electronic and mechanical engineering and information technology, pp 165–168
19.
Zurück zum Zitat Wang S, Yan K, Liao W, Wang S (2010) Towards a load balancing in a three-level cloud computing network. 3rd IEEE international conference on computer science and information technology. vol 1. pp 108–113 Wang S, Yan K, Liao W, Wang S (2010) Towards a load balancing in a three-level cloud computing network. 3rd IEEE international conference on computer science and information technology. vol 1. pp 108–113
20.
Zurück zum Zitat Ergu D, Kou G, Peng Y, Shi Y, Shi Y (2013) The analytic hierarchy process: task scheduling and resource allocation in cloud computing environment. J Supercomput Springer 64:835–848CrossRef Ergu D, Kou G, Peng Y, Shi Y, Shi Y (2013) The analytic hierarchy process: task scheduling and resource allocation in cloud computing environment. J Supercomput Springer 64:835–848CrossRef
21.
Zurück zum Zitat Rai A, Bhagwan R, Guha S (2012) Generalized resource allocation for the cloud. 3rd ACM symposium on cloud computing Rai A, Bhagwan R, Guha S (2012) Generalized resource allocation for the cloud. 3rd ACM symposium on cloud computing
22.
Zurück zum Zitat Sotomayor B, Keahey K, Foster I (2008) Combining batch execution and leasing using virtual machines (2008) 17th international symposium on high performance distributed computing, ACM pp 87–96 Sotomayor B, Keahey K, Foster I (2008) Combining batch execution and leasing using virtual machines (2008) 17th international symposium on high performance distributed computing, ACM pp 87–96
23.
Zurück zum Zitat Sotomayor B, Montero RS, Llorente IM, Foster I (2011) Resource leasing and the art of suspending virtual machines. 11th IEEE international conference on high performance computing and communications. pp 59–68 Sotomayor B, Montero RS, Llorente IM, Foster I (2011) Resource leasing and the art of suspending virtual machines. 11th IEEE international conference on high performance computing and communications. pp 59–68
24.
Zurück zum Zitat Akhani J, Chuadhary S, Somani G (2011) Negotiation for resource allocation in IaaS cloud. 4th annual ACM bangalore conference Akhani J, Chuadhary S, Somani G (2011) Negotiation for resource allocation in IaaS cloud. 4th annual ACM bangalore conference
25.
Zurück zum Zitat Bozdag D, Ozguner F, Catalyurek U (2009) Compaction of schedules and a two-stage approach for duplication-based DAG scheduling. IEEE Trans Parallel Distrib Syst 20(6):857–871CrossRef Bozdag D, Ozguner F, Catalyurek U (2009) Compaction of schedules and a two-stage approach for duplication-based DAG scheduling. IEEE Trans Parallel Distrib Syst 20(6):857–871CrossRef
26.
Zurück zum Zitat Xu Y, Hu H, Yihe S (2010) Data dependence graph directed scheduling for clustered VLIW architectures. Tsinghua Sci Technol IEEE 15(3):299–306CrossRef Xu Y, Hu H, Yihe S (2010) Data dependence graph directed scheduling for clustered VLIW architectures. Tsinghua Sci Technol IEEE 15(3):299–306CrossRef
27.
Zurück zum Zitat Bittencourt LF, Madeira ERM, Fonseca NLSD (2012) Scheduling in hybrid clouds. IEEE Commun Mag 50(9):42–47CrossRef Bittencourt LF, Madeira ERM, Fonseca NLSD (2012) Scheduling in hybrid clouds. IEEE Commun Mag 50(9):42–47CrossRef
28.
Zurück zum Zitat Nathani A, Chaudhary S, Somani G (2012) Policy based resource allocation in IaaS cloud. Future Gen Comput Syst Elsevier 28:94–103CrossRef Nathani A, Chaudhary S, Somani G (2012) Policy based resource allocation in IaaS cloud. Future Gen Comput Syst Elsevier 28:94–103CrossRef
29.
Zurück zum Zitat Xhafa F, Carretero J, Barolli L, Durresi A (2007) Immediate mode scheduling in grid systems. Int J Web Grid Serv 3(2):219–236CrossRef Xhafa F, Carretero J, Barolli L, Durresi A (2007) Immediate mode scheduling in grid systems. Int J Web Grid Serv 3(2):219–236CrossRef
30.
Zurück zum Zitat Xhafa F, Barolli L, Durresi A (2007) Batch mode scheduling in grid systems. Int J Web Grid Serv 3(1):19–37CrossRef Xhafa F, Barolli L, Durresi A (2007) Batch mode scheduling in grid systems. Int J Web Grid Serv 3(1):19–37CrossRef
32.
Zurück zum Zitat Kwok Y, Ahmad I (1999) Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput Surv (CSUR) 31(4):406–471CrossRef Kwok Y, Ahmad I (1999) Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput Surv (CSUR) 31(4):406–471CrossRef
33.
Zurück zum Zitat Zhang Y, Sivasubramaniam A, Moreira J, Franke H (2001) Impact of workload and system parameters on next generation cluster scheduling mechanisms. IEEE Trans Parallel Distrib Syst 12(9):967–985CrossRef Zhang Y, Sivasubramaniam A, Moreira J, Franke H (2001) Impact of workload and system parameters on next generation cluster scheduling mechanisms. IEEE Trans Parallel Distrib Syst 12(9):967–985CrossRef
34.
Zurück zum Zitat Hagras T, Janecek J (2005) A high performance, low complexity algorithm for compile-time task scheduling in heterogeneous systems. Parallel Comput 31(7):653–670CrossRef Hagras T, Janecek J (2005) A high performance, low complexity algorithm for compile-time task scheduling in heterogeneous systems. Parallel Comput 31(7):653–670CrossRef
35.
Zurück zum Zitat Lawler EL, Labetoulle J (1978) On preemptive scheduling of unrelated parallel processors by linear programming. J Assoc Comput Mach 25(4):612–619CrossRefMATHMathSciNet Lawler EL, Labetoulle J (1978) On preemptive scheduling of unrelated parallel processors by linear programming. J Assoc Comput Mach 25(4):612–619CrossRefMATHMathSciNet
36.
Zurück zum Zitat Liu C, Yang S (2011) A heuristic serial schedule algorithm for unrelated parallel machine scheduling with precedence constraints. J Softw 6(6):1146–1153CrossRef Liu C, Yang S (2011) A heuristic serial schedule algorithm for unrelated parallel machine scheduling with precedence constraints. J Softw 6(6):1146–1153CrossRef
37.
Zurück zum Zitat Kumar VSA, Marathe MV, Parthasarathy S, Srinivasan A (2009) Scheduling on unrelated machines under tree-like precedence constraints. Algorithmica 55:205–226CrossRefMATHMathSciNet Kumar VSA, Marathe MV, Parthasarathy S, Srinivasan A (2009) Scheduling on unrelated machines under tree-like precedence constraints. Algorithmica 55:205–226CrossRefMATHMathSciNet
38.
Zurück zum Zitat Lenstra JK, Shmoys DB, Tardos E (1990) Approximation algorithms for scheduling unrelated parallel machines. Math Program 46(1–3):259–271CrossRefMATHMathSciNet Lenstra JK, Shmoys DB, Tardos E (1990) Approximation algorithms for scheduling unrelated parallel machines. Math Program 46(1–3):259–271CrossRefMATHMathSciNet
39.
Zurück zum Zitat Leighton FT, Maggs BM, Rao SB (1994) Packet routing and job-shop scheduling in \(O\) (Congestion + Dilation) steps. Combinatorica 14:167–186CrossRefMATHMathSciNet Leighton FT, Maggs BM, Rao SB (1994) Packet routing and job-shop scheduling in \(O\) (Congestion + Dilation) steps. Combinatorica 14:167–186CrossRefMATHMathSciNet
40.
Zurück zum Zitat Smith W, Foster I, Taylor V (2000) Scheduling with advanced reservations. 14th international parallel and distributed processing symposium. pp 127–132 Smith W, Foster I, Taylor V (2000) Scheduling with advanced reservations. 14th international parallel and distributed processing symposium. pp 127–132
42.
Zurück zum Zitat Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. International joint conference on INC, IMS and IDC. pp 44–51 Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. International joint conference on INC, IMS and IDC. pp 44–51
43.
Zurück zum Zitat Hou E, Ansari N, Ren H (1994) A genetic algorithm for multiprocessor scheduling. IEEE Trans Parallel Distrib Syst 5(2):113–120CrossRef Hou E, Ansari N, Ren H (1994) A genetic algorithm for multiprocessor scheduling. IEEE Trans Parallel Distrib Syst 5(2):113–120CrossRef
44.
Zurück zum Zitat Yang Q, Peng C, Zhao H, Yu Y, Zhou Y, Wang Z, Du S (2014) A new method based on PSR and EA-GMDH for host load prediction in cloud computing system. J Supercomput 68(3):1402–1417CrossRef Yang Q, Peng C, Zhao H, Yu Y, Zhou Y, Wang Z, Du S (2014) A new method based on PSR and EA-GMDH for host load prediction in cloud computing system. J Supercomput 68(3):1402–1417CrossRef
45.
Zurück zum Zitat Gil J, Park JH, Jeong Y (2013) Data center selection based on neuro-fuzzy inference systems in cloud computing environments. J Supercomput 66(3):1194–1214CrossRef Gil J, Park JH, Jeong Y (2013) Data center selection based on neuro-fuzzy inference systems in cloud computing environments. J Supercomput 66(3):1194–1214CrossRef
46.
Zurück zum Zitat Zhang F, Cao J, Li K, Khan SU, Hwang K (2014) Multi-objective scheduling of many tasks in cloud platforms. Future Gen Comput Syst Elsevier 37:309–320CrossRef Zhang F, Cao J, Li K, Khan SU, Hwang K (2014) Multi-objective scheduling of many tasks in cloud platforms. Future Gen Comput Syst Elsevier 37:309–320CrossRef
47.
Zurück zum Zitat Su S, Li J, Huang Q, Huang X, Shuang K, Wang J (2013) Cost-efficient task scheduling for executing large programs in the cloud. Parallel Comput 39(4–5):177–188CrossRef Su S, Li J, Huang Q, Huang X, Shuang K, Wang J (2013) Cost-efficient task scheduling for executing large programs in the cloud. Parallel Comput 39(4–5):177–188CrossRef
48.
Zurück zum Zitat Wang X, Wang Y, Cui Y (2014) A new multi-objective Bi-level programming model for energy and locality aware multi-job scheduling in cloud computing. Future Gen Comput Syst Elsevier 36:91–101CrossRef Wang X, Wang Y, Cui Y (2014) A new multi-objective Bi-level programming model for energy and locality aware multi-job scheduling in cloud computing. Future Gen Comput Syst Elsevier 36:91–101CrossRef
Metadaten
Titel
Efficient task scheduling algorithms for heterogeneous multi-cloud environment
verfasst von
Sanjaya K. Panda
Prasanta K. Jana
Publikationsdatum
01.04.2015
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 4/2015
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-014-1376-6

Weitere Artikel der Ausgabe 4/2015

The Journal of Supercomputing 4/2015 Zur Ausgabe

Premium Partner