Skip to main content
Erschienen in: The Journal of Supercomputing 3/2014

01.06.2014

Cost optimal scheduling in IaaS for dependent workload with particle swarm optimization

verfasst von: Nuttapong Netjinda, Booncharoen Sirinaovakul, Tiranee Achalakul

Erschienen in: The Journal of Supercomputing | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Optimizing cloud provisioning for scientific workflow applications is a challenging problem, since the workflows generally contain dependency between tasks and require specific deadlines. Usually, cloud providers offer many options to the consumers. These options include the number of virtual machines, the type of each virtual machine and the purchasing method for each machine. Currently, cloud provisioning cost optimization is an active research topic. Most of this literature is concerned with task scheduling, cloud option selection, and cloud option selection for scientific workflow applications. However, research that attempts to find solutions which cover both cloud option selection and workflow task scheduling is very limited. In this paper, we focus on optimizing the cost of purchasing infrastructure-as-a-service cloud capabilities to achieve scientific work flow execution within the specific deadlines. The proposed system considers the number of purchased instances, instance types, purchasing options, and task scheduling as constraints in an optimization process. Particle swarm optimization augmented with a variable neighborhood search technique is used to find the optimal solution. Our approach finds the configurations of purchasing options with the optimum budget for a specified workflow application based on the required performance. The solutions from the proposed system show promising performance from the perspectives of the total cost and fitness convergence when compared with other state-of-the-art algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Buyya R, Yeo C, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener Comput Syst 25(6):599–616CrossRef Buyya R, Yeo C, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener Comput Syst 25(6):599–616CrossRef
2.
Zurück zum Zitat Bharathi S, Chervenak A, Deelman E, Mehta G, Su MH, Vahi K (2008) Characterization of scientific workflows. In: Proceedings of the 3rd workshop on workflows in support of large scale science, WORKS 08 Bharathi S, Chervenak A, Deelman E, Mehta G, Su MH, Vahi K (2008) Characterization of scientific workflows. In: Proceedings of the 3rd workshop on workflows in support of large scale science, WORKS 08
4.
Zurück zum Zitat Wu Q, Yun D, Lin W, Gu Y, Lin W, Liu Y (2013) On workflow scheduling for end-to-end performance optimization in distributed network environments. In: Job scheduling strategies for parallel processing. Springer, Berlin, pp 76–95 Wu Q, Yun D, Lin W, Gu Y, Lin W, Liu Y (2013) On workflow scheduling for end-to-end performance optimization in distributed network environments. In: Job scheduling strategies for parallel processing. Springer, Berlin, pp 76–95
5.
Zurück zum Zitat Liu K, Jin H, Chen J, Liu X, Yuan D, Yang Y (2010) A compromised-time-cost scheduling algorithm in SwinDeW-C for instance-intensive cost-constrained workflows on a cloud computing platform. Int J High Perform Comput Appl 24(4):445–456CrossRef Liu K, Jin H, Chen J, Liu X, Yuan D, Yang Y (2010) A compromised-time-cost scheduling algorithm in SwinDeW-C for instance-intensive cost-constrained workflows on a cloud computing platform. Int J High Perform Comput Appl 24(4):445–456CrossRef
6.
Zurück zum Zitat Pandey S, Wu L, Guru SM, Buyya R (2010) A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: Proceedings of the 24th IEEE international conference on advanced information networking and applications, AINA Pandey S, Wu L, Guru SM, Buyya R (2010) A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: Proceedings of the 24th IEEE international conference on advanced information networking and applications, AINA
7.
Zurück zum Zitat Wu Z, Ni Z, Gu L, Liu X (2010) A revised discrete particle swarm optimization for cloud workflow scheduling. In: Proceedings of the 2010 international conference on computational intelligence and security, CIS Wu Z, Ni Z, Gu L, Liu X (2010) A revised discrete particle swarm optimization for cloud workflow scheduling. In: Proceedings of the 2010 international conference on computational intelligence and security, CIS
8.
Zurück zum Zitat Kllapi H, Sitaridi E, Tsangaris MM, Ioannidis Y (2011) Schedule optimization for data processing flows on the cloud. In: Proceedings of the 2011 international conference on management of data, SIGMOD ’11 Kllapi H, Sitaridi E, Tsangaris MM, Ioannidis Y (2011) Schedule optimization for data processing flows on the cloud. In: Proceedings of the 2011 international conference on management of data, SIGMOD ’11
9.
Zurück zum Zitat Byun E, Kee Y, Kim J, Maeng S (2011) Cost optimized provisioning of elastic resources for application workflows. Future Gener Comput Syst 27(8):1011–1026CrossRef Byun E, Kee Y, Kim J, Maeng S (2011) Cost optimized provisioning of elastic resources for application workflows. Future Gener Comput Syst 27(8):1011–1026CrossRef
10.
Zurück zum Zitat Van den Bossche R, Vanmechelen K, Broeckhove J (2010) Cost-optimal scheduling in hybrid IaaS clouds for deadline constrained workloads. In: Proceedings of the 2010 IEEE 3rd international conference on cloud computing, CLOUD Van den Bossche R, Vanmechelen K, Broeckhove J (2010) Cost-optimal scheduling in hybrid IaaS clouds for deadline constrained workloads. In: Proceedings of the 2010 IEEE 3rd international conference on cloud computing, CLOUD
11.
Zurück zum Zitat Rahman M, Li X, Palit H (2011) Hybrid heuristic for scheduling data analytics workflow applications in hybrid cloud environment. In: Proceedings of the 2011 IEEE international symposium on parallel and distributed processing workshops and Phd forum, IPDPSW Rahman M, Li X, Palit H (2011) Hybrid heuristic for scheduling data analytics workflow applications in hybrid cloud environment. In: Proceedings of the 2011 IEEE international symposium on parallel and distributed processing workshops and Phd forum, IPDPSW
12.
Zurück zum Zitat Wu Z, Liu X, Ni Z, Yuan D, Yang Y (2012) A market-oriented hierarchical scheduling strategy in cloud workflow systems. J Supercomput 63(1):256–293CrossRef Wu Z, Liu X, Ni Z, Yuan D, Yang Y (2012) A market-oriented hierarchical scheduling strategy in cloud workflow systems. J Supercomput 63(1):256–293CrossRef
13.
Zurück zum Zitat Abrishami S, Naghibzadeh M, Epema D (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gener Comput Syst 29(1):158–169CrossRef Abrishami S, Naghibzadeh M, Epema D (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gener Comput Syst 29(1):158–169CrossRef
15.
Zurück zum Zitat Li Q, Guo Y (2010) Optimization of resource scheduling in cloud computing. In: Proceedings of the 2010 12th international symposium on symbolic and numeric algorithms for scientific computing, SYNASC Li Q, Guo Y (2010) Optimization of resource scheduling in cloud computing. In: Proceedings of the 2010 12th international symposium on symbolic and numeric algorithms for scientific computing, SYNASC
16.
Zurück zum Zitat Chaisiri S, Lee B, Niyato D (2012) Optimization of resource provisioning cost in cloud computing. IEEE Trans Serv Comput 5(2):164–177CrossRef Chaisiri S, Lee B, Niyato D (2012) Optimization of resource provisioning cost in cloud computing. IEEE Trans Serv Comput 5(2):164–177CrossRef
17.
Zurück zum Zitat Netjinda N, Sirinaovakul B, Achalakul T (2012) Cost optimization in cloud provisioning using particle swarm optimization. In: Proceedings of the 2012 9th international conference on electrical engineering/electronics, computer, telecommunications and information technology, ECTI-CON Netjinda N, Sirinaovakul B, Achalakul T (2012) Cost optimization in cloud provisioning using particle swarm optimization. In: Proceedings of the 2012 9th international conference on electrical engineering/electronics, computer, telecommunications and information technology, ECTI-CON
18.
Zurück zum Zitat Netjinda N, Achalakul T, Sirinaovakul B (2013) Cloud provisioning for workflow application with deadline using discrete PSO. ECTI Trans Comput Inf Technol 7(1):43–51 Netjinda N, Achalakul T, Sirinaovakul B (2013) Cloud provisioning for workflow application with deadline using discrete PSO. ECTI Trans Comput Inf Technol 7(1):43–51
19.
Zurück zum Zitat Chen R, Wang C (2011) Project scheduling heuristics-based standard PSO for task-resource assignment in heterogeneous grid. Abstr Appl Anal 2011:1–20 Chen R, Wang C (2011) Project scheduling heuristics-based standard PSO for task-resource assignment in heterogeneous grid. Abstr Appl Anal 2011:1–20
20.
Zurück zum Zitat Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks
21.
Zurück zum Zitat Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: Proceedings of the IEEE world congress on computational intelligence. The 1998 IEEE international conference on evolutionary computation Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: Proceedings of the IEEE world congress on computational intelligence. The 1998 IEEE international conference on evolutionary computation
22.
Zurück zum Zitat Clerc M, Kennedy J (2002) The particle swarm–explosion. Stability, and convergence in a multidimensional complex space. IEEE Trans Evolut Comput 6(1):58–73 Clerc M, Kennedy J (2002) The particle swarm–explosion. Stability, and convergence in a multidimensional complex space. IEEE Trans Evolut Comput 6(1):58–73
23.
Zurück zum Zitat Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the 2002 congress on evolutionary computation, CEC ’02 Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the 2002 congress on evolutionary computation, CEC ’02
24.
Zurück zum Zitat Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of the 1999 congress on evolutionary computation Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of the 1999 congress on evolutionary computation
25.
Zurück zum Zitat Hansen P, Mladenovic N, Perez JAM (2008) Variable neighborhood search: methods and applications. 4OR 6(4):319–360 Hansen P, Mladenovic N, Perez JAM (2008) Variable neighborhood search: methods and applications. 4OR 6(4):319–360
Metadaten
Titel
Cost optimal scheduling in IaaS for dependent workload with particle swarm optimization
verfasst von
Nuttapong Netjinda
Booncharoen Sirinaovakul
Tiranee Achalakul
Publikationsdatum
01.06.2014
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 3/2014
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-014-1126-9

Weitere Artikel der Ausgabe 3/2014

The Journal of Supercomputing 3/2014 Zur Ausgabe