Skip to main content
Erschienen in: The Journal of Supercomputing 7/2017

12.11.2016

Distributed resource allocation in federated clouds

verfasst von: Yi-Hsuan Lee, Kuo-Chan Huang, Meng-Ru Shieh, Kuan-Chou Lai

Erschienen in: The Journal of Supercomputing | Ausgabe 7/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud computing is an emerging technology which relies on virtualization techniques to achieve the elasticity of shared resources for providing on-demand services. When the service demand increases, more resources are required to satisfy the service demand. Single cloud generally cannot provide unlimited services with limited physical resources; therefore, the federation of multiple clouds may be one possible solution. In such environment, different cloud providers may own different pricing and resource allocating strategies. Thus, how to select the most appropriate provider to host applications becomes an important issue for clients. However, as the requests of accessing distributed resources increase, the occurrences of competing the same resource may also increase. In this study, a Distributed Resource Allocation (DRA) approach is proposed to solve resource competition in the federated cloud environment. Each job is supposed to consist of one or more tasks, and the communication behavior between tasks could be profiled. The proposed approach groups tasks according to communication behavior to minimize communication overhead, and tries to allocate grouped tasks to achieve equilibrium when resource competition occurs. Experimental results show that the cloud provider could obtain more profits by outsourcing resources in the federated cloud with enough resources.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ghodsi A, Zaharia M, Hindman B, Konwinski A, Shenker S, Stoica I (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI’11). Berkeley, CA, pp 323–336 Ghodsi A, Zaharia M, Hindman B, Konwinski A, Shenker S, Stoica I (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI’11). Berkeley, CA, pp 323–336
2.
Zurück zum Zitat Parkes DC, Procaccia AD, Shah N (2015) Beyond dominant resource fairness: extensions, limitations, and indivisibilities. ACM Trans Econ Comput 3(1):3 (Article No. 3) Parkes DC, Procaccia AD, Shah N (2015) Beyond dominant resource fairness: extensions, limitations, and indivisibilities. ACM Trans Econ Comput 3(1):3 (Article No. 3)
3.
Zurück zum Zitat Erdil DC (2013) Autonomic cloud resource sharing for intercloud federations. Future Gen Comput Syst 29(7):1700–1708CrossRef Erdil DC (2013) Autonomic cloud resource sharing for intercloud federations. Future Gen Comput Syst 29(7):1700–1708CrossRef
4.
Zurück zum Zitat Ye D, Chen J (2013) Non-cooperative games on multidimensional resource allocation. Future Gen Comput Syst 29(6):1345–1352MathSciNetCrossRef Ye D, Chen J (2013) Non-cooperative games on multidimensional resource allocation. Future Gen Comput Syst 29(6):1345–1352MathSciNetCrossRef
5.
Zurück zum Zitat Li D, Chen C, Guan J, Zhang Y, Zhu J, Ruozhou Y (2016) DCloud: Deadline-Aware Resource Allocation for Cloud Computing Jobs. IEEE Trans Parallel Distrib Syst 27(8):2248–2260CrossRef Li D, Chen C, Guan J, Zhang Y, Zhu J, Ruozhou Y (2016) DCloud: Deadline-Aware Resource Allocation for Cloud Computing Jobs. IEEE Trans Parallel Distrib Syst 27(8):2248–2260CrossRef
7.
Zurück zum Zitat Han Z, Chu R, Mi H, Wang H (2014) Elastic Allocator: An Adaptive Task Scheduler for Streaming Query in the Cloud. In: Proceedings of IEEE 8th International Symposium on Service Oriented System Engineering, pp 284–289 Han Z, Chu R, Mi H, Wang H (2014) Elastic Allocator: An Adaptive Task Scheduler for Streaming Query in the Cloud. In: Proceedings of IEEE 8th International Symposium on Service Oriented System Engineering, pp 284–289
8.
Zurück zum Zitat Hussain H et al (2013) A survey on resource allocation in high performance distributed computing systems. Parallel Comput 39(11):709–736MathSciNetCrossRef Hussain H et al (2013) A survey on resource allocation in high performance distributed computing systems. Parallel Comput 39(11):709–736MathSciNetCrossRef
9.
Zurück zum Zitat Lucas-Simarro JL, Moreno-Vozmediano R, Montero RS, Llorente IM (2013) Scheduling strategies for optimal service deployment across multiple clouds. Future Gen Comput Syst 29(6):1431–1441CrossRef Lucas-Simarro JL, Moreno-Vozmediano R, Montero RS, Llorente IM (2013) Scheduling strategies for optimal service deployment across multiple clouds. Future Gen Comput Syst 29(6):1431–1441CrossRef
10.
Zurück zum Zitat Hassan M, Song B, Huh EN (2011) Game-based distributed resource allocation in horizontal dynamic cloud federation platform. In: Xiang Y, Cuzzocrea A, Hobbs M, Zhou W (eds) Algorithms and Architectures for Parallel Processing, vol 7016., Lecture Notes in Computer ScienceSpringer, New York, pp 194–205CrossRef Hassan M, Song B, Huh EN (2011) Game-based distributed resource allocation in horizontal dynamic cloud federation platform. In: Xiang Y, Cuzzocrea A, Hobbs M, Zhou W (eds) Algorithms and Architectures for Parallel Processing, vol 7016., Lecture Notes in Computer ScienceSpringer, New York, pp 194–205CrossRef
11.
Zurück zum Zitat Malik S, Huet F, Caromel D (2012) Latency based Dynamic Grouping aware Cloud Scheduling. In: Proceedings of 26th International Conference on Advanced Information Networking and Applications Workshops, pp 1190–1195 Malik S, Huet F, Caromel D (2012) Latency based Dynamic Grouping aware Cloud Scheduling. In: Proceedings of 26th International Conference on Advanced Information Networking and Applications Workshops, pp 1190–1195
13.
Zurück zum Zitat Mell P, Grance T (2011) The NIST Definition of Cloud Computing. NIST Special Publication, USA, pp 800–145 Mell P, Grance T (2011) The NIST Definition of Cloud Computing. NIST Special Publication, USA, pp 800–145
14.
Zurück zum Zitat Wooldridge M (2012) Does Game Theory Work? IEEE Intell Syst 27:76–80CrossRef Wooldridge M (2012) Does Game Theory Work? IEEE Intell Syst 27:76–80CrossRef
15.
Zurück zum Zitat Moreno-Vozmediano R, Montero RS, Llorente IM (2012) IaaS Cloud Architecture: From Virtualized Datacenters to Federated Cloud Infrastructures. IEEE Comput 45(12):65–72CrossRef Moreno-Vozmediano R, Montero RS, Llorente IM (2012) IaaS Cloud Architecture: From Virtualized Datacenters to Federated Cloud Infrastructures. IEEE Comput 45(12):65–72CrossRef
16.
Zurück zum Zitat Murugesan S (2013) Cloud computing: the new normal? IEEE Comput 46(1):77–79CrossRef Murugesan S (2013) Cloud computing: the new normal? IEEE Comput 46(1):77–79CrossRef
17.
Zurück zum Zitat Palmieri F, Buonanno L, Venticinque S, Aversa R, Martino BD (2013) A distributed scheduling framework based on selfish autonomous agents for federated cloud environments. Future Gen Comput Syst 29(6):1461–1472CrossRef Palmieri F, Buonanno L, Venticinque S, Aversa R, Martino BD (2013) A distributed scheduling framework based on selfish autonomous agents for federated cloud environments. Future Gen Comput Syst 29(6):1461–1472CrossRef
18.
Zurück zum Zitat Trent Robert J, Monczka Robert M (2003) Cost-driven pricing: an innovative approach for managing supply chain costs. Supply Chain Forum 4(1):2–10 Trent Robert J, Monczka Robert M (2003) Cost-driven pricing: an innovative approach for managing supply chain costs. Supply Chain Forum 4(1):2–10
19.
Zurück zum Zitat Calheiros RN, Toosi AN, Vecchiola C, Buyya R (2012) A Coordinator for Scaling Elastic Applications across Multiple Clouds. Future Gen Comput Syst 28(8):1350–1362CrossRef Calheiros RN, Toosi AN, Vecchiola C, Buyya R (2012) A Coordinator for Scaling Elastic Applications across Multiple Clouds. Future Gen Comput Syst 28(8):1350–1362CrossRef
20.
Zurück zum Zitat Sedaghat M, Hernandez-Rodriguez F, Elmroth E (2013) A virtual machine re-packing approach to the horizontal vs. vertical elasticity trade-off for cloud autoscaling. In: Proceedings of the 2013 ACM Cloud and Autonomic Computing (Article No. 6) Sedaghat M, Hernandez-Rodriguez F, Elmroth E (2013) A virtual machine re-packing approach to the horizontal vs. vertical elasticity trade-off for cloud autoscaling. In: Proceedings of the 2013 ACM Cloud and Autonomic Computing (Article No. 6)
21.
Zurück zum Zitat Liu S, Ren K, Deng K, Song J (2016) A dynamic resource allocation and task scheduling strategy with uncertain task runtime on IaaS clouds. In: Sixth International Conference on Information Science and Technology (ICIST) Liu S, Ren K, Deng K, Song J (2016) A dynamic resource allocation and task scheduling strategy with uncertain task runtime on IaaS clouds. In: Sixth International Conference on Information Science and Technology (ICIST)
22.
Zurück zum Zitat Malik S, Huet F, Caromel D (2012) Latency based Dynamic Grouping aware Cloud Scheduling. In: 26th International Conference on Advanced Information Networking and Applications Workshops, pp 1190–1195 Malik S, Huet F, Caromel D (2012) Latency based Dynamic Grouping aware Cloud Scheduling. In: 26th International Conference on Advanced Information Networking and Applications Workshops, pp 1190–1195
23.
Zurück zum Zitat Shie MR, Liu CY, Lee YF, Lin YC, Lai KC (2014) Distributed Scheduling Approach Based on Game Theory in the Federated Cloud. In: IEEE Proceedings of 2014 International Conference on Information Science & Applications (ICISA), pp 1–4 Shie MR, Liu CY, Lee YF, Lin YC, Lai KC (2014) Distributed Scheduling Approach Based on Game Theory in the Federated Cloud. In: IEEE Proceedings of 2014 International Conference on Information Science & Applications (ICISA), pp 1–4
24.
Zurück zum Zitat Lan T, Kao D, Chiang M, Sabharwal A (2010) An axiomatic theory of fairness in network resource allocation. In: Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE INFOCOM ’10), pp 1–9 Lan T, Kao D, Chiang M, Sabharwal A (2010) An axiomatic theory of fairness in network resource allocation. In: Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE INFOCOM ’10), pp 1–9
25.
Zurück zum Zitat Wei X, Li H, Yang K, Zou L (2014) Topology-aware Partial Virtual Cluster Mapping Algorithm on Shared Distributed Infrastructures. IEEE Trans Parallel Distrib Syst 25(10):2721–2730CrossRef Wei X, Li H, Yang K, Zou L (2014) Topology-aware Partial Virtual Cluster Mapping Algorithm on Shared Distributed Infrastructures. IEEE Trans Parallel Distrib Syst 25(10):2721–2730CrossRef
26.
Zurück zum Zitat Chung WC, Shih PC, Lai KC, Li KC, Lee CR, Chou J, Hsu CH, Chung YC (2014) Taiwan UniCloud: A Cloud Testbed with Collaborative Cloud Services. In: IEEE International Conference on Cloud Engineering (IC2E). Boston Chung WC, Shih PC, Lai KC, Li KC, Lee CR, Chou J, Hsu CH, Chung YC (2014) Taiwan UniCloud: A Cloud Testbed with Collaborative Cloud Services. In: IEEE International Conference on Cloud Engineering (IC2E). Boston
27.
Zurück zum Zitat Mao Z, Yang J, Shang Y, Liu C, Chen J (2013) A game theory of cloud service deployment. In: IEEE World Congress on Services (SERVICES), pp 436–443 Mao Z, Yang J, Shang Y, Liu C, Chen J (2013) A game theory of cloud service deployment. In: IEEE World Congress on Services (SERVICES), pp 436–443
Metadaten
Titel
Distributed resource allocation in federated clouds
verfasst von
Yi-Hsuan Lee
Kuo-Chan Huang
Meng-Ru Shieh
Kuan-Chou Lai
Publikationsdatum
12.11.2016
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 7/2017
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-016-1918-1

Weitere Artikel der Ausgabe 7/2017

The Journal of Supercomputing 7/2017 Zur Ausgabe