nach oben

The Journal of Supercomputing

Erschienen in:

18.01.2016

Resource stealing: a resource multiplexing method for mix workloads in cloud system

verfasst von: Yusong Tan, Fuhui Wu, Qingbo Wu, Xiangke Liao

Erschienen in: The Journal of Supercomputing | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The cloud computing paradigm enables providing resources on demand. However, most of them focus on a single type of application requiring separate quality of service. In the context that mix heterogeneous workloads are co-scheduled in the cloud, resource multiplexing is the key to improve resource utilization under premise of performance guaranteing. In this paper, we propose a resource stealing mechanism to improve resource multiplexing of cloud resources. It enables free resource fragments reserved by some workloads being utilized by others. To meet certain service level agreement, resource preemption is adopted as a complement to resource stealing. It ensures each workload with a minimum amount of resources when required. Moreover, we propose an adaptive joint resource provisioning algorithm. It integrates our resource multiplexing method into elastic resource provisioning. Experimental results reveal that the proposed algorithms improve resource utilization and workload performance simultaneously.

Vorheriger Artikel A lock-aware virtual machine scheduling scheme for synchronization performance

Nächster Artikel Towards a delivery scheme for speedup of data backup in distributed storage systems using erasure codes

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener Comput Syst 25(6):599–616CrossRef

Staples G (2006) TORQUE resource manager. In: Proceedings of the 2006 ACM/IEEE conference on supercomputing. ACM, p 8

Yang XJ, Liao XK, Lu K (2011) The TianHe-1A supercomputer: its hardware and software[J]. J Comput Sci Technol V26(3):344–351CrossRef

Liao XK, Xiao LQ, Yang CQ et al (2014) MilkyWay-2 supercomputer: system and application[J]. Front Comput Sci 8(3):345–356MathSciNetCrossRef

Vavilapalli VK, Murthy AC, Douglas C, Agarwal S, Konar M, Evans R, Baldeschwieler E (2013) Apache hadoop yarn: yet another resource negotiator. In: Proceedings of the 4th annual symposium on cloud computing. ACM, p 5

Hindman B, Konwinski A, Zaharia M, Ghodsi A, Joseph AD, Katz R, Stoica I (2011) Mesos: a platform for fine-grained resource sharing in the data center. In: Proceedings of the 8th USENIX conference on networked systems design and implementation, p 22

Ghribi C, Zeghlache D (2014) Exact and heuristic graph-coloring for energy efficient advance cloud resource reservation. In: Cloud computing (CLOUD), 2014 IEEE 7th international conference on, June 27–July 2 2014, pp 112–119

Isard M, Budiu M, Yu Y, Birrell A, Fetterly D (2007) Dryad: distributed data-parallel programs from sequential building blocks. ACM SIGOPS Oper Syst Rev 41(3):59–72CrossRef

Xu X, Dou W, Zhang X, Chen J (2015) EnReal: an energy-aware resource allocation method for scientific workflow executions in cloud environment. Cloud Comput IEEE Trans (99):1. doi:10.1109/TCC.2015.2453966

10.

Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113CrossRef

11.

Wang WT, Xu L, Gupta I (2015) Scale Up vs. scale out in cloud storage and graph processing systems. In: Cloud engineering (IC2E), 2015 IEEE international conference on, 9–13 March 2015, pp 428-433. doi:10.1109/IC2E.2015.55

12.

Ekanayake J, Li H, Zhang B, Gunarathne T, Bae SH, Qiu J, Fox G (2010) Twister: a runtime for iterative mapreduce. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, pp 810–818

13.

Murray DG, Schwarzkopf M, Smowton C, Smith S, Madhavapeddy A, Hand S (2011) CIEL: a universal execution engine for distributed data-flow computing. NSDI

14.

Yuan XY, Tang HY, Li Y, Jia T, Liu TC, Wu ZH (2015) A competitive penalty model for availability based cloud SLA. In: Cloud computing (CLOUD), 2015 IEEE 8th International Conference on, June 27–July 2 2015, pp 964–970

15.

Liang Z, Sakr S, Liu A (2015) A Framework for consumer-centric sla management of cloud-hosted databases. In: Services computing, IEEE Transactions on, July–Aug 2015, vol 8, no 4, pp 534–549. doi:10.1109/TSC.2013.5

16.

Tootaghaj DZ, Farhat F, Arjomand M, Faraboschi P, Kandemir MT, Sivasubramaniam A, Das CR (2015) Evaluating the combined impact of node architecture and cloud workload characteristics on network traffic and performance/cost. In: Workload characterization (IISWC), 2015 IEEE international symposium on, 4–6 Oct 2015, pp 203–212. doi:10.1109/IISWC.2015.31

17.

Caglar F, Gokhale A (2014) iOverbook: intelligent resource-overbooking to support soft real-time applications in the cloud. In: Cloud computing (CLOUD), 2014 IEEE 7th international conference on, June 27–July 2 2014, pp 538–545. doi:10.1109/CLOUD.2014.78

18.

Ranger C, Raghuraman R, Penmetsa A, Bradski G, Kozyrakis C (2007) Evaluating mapreduce for multi-core and multiprocessor systems. In: High performance computer architecture, 2007. HPCA 2007. IEEE 13th international symposium on. IEEE, pp 13–24

19.

Guo Z, Fox G, Zhou M, Ruan Y (2012) Improving resource utilization in mapreduce. In: Cluster computing (CLUSTER), 2012 IEEE international conference on. IEEE, pp 402–410

20.

Garg SK, Gopalaiyengar SK, Buyya R (2011) SLA-based resource provisioning for heterogeneous workloads in a virtualized cloud datacenter. In: Algorithms and architectures for parallel processing. Springer, Berlin, Heidelberg, pp 371–384

21.

Meng X, Isci C, Kephart J, Zhang L, Bouillet E, Pendarakis D (2010) Efficient resource provisioning in compute clouds via vm multiplexing. In: Proceedings of the 7th international conference on autonomic computing. ACM, pp 11–20

22.

Calheiros RN, Ranjan R, Buyya R (2011) Virtual machine provisioning based on analytical performance and QoS in cloud computing environments. In: Proceedings of the 2011 international conference on parallel processing (ICPP), pp 295–304, 13–16 Sept 2011

Titel: Resource stealing: a resource multiplexing method for mix workloads in cloud system
verfasst von: Yusong Tan
Fuhui Wu
Qingbo Wu
Xiangke Liao
Publikationsdatum: 18.01.2016
Verlag: Springer US
Erschienen in: The Journal of Supercomputing / Ausgabe 1/2019
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-015-1609-3

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 1/2019

A domain-divided configurable security model for cloud computing-based telecommunication services

High-performance architecture for flow-table lookup in SDN on FPGA

CHAOS: a parallelization scheme for training convolutional neural networks on Intel Xeon Phi

Toward holistic performance management in clouds: taxonomy, challenges and opportunities

A pattern-based outlier region detection method for two-dimensional arrays

Towards a delivery scheme for speedup of data backup in distributed storage systems using erasure codes