Skip to main content
Erschienen in: Cluster Computing 4/2019

20.10.2017

No user left behind: dynamic bottleneck-aware allocation of multiple resources

verfasst von: Jun Liu, Chunyan Zhu

Erschienen in: Cluster Computing | Sonderheft 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The fast-developing of cloud computing causes the resource management to the hot and heat research. Some researcher have studied the resource allocation and proposed some resource allocation mechanisms in the cloud computing, such as max–min fairness that is used in the data center. In order to satisfy the demand of cloud computing, we need to design a efficient and fair resource allocation mechanism. Wang et al. (Proceedings of the USENIX Conference on File and Storage Technologies (FAST), 229–242, 2014) proposed a new resource allocation mechanism, called balancing fairness and efficiency with bottleneck-aware allocation (BAA). BAA aims to find the fair between the users and maximize the resource utilization. However, BAA only consider the two resource types and the resource pool may have multiple resource types such as CPU, memory and storage. In addition, BAA consider the static allocation and do not take into account the dynamic allocation of users join the system one by one. To over this drawback, we propose the bottleneck-aware allocation of multiple resources (MRBAA) and dynamic bottleneck-aware allocation (DBBA) fair allocation mechanism. MRBAA and DBBA have lots of good properties. In addition, we characterizes the properties of our proposed mechanisms. Furthermore, our proposed mechanisms achieves the multiple resources fair and dynamic allocation to become more adaptable the real-world scenarios. Compared with the existing popular mechanism dominant resource fairness (DRF) from the literature, the simulation results show that our proposed mechanisms can efficient use of heterogeneous resources, increase multiple resources utilization, and schedule more tasks to benefit users.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Isard, M., Budiu, M., Yu, Y., Birrell, A., Fetterly, D.: Dryad: distributed data-parallel programs from sequential building blocks. Eng. Anal. 32(1), 67–75 (2007) Isard, M., Budiu, M., Yu, Y., Birrell, A., Fetterly, D.: Dryad: distributed data-parallel programs from sequential building blocks. Eng. Anal. 32(1), 67–75 (2007)
3.
Zurück zum Zitat Ghodsi, A., Zaharia, M., Hindman, B., Konwinski, A., Shenker S., Stoica, I.: Dominant resource fairness: fair allocation of multiple resource types. In; Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, NSDI’11, pp. 24, (2011) Ghodsi, A., Zaharia, M., Hindman, B., Konwinski, A., Shenker S., Stoica, I.: Dominant resource fairness: fair allocation of multiple resource types. In; Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, NSDI’11, pp. 24, (2011)
4.
Zurück zum Zitat Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Comput. Sci. 26(2), 467–475 (2004)MathSciNet Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Comput. Sci. 26(2), 467–475 (2004)MathSciNet
5.
Zurück zum Zitat Hindman, B., Konwinski, A., Zahria, M., Ghodis, A., Joseph, A.D., Katz, R., Shenker, S., Stoica, I.: Mesos: a platform for fine-grained resource sharing in the data center. NSDI 2011, 78–87 (2011) Hindman, B., Konwinski, A., Zahria, M., Ghodis, A., Joseph, A.D., Katz, R., Shenker, S., Stoica, I.: Mesos: a platform for fine-grained resource sharing in the data center. NSDI 2011, 78–87 (2011)
6.
Zurück zum Zitat Ghodsi, A., Zaharia, M., Shenker, S., Stoica, I.: Choosy: max–min fair sharing for datacenter jobs with constraints. Comput. Sci. 32(4), 124–135 (2013) Ghodsi, A., Zaharia, M., Shenker, S., Stoica, I.: Choosy: max–min fair sharing for datacenter jobs with constraints. Comput. Sci. 32(4), 124–135 (2013)
7.
Zurück zum Zitat Isard, M., Prabhakaran, V., Currey, J., Wieder, U., Talwar, K., Goldberg, A.: Fair scheduling for distributed computing clusters. Storage Technol. 16(2), 261–276 (2009) Isard, M., Prabhakaran, V., Currey, J., Wieder, U., Talwar, K., Goldberg, A.: Fair scheduling for distributed computing clusters. Storage Technol. 16(2), 261–276 (2009)
8.
Zurück zum Zitat Zaharia, M., Chowdhury, M., Franklin, J., Shenker, S., Stoica, I.S.: Cluster computing with working sets. HotCloud 35(10), 10–16 (2010) Zaharia, M., Chowdhury, M., Franklin, J., Shenker, S., Stoica, I.S.: Cluster computing with working sets. HotCloud 35(10), 10–16 (2010)
9.
Zurück zum Zitat Wang, H., Varman, P.J.: Balancing fairness and efficiency in tiered storage system with bottleneck-aware allocation. In: Proceedings of the USENIX Conference on File and Storage Technologies (FAST), 229–242 (2014) Wang, H., Varman, P.J.: Balancing fairness and efficiency in tiered storage system with bottleneck-aware allocation. In: Proceedings of the USENIX Conference on File and Storage Technologies (FAST), 229–242 (2014)
10.
Zurück zum Zitat Ian, K., Ariel, D.P., Nisarg, S.: No agent left behind: dynamic fair division of multiple resources. J. Artif. Intel. Res. 51(2), 579–603 (2014)MathSciNetMATH Ian, K., Ariel, D.P., Nisarg, S.: No agent left behind: dynamic fair division of multiple resources. J. Artif. Intel. Res. 51(2), 579–603 (2014)MathSciNetMATH
11.
Zurück zum Zitat Danny, D., Dror, G., Feitelson, J.Y., Halpern, R.K., Nathan, L.: No justified complaints: on fair sharing of multiple resources. In: proceedings of the 3rd Innovations in Theoretical Computer Science Conference, 12, pp. 68–75, (2012) Danny, D., Dror, G., Feitelson, J.Y., Halpern, R.K., Nathan, L.: No justified complaints: on fair sharing of multiple resources. In: proceedings of the 3rd Innovations in Theoretical Computer Science Conference, 12, pp. 68–75, (2012)
12.
Zurück zum Zitat Joe, W.C., Sen, S., Lan, T., Chiang, M.: Multi-resource allocation: fairness efficiency tradeoffs in a unifying framework. In: 31st Annual International Conference on Computer Communications (IEEE INFOCOM), 1206–1214 (2012) Joe, W.C., Sen, S., Lan, T., Chiang, M.: Multi-resource allocation: fairness efficiency tradeoffs in a unifying framework. In: 31st Annual International Conference on Computer Communications (IEEE INFOCOM), 1206–1214 (2012)
13.
Zurück zum Zitat Gutman, A., Nisan, N.: Fair allocation without trade. In: International Conference on Autonomous Agents and Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 719–728 (2012) Gutman, A., Nisan, N.: Fair allocation without trade. In: International Conference on Autonomous Agents and Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 719–728 (2012)
14.
Zurück zum Zitat Liu, H., He, B.: Reciprocal resource fairness: towards cooperative multiple-resource fair sharing in IaaS clouds. In: International Conference for High PERFORMANCE Computing, Networking, Storage and Analysis, 970–981 (2014) Liu, H., He, B.: Reciprocal resource fairness: towards cooperative multiple-resource fair sharing in IaaS clouds. In: International Conference for High PERFORMANCE Computing, Networking, Storage and Analysis, 970–981 (2014)
15.
Zurück zum Zitat Liu, H., He, B.: F2C: enabling fair and fine-grained resource sharing in multi-tenant IaaS clouds. IEEE Trans. Parallel Distrib. Syst. 27(9), 2589–2602 (2015)CrossRef Liu, H., He, B.: F2C: enabling fair and fine-grained resource sharing in multi-tenant IaaS clouds. IEEE Trans. Parallel Distrib. Syst. 27(9), 2589–2602 (2015)CrossRef
16.
Zurück zum Zitat Zarchy, D., Hay, D., Schapira, M .:Capturing resource tradeoffs in fair multi-resource allocation. In: IEEE Conference on Computer Communications (INFOCOM), 1062–1070 (2015) Zarchy, D., Hay, D., Schapira, M .:Capturing resource tradeoffs in fair multi-resource allocation. In: IEEE Conference on Computer Communications (INFOCOM), 1062–1070 (2015)
17.
Zurück zum Zitat Parkes, D.C., Procaccia, A.D., Shan, N.: Beyond dominant resource fairness: extensions, limitations, and indivisibilities. ACM Trans. Econ. Comput. 3(1), 3 (2015)MathSciNetCrossRef Parkes, D.C., Procaccia, A.D., Shan, N.: Beyond dominant resource fairness: extensions, limitations, and indivisibilities. ACM Trans. Econ. Comput. 3(1), 3 (2015)MathSciNetCrossRef
18.
Zurück zum Zitat Liu, X., Zhang, X., Zhang, X et al.: Dynamic fair division of multiple resources with satiable agents in cloud computing systems. In: IEEE Fifth International Conference on Big Data and Cloud Computing. IEEE Computer Society, 131–136 (2015) Liu, X., Zhang, X., Zhang, X et al.: Dynamic fair division of multiple resources with satiable agents in cloud computing systems. In: IEEE Fifth International Conference on Big Data and Cloud Computing. IEEE Computer Society, 131–136 (2015)
19.
Zurück zum Zitat Psomas, C-A., Schwartz, J.: Strategyproof allocation of discrete: indivisible resource allocation in clusters. Tech Report Berkeley (2013) Psomas, C-A., Schwartz, J.: Strategyproof allocation of discrete: indivisible resource allocation in clusters. Tech Report Berkeley (2013)
20.
Zurück zum Zitat Friedman, E., Ghodsi, A., Psomas, C-A.: Strategyproof allocation of discrete jobs on multiple machines. In: Proceedings of the Fifteenth ACM Conference on Economics and Computation, 529–546 (2014) Friedman, E., Ghodsi, A., Psomas, C-A.: Strategyproof allocation of discrete jobs on multiple machines. In: Proceedings of the Fifteenth ACM Conference on Economics and Computation, 529–546 (2014)
21.
Zurück zum Zitat Wang, L., Liang, B., Li, B.: Multi-resource fair allocation in heterogeneous cloud computing systems. IEEE Trans. Parallel Distrib. Syst. 26(10), 2822–2835 (2015)CrossRef Wang, L., Liang, B., Li, B.: Multi-resource fair allocation in heterogeneous cloud computing systems. IEEE Trans. Parallel Distrib. Syst. 26(10), 2822–2835 (2015)CrossRef
22.
Zurück zum Zitat Liu, X., Zhang, X., Li, W. et al.: Discrete interior search algorithm for multi-resource fair allocation in heterogeneous cloud computing systems. In: Intelligent Computing Theories and Application. Springer, Berlin (2016) Liu, X., Zhang, X., Li, W. et al.: Discrete interior search algorithm for multi-resource fair allocation in heterogeneous cloud computing systems. In: Intelligent Computing Theories and Application. Springer, Berlin (2016)
23.
Zurück zum Zitat Zhu, Q., Oh, JC.: An approach to dominant resource fairness in distributed environment. In: Proceedings of the 28th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, 141–150 (2015) Zhu, Q., Oh, JC.: An approach to dominant resource fairness in distributed environment. In: Proceedings of the 28th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, 141–150 (2015)
Metadaten
Titel
No user left behind: dynamic bottleneck-aware allocation of multiple resources
verfasst von
Jun Liu
Chunyan Zhu
Publikationsdatum
20.10.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 4/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1245-1

Weitere Artikel der Sonderheft 4/2019

Cluster Computing 4/2019 Zur Ausgabe