Skip to main content

2017 | OriginalPaper | Buchkapitel

A QoS-Aware Resource Allocation Controller for Function as a Service (FaaS) Platform

verfasst von : MohammadReza HoseinyFarahabady, Young Choon Lee, Albert Y. Zomaya, Zahir Tari

Erschienen in: Service-Oriented Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Function as a Service (FaaS) is a recent event-driven serverless paradigm that allows enterprises to build their applications in a fault tolerant distributed manner. Having been considered as an attractive replacement of traditional Service Oriented Architecture (SOA), the FaaS platform leverages the management of massive data sets or the handling of event streams. However, the realization of such leverage is largely dependent on the effective exploitation of FaaS elasticity/scalability.
In this paper, we present a closed-loop resource allocation controller to dynamically scale resources by predicting the future rate of incoming events and by considering the Quality of Service (QoS) enforcements requested by end-users. The performance evaluation is carried out by comparing the proposed controller with some well-known heuristics such as round robin and best-effort strategies. Experimental results confirm that the proposed controller increases the overall resource utilization by 21% on average, while reducing QoS violations by a factor of almost 3.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Cheng, Z., Caverlee, J., Lee, K., Sui, D.: Exploring millions of footprints in location sharing services. In: International Conference on Weblogs & Social, pp. 81–88. AAAI (2011) Cheng, Z., Caverlee, J., Lee, K., Sui, D.: Exploring millions of footprints in location sharing services. In: International Conference on Weblogs & Social, pp. 81–88. AAAI (2011)
3.
Zurück zum Zitat De Matteis, T., Mencagli, G.: Proactive elasticity and energy awareness in data stream processing. J. Syst. Softw. 127(C), 302–319 (2017)CrossRef De Matteis, T., Mencagli, G.: Proactive elasticity and energy awareness in data stream processing. J. Syst. Softw. 127(C), 302–319 (2017)CrossRef
4.
Zurück zum Zitat De Matteis, T., Mencagli, G.: Keep calm & react with foresight: strategies for low-latency & energy-efficient elastic data stream processing. In: SIGPLAN Principles & Practice of Parallel Programming, pp. 13:1–13:12. ACM (2016) De Matteis, T., Mencagli, G.: Keep calm & react with foresight: strategies for low-latency & energy-efficient elastic data stream processing. In: SIGPLAN Principles & Practice of Parallel Programming, pp. 13:1–13:12. ACM (2016)
5.
Zurück zum Zitat Ebrahimi, E., Lee, C.J., Mutlu, O., Patt, Y.N.: Prefetch-aware shared resource management for multi-core systems. In: International Symposium on Computer Architecture, ISCA 2011, vol. 39, pp. 141–152. ACM (2011) Ebrahimi, E., Lee, C.J., Mutlu, O., Patt, Y.N.: Prefetch-aware shared resource management for multi-core systems. In: International Symposium on Computer Architecture, ISCA 2011, vol. 39, pp. 141–152. ACM (2011)
6.
Zurück zum Zitat Faison, T.: Event-Based Programming: Taking Events to the Limit. Apress, Berkely (2006)MATH Faison, T.: Event-Based Programming: Taking Events to the Limit. Apress, Berkely (2006)MATH
7.
Zurück zum Zitat Ferdman, M., Adileh, A., Kocberber, O., Volos, S., Alisafaee, M., Jevdjic, D., Kaynak, C., et al.: Clearing the clouds: a study of emerging scale-out workloads on modern hardware. SIGPLAN Not. 47(4), 37–48 (2012) Ferdman, M., Adileh, A., Kocberber, O., Volos, S., Alisafaee, M., Jevdjic, D., Kaynak, C., et al.: Clearing the clouds: a study of emerging scale-out workloads on modern hardware. SIGPLAN Not. 47(4), 37–48 (2012)
8.
Zurück zum Zitat Fernandez, R.C., Migliavacca, M., Kalyvianaki, E., Pietzuch, P.: Integrating scale out & fault tolerance in stream proc. using operator state management. In: SIGMOD Management of Data, pp. 725–736. ACM (2013) Fernandez, R.C., Migliavacca, M., Kalyvianaki, E., Pietzuch, P.: Integrating scale out & fault tolerance in stream proc. using operator state management. In: SIGMOD Management of Data, pp. 725–736. ACM (2013)
9.
Zurück zum Zitat Gabor, R., Mendelson, A., Weiss, S.: Service level agreement for multithreaded processors. ACM Trans. Archit. Code Optim. 6(2), 1–33 (2009)CrossRef Gabor, R., Mendelson, A., Weiss, S.: Service level agreement for multithreaded processors. ACM Trans. Archit. Code Optim. 6(2), 1–33 (2009)CrossRef
10.
Zurück zum Zitat Gabor, R., Weiss, S., Mendelson, A.: Fairness enforcement in switch on event multithreading. ACM Trans. Archit. Code Optim. 4(3), 34 (2007)CrossRef Gabor, R., Weiss, S., Mendelson, A.: Fairness enforcement in switch on event multithreading. ACM Trans. Archit. Code Optim. 4(3), 34 (2007)CrossRef
11.
Zurück zum Zitat Gedik, B., Schneider, S., Hirzel, M., Wu, K.L.: Elastic scaling for data stream processing. IEEE Trans. Parallel Distrib. Syst. 25(6), 1447–1463 (2014)CrossRef Gedik, B., Schneider, S., Hirzel, M., Wu, K.L.: Elastic scaling for data stream processing. IEEE Trans. Parallel Distrib. Syst. 25(6), 1447–1463 (2014)CrossRef
13.
Zurück zum Zitat Grewal, M.S., Andrews, A.P.: Kalman Filtering: Theory and Practice with MATLAB, 4th edn. Wiley-IEEE Press (2014) Grewal, M.S., Andrews, A.P.: Kalman Filtering: Theory and Practice with MATLAB, 4th edn. Wiley-IEEE Press (2014)
15.
Zurück zum Zitat Hoseinyfarahabady, M., Lee, Y.C., Zomaya, A., Tari, Z., Song, A.: A model predictive controller for contention-aware resource allocation in virtualized data centers. In: Symposium on Modeling, Analysis & Simulation of Computer & Telecommunication Systems (MASCOTS 2016), pp. 277–282. IEEE, London (2016) Hoseinyfarahabady, M., Lee, Y.C., Zomaya, A., Tari, Z., Song, A.: A model predictive controller for contention-aware resource allocation in virtualized data centers. In: Symposium on Modeling, Analysis & Simulation of Computer & Telecommunication Systems (MASCOTS 2016), pp. 277–282. IEEE, London (2016)
16.
Zurück zum Zitat Hoseinyfarahabady, M., Taheri, J., Tari, Z., Zomaya, A.: A dynamic resource controller for a lambda architecture. In: 46th International Conference on Parallel Processing (ICPP). IEEE, Bristol (2017) Hoseinyfarahabady, M., Taheri, J., Tari, Z., Zomaya, A.: A dynamic resource controller for a lambda architecture. In: 46th International Conference on Parallel Processing (ICPP). IEEE, Bristol (2017)
20.
Zurück zum Zitat Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Neural Networks, vol. 4, pp. 1942–1948. IEEE, November 1995 Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Neural Networks, vol. 4, pp. 1942–1948. IEEE, November 1995
21.
Zurück zum Zitat Kusic, D., Kephart, J.O., Hanson, J.E., Kandasamy, N., Jiang, G.: Power & performance management of virtualized computing environments via lookahead control. Cluster Comput. 12(1), 1–15 (2009)CrossRef Kusic, D., Kephart, J.O., Hanson, J.E., Kandasamy, N., Jiang, G.: Power & performance management of virtualized computing environments via lookahead control. Cluster Comput. 12(1), 1–15 (2009)CrossRef
23.
Zurück zum Zitat Mutlu, O., Moscibroda, T.: Stall-time fair memory access scheduling for chip multiprocessors. In: Symposium on Microarchitecture, pp. 146–160. IEEE/ACM (2007) Mutlu, O., Moscibroda, T.: Stall-time fair memory access scheduling for chip multiprocessors. In: Symposium on Microarchitecture, pp. 146–160. IEEE/ACM (2007)
24.
Zurück zum Zitat Poli, R., Kennedy, J., Blackwell, T.: Particle swarm optimization. Swarm Intell. 1(1), 33–57 (2007)CrossRef Poli, R., Kennedy, J., Blackwell, T.: Particle swarm optimization. Swarm Intell. 1(1), 33–57 (2007)CrossRef
25.
Zurück zum Zitat Rawlings, J.B., Mayne, D.Q.: Model Predictive Control: Theory and Design. Nob Hill, Madison (2009) Rawlings, J.B., Mayne, D.Q.: Model Predictive Control: Theory and Design. Nob Hill, Madison (2009)
26.
Zurück zum Zitat Sbarski, P.: Serverless Architectures on AWS: With examples using AWS Lambda. Manning Publications, Shelter Island (2017) Sbarski, P.: Serverless Architectures on AWS: With examples using AWS Lambda. Manning Publications, Shelter Island (2017)
27.
Zurück zum Zitat Srikantaiah, S., Kansal, A., Zhao, F.: Energy aware consolidation for cloud computing. In: Power Aware Computing and Systems, HotPower 2008, p. 10. USENIX Association (2008) Srikantaiah, S., Kansal, A., Zhao, F.: Energy aware consolidation for cloud computing. In: Power Aware Computing and Systems, HotPower 2008, p. 10. USENIX Association (2008)
28.
Zurück zum Zitat Subramanian, L., Seshadri, V., Ghosh, A., Khan, S., Mutlu, O.: The application slowdown model: Quantifying and controlling the impact of inter-application interference at shared caches and main memory. In: International Symposium on Microarchitecture, pp. 62–75. MICRO-48. ACM (2015) Subramanian, L., Seshadri, V., Ghosh, A., Khan, S., Mutlu, O.: The application slowdown model: Quantifying and controlling the impact of inter-application interference at shared caches and main memory. In: International Symposium on Microarchitecture, pp. 62–75. MICRO-48. ACM (2015)
29.
Zurück zum Zitat Tembey, P., Gavrilovska, A., Schwan, K.: Merlin: application & platform-aware resource allocation in consol. servers. In: SOCC 2014, pp. 1–14 (2014) Tembey, P., Gavrilovska, A., Schwan, K.: Merlin: application & platform-aware resource allocation in consol. servers. In: SOCC 2014, pp. 1–14 (2014)
30.
Zurück zum Zitat Usui, H., Subramanian, L., Chang, K.K.W., Mutlu, O.: Dash: deadline-aware high-performance memory scheduler for heterogeneous systems with hardware accelerators. ACM Trans. Archit. Code Optim. 12(4), 1–28 (2016)CrossRef Usui, H., Subramanian, L., Chang, K.K.W., Mutlu, O.: Dash: deadline-aware high-performance memory scheduler for heterogeneous systems with hardware accelerators. ACM Trans. Archit. Code Optim. 12(4), 1–28 (2016)CrossRef
31.
Zurück zum Zitat Valduriez, P., Soriente, C., Jim, R.: Streamcloud: elastic & scalable data streaming. IEEE Trans. Parallel Distrib. Syst. 23(12), 2351–2365 (2012)CrossRef Valduriez, P., Soriente, C., Jim, R.: Streamcloud: elastic & scalable data streaming. IEEE Trans. Parallel Distrib. Syst. 23(12), 2351–2365 (2012)CrossRef
32.
Zurück zum Zitat Yang, H., Breslow, A., Mars, J., Tang, L.: Bubble-flux: precise online QOS management for increased utilization in warehouse scale computers. SIGARCH Comput. Archit. News 41(3), 607–618 (2013)CrossRef Yang, H., Breslow, A., Mars, J., Tang, L.: Bubble-flux: precise online QOS management for increased utilization in warehouse scale computers. SIGARCH Comput. Archit. News 41(3), 607–618 (2013)CrossRef
33.
Zurück zum Zitat Ye, K., Wu, Z., Wang, C., Zhou, B.B., Si, W., Jiang, X., Zomaya, A.Y.: Profiling-based workload consolidation and migration in virtualized data centers. IEEE Trans. Parallel Distrib. Syst. 26(3), 878–890 (2015)CrossRef Ye, K., Wu, Z., Wang, C., Zhou, B.B., Si, W., Jiang, X., Zomaya, A.Y.: Profiling-based workload consolidation and migration in virtualized data centers. IEEE Trans. Parallel Distrib. Syst. 26(3), 878–890 (2015)CrossRef
Metadaten
Titel
A QoS-Aware Resource Allocation Controller for Function as a Service (FaaS) Platform
verfasst von
MohammadReza HoseinyFarahabady
Young Choon Lee
Albert Y. Zomaya
Zahir Tari
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-69035-3_17

Premium Partner