Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 2/2022

24-07-2021 | Research Article-Computer Engineering and Computer Science

Resource Provisioning Through Machine Learning in Cloud Services

Authors: Mahendra Pratap Yadav, Rohit, Dharmendra Kumar Yadav

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Efficient resource provisioning is one of the important research challenges in cloud computing. Cloud providers use auto-scaling techniques for resource provisioning to manage the fluctuating workload as well as SLA violations. Auto-scaling is necessary for optimal and efficient resource allocation to manage the workload that will reduce power consumption and will also guarantee for better quality of service (QoS). It is essential for those services which support rigorous quality of service (QoS) requirements such as minimum response time or maximum throughput. Cloud providers implement service elasticity through auto-scaling mechanisms. This paper uses a novel prediction technique for resource provisioning through the auto-scaling mechanism. The prediction is done using time series data analytics with the help of the deep learning technique (i.e., LSTM). The predictive resource provisioning technique will predict the traffic load over the server and then estimates the required number of computing resources. The estimated computing resources are provisioned through the queuing theory so that it optimizes the response time and satisfies the SLA contract between the end-user and provider. The optimal resource provisioning will also reduce the consumption of computing resources while attenuating resource over-provisioning minimizes energy consumption and reduces the infrastructure’s operating costs. The experimental results show that the workload prediction through LSTM obtains better accuracy than other traditional models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ellman, J.; Lee, N.; Jin, N.: Cloud computing deployment: a cost-modelling case-study. Wireless Networks 1–8 (2018) Ellman, J.; Lee, N.; Jin, N.: Cloud computing deployment: a cost-modelling case-study. Wireless Networks 1–8 (2018)
2.
go back to reference K. Li: Quantitative modeling and analytical calculation of elasticity in cloud computing, IEEE Transactions on Cloud Computing K. Li: Quantitative modeling and analytical calculation of elasticity in cloud computing, IEEE Transactions on Cloud Computing
3.
go back to reference Al-Dhuraibi, Y.; Paraiso, F.; Djarallah, N.; Merle, P.: Elasticity in cloud computing: state of the art and research challenges. IEEE Trans. Serv. Comput. 11(2), 430–447 (2017)CrossRef Al-Dhuraibi, Y.; Paraiso, F.; Djarallah, N.; Merle, P.: Elasticity in cloud computing: state of the art and research challenges. IEEE Trans. Serv. Comput. 11(2), 430–447 (2017)CrossRef
4.
go back to reference Coutinho, E.F.; de Carvalho Sousa, F.R.; Rego, P.A.L.; Gomes, D.G.; de Souza, J.N.: Elasticity in cloud computing: a survey. Annals Telecommun-Annales des Télécommun 70(7–8), 289–309 (2015)CrossRef Coutinho, E.F.; de Carvalho Sousa, F.R.; Rego, P.A.L.; Gomes, D.G.; de Souza, J.N.: Elasticity in cloud computing: a survey. Annals Telecommun-Annales des Télécommun 70(7–8), 289–309 (2015)CrossRef
5.
go back to reference Singh, P.; Gupta, P.; Jyoti, K.; Nayyar, A.: Research on auto-scaling of web applications in cloud: survey, trends and future directions. Scalable Comput: Practice Experience 20(2), 399–432 (2019) Singh, P.; Gupta, P.; Jyoti, K.; Nayyar, A.: Research on auto-scaling of web applications in cloud: survey, trends and future directions. Scalable Comput: Practice Experience 20(2), 399–432 (2019)
6.
go back to reference Moreno-Vozmediano, R.; Montero, R.S.; Huedo, E.; Llorente, I.M.: Efficient resource provisioning for elastic cloud services based on machine learning techniques. J Cloud Comput 8(1), 5 (2019)CrossRef Moreno-Vozmediano, R.; Montero, R.S.; Huedo, E.; Llorente, I.M.: Efficient resource provisioning for elastic cloud services based on machine learning techniques. J Cloud Comput 8(1), 5 (2019)CrossRef
7.
go back to reference Nawrocki, P.; Grzywacz, M.; Sniezynski, B.: Adaptive resource planning for cloud-based services using machine learning. J Parallel Distributed Comput 152, 88–97 (2021)CrossRef Nawrocki, P.; Grzywacz, M.; Sniezynski, B.: Adaptive resource planning for cloud-based services using machine learning. J Parallel Distributed Comput 152, 88–97 (2021)CrossRef
8.
go back to reference Osypanka, P.; Nawrocki, P.: Resource usage cost optimization in cloud computing using machine learning, IEEE Transactions on Cloud Computing Osypanka, P.; Nawrocki, P.: Resource usage cost optimization in cloud computing using machine learning, IEEE Transactions on Cloud Computing
9.
go back to reference Sniezynski, B.; Nawrocki, P.; Wilk, M.; Jarzab, M.; Zielinski, K.: Vm reservation plan adaptation using machine learning in cloud computing. J Grid Comput 17(4), 797–812 (2019)CrossRef Sniezynski, B.; Nawrocki, P.; Wilk, M.; Jarzab, M.; Zielinski, K.: Vm reservation plan adaptation using machine learning in cloud computing. J Grid Comput 17(4), 797–812 (2019)CrossRef
10.
go back to reference Kumar, J.; Singh, A.K.: Workload prediction in cloud using artificial neural network and adaptive differential evolution. Future Gener Comput Syst 81, 41–52 (2018)CrossRef Kumar, J.; Singh, A.K.: Workload prediction in cloud using artificial neural network and adaptive differential evolution. Future Gener Comput Syst 81, 41–52 (2018)CrossRef
11.
go back to reference Bankole, A. A.; Ajila, S. A.: Predicting cloud resource provisioning using machine learning techniques, in: 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), IEEE, pp. 1–4 (2013) Bankole, A. A.; Ajila, S. A.: Predicting cloud resource provisioning using machine learning techniques, in: 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), IEEE, pp. 1–4 (2013)
12.
go back to reference Ghosh, P.; Song, J.; Aksan, E.; Hilliges, O.: Learning human motion models for long-term predictions, in: 2017 International Conference on 3D Vision (3DV), IEEE, pp. 458–466 (2017) Ghosh, P.; Song, J.; Aksan, E.; Hilliges, O.: Learning human motion models for long-term predictions, in: 2017 International Conference on 3D Vision (3DV), IEEE, pp. 458–466 (2017)
13.
go back to reference Nelson, D.M., Pereira, A.C., de Oliveira, R.A., Stock market’s price movement prediction with lstm neural networks. International joint conference on neural networks (IJCNN). IEEE 2017, 1419–1426 (2017) Nelson, D.M., Pereira, A.C., de Oliveira, R.A., Stock market’s price movement prediction with lstm neural networks. International joint conference on neural networks (IJCNN). IEEE 2017, 1419–1426 (2017)
14.
go back to reference Vilaplana Mayoral, J.; Solsona Tehàs, F.; Teixidó Torrelles, I.; Mateo, J.; Abella i Pons, F.; Rius, J.: A queuing theory model for cloud computing. Journal of Supercomputing 69(1): 492–507 (2014) Vilaplana Mayoral, J.; Solsona Tehàs, F.; Teixidó Torrelles, I.; Mateo, J.; Abella i Pons, F.; Rius, J.: A queuing theory model for cloud computing. Journal of Supercomputing 69(1): 492–507 (2014)
16.
go back to reference Jiang, J.; Lu, J.; Zhang, G.; Long, G.; Optimal cloud resource auto-scaling for web applications. In: 13th IEEE/ACM International Symposium on Cluster. Cloud, and Grid Computing, IEEE 2013, 58–65 (2013) Jiang, J.; Lu, J.; Zhang, G.; Long, G.; Optimal cloud resource auto-scaling for web applications. In: 13th IEEE/ACM International Symposium on Cluster. Cloud, and Grid Computing, IEEE 2013, 58–65 (2013)
17.
go back to reference Messias, V.R.; Estrella, J.C.; Ehlers, R.; Santana, M.J.; Santana, R.C.; Reiff-Marganiec, S.: Combining time series prediction models using genetic algorithm to autoscaling web applications hosted in the cloud infrastructure. Neural Comput. Appl. 27(8), 2383–2406 (2016)CrossRef Messias, V.R.; Estrella, J.C.; Ehlers, R.; Santana, M.J.; Santana, R.C.; Reiff-Marganiec, S.: Combining time series prediction models using genetic algorithm to autoscaling web applications hosted in the cloud infrastructure. Neural Comput. Appl. 27(8), 2383–2406 (2016)CrossRef
18.
go back to reference Hasan, M.Z., Magana, E., Clemm, A., Tucker, L., Gudreddi, S.L.D., Integrated and autonomic cloud resource scaling. IEEE network operations and management symposium. IEEE 2012, 1327–1334 (2012) Hasan, M.Z., Magana, E., Clemm, A., Tucker, L., Gudreddi, S.L.D., Integrated and autonomic cloud resource scaling. IEEE network operations and management symposium. IEEE 2012, 1327–1334 (2012)
19.
go back to reference Lim, H. C.; Babu, S.; Chase, J. S.; Parekh, S. S.: Automated control in cloud computing: challenges and opportunities, in: Proceedings of the 1st workshop on Automated control for datacenters and clouds, pp. 13–18 (2009) Lim, H. C.; Babu, S.; Chase, J. S.; Parekh, S. S.: Automated control in cloud computing: challenges and opportunities, in: Proceedings of the 1st workshop on Automated control for datacenters and clouds, pp. 13–18 (2009)
20.
go back to reference Padala, P.; Hou, K.-Y.; Shin, K. G.; Zhu, X.; Uysal, M.; Wang, Z.; Singhal, S.; Merchant, A.: Automated control of multiple virtualized resources, in: Proceedings of the 4th ACM European conference on Computer systems, pp. 13–26 (2009) Padala, P.; Hou, K.-Y.; Shin, K. G.; Zhu, X.; Uysal, M.; Wang, Z.; Singhal, S.; Merchant, A.: Automated control of multiple virtualized resources, in: Proceedings of the 4th ACM European conference on Computer systems, pp. 13–26 (2009)
21.
go back to reference Roy, N.; Dubey, A.; Gokhale, A.: Efficient autoscaling in the cloud using predictive models for workload forecasting, in: 2011 IEEE 4th International Conference on Cloud Computing, IEEE, pp. 500–507 (2011) Roy, N.; Dubey, A.; Gokhale, A.: Efficient autoscaling in the cloud using predictive models for workload forecasting, in: 2011 IEEE 4th International Conference on Cloud Computing, IEEE, pp. 500–507 (2011)
22.
go back to reference Dutreilh, X.; Kirgizov, S.; Melekhova, O.; Malenfant, J.; Rivierre, N.; Truck, I.: Using reinforcement learning for autonomic resource allocation in clouds: towards a fully automated workflow, in: ICAS 2011, The Seventh International Conference on Autonomic and Autonomous Systems, pp. 67–74 (2011) Dutreilh, X.; Kirgizov, S.; Melekhova, O.; Malenfant, J.; Rivierre, N.; Truck, I.: Using reinforcement learning for autonomic resource allocation in clouds: towards a fully automated workflow, in: ICAS 2011, The Seventh International Conference on Autonomic and Autonomous Systems, pp. 67–74 (2011)
23.
go back to reference Tesauro, G.; Jong, N. K.; Das, R.; Bennani, M. N.: A hybrid reinforcement learning approach to autonomic resource allocation, in: 2006 IEEE International Conference on Autonomic Computing, IEEE, pp. 65–73 (2006) Tesauro, G.; Jong, N. K.; Das, R.; Bennani, M. N.: A hybrid reinforcement learning approach to autonomic resource allocation, in: 2006 IEEE International Conference on Autonomic Computing, IEEE, pp. 65–73 (2006)
24.
go back to reference Duggan, J.; Howley, E.; Barrett, E.: Applying reinforcement learning towards automating resource allocation and application scalability in the cloud, Concurrency And Computation: Practice And Experience (To Appear) Duggan, J.; Howley, E.; Barrett, E.: Applying reinforcement learning towards automating resource allocation and application scalability in the cloud, Concurrency And Computation: Practice And Experience (To Appear)
25.
go back to reference Carincotte, C.; Derrode, S.; Bourennane, S.: Unsupervised change detection on sar images using fuzzy hidden markov chains. IEEE Trans. Geosci. Remote Sens. 44(2), 432–441 (2006)CrossRef Carincotte, C.; Derrode, S.; Bourennane, S.: Unsupervised change detection on sar images using fuzzy hidden markov chains. IEEE Trans. Geosci. Remote Sens. 44(2), 432–441 (2006)CrossRef
26.
go back to reference Kaur, P.D.; Chana, I.: A resource elasticity framework for qos-aware execution of cloud applications. Future Gener. Comput. Syst. 37, 14–25 (2014)CrossRef Kaur, P.D.; Chana, I.: A resource elasticity framework for qos-aware execution of cloud applications. Future Gener. Comput. Syst. 37, 14–25 (2014)CrossRef
27.
go back to reference Nakano, K.; Olariu, S.: Uniform leader election protocols for radio networks. IEEE Trans. Parallel Distrib. Syst. 13(5), 516–526 (2002)CrossRef Nakano, K.; Olariu, S.: Uniform leader election protocols for radio networks. IEEE Trans. Parallel Distrib. Syst. 13(5), 516–526 (2002)CrossRef
28.
go back to reference Pai, P.-F.; Lin, C.-S.: A hybrid arima and support vector machines model in stock price forecasting. Omega 33(6), 497–505 (2005)CrossRef Pai, P.-F.; Lin, C.-S.: A hybrid arima and support vector machines model in stock price forecasting. Omega 33(6), 497–505 (2005)CrossRef
29.
go back to reference Yao, X.; Liu, Y.: A new evolutionary system for evolving artificial neural networks. IEEE Trans. Neural Netw. 8(3), 694–713 (1997)CrossRef Yao, X.; Liu, Y.: A new evolutionary system for evolving artificial neural networks. IEEE Trans. Neural Netw. 8(3), 694–713 (1997)CrossRef
30.
go back to reference Kavousi-Fard, A.; Samet, H.; Marzbani, F.: A new hybrid modified firefly algorithm and support vector regression model for accurate short term load forecasting. Expert Syst. Appl. 41(13), 6047–6056 (2014)CrossRef Kavousi-Fard, A.; Samet, H.; Marzbani, F.: A new hybrid modified firefly algorithm and support vector regression model for accurate short term load forecasting. Expert Syst. Appl. 41(13), 6047–6056 (2014)CrossRef
31.
go back to reference Han, S.; Qubo, C.; Meng, H.: Parameter selection in svm with rbf kernel function, in: World Automation Congress 2012, IEEE, pp. 1–4 (2012) Han, S.; Qubo, C.; Meng, H.: Parameter selection in svm with rbf kernel function, in: World Automation Congress 2012, IEEE, pp. 1–4 (2012)
32.
go back to reference Sherstinsky, A.: Fundamentals of recurrent neural network (rnn) and long short-term memory (lstm) network. Phys. D 404, 132306 (2020)MathSciNetCrossRef Sherstinsky, A.: Fundamentals of recurrent neural network (rnn) and long short-term memory (lstm) network. Phys. D 404, 132306 (2020)MathSciNetCrossRef
33.
go back to reference Liu, H.; Mi, X.; Li, Y.: Smart multi-step deep learning model for wind speed forecasting based on variational mode decomposition, singular spectrum analysis, lstm network and elm. Energy Convers. Manage. 159, 54–64 (2018)CrossRef Liu, H.; Mi, X.; Li, Y.: Smart multi-step deep learning model for wind speed forecasting based on variational mode decomposition, singular spectrum analysis, lstm network and elm. Energy Convers. Manage. 159, 54–64 (2018)CrossRef
34.
go back to reference Mohammadi, M.; Jolai, F.; Rostami, H.: An m/m/c queue model for hub covering location problem. Math. Comput. Modell. 54(11–12), 2623–2638 (2011)MathSciNetCrossRef Mohammadi, M.; Jolai, F.; Rostami, H.: An m/m/c queue model for hub covering location problem. Math. Comput. Modell. 54(11–12), 2623–2638 (2011)MathSciNetCrossRef
35.
go back to reference Tian, N.; Li, Q.-L.; Gao, J.: Conditional stochastic decompositions in the m/m/c queue with server vacations. Stochastic Models 15(2), 367–377 (1999)MathSciNetCrossRef Tian, N.; Li, Q.-L.; Gao, J.: Conditional stochastic decompositions in the m/m/c queue with server vacations. Stochastic Models 15(2), 367–377 (1999)MathSciNetCrossRef
Metadata
Title
Resource Provisioning Through Machine Learning in Cloud Services
Authors
Mahendra Pratap Yadav
Rohit
Dharmendra Kumar Yadav
Publication date
24-07-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05864-5

Other articles of this Issue 2/2022

Arabian Journal for Science and Engineering 2/2022 Go to the issue

Research Article-Computer Engineering and Computer Science

Distance Estimation from a Monocular Camera Using Face and Body Features

Research Article-Computer Engineering and Computer Science

Federated Learning: Sum Power Constraints Optimization Design

Research Article-Computer Engineering and Computer Science

High Occupancy Itemset Mining with Consideration of Transaction Occupancy

Premium Partners