Skip to main content
Erschienen in: Wireless Personal Communications 3/2021

03.09.2020

Performance Assessment of Time Series Forecasting Models for Cloud Datacenter Networks’ Workload Prediction

verfasst von: Jitendra Kumar, Ashutosh Kumar Singh

Erschienen in: Wireless Personal Communications | Ausgabe 3/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The resource scaling has been influential in enabling the cloud service providers to provision the resources on-demand effectively. The prior estimation of workloads helps in addressing the scaling issues arises due to dynamic nature of the resource demands. In this paper, we evaluate six different forecasting approaches over real world workload data traces of web and cloud servers. The entire analysis is carried out three times as three different functions are used to measure the deviation in forecasts. The three forecast error measures are root mean squared error, mean absolute error, and mean absolute scaled error. We also carried out a statistical evaluation using Friedman test and Finner post-hoc analysis. The study concludes that the auto ARIMA process outperforms other models and achieves the best rank in the statistical analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sebrechts, M., Van Seghbroeck, G., Wauters, T., Volckaert, B., & De Turck, F. (2018). Orchestrator conversation: Distributed management of cloud applications. International Journal of Network Management, 28(6), e2036.CrossRef Sebrechts, M., Van Seghbroeck, G., Wauters, T., Volckaert, B., & De Turck, F. (2018). Orchestrator conversation: Distributed management of cloud applications. International Journal of Network Management, 28(6), e2036.CrossRef
2.
Zurück zum Zitat Singh, A. K., & Kumar, J. (2019). Secure and energy aware load balancing framework for cloud data centre networks. Electronics Letters, 55(9), 540–541.CrossRef Singh, A. K., & Kumar, J. (2019). Secure and energy aware load balancing framework for cloud data centre networks. Electronics Letters, 55(9), 540–541.CrossRef
3.
Zurück zum Zitat Amiri, M., & Mohammad-Khanli, L. (2017). Survey on prediction models of applications for resources provisioning in cloud. Journal of Network and Computer Applications, 82(Supplement C), 93–113.CrossRef Amiri, M., & Mohammad-Khanli, L. (2017). Survey on prediction models of applications for resources provisioning in cloud. Journal of Network and Computer Applications, 82(Supplement C), 93–113.CrossRef
4.
Zurück zum Zitat Li, T.-H. (2005). A hierarchical framework for modeling and forecasting web server workload. Journal of the American Statistical Association, 100(471), 748–63.MathSciNetCrossRef Li, T.-H. (2005). A hierarchical framework for modeling and forecasting web server workload. Journal of the American Statistical Association, 100(471), 748–63.MathSciNetCrossRef
5.
Zurück zum Zitat Roy, N., Dubey, A., & Gokhale, A. (2011). Efficient autoscaling in the cloud using predictive models for workload forecasting. In 2011 IEEE 4th International Conference on Cloud Computing, pp. 500–507. Roy, N., Dubey, A., & Gokhale, A. (2011). Efficient autoscaling in the cloud using predictive models for workload forecasting. In 2011 IEEE 4th International Conference on Cloud Computing, pp. 500–507.
6.
Zurück zum Zitat Tran, V. G., Debusschere, V., & Bacha, S. (2012). Hourly server workload forecasting up to 168 hours ahead using seasonal arima model. IEEE International Conference on Industrial Technology, 2012, 1127–1131. Tran, V. G., Debusschere, V., & Bacha, S. (2012). Hourly server workload forecasting up to 168 hours ahead using seasonal arima model. IEEE International Conference on Industrial Technology, 2012, 1127–1131.
7.
Zurück zum Zitat Calheiros, R. N., Masoumi, E., Ranjan, R., & Buyya, R. (2015). Workload prediction using arima model and its impact on cloud applications’ qos. IEEE Transactions on Cloud Computing, 3(4), 449–458.CrossRef Calheiros, R. N., Masoumi, E., Ranjan, R., & Buyya, R. (2015). Workload prediction using arima model and its impact on cloud applications’ qos. IEEE Transactions on Cloud Computing, 3(4), 449–458.CrossRef
8.
Zurück zum Zitat Cao, J., Zhu, X., Dong, F., Liu, B., Ma, Z., & Min, H. (2016). Time series based bandwidth allocation strategy in cloud datacenter. International Conference on Advanced Cloud and Big Data (CBD), 2016, 228–233.CrossRef Cao, J., Zhu, X., Dong, F., Liu, B., Ma, Z., & Min, H. (2016). Time series based bandwidth allocation strategy in cloud datacenter. International Conference on Advanced Cloud and Big Data (CBD), 2016, 228–233.CrossRef
9.
Zurück zum Zitat Khan, A., Yan, X., Tao, S., & Anerousis, N. (2012). Workload characterization and prediction in the cloud: A multiple time series approach. IEEE Network Operations and Management Symposium, 2012, 1287–1294. Khan, A., Yan, X., Tao, S., & Anerousis, N. (2012). Workload characterization and prediction in the cloud: A multiple time series approach. IEEE Network Operations and Management Symposium, 2012, 1287–1294.
10.
Zurück zum Zitat Ye, Z., Mistry, S., Bouguettaya, A., & Dong, H. (2016). Long-term qos-aware cloud service composition using multivariate time series analysis. IEEE Transactions on Services Computing, 9(3), 382–393.CrossRef Ye, Z., Mistry, S., Bouguettaya, A., & Dong, H. (2016). Long-term qos-aware cloud service composition using multivariate time series analysis. IEEE Transactions on Services Computing, 9(3), 382–393.CrossRef
11.
Zurück zum Zitat Messias, V. R., Estrella, J. C., Ehlers, R., Santana, M. J., Santana, R. C., & Reiff-Marganiec, S. (2016). Combining time series prediction models using genetic algorithm to autoscaling web applications hosted in the cloud infrastructure. Neural Computing and Applications, 27(8), 2383–2406.CrossRef Messias, V. R., Estrella, J. C., Ehlers, R., Santana, M. J., Santana, R. C., & Reiff-Marganiec, S. (2016). Combining time series prediction models using genetic algorithm to autoscaling web applications hosted in the cloud infrastructure. Neural Computing and Applications, 27(8), 2383–2406.CrossRef
12.
Zurück zum Zitat Liu, C., Liu, C., Shang, Y., Chen, S., Cheng, B., & Chen, J. (2017). An adaptive prediction approach based on workload pattern discrimination in the cloud. Journal of Network and Computer Applications, 80(C), 35–44.CrossRef Liu, C., Liu, C., Shang, Y., Chen, S., Cheng, B., & Chen, J. (2017). An adaptive prediction approach based on workload pattern discrimination in the cloud. Journal of Network and Computer Applications, 80(C), 35–44.CrossRef
13.
Zurück zum Zitat Cetinski, K., & Juric, M. B. (2015). Ame-wpc: Advanced model for efficient workload prediction in the cloud. Journal of Network and Computer Applications, 55, 191–201.CrossRef Cetinski, K., & Juric, M. B. (2015). Ame-wpc: Advanced model for efficient workload prediction in the cloud. Journal of Network and Computer Applications, 55, 191–201.CrossRef
14.
Zurück zum Zitat Rahman, Z.U., Hussain, O.K., & Hussain, F.K. (2014). Time series qos forecasting for management of cloud services. In 2014 Ninth International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 183–190. Rahman, Z.U., Hussain, O.K., & Hussain, F.K. (2014). Time series qos forecasting for management of cloud services. In 2014 Ninth International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 183–190.
15.
Zurück zum Zitat Khan, M.N.A.H., Liu, Y., Alipour, H., & Singh, S. (2015). Modeling the autoscaling operations in cloud with time series data. In Proceedings of the 2015 IEEE 34th Symposium on Reliable Distributed Systems Workshop (SRDSW’15), IEEE Computer Society, Washington, DC, USA, pp. 7–12. Khan, M.N.A.H., Liu, Y., Alipour, H., & Singh, S. (2015). Modeling the autoscaling operations in cloud with time series data. In Proceedings of the 2015 IEEE 34th Symposium on Reliable Distributed Systems Workshop (SRDSW’15), IEEE Computer Society, Washington, DC, USA, pp. 7–12.
16.
Zurück zum Zitat Baldan, F. J., Ramirez-Gallego, S., Bergmeir, C., Herrera, F., & Benitez, J. M. (2016). A forecasting methodology for workload forecasting in cloud systems. IEEE Transactions on Cloud Computing, 6(4), 929–941.CrossRef Baldan, F. J., Ramirez-Gallego, S., Bergmeir, C., Herrera, F., & Benitez, J. M. (2016). A forecasting methodology for workload forecasting in cloud systems. IEEE Transactions on Cloud Computing, 6(4), 929–941.CrossRef
17.
Zurück zum Zitat Kim, I.K., Wang, W., Qi, Y., & Humphrey, M. (2016). Empirical evaluation of workload forecasting techniques for predictive cloud resource scaling. In 2016 IEEE 9th International Conference on Cloud Computing (CLOUD), (pp. 1–10). Kim, I.K., Wang, W., Qi, Y., & Humphrey, M. (2016). Empirical evaluation of workload forecasting techniques for predictive cloud resource scaling. In 2016 IEEE 9th International Conference on Cloud Computing (CLOUD), (pp. 1–10).
18.
Zurück zum Zitat Kumar, A. S., & Mazumdar, S. (2016). Forecasting hpc workload using arma models and ssa. International Conference on Information Technology (ICIT), 2016, 294–297. Kumar, A. S., & Mazumdar, S. (2016). Forecasting hpc workload using arma models and ssa. International Conference on Information Technology (ICIT), 2016, 294–297.
19.
Zurück zum Zitat Kumar, J., & Singh, A. K. (2018). Workload prediction in cloud using artificial neural network and adaptive differential evolution. Future Generation Computer Systems, 81, 41–52.CrossRef Kumar, J., & Singh, A. K. (2018). Workload prediction in cloud using artificial neural network and adaptive differential evolution. Future Generation Computer Systems, 81, 41–52.CrossRef
20.
Zurück zum Zitat Bibal Benifa, J. V., & Dharma, D. (2018). Has: Hybrid auto-scaler for resource scaling in cloud environment. Journal of Parallel and Distributed Computing, 120, 1–15.CrossRef Bibal Benifa, J. V., & Dharma, D. (2018). Has: Hybrid auto-scaler for resource scaling in cloud environment. Journal of Parallel and Distributed Computing, 120, 1–15.CrossRef
21.
Zurück zum Zitat Kaur, G., Bala, A., & Chana, I. (2019). An intelligent regressive ensemble approach for predicting resource usage in cloud computing. Journal of Parallel and Distributed Computing, 123, 1–12.CrossRef Kaur, G., Bala, A., & Chana, I. (2019). An intelligent regressive ensemble approach for predicting resource usage in cloud computing. Journal of Parallel and Distributed Computing, 123, 1–12.CrossRef
22.
Zurück zum Zitat Mohiuddin, I., & Almogren, A. (2019). Workload aware vm consolidation method in edge/cloud computing for IoT applications. Journal of Parallel and Distributed Computing, 123, 204–214.CrossRef Mohiuddin, I., & Almogren, A. (2019). Workload aware vm consolidation method in edge/cloud computing for IoT applications. Journal of Parallel and Distributed Computing, 123, 204–214.CrossRef
23.
Zurück zum Zitat Moghaddam, S. K., Buyya, R., & Ramamohanarao, K. (2019). Acas: An anomaly-based cause aware auto-scaling framework for clouds. Journal of Parallel and Distributed Computing, 126, 107–120.CrossRef Moghaddam, S. K., Buyya, R., & Ramamohanarao, K. (2019). Acas: An anomaly-based cause aware auto-scaling framework for clouds. Journal of Parallel and Distributed Computing, 126, 107–120.CrossRef
24.
Zurück zum Zitat Kumar, J., Goomer, R., & Singh, A. K. (2018). Long short term memory recurrent neural network (LSTM-RNN) based workload forecasting model for cloud datacenters. Procedia Computer Science, 125, 676–682.CrossRef Kumar, J., Goomer, R., & Singh, A. K. (2018). Long short term memory recurrent neural network (LSTM-RNN) based workload forecasting model for cloud datacenters. Procedia Computer Science, 125, 676–682.CrossRef
25.
Zurück zum Zitat Kumar, J., & Singh, A. K. (2016). Dynamic resource scaling in cloud using neural network and black hole algorithm. Fifth International Conference on Eco-friendly Computing and Communication Systems (ICECCS), 2016, 63–67. Kumar, J., & Singh, A. K. (2016). Dynamic resource scaling in cloud using neural network and black hole algorithm. Fifth International Conference on Eco-friendly Computing and Communication Systems (ICECCS), 2016, 63–67.
26.
Zurück zum Zitat Pontius, R. G., Thontteh, O., & Chen, H. (2008). Components of information for multiple resolution comparison between maps that share a real variable. Environmental and Ecological Statistics, 15(2), 111–142.MathSciNetCrossRef Pontius, R. G., Thontteh, O., & Chen, H. (2008). Components of information for multiple resolution comparison between maps that share a real variable. Environmental and Ecological Statistics, 15(2), 111–142.MathSciNetCrossRef
27.
Zurück zum Zitat Willmott, C. J., & Matsuura, K. (2005). Advantages of the mean absolute error (mae) over the root mean square error (rmse) in assessing average model performance. Climate Research, 30, 79–82.CrossRef Willmott, C. J., & Matsuura, K. (2005). Advantages of the mean absolute error (mae) over the root mean square error (rmse) in assessing average model performance. Climate Research, 30, 79–82.CrossRef
28.
Zurück zum Zitat Willmott, C. J., & Matsuura, K. (2006). On the use of dimensioned measures of error to evaluate the performance of spatial interpolators. International Journal of Geographical Information Science, 20(1), 89–102.CrossRef Willmott, C. J., & Matsuura, K. (2006). On the use of dimensioned measures of error to evaluate the performance of spatial interpolators. International Journal of Geographical Information Science, 20(1), 89–102.CrossRef
29.
Zurück zum Zitat Hyndman, R. J., & Koehler, A. B. (2006). Another look at measures of forecast accuracy. International Journal of Forecasting, 22(4), 679–688.CrossRef Hyndman, R. J., & Koehler, A. B. (2006). Another look at measures of forecast accuracy. International Journal of Forecasting, 22(4), 679–688.CrossRef
30.
Zurück zum Zitat Tsay, R. S. (2000). Time series and forecasting: Brief history and future research. Journal of the American Statistical Association, 95(450), 638–643.CrossRef Tsay, R. S. (2000). Time series and forecasting: Brief history and future research. Journal of the American Statistical Association, 95(450), 638–643.CrossRef
31.
Zurück zum Zitat Makridakis, S., Wheelwright, S. C., & Hyndman, R. J. (1998). Forecasting: Methods and applications (3rd ed.). New York: Wiley. Makridakis, S., Wheelwright, S. C., & Hyndman, R. J. (1998). Forecasting: Methods and applications (3rd ed.). New York: Wiley.
32.
Zurück zum Zitat Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis. New York: Wiley.CrossRef Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis. New York: Wiley.CrossRef
33.
Zurück zum Zitat Hyndman, R. J., & Khandakar, Y. (2008). Automatic time series forecasting: the forecast package for R. Journal of Statistical Software, 26(3), 1–22. Hyndman, R. J., & Khandakar, Y. (2008). Automatic time series forecasting: the forecast package for R. Journal of Statistical Software, 26(3), 1–22.
35.
Zurück zum Zitat Reiss, C., Wilkes, J., & Hellerstein, J. L. (2011). Google cluster-usage traces: Format + schema. Google Inc., White Paper, 1–14. Reiss, C., Wilkes, J., & Hellerstein, J. L. (2011). Google cluster-usage traces: Format + schema. Google Inc., White Paper, 1–14.
36.
Zurück zum Zitat Friedman, M. (1937). The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association, 32(200), 675–701.CrossRef Friedman, M. (1937). The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association, 32(200), 675–701.CrossRef
37.
Zurück zum Zitat Conover, W. J., & Conover, W. J. (1980). Practical nonparametric statistics. New York: Wiley.MATH Conover, W. J., & Conover, W. J. (1980). Practical nonparametric statistics. New York: Wiley.MATH
38.
Zurück zum Zitat Rodríguez-Fdez, I., Canosa, A., Mucientes, M., & Bugarín, A. (2015). STAC: a web platform for the comparison of algorithms using statistical tests. In Proceedings of the 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). Rodríguez-Fdez, I., Canosa, A., Mucientes, M., & Bugarín, A. (2015). STAC: a web platform for the comparison of algorithms using statistical tests. In Proceedings of the 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).
39.
Zurück zum Zitat Finner, H. (1993). On a monotonicity problem in step-down multiple test procedures. Journal of the American Statistical Association, 88(423), 920–923.MathSciNetCrossRef Finner, H. (1993). On a monotonicity problem in step-down multiple test procedures. Journal of the American Statistical Association, 88(423), 920–923.MathSciNetCrossRef
Metadaten
Titel
Performance Assessment of Time Series Forecasting Models for Cloud Datacenter Networks’ Workload Prediction
verfasst von
Jitendra Kumar
Ashutosh Kumar Singh
Publikationsdatum
03.09.2020
Verlag
Springer US
Erschienen in
Wireless Personal Communications / Ausgabe 3/2021
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-020-07773-6

Weitere Artikel der Ausgabe 3/2021

Wireless Personal Communications 3/2021 Zur Ausgabe

Neuer Inhalt