Skip to main content
Top
Published in: The Journal of Supercomputing 14/2023

26-04-2023

Multivariate outlier filtering for A-NFVLearn: an advanced deep VNF resource usage forecasting technique

Authors: Cédric St-Onge, Nadjia Kara, Claes Edstrom

Published in: The Journal of Supercomputing | Issue 14/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Virtual Network Function Resource Adaptation (VNF-RA) aims at adequately adapting Network Function Virtualization Infrastructure (NFVI) resources according to the geographical fluctuation of user demand by maximizing the quality of service (QoS) of the offered services and the energy consumption of the NFVI while limiting the risks of Service Level Agreement (SLA) breaches, the CAPEX and OPEX of the cloud operators and their customers. Virtual Network Function (VNF) resource usage forecasting leads, therefore, a key role in enabling proactive resource adaptation in dynamic Network Function Virtualization (NFV) environments whose resource demand constantly changes. In parallel, Long Short-Term Memory (LSTM)-based prediction has garnered huge interest in the research community. Several research teams have proposed different VNF resource usage prediction algorithms based on this machine learning technique. However, current LSTM-based VNF resource usage forecasting techniques lack the flexibility to take several resource attributes of different scales, over many time steps, in order to predict several other resource attributes over many time steps from a Service Function Chain (SFC). In this paper, we push the state of the art forward by presenting A-NFVLearn, a flexible multivariate, LSTM-based model with an attention mechanism which uses different attributes of resource load history (CPU, memory, I/O bandwidth) from various VNFs of an SFC to forecast future load of multiple resources of a VNF. Next, we propose a multivariate outlier filtering scheme at pre-processing based on Adjusted Outlyingness (AO), which improves the training time performance of LSTM-based models without impacting prediction accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Boutaba R, Shahriar N, Salahuddin MA, Limam N (2021) Managing virtualized networks and services with machine learning. Communication Networks and Service Management in the Era of Artificial Intelligence and Machine Learning 33–68 Boutaba R, Shahriar N, Salahuddin MA, Limam N (2021) Managing virtualized networks and services with machine learning. Communication Networks and Service Management in the Era of Artificial Intelligence and Machine Learning 33–68
3.
go back to reference Mijumbi R, Hasija S, Davy S, Davy A, Jennings B, Boutaba R (2017) Topology-aware prediction of virtual network function resource requirements. IEEE Trans Netw Serv Manag 14:106–120CrossRef Mijumbi R, Hasija S, Davy S, Davy A, Jennings B, Boutaba R (2017) Topology-aware prediction of virtual network function resource requirements. IEEE Trans Netw Serv Manag 14:106–120CrossRef
4.
go back to reference Cho Y, Jang S, Pack S (2020) On performance VNF load prediction models in service function chaining. In: International Conference on ICT Convergence, vol 2020-Octob, pp 344–346 Cho Y, Jang S, Pack S (2020) On performance VNF load prediction models in service function chaining. In: International Conference on ICT Convergence, vol 2020-Octob, pp 344–346
5.
go back to reference Afanasyev DO, Fedorova EA (2019) On the impact of outlier filtering on the electricity price forecasting accuracy. Appl Energy 236:196–210CrossRef Afanasyev DO, Fedorova EA (2019) On the impact of outlier filtering on the electricity price forecasting accuracy. Appl Energy 236:196–210CrossRef
6.
go back to reference Shah I, Akbar S, Saba T, Ali S, Rehman A (2021) Short-term forecasting for the electricity spot prices with extreme values treatment. IEEE Access 9:105451–105462CrossRef Shah I, Akbar S, Saba T, Ali S, Rehman A (2021) Short-term forecasting for the electricity spot prices with extreme values treatment. IEEE Access 9:105451–105462CrossRef
7.
go back to reference Yang AC, Hsu HH, Lu MD (2009) Outlier filtering for identification of gene regulations in microarray time-series data. Proc Int Conf Compl Intell Softw Intens Syst CISIS 2009:854–859 Yang AC, Hsu HH, Lu MD (2009) Outlier filtering for identification of gene regulations in microarray time-series data. Proc Int Conf Compl Intell Softw Intens Syst CISIS 2009:854–859
9.
go back to reference Zhang W, Guo W, Liu X, Liu Y, Zhou J, Li B, Lu Q, Yang S (2018) LSTM-based analysis of industrial IoT equipment. IEEE Access 6:23551–23560CrossRef Zhang W, Guo W, Liu X, Liu Y, Zhou J, Li B, Lu Q, Yang S (2018) LSTM-based analysis of industrial IoT equipment. IEEE Access 6:23551–23560CrossRef
10.
go back to reference Eramo V, Lavacca FG, Catena T, Salazar PJP (2020) Proposal and investigation of an artificial intelligence (Ai)-based cloud resource allocation algorithm in network function virtualization architectures. Fut Intern 12(11):1–13 Eramo V, Lavacca FG, Catena T, Salazar PJP (2020) Proposal and investigation of an artificial intelligence (Ai)-based cloud resource allocation algorithm in network function virtualization architectures. Fut Intern 12(11):1–13
12.
go back to reference Patel YS, Verma D, Misra R (2019) Deep learning based resource allocation for auto-scaling VNFs. International Symposium on Advanced Networks and Telecommunication Systems, ANTS 2019–Dec:1–6 Patel YS, Verma D, Misra R (2019) Deep learning based resource allocation for auto-scaling VNFs. International Symposium on Advanced Networks and Telecommunication Systems, ANTS 2019–Dec:1–6
13.
go back to reference Lange S, Tu NV, Jeong SY, Lee DY, Kim HG, Hong J, Yoo JH, Hong JWK (2021) A network intelligence architecture for efficient VNF lifecycle management. IEEE Trans Netw Serv Manag 18(2):1476–1490CrossRef Lange S, Tu NV, Jeong SY, Lee DY, Kim HG, Hong J, Yoo JH, Hong JWK (2021) A network intelligence architecture for efficient VNF lifecycle management. IEEE Trans Netw Serv Manag 18(2):1476–1490CrossRef
14.
go back to reference Kim HG, Jeong SY, Lee DY, Choi H, Yoo JH, Hong JWK (2019) A deep learning approach to VNF resource prediction using correlation between VNFs. In: Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019, pp 444–449 Kim HG, Jeong SY, Lee DY, Choi H, Yoo JH, Hong JWK (2019) A deep learning approach to VNF resource prediction using correlation between VNFs. In: Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019, pp 444–449
15.
go back to reference Hochreiter S, Urgen Schmidhuber J (1997) Ltsm. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Urgen Schmidhuber J (1997) Ltsm. Neural Comput 9(8):1735–1780CrossRef
16.
go back to reference Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. ICLR 1–15 Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. ICLR 1–15
17.
go back to reference Khalid R, Javaid N, Al-zahrani FA, Aurangzeb K, Qazi EUH, Ashfaq T (2020) Electricity load and price forecasting using jaya-long short term memory (JLSTM) in smart grids. Entropy 22(1):10CrossRef Khalid R, Javaid N, Al-zahrani FA, Aurangzeb K, Qazi EUH, Ashfaq T (2020) Electricity load and price forecasting using jaya-long short term memory (JLSTM) in smart grids. Entropy 22(1):10CrossRef
20.
go back to reference Yu L, Wu C, Xiong NN (2022) An intelligent data analysis system combining ARIMA and LSTM for persistent organic pollutants concentration prediction. Electronics 11(4):652CrossRef Yu L, Wu C, Xiong NN (2022) An intelligent data analysis system combining ARIMA and LSTM for persistent organic pollutants concentration prediction. Electronics 11(4):652CrossRef
21.
go back to reference Zhang C, Hu D, Yang T (2022) Anomaly detection and diagnosis for wind turbines using long short-term memory-based stacked denoising autoencoders and XGBoost. Reliab Eng Syst Saf 222(March):108445CrossRef Zhang C, Hu D, Yang T (2022) Anomaly detection and diagnosis for wind turbines using long short-term memory-based stacked denoising autoencoders and XGBoost. Reliab Eng Syst Saf 222(March):108445CrossRef
24.
go back to reference Hubert M, Van Der Veeken S (2008) Outlier detection for skewed data. J Chemo 22(3–4):235–246CrossRef Hubert M, Van Der Veeken S (2008) Outlier detection for skewed data. J Chemo 22(3–4):235–246CrossRef
25.
Metadata
Title
Multivariate outlier filtering for A-NFVLearn: an advanced deep VNF resource usage forecasting technique
Authors
Cédric St-Onge
Nadjia Kara
Claes Edstrom
Publication date
26-04-2023
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 14/2023
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-023-05283-3

Other articles of this Issue 14/2023

The Journal of Supercomputing 14/2023 Go to the issue

Premium Partner