Skip to main content

2023 | OriginalPaper | Buchkapitel

A Correlation Analysis-Based Mobile Core Network KPI Anomaly Detection Method via Ensemble Learning

verfasst von : Li Wang, Ying Liu, Weiting Zhang, Xincheng Yan, Na Zhou, Zhihong Jiang

Erschienen in: Emerging Networking Architecture and Technologies

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the development of new networks, applications in mobile communication networks, such as mobile payment and online classes, have become an indispensable part of people’s lives. The core network is one of the most important components of the mobile communication network, which is not only essential but also complex. If the core network fails, it will cause a substantial economic loss. To ensure the reliability and stability of the mobile core network, operators need to detect abnormalities in Key Performance Indicators (KPI,e.g., average response time). Datasets of KPI are usually unbalanced and have a wide range of features. Therefore, we propose a correlation analysis-based KPI anomaly detection via an ensemble learning frame. This frame first performs data augmentation on the dataset using SMOTE oversampling algorithm and uses the Pearson correlation coefficient method for feature selection, then construct an ensemble learning XGBoost-based anomaly detection method for KPI. Finally, we evaluate our scheme with the confusion matrix. The results show that our scheme obtained a high accuracy and recall rate. The training and testing dataset we collected is a KPI dataset of a Chinese operator for the first three months of 2020. It is worth noting that no relevant studies used this dataset before.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Pei, D.: A study on KPI anomaly detection of cloud data center servers based on machine learning, Zhengzhou University (2020) Pei, D.: A study on KPI anomaly detection of cloud data center servers based on machine learning, Zhengzhou University (2020)
3.
Zurück zum Zitat Sun, Y.Q., et al.: Evaluation of KPI anomaly detection methods. Front. Data Comput. Dev. 4(03), 46–65 (2022) Sun, Y.Q., et al.: Evaluation of KPI anomaly detection methods. Front. Data Comput. Dev. 4(03), 46–65 (2022)
4.
Zurück zum Zitat Zhang, Y., et al.: Network anomography. In: Proceedings of the 5th ACM SIGCOMM Conference on Internet Measurement, p. 30 (2005) Zhang, Y., et al.: Network anomography. In: Proceedings of the 5th ACM SIGCOMM Conference on Internet Measurement, p. 30 (2005)
5.
Zurück zum Zitat Siffer, A., et al.: Anomaly detection in streams with extreme value theory. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1067–1075 (2017) Siffer, A., et al.: Anomaly detection in streams with extreme value theory. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1067–1075 (2017)
6.
Zurück zum Zitat Li, J., et al.: FluxEV: a fast and effective unsupervised framework for time-series anomaly detection. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 824–832 (2021) Li, J., et al.: FluxEV: a fast and effective unsupervised framework for time-series anomaly detection. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 824–832 (2021)
7.
Zurück zum Zitat Chen, Y., et al.: A provider-side view of web search response time. ACM SIGCOMM Comput. Commun. Rev. 43(4), 243–254 (2013)CrossRef Chen, Y., et al.: A provider-side view of web search response time. ACM SIGCOMM Comput. Commun. Rev. 43(4), 243–254 (2013)CrossRef
8.
Zurück zum Zitat Vallis, O., et al.: A novel technique for long-term anomaly detection in the cloud. In: 6th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2014), Philadelphia, USA, pp. 534–537 (2014) Vallis, O., et al.: A novel technique for long-term anomaly detection in the cloud. In: 6th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2014), Philadelphia, USA, pp. 534–537 (2014)
9.
Zurück zum Zitat Pei, D., et al.: Intelligent operation and maintenance based on machine learning. Commun. Chin. Comput. Soc. 13(12), 68–72 (2017) Pei, D., et al.: Intelligent operation and maintenance based on machine learning. Commun. Chin. Comput. Soc. 13(12), 68–72 (2017)
11.
Zurück zum Zitat Liu, D.P., et al.: Opprentice: towards practical and automatic anomaly detection through machine learning. In: Proceedings of the Internet Measurement Conference 2015, pp. 211–224 (2015) Liu, D.P., et al.: Opprentice: towards practical and automatic anomaly detection through machine learning. In: Proceedings of the Internet Measurement Conference 2015, pp. 211–224 (2015)
12.
Zurück zum Zitat Laptev, N., et al.: Generic and scalable framework for automated time-series anomaly detection. In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, USA, pp. 1939–1947 (2015) Laptev, N., et al.: Generic and scalable framework for automated time-series anomaly detection. In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, USA, pp. 1939–1947 (2015)
13.
Zurück zum Zitat Yu, G., et al.: Unsupervised online anomaly detection with parameter adaptation for KPI abrupt changes. IEEE Trans. Netw. Serv. Manag. 17(3), 1294–1308 (2020) Yu, G., et al.: Unsupervised online anomaly detection with parameter adaptation for KPI abrupt changes. IEEE Trans. Netw. Serv. Manag. 17(3), 1294–1308 (2020)
14.
Zurück zum Zitat Hu, M., et al.: Detecting anomalies in time series data via a meta-feature based approach. IEEE Access 6, 27760–27776 (2018)CrossRef Hu, M., et al.: Detecting anomalies in time series data via a meta-feature based approach. IEEE Access 6, 27760–27776 (2018)CrossRef
16.
Zurück zum Zitat Li, Y., et al.: IEEE EUC. Achieving a Blockchain-Based Privacy-Preserving Quality-Aware Knowledge Marketplace in Crowdsensing. Wuhan, China (2022) Li, Y., et al.: IEEE EUC. Achieving a Blockchain-Based Privacy-Preserving Quality-Aware Knowledge Marketplace in Crowdsensing. Wuhan, China (2022)
17.
Zurück zum Zitat Xu, H.W., et al.: Unsupervised anomaly detection via variational autoencoder for seasonal KPIs in web applications In: Proceedings of the 2018 World Wide Web Conference (2018) Xu, H.W., et al.: Unsupervised anomaly detection via variational autoencoder for seasonal KPIs in web applications In: Proceedings of the 2018 World Wide Web Conference (2018)
18.
Zurück zum Zitat Chen, W., et al.: Unsupervised anomaly detection for intricate KPIs via adversarial training of VAE. In: IEEE INFOCOM 2019-IEEE Conference on Computer Communications. IEEE, pp. 891–1899 (2019) Chen, W., et al.: Unsupervised anomaly detection for intricate KPIs via adversarial training of VAE. In: IEEE INFOCOM 2019-IEEE Conference on Computer Communications. IEEE, pp. 891–1899 (2019)
20.
Zurück zum Zitat Zhang, C., et al.: FRUIT: a blockchain-based efficient and privacy-preserving quality-aware incentive scheme. IEEE J. Sel. Areas Commun. Early Access (2022) Zhang, C., et al.: FRUIT: a blockchain-based efficient and privacy-preserving quality-aware incentive scheme. IEEE J. Sel. Areas Commun. Early Access (2022)
21.
Zurück zum Zitat Zhang, W., et al.: Deep reinforcement learning based resource management for DNN inference in industrial IoT. IEEE Trans. Veh. Technol. 1 (2021) Zhang, W., et al.: Deep reinforcement learning based resource management for DNN inference in industrial IoT. IEEE Trans. Veh. Technol. 1 (2021)
22.
Zurück zum Zitat Wang, J.S., et al.: ReLFA: resist link flooding attacks via Renyi entropy and deep reinforcement learning in SDN-IoT. China Commun. 19(7), 15 (2022)CrossRef Wang, J.S., et al.: ReLFA: resist link flooding attacks via Renyi entropy and deep reinforcement learning in SDN-IoT. China Commun. 19(7), 15 (2022)CrossRef
23.
Zurück zum Zitat Chawla, N.V., et al.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)CrossRefMATH Chawla, N.V., et al.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)CrossRefMATH
24.
Zurück zum Zitat Abdi, L., Hashemi, S.: To combat multi-class imbalanced problems by means of over-sampling techniques. IEEE Trans. Knowl. Data Eng. 28(1), 238–251 (2015)CrossRef Abdi, L., Hashemi, S.: To combat multi-class imbalanced problems by means of over-sampling techniques. IEEE Trans. Knowl. Data Eng. 28(1), 238–251 (2015)CrossRef
25.
Zurück zum Zitat Chen, R., et al.: Looseness diagnosis method for a connecting bolt of fan foundation based on sensitive mixed-domain features of excitation-response and manifold learning. Neurocomputing, p. S0925231216310694 (2016) Chen, R., et al.: Looseness diagnosis method for a connecting bolt of fan foundation based on sensitive mixed-domain features of excitation-response and manifold learning. Neurocomputing, p. S0925231216310694 (2016)
26.
Zurück zum Zitat Xue, X., Zhou, J.: A hybrid fault diagnosis approach based on mixed-domain state features for rotating machinery. ISA Trans. 66, 284–295 (2016)CrossRef Xue, X., Zhou, J.: A hybrid fault diagnosis approach based on mixed-domain state features for rotating machinery. ISA Trans. 66, 284–295 (2016)CrossRef
27.
Zurück zum Zitat Chen, T.C., Guestrin, C. XGBoost: a scalable tree boosting system. In: The 22nd ACM SIGKDD International Conference (2016) Chen, T.C., Guestrin, C. XGBoost: a scalable tree boosting system. In: The 22nd ACM SIGKDD International Conference (2016)
28.
Zurück zum Zitat Wang, J., et al.: A review of feature selection methods. Comput. Eng. Sci. 12, 72–75 (2005) Wang, J., et al.: A review of feature selection methods. Comput. Eng. Sci. 12, 72–75 (2005)
30.
Zurück zum Zitat Dong, M.G., et al.: A multi-class unbalanced oversampling algorithm using sampling safety factor. Comput. Scie. Explor. 14(10), 1776–1786 (2020) Dong, M.G., et al.: A multi-class unbalanced oversampling algorithm using sampling safety factor. Comput. Scie. Explor. 14(10), 1776–1786 (2020)
31.
Zurück zum Zitat Zhu, T.F., et al.: Synthetic minority oversampling technique for multiclass imbalance problems. Pattern Recogn. J. Pattern Recogn. Soc. 72, 327–340 (2017)CrossRef Zhu, T.F., et al.: Synthetic minority oversampling technique for multiclass imbalance problems. Pattern Recogn. J. Pattern Recogn. Soc. 72, 327–340 (2017)CrossRef
Metadaten
Titel
A Correlation Analysis-Based Mobile Core Network KPI Anomaly Detection Method via Ensemble Learning
verfasst von
Li Wang
Ying Liu
Weiting Zhang
Xincheng Yan
Na Zhou
Zhihong Jiang
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-9697-9_39