Skip to main content
Top

2018 | OriginalPaper | Chapter

Anomaly Detection and Diagnosis for Container-Based Microservices with Performance Monitoring

Authors : Qingfeng Du, Tiandi Xie, Yu He

Published in: Algorithms and Architectures for Parallel Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With emerging container technologies, such as Docker, microservices-based applications can be developed and deployed in cloud environment much agiler. The dependability of these microservices becomes a major concern of application providers. Anomalous behaviors which may lead to unexpected failures can be detected with anomaly detection techniques. In this paper, an anomaly detection system (ADS) is designed to detect and diagnose the anomalies in microservices by monitoring and analyzing real-time performance data of them. The proposed ADS consists of a monitoring module that collects the performance data of containers, a data processing module based on machine learning models and a fault injection module integrated for training these models. The fault injection module is also used to assess the anomaly detection and diagnosis performance of our ADS. Clearwater, an open source virtual IP Multimedia Subsystem, is used for the validation of our ADS and experimental results show that the proposed ADS works well.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Singh, V., et al.: Container-based microservice architecture for cloud applications. In: Computing, Communication and Automation (ICCCA) (2017) Singh, V., et al.: Container-based microservice architecture for cloud applications. In: Computing, Communication and Automation (ICCCA) (2017)
2.
go back to reference Sauvanaud, C., et al.: Anomaly detection and diagnosis for cloud services: practical experiments and lessons learned. J. Syst. Softw. 139, 84–106 (2018)CrossRef Sauvanaud, C., et al.: Anomaly detection and diagnosis for cloud services: practical experiments and lessons learned. J. Syst. Softw. 139, 84–106 (2018)CrossRef
5.
go back to reference Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Computing Surveys (2009) Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Computing Surveys (2009)
6.
go back to reference Wang, T., Zhang, W., Ye, C., et al.: FD4C: automatic fault diagnosis framework for web applications in cloud computing. IEEE Trans. Syst. Man Cybern.: Syst. 46(1), 61–75 (2016)CrossRef Wang, T., Zhang, W., Ye, C., et al.: FD4C: automatic fault diagnosis framework for web applications in cloud computing. IEEE Trans. Syst. Man Cybern.: Syst. 46(1), 61–75 (2016)CrossRef
7.
go back to reference Amaral, M., Polo, J., et al.: Performance evaluation of microservices architectures using containers. In: 2015 IEEE 14th International Symposium on Network Computing and Applications (NCA), pp. 27–34. IEEE (2015) Amaral, M., Polo, J., et al.: Performance evaluation of microservices architectures using containers. In: 2015 IEEE 14th International Symposium on Network Computing and Applications (NCA), pp. 27–34. IEEE (2015)
8.
go back to reference Ferreira, A., Felter, W., et al.: An updated performance comparison of virtual machines and Linux containers. Technical Report RC25482 (AUS1407-001). IBM (2014) Ferreira, A., Felter, W., et al.: An updated performance comparison of virtual machines and Linux containers. Technical Report RC25482 (AUS1407-001). IBM (2014)
9.
go back to reference Kjallman, J., Morabito, R., Komu, M.: Hypervisors vs. lightweight virtualization: a performance comparison. In: IEEE International Conference on Cloud Engineering (2015) Kjallman, J., Morabito, R., Komu, M.: Hypervisors vs. lightweight virtualization: a performance comparison. In: IEEE International Conference on Cloud Engineering (2015)
10.
go back to reference Zheng, Z., Zhang, Y., Lyu, M.R.: An online performance prediction framework for service-oriented systems. IEEE Trans. Syst. Man Cybern. 44, 1169–1181 (2014)CrossRef Zheng, Z., Zhang, Y., Lyu, M.R.: An online performance prediction framework for service-oriented systems. IEEE Trans. Syst. Man Cybern. 44, 1169–1181 (2014)CrossRef
11.
go back to reference Mi, H., Wang, H., et al.: Toward fine-grained, unsupervised, scalable performance diagnosis for production cloud computing systems. IEEE Trans. Parallel Distrib. Syst. 24(6), 1245–1255 (2013)CrossRef Mi, H., Wang, H., et al.: Toward fine-grained, unsupervised, scalable performance diagnosis for production cloud computing systems. IEEE Trans. Parallel Distrib. Syst. 24(6), 1245–1255 (2013)CrossRef
12.
go back to reference Zhang, S., Pattipati, K.R., et al.: Dynamic coupled fault diagnosis with propagation and observation delays. IEEE Trans. Syst. Man Cybern.: Syst. 43(6), 1424–1439 (2013)CrossRef Zhang, S., Pattipati, K.R., et al.: Dynamic coupled fault diagnosis with propagation and observation delays. IEEE Trans. Syst. Man Cybern.: Syst. 43(6), 1424–1439 (2013)CrossRef
13.
go back to reference Pahl, C.: Containerization and the PaaS cloud. IEEE Cloud Comput. 2, 24–31 (2015)CrossRef Pahl, C.: Containerization and the PaaS cloud. IEEE Cloud Comput. 2, 24–31 (2015)CrossRef
14.
go back to reference Liao, W.T.: Clustering of time series data–a survey. Pattern Recogn. 38(11), 1857–1874 (2005)CrossRef Liao, W.T.: Clustering of time series data–a survey. Pattern Recogn. 38(11), 1857–1874 (2005)CrossRef
Metadata
Title
Anomaly Detection and Diagnosis for Container-Based Microservices with Performance Monitoring
Authors
Qingfeng Du
Tiandi Xie
Yu He
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-05063-4_42

Premium Partner