Skip to main content

2022 | OriginalPaper | Buchkapitel

Features of Software Development for Data Mining of Storage System State

verfasst von : A. Zarubin, V. Moshkin, A. Koval

Erschienen in: Advances in Automation III

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article proposes the architecture of a diagnostic data mining software system for data storage systems. Analysis of logs consists of several stages: extraction of metrics from big data storage diagnostic information using artificial neural networks, analysis of time series anomalies for diagnostic data metrics using machine learning methods, generalization of the results of the analysis of anomalies and patterns of change and existence of storage performance metrics based on the characteristics of the subject area using a subject ontology, the inference of the recommendation to the administrator for correcting the storage system state through the composition of the results of the analysis of anomalies and subject ontology. In the article, an effective solution (software or algorithm) is found for the implementation of each stage. In the future, it is planned to develop this system and evaluate its effectiveness during experiments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
8.
Zurück zum Zitat Ramaswamy, S., Rastogi, R., Shim, K.: Efficient algorithms for mining outliers from large data sets. ACM SIGMOD Rec. 29, 427–438 (2000)CrossRef Ramaswamy, S., Rastogi, R., Shim, K.: Efficient algorithms for mining outliers from large data sets. ACM SIGMOD Rec. 29, 427–438 (2000)CrossRef
9.
Zurück zum Zitat Angiulli F., Pizzuti C.: Fast outlier detection in high dimensional spaces. In: Elomaa T., Mannila H., Toivonen H. (eds.) Principles of Data Mining and Knowledge Discovery. PKDD 2002. Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence), vol. 2431. Springer, Berlin (2002) Angiulli F., Pizzuti C.: Fast outlier detection in high dimensional spaces. In: Elomaa T., Mannila H., Toivonen H. (eds.) Principles of Data Mining and Knowledge Discovery. PKDD 2002. Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence), vol. 2431. Springer, Berlin (2002)
10.
Zurück zum Zitat Bay, S.D., Schwabacher, M.: Mining distance-based outliers in near linear time with randomization and a simple pruning rule. In: Proceedings of the ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 29–38 (2003) Bay, S.D., Schwabacher, M.: Mining distance-based outliers in near linear time with randomization and a simple pruning rule. In: Proceedings of the ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 29–38 (2003)
12.
Zurück zum Zitat Cho, K., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv:1406.1078 (2014) Cho, K., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv:​1406.​1078 (2014)
13.
Zurück zum Zitat Yarushkina, N., Moshkin, V., Filippov, A.: Development of a knowledge base based on context analysis of external information resources. In: Proceedings of the International Conference Information Technology and Nanotechnology Session Data Science, pp. 328–337 (2018) Yarushkina, N., Moshkin, V., Filippov, A.: Development of a knowledge base based on context analysis of external information resources. In: Proceedings of the International Conference Information Technology and Nanotechnology Session Data Science, pp. 328–337 (2018)
15.
Zurück zum Zitat Yarushkina, N., Moshkin, V., Filippov, A., Guskov, G.: Developing a fuzzy knowledge base and filling it with knowledge extracted from various documents. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds.) ICAISC 2018. LNCS (LNAI), vol. 10842, pp. 799–810. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91262-2_70CrossRef Yarushkina, N., Moshkin, V., Filippov, A., Guskov, G.: Developing a fuzzy knowledge base and filling it with knowledge extracted from various documents. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds.) ICAISC 2018. LNCS (LNAI), vol. 10842, pp. 799–810. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-91262-2_​70CrossRef
Metadaten
Titel
Features of Software Development for Data Mining of Storage System State
verfasst von
A. Zarubin
V. Moshkin
A. Koval
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-030-94202-1_45