Skip to main content

2017 | OriginalPaper | Buchkapitel

Local-to-Global Unsupervised Anomaly Detection from Temporal Data

verfasst von : Seif-Eddine Benkabou, Khalid Benabdeslem, Bruno Canitia

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Anomaly detection for temporal data has received much attention by many real-world applications. Most existing unsupervised methods dealing with this task are based on a sequential two-way approach (clustering and detection). Because of this, the clustering is less robust to anomalous series in data which distorts the detection step. Thus, to overcome this problem, we propose an embedded technique simultaneously dealing with both methods. We reformulate the task of anomaly detection as a local-weighting-instance clustering problem. The anomalous series are detected locally in each cluster as well as globally in the data, as a whole. Extensive experiments on benchmark datasets are carried out to validate our approach and compare it with other state-of-the-art methods of detection.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bahadori, M., Kale, D., Yingying, F., Yan, L.: Functional subspace clustering with application to time series. In: Proceedings of ICML, pp. 228–237 (2015) Bahadori, M., Kale, D., Yingying, F., Yan, L.: Functional subspace clustering with application to time series. In: Proceedings of ICML, pp. 228–237 (2015)
2.
Zurück zum Zitat Budalakoti, S., Srivastava, A., Otey, M.: Anomaly detection and diagnosis algorithms for discrete symbol sequences with applications to airline safety. IEEE Trans. Syst. Man Cybern. Part C: Appl. 39(1), 101–113 (2009)CrossRef Budalakoti, S., Srivastava, A., Otey, M.: Anomaly detection and diagnosis algorithms for discrete symbol sequences with applications to airline safety. IEEE Trans. Syst. Man Cybern. Part C: Appl. 39(1), 101–113 (2009)CrossRef
3.
Zurück zum Zitat Chandola, V., Mithal, V., Kumar, V.: Comparative evaluation of anomaly detection techniques for sequence data. In: Proceedings of ICDM, pp. 743–748 (2008) Chandola, V., Mithal, V., Kumar, V.: Comparative evaluation of anomaly detection techniques for sequence data. In: Proceedings of ICDM, pp. 743–748 (2008)
5.
Zurück zum Zitat Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH
6.
Zurück zum Zitat Ferraty, F., Vieu, P.: Nonparametric Functional Data Analysis: Theory and Practice. Springer, Heidelberg (2006)MATH Ferraty, F., Vieu, P.: Nonparametric Functional Data Analysis: Theory and Practice. Springer, Heidelberg (2006)MATH
7.
Zurück zum Zitat Görnitz, N., Braun, L., Kloft, M.: Hidden Markov anomaly detection. In: Proceedings of ICML, pp. 1833–1842 (2015) Görnitz, N., Braun, L., Kloft, M.: Hidden Markov anomaly detection. In: Proceedings of ICML, pp. 1833–1842 (2015)
8.
Zurück zum Zitat Gupta, M., Gao, J., Aggarwal, C., Han, J.: Outlier detection for temporal data: a survey. IEEE Trans. Knowl. Data Eng. 26(9), 2250–2267 (2014)CrossRefMATH Gupta, M., Gao, J., Aggarwal, C., Han, J.: Outlier detection for temporal data: a survey. IEEE Trans. Knowl. Data Eng. 26(9), 2250–2267 (2014)CrossRefMATH
9.
Zurück zum Zitat Hautamaki, T., Nykanen, P., Frant, P.: Time-series clustering by approximate prototypes. In: Proceedings of ICPR, pp. 1–4 (2008) Hautamaki, T., Nykanen, P., Frant, P.: Time-series clustering by approximate prototypes. In: Proceedings of ICPR, pp. 1–4 (2008)
10.
Zurück zum Zitat Huang, J., Ng, M., Rong, H., Li, Z.: Automated variable weighting in k-means type clustering. IEEE Trans. Pattern Anal. Mach. Intell. 27, 657–668 (2005)CrossRef Huang, J., Ng, M., Rong, H., Li, Z.: Automated variable weighting in k-means type clustering. IEEE Trans. Pattern Anal. Mach. Intell. 27, 657–668 (2005)CrossRef
11.
Zurück zum Zitat Jing, L., Ng, M., Huang, Z.: An entropy weighting k-means algorithm for subspace clustering of high-dimensional sparse data. IEEE Trans. Knowl. Data Eng. 19(8), 1026–1041 (2007)CrossRef Jing, L., Ng, M., Huang, Z.: An entropy weighting k-means algorithm for subspace clustering of high-dimensional sparse data. IEEE Trans. Knowl. Data Eng. 19(8), 1026–1041 (2007)CrossRef
12.
Zurück zum Zitat Lane, T., Brodley, C.: Sequence matching and learning in anomaly detection for computer security. In: AAAI Workshop: AI Approaches to Fraud Detection and Risk Management, pp. 43–49 (1997) Lane, T., Brodley, C.: Sequence matching and learning in anomaly detection for computer security. In: AAAI Workshop: AI Approaches to Fraud Detection and Risk Management, pp. 43–49 (1997)
13.
Zurück zum Zitat Modha, D., Spangler, S.: Feature weighting in k-means clustering. Mach. Learn. 52, 217–237 (2003)CrossRefMATH Modha, D., Spangler, S.: Feature weighting in k-means clustering. Mach. Learn. 52, 217–237 (2003)CrossRefMATH
14.
Zurück zum Zitat Ng, A., Jordan, M., Weiss, Y.: Analysis and an algorithm. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 849–856. MIT Press (2002) Ng, A., Jordan, M., Weiss, Y.: Analysis and an algorithm. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 849–856. MIT Press (2002)
15.
Zurück zum Zitat Petitjean, F., Forestier, G., Webb, G., Nicholson, A., Chen, Y., Keogh, E.: Dynamic time warping averaging of time series allows faster, more accurate classification. In: Proceedings of ICDM, pp. 470–479 (2014) Petitjean, F., Forestier, G., Webb, G., Nicholson, A., Chen, Y., Keogh, E.: Dynamic time warping averaging of time series allows faster, more accurate classification. In: Proceedings of ICDM, pp. 470–479 (2014)
16.
Zurück zum Zitat Portnoy, L., Eskin, E., Stolfo, S.: Intrusion detection with unlabeled data using clustering. In: Proceedings of ACM CSS Workshop on Data Mining Applied to Security (DMSA), pp. 5–8 (2001) Portnoy, L., Eskin, E., Stolfo, S.: Intrusion detection with unlabeled data using clustering. In: Proceedings of ACM CSS Workshop on Data Mining Applied to Security (DMSA), pp. 5–8 (2001)
17.
Zurück zum Zitat Salvador, S., Chan, P.: Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 11(5), 561–580 (2007) Salvador, S., Chan, P.: Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 11(5), 561–580 (2007)
18.
Zurück zum Zitat Schölkopf, B., Williamson, R., Smola, A., Shawe-Taylor, J., Platt, J.: Support vector method for novelty detection. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 582–588 (1999) Schölkopf, B., Williamson, R., Smola, A., Shawe-Taylor, J., Platt, J.: Support vector method for novelty detection. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 582–588 (1999)
Metadaten
Titel
Local-to-Global Unsupervised Anomaly Detection from Temporal Data
verfasst von
Seif-Eddine Benkabou
Khalid Benabdeslem
Bruno Canitia
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-57454-7_59