Skip to main content
Top

2015 | OriginalPaper | Chapter

Adaptive Threshold for Anomaly Detection Using Time Series Segmentation

Authors : Mohamed-Cherif Dani, François-Xavier Jollois, Mohamed Nadif, Cassiano Freixo

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Time series data are generated from almost every domain and anomaly detection becomes extremely important in the last decade. It consists in detecting anomalous patterns through identifying some new and unknown behaviors that are abnormal or inconsistent relative to most of the data. An efficient anomaly detection algorithm has to adapt the detection process for each system condition and each time series behavior. In this paper, we propose an adaptive threshold able to detect anomalies in univariate time series. Our algorithm is based on segmentation and local means and standard deviations. It allows us to simplify time series visualization and to detect new abnormal data as time series jumps within different time series behavior. On synthetic and real datasets the proposed approach shows good ability in detecting abnormalities.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Gupta, M., Gao, J., Aggarwa, C.C., Han, J.: Outlier detection for temporal data: a survey. IEEE Trans. Knowl. Data Eng. 26, 2250–2267 (2014)CrossRef Gupta, M., Gao, J., Aggarwa, C.C., Han, J.: Outlier detection for temporal data: a survey. IEEE Trans. Knowl. Data Eng. 26, 2250–2267 (2014)CrossRef
3.
go back to reference Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. 41(3), 58 (2009). Article 15CrossRef Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. 41(3), 58 (2009). Article 15CrossRef
4.
go back to reference Dani, M.-C., Freixo, C., Jollois, F.-X., Nadif, M.: Unsupervised anomaly detection for aircraft condition monitoring system. In: IEEE Aeroconf 2015 (2015) Dani, M.-C., Freixo, C., Jollois, F.-X., Nadif, M.: Unsupervised anomaly detection for aircraft condition monitoring system. In: IEEE Aeroconf 2015 (2015)
5.
go back to reference Martí, L., Sanchez-Pi, N., Molina, J.M., Bicharra Garcia, A.C.: YASA: yet another time series segmentation algorithm for anomaly detection in big data problems. In: Polycarpou, M., de Carvalho, A.C.P.L.F., Pan, J.-S., Woźniak, M., Quintian, H., Corchado, E. (eds.) HAIS 2014. LNCS, vol. 8480, pp. 697–708. Springer, Heidelberg (2014) CrossRef Martí, L., Sanchez-Pi, N., Molina, J.M., Bicharra Garcia, A.C.: YASA: yet another time series segmentation algorithm for anomaly detection in big data problems. In: Polycarpou, M., de Carvalho, A.C.P.L.F., Pan, J.-S., Woźniak, M., Quintian, H., Corchado, E. (eds.) HAIS 2014. LNCS, vol. 8480, pp. 697–708. Springer, Heidelberg (2014) CrossRef
6.
go back to reference Salvador, S., Chan, P.: Learning states and rules for detecting anomalies in time series. Appl. Intell. 23(3), 241–255 (2005)CrossRef Salvador, S., Chan, P.: Learning states and rules for detecting anomalies in time series. Appl. Intell. 23(3), 241–255 (2005)CrossRef
7.
go back to reference Keogh, E., Lin, J., Ada, F.: HOT SAX: efficiently finding the most unusual time series subsequence. In: Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM 2005), pp. 226–233. IEEE Computer Society, Washington, DC (2005) Keogh, E., Lin, J., Ada, F.: HOT SAX: efficiently finding the most unusual time series subsequence. In: Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM 2005), pp. 226–233. IEEE Computer Society, Washington, DC (2005)
8.
go back to reference Breunig, M.M., Kriegel, H.-P., Ng, R.T., Sander, J.: LOF: identifying density-based local outliers. SIGMOD Rec. 29(2), 93–104 (2000)CrossRef Breunig, M.M., Kriegel, H.-P., Ng, R.T., Sander, J.: LOF: identifying density-based local outliers. SIGMOD Rec. 29(2), 93–104 (2000)CrossRef
9.
go back to reference Chen, C., Liu, L.-M.: Joint estimation of model parameters and outlier effects in time series. J. Am. Stat. Assoc. 88, 284–297 (1993)MATH Chen, C., Liu, L.-M.: Joint estimation of model parameters and outlier effects in time series. J. Am. Stat. Assoc. 88, 284–297 (1993)MATH
10.
go back to reference Mnz, G., Li, S., Carle, G.: Traffic anomaly detection using k-means clustering. In: Proceedings of Leistungs-, Zuverlssigkeits-und Verlsslichkeitsbewertung von Kommunikationsnetzen und Verteilten Systemen, GI/ITG-Workshop MMBnet, September 2007 Mnz, G., Li, S., Carle, G.: Traffic anomaly detection using k-means clustering. In: Proceedings of Leistungs-, Zuverlssigkeits-und Verlsslichkeitsbewertung von Kommunikationsnetzen und Verteilten Systemen, GI/ITG-Workshop MMBnet, September 2007
11.
go back to reference Gupta, M., Sharma, A.B., Chen, H., Jiang, G.: Context-aware time series anomaly detection for complex systems. In: Proceedings of the SDM Workshop (2013) Gupta, M., Sharma, A.B., Chen, H., Jiang, G.: Context-aware time series anomaly detection for complex systems. In: Proceedings of the SDM Workshop (2013)
12.
go back to reference Rosner, B.: Percentage points for a generalized ESD many-outlier procedure. Technometrics 25(2), 165–172 (1983)CrossRefMATH Rosner, B.: Percentage points for a generalized ESD many-outlier procedure. Technometrics 25(2), 165–172 (1983)CrossRefMATH
13.
go back to reference Miller, J.: Reaction time analysis with outlier exclusion: bias varies with sample size. Q. J. Exper. Psychol. 43(4), 907–912 (1991)CrossRef Miller, J.: Reaction time analysis with outlier exclusion: bias varies with sample size. Q. J. Exper. Psychol. 43(4), 907–912 (1991)CrossRef
14.
go back to reference Chakrabarti, K., Keogh, E., Mehrotra, S., Pazzani, M.: Locally adaptive dimensionality reduction for indexing large time series databases. ACM Trans. Database Syst. 27(2), 188–228 (2002)CrossRef Chakrabarti, K., Keogh, E., Mehrotra, S., Pazzani, M.: Locally adaptive dimensionality reduction for indexing large time series databases. ACM Trans. Database Syst. 27(2), 188–228 (2002)CrossRef
15.
go back to reference Haar, A.: Zur Theorie der orthogonalen Funktionensysteme. Math. Ann. 38–53 (1911). German Haar, A.: Zur Theorie der orthogonalen Funktionensysteme. Math. Ann. 38–53 (1911). German
Metadata
Title
Adaptive Threshold for Anomaly Detection Using Time Series Segmentation
Authors
Mohamed-Cherif Dani
François-Xavier Jollois
Mohamed Nadif
Cassiano Freixo
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-26555-1_10

Premium Partner