Skip to main content
Erschienen in: Knowledge and Information Systems 3/2018

09.09.2017 | Regular Paper

Time series classification with feature covariance matrices

verfasst von: Hamza Ergezer, Kemal Leblebicioğlu

Erschienen in: Knowledge and Information Systems | Ausgabe 3/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work, a novel approach utilizing feature covariance matrices is proposed for time series classification. In order to adapt the feature covariance matrices into time series classification problem, a feature vector is defined for each point in a time series. The feature vector comprises local and global information such as value, derivative, rank, deviation from the mean, the time index of the point and cumulative sum up to the point. Extracted feature vectors for the time instances are concatenated to construct feature matrices for the overlapping subsequences. Covariances of the feature matrices are used to describe the subsequences. Our main purpose in this work is to introduce and evaluate the feature covariance representation for time series classification. Therefore, in classification stage, firstly, 1-NN classifier is utilized. After showing the effectiveness of the representation with 1-NN classifier, the experiments are repeated with SVM classifier. The other novelty in this work is that a novel distance measure is introduced for time series by feature covariance matrix representation. Conducted experiments on UCR time series datasets show that the proposed method mostly outperforms the well-known methods such as DTW, shapelet transform and other state-of-the-art techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Ahmed N, Atiya AF, Gayar N, El-Shishiny H (2010) An empirical comparison of machine learning models for time series forecasting. Econom Rev 29(5–6):594–621MathSciNetCrossRef Ahmed N, Atiya AF, Gayar N, El-Shishiny H (2010) An empirical comparison of machine learning models for time series forecasting. Econom Rev 29(5–6):594–621MathSciNetCrossRef
4.
Zurück zum Zitat Arsigny V, Fillard P, Pennec X, Ayache N (2006) Log-euclidean metrics for fast and simple calculus on diffusion tensors. Magn Reson Med 56(2):411–421CrossRef Arsigny V, Fillard P, Pennec X, Ayache N (2006) Log-euclidean metrics for fast and simple calculus on diffusion tensors. Magn Reson Med 56(2):411–421CrossRef
5.
Zurück zum Zitat Ayadi ME, Kamel M, Karray F (2011) Survey on speech emotion recognition: features, classification schemes, and databases. Pattern Recogn 44(3):572–587CrossRefMATH Ayadi ME, Kamel M, Karray F (2011) Survey on speech emotion recognition: features, classification schemes, and databases. Pattern Recogn 44(3):572–587CrossRefMATH
6.
Zurück zum Zitat Bagnall A, Lines J, Hills J, Bostrom A (2015) Time-series classification with cote: the collective of transformation-based ensembles. IEEE Trans Knowl Data Eng 27(9):2522–2535CrossRef Bagnall A, Lines J, Hills J, Bostrom A (2015) Time-series classification with cote: the collective of transformation-based ensembles. IEEE Trans Knowl Data Eng 27(9):2522–2535CrossRef
7.
Zurück zum Zitat Bailly A, Malinowski S, Tavenard R, Guyet T, Chapel L (2015) Bag-of-temporal-sift-words for time series classification. In: ECML/PKDD workshop on advanced analytics and learning on temporal data Bailly A, Malinowski S, Tavenard R, Guyet T, Chapel L (2015) Bag-of-temporal-sift-words for time series classification. In: ECML/PKDD workshop on advanced analytics and learning on temporal data
8.
Zurück zum Zitat Barachant A, Bonnet S, Congedo M, Jutten C (2013) Classification of covariance matrices using a riemannian-based kernel for bci applications. Neurocomputing 112:172–178CrossRef Barachant A, Bonnet S, Congedo M, Jutten C (2013) Classification of covariance matrices using a riemannian-based kernel for bci applications. Neurocomputing 112:172–178CrossRef
9.
Zurück zum Zitat Bay Herbert TT, Gool LV (2006) Surf: speeded up robust features. In: European conference on computer vision, pp 404–417 Bay Herbert TT, Gool LV (2006) Surf: speeded up robust features. In: European conference on computer vision, pp 404–417
10.
Zurück zum Zitat Baydogan MG, Runger G, Tuv E (2013) A bag-of-features framework to classify time series. IEEE Trans Pattern Anal Mach Intell 35(11):2796–2802CrossRef Baydogan MG, Runger G, Tuv E (2013) A bag-of-features framework to classify time series. IEEE Trans Pattern Anal Mach Intell 35(11):2796–2802CrossRef
11.
Zurück zum Zitat Chebbi Z, Moakher M (2012) Means of hermitian positive-definite matrices based on the log-determinant alpha-divergence function. Linear Algebra Appl 436(7):1872–1889MathSciNetCrossRefMATH Chebbi Z, Moakher M (2012) Means of hermitian positive-definite matrices based on the log-determinant alpha-divergence function. Linear Algebra Appl 436(7):1872–1889MathSciNetCrossRefMATH
13.
Zurück zum Zitat Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE Conf Comput Vis Pattern Recogn 1:886–893 Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE Conf Comput Vis Pattern Recogn 1:886–893
14.
Zurück zum Zitat Deng H, Runger G, Tuv E, Vladimir M (2013) A time series forest for classification and feature extraction. Inf Sci 239:142–153MathSciNetCrossRefMATH Deng H, Runger G, Tuv E, Vladimir M (2013) A time series forest for classification and feature extraction. Inf Sci 239:142–153MathSciNetCrossRefMATH
15.
Zurück zum Zitat Erdem E, Erdem A (2013) Visual saliency estimation by nonlinearly integrating features using region covariances. J Vis 13(4), article no. 11. doi:10.1167/13.4.11 Erdem E, Erdem A (2013) Visual saliency estimation by nonlinearly integrating features using region covariances. J Vis 13(4), article no. 11. doi:10.​1167/​13.​4.​11
16.
Zurück zum Zitat Ergezer H, Leblebicioğlu K (2016) Anomaly detection and activity perception using covariance descriptor for trajectories. In: European conference on computer vision, Springer, Berlin, pp 728–742 Ergezer H, Leblebicioğlu K (2016) Anomaly detection and activity perception using covariance descriptor for trajectories. In: European conference on computer vision, Springer, Berlin, pp 728–742
17.
Zurück zum Zitat Esling P, Agon C (2012) Time-series data mining. ACM Comput Surv (CSUR) 45(1), article no. 12 Esling P, Agon C (2012) Time-series data mining. ACM Comput Surv (CSUR) 45(1), article no. 12
18.
Zurück zum Zitat Freifeld O (2014) Statistics on manifolds with applications to modeling shape deformations. Ph.D. Thesis, Brown University Freifeld O (2014) Statistics on manifolds with applications to modeling shape deformations. Ph.D. Thesis, Brown University
19.
Zurück zum Zitat Förstner W, Moonen B (2003) A metric for covariance matrices. Geodesy-The Challenge of the 3rd Millennium. Springer, Berlin Förstner W, Moonen B (2003) A metric for covariance matrices. Geodesy-The Challenge of the 3rd Millennium. Springer, Berlin
20.
Zurück zum Zitat Fu Z, Lu G, Ting K, Zhang D (2011) Music classification via the bag-of features approach. Pattern Recogn Lett 32(14):1768–1777CrossRef Fu Z, Lu G, Ting K, Zhang D (2011) Music classification via the bag-of features approach. Pattern Recogn Lett 32(14):1768–1777CrossRef
21.
Zurück zum Zitat Fulcher BD, Jones NS (2014) Highly comparative feature-based time-series classification. IEEE Trans Knowl Data Eng 26(12):3026–3037CrossRef Fulcher BD, Jones NS (2014) Highly comparative feature-based time-series classification. IEEE Trans Knowl Data Eng 26(12):3026–3037CrossRef
22.
Zurück zum Zitat Guo K, Ishwar P, Konrad J (2013) Action recognition from video using feature covariance matrices. IEEE Trans Image Process 22(6):2479–2494MathSciNetCrossRefMATH Guo K, Ishwar P, Konrad J (2013) Action recognition from video using feature covariance matrices. IEEE Trans Image Process 22(6):2479–2494MathSciNetCrossRefMATH
23.
Zurück zum Zitat Hills J, Lines J, Baranauskas E, Mapp J, Bagnall A (2014) Classification of time series by shapelet transformation. Data Min Knowl Disc 28(4):851–881MathSciNetCrossRefMATH Hills J, Lines J, Baranauskas E, Mapp J, Bagnall A (2014) Classification of time series by shapelet transformation. Data Min Knowl Disc 28(4):851–881MathSciNetCrossRefMATH
24.
Zurück zum Zitat Jeong Y, Jeong M, Omitaomu O (2011) Weighted dynamic time warping for time series classification. Pattern Recogn 44(9):2231–2240CrossRef Jeong Y, Jeong M, Omitaomu O (2011) Weighted dynamic time warping for time series classification. Pattern Recogn 44(9):2231–2240CrossRef
25.
Zurück zum Zitat Karlsson I, Papapetrou P, Boström H (2016) Generalized random shapelet forests. Data Min Knowl Disc 30(5):1053–1085MathSciNetCrossRef Karlsson I, Papapetrou P, Boström H (2016) Generalized random shapelet forests. Data Min Knowl Disc 30(5):1053–1085MathSciNetCrossRef
26.
Zurück zum Zitat Kate RJ (2016) Using dynamic time warping distances as features for improved time series classification. Data Min Knowl Disc 30(2):283–312MathSciNetCrossRef Kate RJ (2016) Using dynamic time warping distances as features for improved time series classification. Data Min Knowl Disc 30(2):283–312MathSciNetCrossRef
27.
Zurück zum Zitat Keogh EJ, Pazzani MJ (2001) Derivative dynamic time warping. In: Proceedings of the 2001 SIAM international conference on data mining Keogh EJ, Pazzani MJ (2001) Derivative dynamic time warping. In: Proceedings of the 2001 SIAM international conference on data mining
28.
Zurück zum Zitat Laptev I (2005) On space-time interest points. Int J Comput Vis 64(2–3):107–123CrossRef Laptev I (2005) On space-time interest points. Int J Comput Vis 64(2–3):107–123CrossRef
29.
Zurück zum Zitat Lee JM (2006) Riemannian manifolds: an introduction to curvature, vol 176. Springer, Berlin Lee JM (2006) Riemannian manifolds: an introduction to curvature, vol 176. Springer, Berlin
30.
Zurück zum Zitat Lin J, Keogh E, Wei L, Lonardi S (2007) Experiencing sax: a novel symbolic representation of time series. Data Min Knowl Disc 15(2):107–144MathSciNetCrossRef Lin J, Keogh E, Wei L, Lonardi S (2007) Experiencing sax: a novel symbolic representation of time series. Data Min Knowl Disc 15(2):107–144MathSciNetCrossRef
31.
Zurück zum Zitat Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Min Knowl Disc 29:565–592MathSciNetCrossRef Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Min Knowl Disc 29:565–592MathSciNetCrossRef
32.
Zurück zum Zitat Lowe D (1999) Object recognition from local scale-invariant features. Proc Seventh IEEE Int Conf Comput Vis 2:1150–1157CrossRef Lowe D (1999) Object recognition from local scale-invariant features. Proc Seventh IEEE Int Conf Comput Vis 2:1150–1157CrossRef
33.
Zurück zum Zitat Mikolajczyk K et al (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 27(10):1615–1630CrossRef Mikolajczyk K et al (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 27(10):1615–1630CrossRef
34.
Zurück zum Zitat Mohan A, Papageorgiou C, Poggio T (2001) Example-based object detection in images by components. IEEE Trans Pattern Anal Mach Intell 23(4):349–361CrossRef Mohan A, Papageorgiou C, Poggio T (2001) Example-based object detection in images by components. IEEE Trans Pattern Anal Mach Intell 23(4):349–361CrossRef
35.
Zurück zum Zitat Mueen A, Keogh E, Youngin N (2011) Logical-shapelets: an expressive primitive for time series classification. In: Proceedings of 17th ACM SIGKDD internatinal conference knowledge discovery data mining, pp 1154–1162 Mueen A, Keogh E, Youngin N (2011) Logical-shapelets: an expressive primitive for time series classification. In: Proceedings of 17th ACM SIGKDD internatinal conference knowledge discovery data mining, pp 1154–1162
36.
Zurück zum Zitat Pongpaichet S, Tang M, Jalali L, Jain R (2016) Using photos as micro-reports of events. In: In Proceedings of the 2016 ACM on international conference on multimedia retrieval, pp 87–94. ACM Pongpaichet S, Tang M, Jalali L, Jain R (2016) Using photos as micro-reports of events. In: In Proceedings of the 2016 ACM on international conference on multimedia retrieval, pp 87–94. ACM
37.
Zurück zum Zitat Porikli F, Tuzel O, Meer P (2006) Covariance tracking using model update based on lie algebra. In: CVPR, pp 728–735 Porikli F, Tuzel O, Meer P (2006) Covariance tracking using model update based on lie algebra. In: CVPR, pp 728–735
38.
Zurück zum Zitat Ratanamahatana C, Keogh E (2005) Three myths about dynamic time warping data mining. In: In Proceedings of SIAM international conference on data mining (SDM’05), pp 506–510 Ratanamahatana C, Keogh E (2005) Three myths about dynamic time warping data mining. In: In Proceedings of SIAM international conference on data mining (SDM’05), pp 506–510
39.
Zurück zum Zitat Ratanamahatana CA, Keogh E (2004) Making time-series classification more accurate using learned constraints. In: Proceedings of SIAM international conference on data mining (SDM04), pp 11–22 Ratanamahatana CA, Keogh E (2004) Making time-series classification more accurate using learned constraints. In: Proceedings of SIAM international conference on data mining (SDM04), pp 11–22
40.
Zurück zum Zitat Ratanamahatana CA, Lin J, Gunopulos D, Keogh E, Vlachos M, Das G (2005) Mining time series data. In: Data mining and knowledge discovery handbook 1069–1103, Springer, US Ratanamahatana CA, Lin J, Gunopulos D, Keogh E, Vlachos M, Das G (2005) Mining time series data. In: Data mining and knowledge discovery handbook 1069–1103, Springer, US
41.
Zurück zum Zitat Sadatnejad K, Ghidary SS (2016) Kernel learning over the manifold of symmetric positive definite matrices for dimensionality reduction in a bci application. Neurocomputing 179:152–160CrossRef Sadatnejad K, Ghidary SS (2016) Kernel learning over the manifold of symmetric positive definite matrices for dimensionality reduction in a bci application. Neurocomputing 179:152–160CrossRef
42.
Zurück zum Zitat Tang M, Agrawal P, Nie F, Pongpaichet S, Jain R (2016) A graph based multimodal geospatial interpolation framework. In: In 2016 IEEE international conference on multimedia and expo (ICME), pp 1–6 Tang M, Agrawal P, Nie F, Pongpaichet S, Jain R (2016) A graph based multimodal geospatial interpolation framework. In: In 2016 IEEE international conference on multimedia and expo (ICME), pp 1–6
43.
44.
Zurück zum Zitat Tang M, Wu X, Agrawal P, Pongpaichet S, Jain R (2017) Integration of diverse data sources for spatial PM2. 5 data interpolation. IEEE Trans Multimedia 19(2):408–417. Tang M, Wu X, Agrawal P, Pongpaichet S, Jain R (2017) Integration of diverse data sources for spatial PM2. 5 data interpolation. IEEE Trans Multimedia 19(2):408–417.
45.
Zurück zum Zitat Tuzel O, Porikli F, Meer P (2006) Region covariance: a fast descriptor for detection and classification. In: European conference on computer vision. Springer, Berlin, pp 589–600 Tuzel O, Porikli F, Meer P (2006) Region covariance: a fast descriptor for detection and classification. In: European conference on computer vision. Springer, Berlin, pp 589–600
46.
Zurück zum Zitat Tuzel O, Porikli F, Meer P (2008) Pedestrian detection via classification on riemannian manifolds. IEEE Trans Pattern Anal Mach Intell 30(10):1713–1727CrossRef Tuzel O, Porikli F, Meer P (2008) Pedestrian detection via classification on riemannian manifolds. IEEE Trans Pattern Anal Mach Intell 30(10):1713–1727CrossRef
47.
Zurück zum Zitat Wang X, Mueen A, Ding H, Trajcevski G, Scheuermann P, Keogh E (2013) Experimental comparison of representation methods and distance measures for time series data. Data Min Knowl Disc 26(2):275–309MathSciNetCrossRef Wang X, Mueen A, Ding H, Trajcevski G, Scheuermann P, Keogh E (2013) Experimental comparison of representation methods and distance measures for time series data. Data Min Knowl Disc 26(2):275–309MathSciNetCrossRef
48.
Zurück zum Zitat Ye L, Keogh E (2009) Time series shapelets: A new primitive for data mining. In: Proceedings of 15th ACM SIGKDD international conference on knowledge discovery data mining, pp 947–956 Ye L, Keogh E (2009) Time series shapelets: A new primitive for data mining. In: Proceedings of 15th ACM SIGKDD international conference on knowledge discovery data mining, pp 947–956
49.
Zurück zum Zitat Zhang Q, Goldman S, Yu W, Fritts J (2002) Content-based image retrieval using multiple-instance learning. ICML 2:682–689 Zhang Q, Goldman S, Yu W, Fritts J (2002) Content-based image retrieval using multiple-instance learning. ICML 2:682–689
50.
Zurück zum Zitat Zhao J, Itti L (2016) Classifying time series using local descriptors with hybrid sampling. IEEE Trans Knowl Data Eng 28(3):623–637CrossRef Zhao J, Itti L (2016) Classifying time series using local descriptors with hybrid sampling. IEEE Trans Knowl Data Eng 28(3):623–637CrossRef
Metadaten
Titel
Time series classification with feature covariance matrices
verfasst von
Hamza Ergezer
Kemal Leblebicioğlu
Publikationsdatum
09.09.2017
Verlag
Springer London
Erschienen in
Knowledge and Information Systems / Ausgabe 3/2018
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-017-1098-1

Weitere Artikel der Ausgabe 3/2018

Knowledge and Information Systems 3/2018 Zur Ausgabe