Top

Pattern Analysis and Applications

Published in:

04-04-2018 | Theoretical Advances

Bag of recurrence patterns representation for time-series classification

Authors: Nima Hatami, Yann Gavet, Johan Debayle

Published in: Pattern Analysis and Applications | Issue 3/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Time-series classification (TSC) has attracted a lot of attention in pattern recognition, because wide range of applications from different domains such as finance and health informatics deal with time-series signals. Bag-of-features (BoF) model has achieved a great success in TSC task by summarizing signals according to the frequencies of “feature words” of a data-learned dictionary. This paper proposes embedding the recurrence plots (RP), a visualization technique for analysis of dynamic systems, in the BoF model for TSC. While the traditional BoF approach extracts features from 1D signal segments, this paper uses the RP to transform time-series into 2D texture images and then applies the BoF on them. Image representation of time-series enables us to explore different visual descriptors that are not available for 1D signals and to treat TSC task as a texture recognition problem. Experimental results on the UCI time-series classification archive demonstrates a significant accuracy boost by the proposed bag of recurrence patterns, compared not only to the existing BoF models, but also to the state-of-the art algorithms.

previous article Feature selection via Lèvy Antlion optimization

next article SIFT-based iris recognition revisited: prerequisites, advantages and improvements

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Acharya U, Sree S, Chattopadhyay S, Yu W, Ang P (2011) Application of recurrence quantification analysis for the automated identification of epileptic EEG signals. Int J Neural Syst 21(03):199–211CrossRef

Allili M (2012) Wavelet modeling using finite mixtures of generalized Gaussian distributions: application to texture discrimination and retrieval. IEEE Trans Image Process 21(4):1452–1464MathSciNetCrossRefMATH

Armano G, Chira C, Hatami N (2012) Error-correcting output codes for multi-label text categorization. In: 3rd Italian information retrieval workshop (IIR), pp 26–37

Bailly A, Malinowski S, Tavenard R, Guyet T, Chapel L (2015) Bag-of-temporal-sift-words for time series classification. In: ECML/PKDD workshop on advanced analytics and learning on temporal data

Bailly A, Malinowski S, Tavenard R, Guyet T, Chapel L (2016) Dense bag-of-temporal-sift-words for time series classification. Lecture Notes in Artificial Intelligence

Baydogan M, Runger G (2016) Time series representation and similarity based on local auto patterns. Data Min Knowl Discov 30(2):476–509MathSciNetCrossRefMATH

Baydogan M, Runger G, Tuv E (2013) A bag-of-features framework to classify time series. IEEE Trans PAMI 35(11):2796–2802CrossRef

Bromuri S, Zufferey D, Hennebert J, Schumacher M (2014) Multi-label classification of chronically ill patients with bag of words and supervised dimensionality reduction algorithms. J Biomed Inform 51:165–175CrossRef

Chang C, Lin C (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef

10.

Chen Y, Keogh E, Hu B, Begum N, Bagnall A, Mueen A, Batista G (2015) The ucr time series classification archive

11.

Chen Y, Yang H (2012) Multiscale recurrence analysis of long-term nonlinear and nonstationary time series. Chaos Solitons Fractals 45(7):978–987CrossRef

12.

Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. CVPR, San DiegoCrossRef

13.

Dong Y, Feng J, Liang L, Zheng L (2017) Multiscale Sampling Based Texture Image Classification. IEEE Signal Process Lett 24(5):614–618CrossRef

14.

Dong Y, Tao D, Li X, Ma J, Pu J (2015) Texture classification and retrieval using shearlets and linear regression. IEEE Trans Cybern 45(3):358–369CrossRef

15.

Eads D, Glocer K, Perkins S, Theiler J (2005) Grammar-guided feature extraction for time series classification. NIPS

16.

Eckmann JP, Kamphorst SO, Ruelle D (1987) Recurrence plots of dynamical systems. Europhys Lett 4(9):973–977CrossRef

17.

Fu Z, Lu G, Ting K, Zhang D (2011) Music classification via the bag-of-features approach. Pattern Recognit Lett 32(14):1768–1777CrossRef

18.

Geurts P (2009) Pattern extraction for time series classification. In: 5th EU conference principles of data mining and knowledge discovery, pp 115–127

19.

Grabocka J, Wistuba M, Schmidt-Thieme L (2015) Scalable classification of repetitive time series through frequencies of local polynomials. IEEE Trans Knowl Data Eng 27(6):1683–1695CrossRef

20.

Hatami N, Gavet Y, Debayle J (2017) Classification of time-series images using deep convolutional neural networks. In: International conference on machine vision (ICMV)

21.

Hatami N (2008) Thinned ecoc decomposition for gene expression based cancer classification. In: 8th IEEE Conference on intelligent systems design and applications, pp 216–221

22.

Hatami N (2012a) Some proposals for combining ensemble classifiers. Ph.D. thesis, University of Cagliari

23.

Hatami N (2012b) Thinned-ecoc ensemble based on sequential code shrinking. Expert Syst Appl 39(1):936–947CrossRef

24.

Hatami N, Chira C (2013) Classifiers with a reject option for early time-series classification. In: IEEE symposium on computational intelligence and ensemble learning (CIEL), pp 9–16

25.

Hatami N, Ebrahimpour R, Ghaderi R (2008) Ecoc-based training of neural networks for face recognition. In: IEEE conference on cybernetics and intelligent systems, pp 450–454

26.

Jeong Y, Jeong M, Omitaomu O (2011) Weighted dynamic time warping for time series classification. Pattern Recognit 44(9):2231–2240CrossRef

27.

Keogh E, Kasetty S (2003) On the need for time series data mining benchmarks: a survey and empirical demonstration. Data Min Knowl Discov 7(4):349–371MathSciNetCrossRef

28.

Kumar N, Lolla V, Keogh E, Lonardi S, Ratanamahatana C, Wei L (2005) Time-series bitmaps: a practical visualization tool for working with large time series databases. In SIAM international conference on data mining, pp 531–535

29.

Lategahn H, Gross S, Stehle T, Aach T (2010) Texture classification by modeling joint distributions of local patterns with Gaussian mixtures. IEEE Trans image Process 19(6):1548–1557MathSciNetCrossRefMATH

30.

Lin J, Khade R, Li Y (2012) Rotation-invariant similarity in time series using bag-of-patterns representation. J Intell Inf Syst 39(2):287–315CrossRef

31.

Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef

32.

Marwan N, Romano MC, Thiel M, Kurths J (2007) Recurrence plots for the analysis of complex systems. Phys Rep 438(5–6):237–329MathSciNetCrossRef

33.

Marwan N, Wessel N, Meyerfeldt U, Schirdewan A, Kurths J (2002) Recurrence plot based measures of complexity and its application to heart rate variability data. Phys Rev E 66(2):026702CrossRefMATH

34.

Marwan N, Kurths J (2009) Comment on stochastic analysis of recurrence plots with applications to the detection of deterministic signals by rohde et al.[physica d 237 (2008) 619629]</CHECK>. Physica D 238:1711–1715CrossRefMATH

35.

Mehta R, Eguiazarian K (2016) Texture classification using dense micro-block difference. IEEE Trans Image Process 25(4):1604–1616MathSciNetCrossRefMATH

36.

Nanopoulos A, Alcock R, Manolopoulos Y (2001) Feature-based classification of time-series data. Int J Comput Res 10:49–61

37.

Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. TPAMI 7(24):971–987CrossRefMATH

38.

Ratanamahatana C, Keogh E (2004) Making time-series classification more accurate using learned constraints. In: Proceedings of SIAM International Conference on Data Mining, pp 11–22

39.

Rodriguez J, Alonso C (2004) Interval and dynamic time warping-based decision trees. In: ACM symposium on applied computing, pp 548–552

40.

Rodriguez J, Alonso C, Maestro J (2005) Support vector machines of interval-based features for time series classification. Knowl Based Syst 18:171–178CrossRef

41.

Rohde G, Nichols J, Dissinger B, Bucholtz F (2008) Stochastic analysis of recurrence plots with applications to the detection of deterministic signals. Phys D Nonlinear Phenom 237(5):619–629MathSciNetCrossRefMATH

42.

Roma G, Nogueira W, Herrera P, de Boronat R (2013) Recurrence quantification analysis features for auditory scene classification. In: IEEE AASP challenge on detection and classification of acoustic scenes and events

43.

Schafer P (2015) The boss is concerned with time series classification in the presence of noise. Data Min Knowl Discov 29(6):1505–1530MathSciNetCrossRefMATH

44.

Senin P, Malinchik S (2013) Sax-vsm: Interpretable time series classification using sax and vector space model. In: IEEE 13th international conference on data mining (ICDM), pp 1175–1180

45.

Souza V, Silva D, Batista G (2013) Time series classification using compression distance of recurrence plots. In: IEEE 13th international conference on data mining, pp 687–696

46.

Souza V, Silva D, Batista G (2014) Extracting texture features for time series classification. In: 22nd international conference on pattern recognition (ICPR), pp 1425–1430

47.

Thiel M, Romano MC, Kurths J (2003) Analytical description of recurrence plots of white noise and chaotic processes,.arXiv:nlin/0301027

48.

Ueno K, Xi X, Keogh E, Lee D (2007) Anytime classification using the nearest neighbour algorithm with applications to stream mining. In: IEEE international conference on data mining, pp 623–632

49.

Wang J, Liu P, She M, Nahavandi S, Kouzani A (2013) Bag-of-words representation for biomedical time series classification. Biomed Signal Process Control 8(6):634–644CrossRef

50.

Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y (2010) Locality-constrained linear coding for image classification. In: CVPR, pp 3360–3367

51.

Wang Z, Oates T (2014) Time warping symbolic aggregation approximation with bag-of-patterns representation for time series classification. In: 13th international conference on machine learning and applications (ICMLA), pp 270–275

52.

Wang Z, Oates T (2015) Pooling sax-bop approaches with boosting to classify multivariate synchronous physiological time series data. In: FLAIRS conference, pp 335–341

53.

Xing Z, Pei J, Yu P (2011) Early prediction on time series: a nearest neighbor approach. Int Joint Conf Artif Intell 2168:1297–1302

54.

Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification. In: CVPR, pp 1794–1801

55.

Yang H (2011) Multiscale recurrence quantification analysis of spatial cardiac vectorcardiogram signals. IEEE Trans Biomed Eng 58(2):339–347CrossRef

56.

Zbilut JP, Webber CL Jr (1992) Embeddings and delays as derived from quantification of recurrence plots. Phys Lett A 171(3–4):199–203CrossRef

57.

Zhang M, Sawchuk A (2012) Motion primitive-based human activity recognition using a bag-of-features approach. In: ACM SIGHIT symposium on international health informatics (IHI), pp 631–640

58.

Zhao J, Itti L (2016) Classifying time series using local descriptors with hybrid sampling. IEEE Trans Knowl Data Eng 28:623–637CrossRef

Title: Bag of recurrence patterns representation for time-series classification
Authors: Nima Hatami
Yann Gavet
Johan Debayle
Publication date: 04-04-2018
Publisher: Springer London
Published in: Pattern Analysis and Applications / Issue 3/2019
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI: https://doi.org/10.1007/s10044-018-0703-6

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 3/2019

Feature selection via Lèvy Antlion optimization

Commentary on “New aggregation operators of single-valued neutrosophic hesitant fuzzy set and their application in multi-attribute decision making”

A bi-objective hybrid algorithm for the classification of imbalanced noisy and borderline data sets

A generalized multi-scale line-detection method to boost retinal vessel segmentation sensitivity

Local support-based partition algorithm for frequent pattern mining

Unifying the skeletonization methods via modifying images

Premium Partner