Skip to main content

2017 | OriginalPaper | Buchkapitel

Efficient Temporal Kernels Between Feature Sets for Time Series Classification

verfasst von : Romain Tavenard, Simon Malinowski, Laetitia Chapel, Adeline Bailly, Heider Sanchez, Benjamin Bustos

Erschienen in: Machine Learning and Knowledge Discovery in Databases

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the time-series classification context, the majority of the most accurate core methods are based on the Bag-of-Words framework, in which sets of local features are first extracted from time series. A dictionary of words is then learned and each time series is finally represented by a histogram of word occurrences. This representation induces a loss of information due to the quantization of features into words as all the time series are represented using the same fixed dictionary. In order to overcome this issue, we introduce in this paper a kernel operating directly on sets of features. Then, we extend it to a time-compliant kernel that allows one to take into account the temporal information. We apply this kernel in the time series classification context. Proposed kernel has a quadratic complexity with the size of input feature sets, which is problematic when dealing with long time series. However, we show that kernel approximation techniques can be used to define a good trade-off between accuracy and complexity. We experimentally demonstrate that the proposed kernel can significantly improve the performance of time series classification algorithms based on Bag-of-Words.
Code related to this chapter is available at: https://​github.​com/​rtavenar/​SQFD-TimeSeries
Data related to this chapter are available at: http://​www.​timeseriesclassi​fication.​com

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
https://​github.​com/​rtavenar/​SQFD-TimeSeries: contains code and supplementary material.
 
2
See Supplementary material for experiments on more datasets.
 
3
For the sake of brevity, we focus on standalone classifiers that are shown in [1] to outperform competitors in their categories.
 
Literatur
2.
Zurück zum Zitat Bailly, A., Malinowski, S., Tavenard, R., Chapel, L., Guyet, T.: Dense bag-of-temporal-SIFT-words for time series classification. In: Douzal-Chouakria, A., Vilar, J.A., Marteau, P.-F. (eds.) AALTD 2015. LNCS (LNAI), vol. 9785, pp. 17–30. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44412-3_2 Bailly, A., Malinowski, S., Tavenard, R., Chapel, L., Guyet, T.: Dense bag-of-temporal-SIFT-words for time series classification. In: Douzal-Chouakria, A., Vilar, J.A., Marteau, P.-F. (eds.) AALTD 2015. LNCS (LNAI), vol. 9785, pp. 17–30. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-44412-3_​2
3.
Zurück zum Zitat Baydogan, M.G., Runger, G.: Learning a symbolic representation for multivariate time series classification. Data Min. Knowl. Discov. 29(2), 400–422 (2015)MathSciNetCrossRef Baydogan, M.G., Runger, G.: Learning a symbolic representation for multivariate time series classification. Data Min. Knowl. Discov. 29(2), 400–422 (2015)MathSciNetCrossRef
4.
Zurück zum Zitat Baydogan, M.G., Runger, G., Tuv, E.: A bag-of-features framework to classify time series. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2796–2802 (2013)CrossRef Baydogan, M.G., Runger, G., Tuv, E.: A bag-of-features framework to classify time series. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2796–2802 (2013)CrossRef
5.
Zurück zum Zitat Beecks, C., Uysal, M.S., Seidl, T.: Signature quadratic form distance. In: Proceedings of ACM International Conference on Image and Video Retrieval, pp. 438–445 (2010) Beecks, C., Uysal, M.S., Seidl, T.: Signature quadratic form distance. In: Proceedings of ACM International Conference on Image and Video Retrieval, pp. 438–445 (2010)
6.
Zurück zum Zitat Bo, L., Sminchisescu, C.: Efficient match kernel between sets of features for visual recognition. Adv. Neural Inf. Process. Syst. 22, 135–143 (2009) Bo, L., Sminchisescu, C.: Efficient match kernel between sets of features for visual recognition. Adv. Neural Inf. Process. Syst. 22, 135–143 (2009)
7.
Zurück zum Zitat Candan, K.S., Rossini, R., Sapino, M.L.: sDTW: computing DTW distances using locally relevant constraints based on salient feature alignments. In: Proceedings of International Conference on Very Large DataBases, vol. 5, pp. 1519–1530 (2012) Candan, K.S., Rossini, R., Sapino, M.L.: sDTW: computing DTW distances using locally relevant constraints based on salient feature alignments. In: Proceedings of International Conference on Very Large DataBases, vol. 5, pp. 1519–1530 (2012)
9.
Zurück zum Zitat Cuturi, M.: Fast global alignment kernels. In: Proceedings of International Conference on Machine Learning, pp. 929–936 (2011) Cuturi, M.: Fast global alignment kernels. In: Proceedings of International Conference on Machine Learning, pp. 929–936 (2011)
10.
Zurück zum Zitat Drineas, P., Mahoney, M.W.: On the nyström method for approximating a gram matrix for improved kernel-based learning. J. Mach. Learn. Res. 6, 2153–2175 (2005)MathSciNetMATH Drineas, P., Mahoney, M.W.: On the nyström method for approximating a gram matrix for improved kernel-based learning. J. Mach. Learn. Res. 6, 2153–2175 (2005)MathSciNetMATH
11.
Zurück zum Zitat Gärtner, T., Flach, P.A., Kowalczyk, A., Smola, A.J.: Multi-instance kernels. In: Proceedings of International Conference on Machine Learning (2002) Gärtner, T., Flach, P.A., Kowalczyk, A., Smola, A.J.: Multi-instance kernels. In: Proceedings of International Conference on Machine Learning (2002)
12.
Zurück zum Zitat Górecki, T., Łuczak, M.: Non-isometric transforms in time series classification using DTW. Knowl.-Based Syst. 61, 98–108 (2014)CrossRefMATH Górecki, T., Łuczak, M.: Non-isometric transforms in time series classification using DTW. Knowl.-Based Syst. 61, 98–108 (2014)CrossRefMATH
13.
Zurück zum Zitat Grabocka, J., Schilling, N., Wistuba, M., Schmidt-Thieme, L.: Learning time-series shapelets. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 392–401 (2014) Grabocka, J., Schilling, N., Wistuba, M., Schmidt-Thieme, L.: Learning time-series shapelets. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 392–401 (2014)
14.
Zurück zum Zitat Gretton, A., Borgwardt, K.M., Rasch, M., Schölkopf, B., Smola, A.J.: A kernel method for the two-sample-problem. In: Advances in Neural Information Processing Systems, pp. 513–520 (2006) Gretton, A., Borgwardt, K.M., Rasch, M., Schölkopf, B., Smola, A.J.: A kernel method for the two-sample-problem. In: Advances in Neural Information Processing Systems, pp. 513–520 (2006)
15.
Zurück zum Zitat Hills, J., Lines, J., Baranauskas, E., Mapp, J., Bagnall, A.: Classification of time series by shapelet transformation. Data Min. Knowl. Discov. 28(4), 851–881 (2014)MathSciNetCrossRefMATH Hills, J., Lines, J., Baranauskas, E., Mapp, J., Bagnall, A.: Classification of time series by shapelet transformation. Data Min. Knowl. Discov. 28(4), 851–881 (2014)MathSciNetCrossRefMATH
16.
Zurück zum Zitat Huttenlocher, D.P., Klanderman, G.A., Rucklidge, W.J.: Comparing images using the Hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15(9), 850–863 (1993)CrossRef Huttenlocher, D.P., Klanderman, G.A., Rucklidge, W.J.: Comparing images using the Hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15(9), 850–863 (1993)CrossRef
17.
Zurück zum Zitat Le Cun, Y., Bengio, Y.: Convolutional networks for images, speech, and time series. In: The Handbook of Brain Theory and Neural Networks, vol. 3361, pp. 255–258 (1995) Le Cun, Y., Bengio, Y.: Convolutional networks for images, speech, and time series. In: The Handbook of Brain Theory and Neural Networks, vol. 3361, pp. 255–258 (1995)
18.
Zurück zum Zitat Lin, J., Keogh, E., Lonardi, S., Chiu, B.: A symbolic representation of time series, with implications for streaming algorithms. In: Proceedings of ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, pp. 2–11 (2003) Lin, J., Keogh, E., Lonardi, S., Chiu, B.: A symbolic representation of time series, with implications for streaming algorithms. In: Proceedings of ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, pp. 2–11 (2003)
19.
Zurück zum Zitat Lin, J., Khade, R., Li, Y.: Rotation-invariant similarity in time series using bag-of-patterns representation. Int. J. Inf. Syst. 39, 287–315 (2012)CrossRef Lin, J., Khade, R., Li, Y.: Rotation-invariant similarity in time series using bag-of-patterns representation. Int. J. Inf. Syst. 39, 287–315 (2012)CrossRef
20.
Zurück zum Zitat Mairal, J., Koniusz, P., Harchaoui, Z., Schmid, C.: Convolutional kernel networks. In: Advances in Neural Information Processing Systems, pp. 2627–2635 (2014) Mairal, J., Koniusz, P., Harchaoui, Z., Schmid, C.: Convolutional kernel networks. In: Advances in Neural Information Processing Systems, pp. 2627–2635 (2014)
21.
Zurück zum Zitat Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH
22.
Zurück zum Zitat Perronnin, F., Dance, C.: Fisher kernels on visual vocabularies for image categorization. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007) Perronnin, F., Dance, C.: Fisher kernels on visual vocabularies for image categorization. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
23.
Zurück zum Zitat Rahimi, A., Recht, B.: Random features for large-scale kernel machines. In: Advances in Neural Information Processing Systems, pp. 1177–1184 (2007) Rahimi, A., Recht, B.: Random features for large-scale kernel machines. In: Advances in Neural Information Processing Systems, pp. 1177–1184 (2007)
24.
Zurück zum Zitat Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Sig. Process. 26(1), 43–49 (1978)CrossRefMATH Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Sig. Process. 26(1), 43–49 (1978)CrossRefMATH
25.
Zurück zum Zitat Schäfer, P.: The BOSS is concerned with time series classification in the presence of noise. Data Min. Knowl. Discov. 29(6), 1505–1530 (2014)MathSciNetCrossRef Schäfer, P.: The BOSS is concerned with time series classification in the presence of noise. Data Min. Knowl. Discov. 29(6), 1505–1530 (2014)MathSciNetCrossRef
26.
Zurück zum Zitat Senin, P., Malinchik, S.: SAX-VSM: interpretable time series classification using SAX and vector space model. In: Proceedings of IEEE International Conference on Data Mining, pp. 1175–1180 (2013) Senin, P., Malinchik, S.: SAX-VSM: interpretable time series classification using SAX and vector space model. In: Proceedings of IEEE International Conference on Data Mining, pp. 1175–1180 (2013)
27.
Zurück zum Zitat Wang, J., Liu, P., She, M.F.H., Nahavandi, S., Kouzani, A.: Bag-of-words representation for biomedical time series classification. Biomed. Sig. Process. Control 8(6), 634–644 (2013)CrossRef Wang, J., Liu, P., She, M.F.H., Nahavandi, S., Kouzani, A.: Bag-of-words representation for biomedical time series classification. Biomed. Sig. Process. Control 8(6), 634–644 (2013)CrossRef
28.
Zurück zum Zitat Xie, J., Beigi, M.: A scale-invariant local descriptor for event recognition in 1D sensor signals. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1226–1229 (2009) Xie, J., Beigi, M.: A scale-invariant local descriptor for event recognition in 1D sensor signals. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1226–1229 (2009)
29.
Zurück zum Zitat Ye, L., Keogh, E.: Time series shapelets: a new primitive for data mining. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 947–956 (2009) Ye, L., Keogh, E.: Time series shapelets: a new primitive for data mining. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 947–956 (2009)
Metadaten
Titel
Efficient Temporal Kernels Between Feature Sets for Time Series Classification
verfasst von
Romain Tavenard
Simon Malinowski
Laetitia Chapel
Adeline Bailly
Heider Sanchez
Benjamin Bustos
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-71246-8_32