Skip to main content

2016 | OriginalPaper | Buchkapitel

Dimension Reduction in Dissimilarity Spaces for Time Series Classification

verfasst von : Brijnesh Jain, Stephan Spiegel

Erschienen in: Advanced Analysis and Learning on Temporal Data

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Time series classification in the dissimilarity space combines the advantages of elastic dissimilarity functions such as the dynamic time warping distance and the rich mathematical structure of Euclidean spaces. We applied dimension reduction using PCA followed by support vector learning on dissimilarity representations to 42 UCR datasets. The results suggest that time series classification in dissimilarity space has potential to complement the state-of-the-art, because the SVM classifiers perform better on the 42 datasets with higher confidence than the nearest-neighbor classifier based on the dynamic time warping distance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Batista, G.E., Wang, X., Keogh, E.J.: A complexity-invariant distance measure for time series. In: SIAM International Conference on Data Mining, vol. 11, pp. 699–710 (2011) Batista, G.E., Wang, X., Keogh, E.J.: A complexity-invariant distance measure for time series. In: SIAM International Conference on Data Mining, vol. 11, pp. 699–710 (2011)
2.
Zurück zum Zitat Boser, B.E., Guyon, I., Vapnik, V.: A training algorithm for optimal margin classifiers. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152 (1992) Boser, B.E., Guyon, I., Vapnik, V.: A training algorithm for optimal margin classifiers. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152 (1992)
3.
Zurück zum Zitat Bunke, H., Riesen, K.: Graph classification based on dissimilarity space embedding. In: da Vitoria Lobo, N., Kasparis, T., Roli, F., Kwok, J.T., Georgiopoulos, M., Anagnostopoulos, G.C., Loog, M. (eds.) Structural, Syntactic, and Statistical Pattern Recognition. LNCS, vol. 5342, pp. 996–1007. Springer, Heidelberg (2008)CrossRef Bunke, H., Riesen, K.: Graph classification based on dissimilarity space embedding. In: da Vitoria Lobo, N., Kasparis, T., Roli, F., Kwok, J.T., Georgiopoulos, M., Anagnostopoulos, G.C., Loog, M. (eds.) Structural, Syntactic, and Statistical Pattern Recognition. LNCS, vol. 5342, pp. 996–1007. Springer, Heidelberg (2008)CrossRef
4.
Zurück zum Zitat Cao, L.J., Chua, K.S., Chong, W.K., Lee, H.P., Gu, Q.M.: A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing 55(1–2), 321–336 (2003) Cao, L.J., Chua, K.S., Chong, W.K., Lee, H.P., Gu, Q.M.: A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing 55(1–2), 321–336 (2003)
5.
Zurück zum Zitat Chen, Y., Garcia, E., Gupta, M., Rahimi, A., Cazzanti, L.: Similarity-based classification: concepts and algorithms. J. Mach. Learn. Res. 10, 747–776 (2009)MathSciNetMATH Chen, Y., Garcia, E., Gupta, M., Rahimi, A., Cazzanti, L.: Similarity-based classification: concepts and algorithms. J. Mach. Learn. Res. 10, 747–776 (2009)MathSciNetMATH
6.
Zurück zum Zitat Cortes, C., Vapnik, V.: Support-vector network. Mach. Learn. 20, 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector network. Mach. Learn. 20, 273–297 (1995)MATH
7.
Zurück zum Zitat Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91(2), 201–213 (2002)MathSciNetCrossRefMATH Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91(2), 201–213 (2002)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Duin, R., de Ridder, D., Tax, D.: Experiments with object based discriminant functions; a featureless approach to pattern recognition. Pattern Recogn. Lett. 18(11–13), 1159–1166 (1997)CrossRef Duin, R., de Ridder, D., Tax, D.: Experiments with object based discriminant functions; a featureless approach to pattern recognition. Pattern Recogn. Lett. 18(11–13), 1159–1166 (1997)CrossRef
9.
Zurück zum Zitat Duin, R.P.W., Pekalska, E.: The dissimilarity space: bridging structural and statistical pattern recognition. Pattern Recogn. Lett. 33(7), 807–962 (2012)CrossRef Duin, R.P.W., Pekalska, E.: The dissimilarity space: bridging structural and statistical pattern recognition. Pattern Recogn. Lett. 33(7), 807–962 (2012)CrossRef
10.
Zurück zum Zitat Fu, T.: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)CrossRef Fu, T.: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)CrossRef
11.
Zurück zum Zitat Geibel, P., Jain, B., Wysotzki, F.: SVM learning with the SH inner product. In: European Symposium on Artificial Neural Networks (2004) Geibel, P., Jain, B., Wysotzki, F.: SVM learning with the SH inner product. In: European Symposium on Artificial Neural Networks (2004)
12.
Zurück zum Zitat Geurts, P.: Pattern extraction for time series classification. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 115–127. Springer, Heidelberg (2001)CrossRef Geurts, P.: Pattern extraction for time series classification. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 115–127. Springer, Heidelberg (2001)CrossRef
13.
Zurück zum Zitat Graepel, T., Herbrich, R., Bollmann-Sdorra, P., Obermayer, K.: Classification on pairwise proximity data. In: Advances in Neural Information Processing Systems (1999) Graepel, T., Herbrich, R., Bollmann-Sdorra, P., Obermayer, K.: Classification on pairwise proximity data. In: Advances in Neural Information Processing Systems (1999)
14.
Zurück zum Zitat Graepel, T., Herbrich, R., Schölkopf, B., Smola, A., Bartlett, P., Müller, K.-R., Obermayer, K., Williamson, R.: Classification on proximity data with LP-machines. In: International Conference on Artificial Neural Networks (1999) Graepel, T., Herbrich, R., Schölkopf, B., Smola, A., Bartlett, P., Müller, K.-R., Obermayer, K., Williamson, R.: Classification on proximity data with LP-machines. In: International Conference on Artificial Neural Networks (1999)
15.
Zurück zum Zitat Gudmundsson, S., Runarsson, T.P., Sigurdsson, S.: Support vector machines and dynamic time warping for time series. In: Joint Conference on Neural Networks (2008) Gudmundsson, S., Runarsson, T.P., Sigurdsson, S.: Support vector machines and dynamic time warping for time series. In: Joint Conference on Neural Networks (2008)
16.
Zurück zum Zitat Haasdonk, H., Burkhardt, B.: Invariant kernels for pattern analysis and machine learning. Mach. Learn. 68, 35–61 (2007)CrossRef Haasdonk, H., Burkhardt, B.: Invariant kernels for pattern analysis and machine learning. Mach. Learn. 68, 35–61 (2007)CrossRef
18.
Zurück zum Zitat Jain, B.J., Geibel, P., Wysotzki, F.: SVM learning with the Schur? Hadamard inner product for graphs. Neurocomputing 64, 93–105 (2005)CrossRef Jain, B.J., Geibel, P., Wysotzki, F.: SVM learning with the Schur? Hadamard inner product for graphs. Neurocomputing 64, 93–105 (2005)CrossRef
19.
Zurück zum Zitat Jain, B.J., Spiegel, S.: Time series classification in dissimilarity spaces. In: Proceedings of the 1st International Workshop on Advanced Analytics and Learning on Temporal Data (2015) Jain, B.J., Spiegel, S.: Time series classification in dissimilarity spaces. In: Proceedings of the 1st International Workshop on Advanced Analytics and Learning on Temporal Data (2015)
21.
Zurück zum Zitat Kate, R.J.: Using dynamic time warping distances as features for improved time series classification. Data Min. Knowl. Discov. 30(2), 283–312 (2016)MathSciNetCrossRef Kate, R.J.: Using dynamic time warping distances as features for improved time series classification. Data Min. Knowl. Discov. 30(2), 283–312 (2016)MathSciNetCrossRef
23.
Zurück zum Zitat Laub, J., Müller, K.R.: Feature discovery in non-metric pairwise data. J. Mach. Learn. Res. 5, 801–818 (2004)MathSciNetMATH Laub, J., Müller, K.R.: Feature discovery in non-metric pairwise data. J. Mach. Learn. Res. 5, 801–818 (2004)MathSciNetMATH
24.
Zurück zum Zitat Lin, J., Keogh, E., Wei, L., Lonardi, S.: Experiencing SAX: a novel symbolic representation of time series. Data Min. Knowl. Discov. 15(2), 107–144 (2007)MathSciNetCrossRef Lin, J., Keogh, E., Wei, L., Lonardi, S.: Experiencing SAX: a novel symbolic representation of time series. Data Min. Knowl. Discov. 15(2), 107–144 (2007)MathSciNetCrossRef
25.
Zurück zum Zitat Lines, J., Bagnall, A.: Time series classification with ensembles of elastic distance measures. Data Min. Knowl. Discov. 29(3), 565–592 (2015)MathSciNetCrossRef Lines, J., Bagnall, A.: Time series classification with ensembles of elastic distance measures. Data Min. Knowl. Discov. 29(3), 565–592 (2015)MathSciNetCrossRef
26.
Zurück zum Zitat Livi, L., Rizzi, A., Sadeghian, A.: Optimized dissimilarity space embedding for labeled graphs. Inf. Sci. 266, 47–64 (2014)MathSciNetCrossRef Livi, L., Rizzi, A., Sadeghian, A.: Optimized dissimilarity space embedding for labeled graphs. Inf. Sci. 266, 47–64 (2014)MathSciNetCrossRef
27.
Zurück zum Zitat Ong, C., Mary, X., Canu, S., Smola, A.J.: Learning with non-positive kernels. In: International Conference on Machine Learning (2004) Ong, C., Mary, X., Canu, S., Smola, A.J.: Learning with non-positive kernels. In: International Conference on Machine Learning (2004)
28.
Zurück zum Zitat Pekalska, E., Duin, R.P.W.: The Dissimilarity Representation for Pattern Recognition. World Scientific, River Edge (2005)MATH Pekalska, E., Duin, R.P.W.: The Dissimilarity Representation for Pattern Recognition. World Scientific, River Edge (2005)MATH
29.
Zurück zum Zitat Pekalska, E., Duin, R.P.W., Paclik, P.: Prototype selection for dissimilarity-based classifiers. Pattern Recogn. 39(2), 189–208 (2006)CrossRefMATH Pekalska, E., Duin, R.P.W., Paclik, P.: Prototype selection for dissimilarity-based classifiers. Pattern Recogn. 39(2), 189–208 (2006)CrossRefMATH
30.
Zurück zum Zitat Petitjean, F., Ketterlin, A., Gançarski, P.: A global averaging method for dynamic time warping, with applications to clustering. Pattern Recogn. 44(3), 678–693 (2011)CrossRefMATH Petitjean, F., Ketterlin, A., Gançarski, P.: A global averaging method for dynamic time warping, with applications to clustering. Pattern Recogn. 44(3), 678–693 (2011)CrossRefMATH
31.
Zurück zum Zitat Riesen, K., Neuhaus, M., Bunke, H.: Graph embedding in vector spaces by means of prototype selection. In: Escolano, F., Vento, M. (eds.) GbRPR. LNCS, vol. 4538, pp. 383–393. Springer, Heidelberg (2007)CrossRef Riesen, K., Neuhaus, M., Bunke, H.: Graph embedding in vector spaces by means of prototype selection. In: Escolano, F., Vento, M. (eds.) GbRPR. LNCS, vol. 4538, pp. 383–393. Springer, Heidelberg (2007)CrossRef
32.
Zurück zum Zitat Riesen, K., Bunke, H.: Graph classification based on vector space embedding. Int. J. Pattern Recogn. Artif. Intell. 23(6), 1053–1081 (2009)MathSciNetCrossRefMATH Riesen, K., Bunke, H.: Graph classification based on vector space embedding. Int. J. Pattern Recogn. Artif. Intell. 23(6), 1053–1081 (2009)MathSciNetCrossRefMATH
33.
Zurück zum Zitat Spillmann, B., Neuhaus, M., Bunke, H., Pękalska, E., Duin, R.P.W.: Transforming strings to vector spaces using prototype selection. In: Yeung, D.-Y., Kwok, J.T., Fred, A., Roli, F., de Ridder, D. (eds.) Structural, Syntactic, and Statistical Pattern Recognition. LNCS, vol. 4109, pp. 287–296. Springer, Heidelberg (2006)CrossRef Spillmann, B., Neuhaus, M., Bunke, H., Pękalska, E., Duin, R.P.W.: Transforming strings to vector spaces using prototype selection. In: Yeung, D.-Y., Kwok, J.T., Fred, A., Roli, F., de Ridder, D. (eds.) Structural, Syntactic, and Statistical Pattern Recognition. LNCS, vol. 4109, pp. 287–296. Springer, Heidelberg (2006)CrossRef
34.
Zurück zum Zitat Subasi, A., Gursoy, M.I.: EEG signal classification using PCA, ICA, LDA and support vector machines. Expert Syst. Appl. 37(12), 8659–8666 (2010)CrossRef Subasi, A., Gursoy, M.I.: EEG signal classification using PCA, ICA, LDA and support vector machines. Expert Syst. Appl. 37(12), 8659–8666 (2010)CrossRef
35.
Zurück zum Zitat Xi, X., Keogh, E., Shelton, C., Wei, L., Ratanamahatana, C.A.: Fast time series classification using numerosity reduction. In: International Conference on Machine Learning (2006) Xi, X., Keogh, E., Shelton, C., Wei, L., Ratanamahatana, C.A.: Fast time series classification using numerosity reduction. In: International Conference on Machine Learning (2006)
36.
Zurück zum Zitat Xing, Z., Pei, J., Keogh, E.: A brief survey on sequence classification. ACM SIGKDD Explor. Newslett. 12(1), 40–48 (2010)CrossRef Xing, Z., Pei, J., Keogh, E.: A brief survey on sequence classification. ACM SIGKDD Explor. Newslett. 12(1), 40–48 (2010)CrossRef
Metadaten
Titel
Dimension Reduction in Dissimilarity Spaces for Time Series Classification
verfasst von
Brijnesh Jain
Stephan Spiegel
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-44412-3_3

Premium Partner