Skip to main content
Erschienen in: Knowledge and Information Systems 2/2016

01.02.2016 | Regular Paper

Minimizing response time in time series classification

verfasst von: Shin Ando, Einoshin Suzuki

Erschienen in: Knowledge and Information Systems | Ausgabe 2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Providing a timely output is one of the important criteria in applications of time series classification. Recent studies have been motivated to explore models of early prediction, prediction based on truncated temporal observations. The truncation of input improves the response time, but generally reduces the reliability of the prediction. The trade-off between the earliness and the accuracy is an inherent challenge of learning an early prediction model. In this paper, we present an optimization-based approach for learning an ensemble model for timely prediction with an intuitive objective function. The proposed model is comprised of time series classifiers with different response time, and a sequential aggregation procedure to determine the single timing of its output. We formalize the training of the ensemble classifier as a quadratic programming problem and present an iterative algorithm which minimizes an empirical risk function and the response time required to achieve the minimal risk simultaneously. We conduct an empirical study using a collection of behavior and time series datasets to evaluate the proposed algorithm. In the comparisons of the traditional and time-sensitive performance measures, the ensemble framework showed significant advantages over the existing methods on early prediction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The codes and the instructions for generating the above datasets are provided at http://​www.​rs.​tus.​ac.​jp/​ando/​expdat_​sdm13.​html.
 
Literatur
1.
Zurück zum Zitat Anderson H, Parrish N, Tsukida K, Gupta M (2012) Reliable early classification of time series. In: IEEE international conference on Acoustics, speech and signal processing (ICASSP), pp 2073–2076 Anderson H, Parrish N, Tsukida K, Gupta M (2012) Reliable early classification of time series. In: IEEE international conference on Acoustics, speech and signal processing (ICASSP), pp 2073–2076
2.
Zurück zum Zitat Ando S, Suzuki E (2011) Role-behavior analysis from trajectory data by cross-domain learning. In: Proceedings of the 2011 IEEE 11th international conference on data mining, ICDM ’11, pp 21–30 Ando S, Suzuki E (2011) Role-behavior analysis from trajectory data by cross-domain learning. In: Proceedings of the 2011 IEEE 11th international conference on data mining, ICDM ’11, pp 21–30
3.
Zurück zum Zitat Ando S, Suzuki E (2013) Time-sensitive classification of behavioral data. In: Proceedings of the 13th SIAM international conference on data mining, pp 458–466 Ando S, Suzuki E (2013) Time-sensitive classification of behavioral data. In: Proceedings of the 13th SIAM international conference on data mining, pp 458–466
4.
Zurück zum Zitat Ando S, Thanomphongphan T, Hoshino D, Seki Y, Suzuki E (2011) ACE: anomaly clustering ensemble for multi-perspective anomaly detection in robot behaviors. In: Proceedings of the tenth SIAM international conference on data mining, pp 1–12 Ando S, Thanomphongphan T, Hoshino D, Seki Y, Suzuki E (2011) ACE: anomaly clustering ensemble for multi-perspective anomaly detection in robot behaviors. In: Proceedings of the tenth SIAM international conference on data mining, pp 1–12
5.
Zurück zum Zitat Ando S, Thanomphongphan T, Seki Y, Suzuki E (2013) Ensemble anomaly detection from multi-resolution trajectory features. Data Min Knowl Discov 29:39–84 Ando S, Thanomphongphan T, Seki Y, Suzuki E (2013) Ensemble anomaly detection from multi-resolution trajectory features. Data Min Knowl Discov 29:39–84
7.
Zurück zum Zitat Bartlett PL, Wegkamp MH (2008) Classification with a reject option using a hinge loss. J Mach Learn Res 9:1823–1840MathSciNetMATH Bartlett PL, Wegkamp MH (2008) Classification with a reject option using a hinge loss. J Mach Learn Res 9:1823–1840MathSciNetMATH
8.
Zurück zum Zitat Buza K, Nanopoulos A, Schmidt-Thieme L (2011) INSIGHT: efficient and effective instance selection for time-series classification. In: Proceedings of the 15th Pacific-Asia conference on advances in knowledge discovery and data mining, volume part II, PAKDD’11. Springer, Berlin, pp 149–160 Buza K, Nanopoulos A, Schmidt-Thieme L (2011) INSIGHT: efficient and effective instance selection for time-series classification. In: Proceedings of the 15th Pacific-Asia conference on advances in knowledge discovery and data mining, volume part II, PAKDD’11. Springer, Berlin, pp 149–160
9.
Zurück zum Zitat Boyd S, Vandenberghe L (2004) Convex optimization. Berichte über verteilte messysteme. Cambridge University Press, CambridgeCrossRef Boyd S, Vandenberghe L (2004) Convex optimization. Berichte über verteilte messysteme. Cambridge University Press, CambridgeCrossRef
10.
Zurück zum Zitat Buza K, Nanopoulos A, Schmidt-Thieme L (2011) IQ estimation for accurate time-series classification. In: IEEE symposium on computational intelligence and data mining (CIDM), pp 216–223 Buza K, Nanopoulos A, Schmidt-Thieme L (2011) IQ estimation for accurate time-series classification. In: IEEE symposium on computational intelligence and data mining (CIDM), pp 216–223
11.
Zurück zum Zitat Cao L, Yu PS (2012) Behavior computing: modeling, analysis, mining and decision. Springer, BerlinCrossRef Cao L, Yu PS (2012) Behavior computing: modeling, analysis, mining and decision. Springer, BerlinCrossRef
12.
Zurück zum Zitat Du J, Ni EA, Ling CX (2010) Adapting cost-sensitive learning for reject option. In: Proceedings of the 19th ACM international conference on information and knowledge management, CIKM ’10, pp 1865–1868 Du J, Ni EA, Ling CX (2010) Adapting cost-sensitive learning for reject option. In: Proceedings of the 19th ACM international conference on information and knowledge management, CIKM ’10, pp 1865–1868
13.
Zurück zum Zitat Elkan C (2001) The foundations of cost-sensitive learning. In: Proceedings of the 17th international joint conference on artificial intelligence, vol 2, pp 973–978 Elkan C (2001) The foundations of cost-sensitive learning. In: Proceedings of the 17th international joint conference on artificial intelligence, vol 2, pp 973–978
15.
Zurück zum Zitat Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139MathSciNetCrossRefMATH Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139MathSciNetCrossRefMATH
16.
Zurück zum Zitat Ghalwash M, Obradovic Z (2012) Early classification of multivariate temporal observations by extraction of interpretable shapelets. BMC Bioinform 13:1–12CrossRef Ghalwash M, Obradovic Z (2012) Early classification of multivariate temporal observations by extraction of interpretable shapelets. BMC Bioinform 13:1–12CrossRef
17.
Zurück zum Zitat Hanczar B, Dougherty ER (2008) Classification with reject option in gene expression data. Bioinformatics 24(17):1889–1895CrossRef Hanczar B, Dougherty ER (2008) Classification with reject option in gene expression data. Bioinformatics 24(17):1889–1895CrossRef
18.
Zurück zum Zitat Hatami N, Chira C (2013) Classifiers with a reject option for early time-series classification. In: IEEE symposium on computational intelligence and ensemble learning (CIEL), pp 9–16 Hatami N, Chira C (2013) Classifiers with a reject option for early time-series classification. In: IEEE symposium on computational intelligence and ensemble learning (CIEL), pp 9–16
19.
Zurück zum Zitat Hoai M (2012) Max-margin early event detectors. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition (CVPR), CVPR ’12, pp 2863–2870 Hoai M (2012) Max-margin early event detectors. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition (CVPR), CVPR ’12, pp 2863–2870
20.
Zurück zum Zitat Joachims T, Finley T, Yu CNJ (2009) Cutting-plane training of structural SVMs. Mach Learn 77:27–59CrossRefMATH Joachims T, Finley T, Yu CNJ (2009) Cutting-plane training of structural SVMs. Mach Learn 77:27–59CrossRefMATH
21.
Zurück zum Zitat Kaluz̆a B, Mirchevska V, Dovgan E, Lus̆trek M, Gams M (2010) An agent-based approach to care in independent living. In: de Ruyter B, Wichert R, Keyson D, Markopoulos P, Streitz N, Divitini M, Georgantas N, Mana Gomez A (eds) Ambient intelligence, Lecture Notes in Computer Science, vol 6439. Springer, Berlin, pp 177–186 Kaluz̆a B, Mirchevska V, Dovgan E, Lus̆trek M, Gams M (2010) An agent-based approach to care in independent living. In: de Ruyter B, Wichert R, Keyson D, Markopoulos P, Streitz N, Divitini M, Georgantas N, Mana Gomez A (eds) Ambient intelligence, Lecture Notes in Computer Science, vol 6439. Springer, Berlin, pp 177–186
22.
23.
Zurück zum Zitat Kouno A, Takano S, Suzuki E (2010) Constructing low-cost swarm robots that march in column formation. In: Proceedings of the 7th international conference on swarm intelligence, ANTS’10, pp 556–557 Kouno A, Takano S, Suzuki E (2010) Constructing low-cost swarm robots that march in column formation. In: Proceedings of the 7th international conference on swarm intelligence, ANTS’10, pp 556–557
24.
Zurück zum Zitat Kumar S, Nguyen HT, Suzuki E (2010) Understanding the behaviour of reactive robots in a patrol task by analysing their trajectories. In: Proceedings of the 2010 IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology, vol 02, WI-IAT ’10, pp 56–63 Kumar S, Nguyen HT, Suzuki E (2010) Understanding the behaviour of reactive robots in a patrol task by analysing their trajectories. In: Proceedings of the 2010 IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology, vol 02, WI-IAT ’10, pp 56–63
27.
Zurück zum Zitat Mori A, Uchida S, Kurazume R, Taniguchi R, Hasegawa T, Sakoe H (2006) Early recognition and prediction of gestures. In: Proceedings of the 18th international conference on pattern recognition, vol 03, ICPR ’06, pp 560–563 Mori A, Uchida S, Kurazume R, Taniguchi R, Hasegawa T, Sakoe H (2006) Early recognition and prediction of gestures. In: Proceedings of the 18th international conference on pattern recognition, vol 03, ICPR ’06, pp 560–563
28.
Zurück zum Zitat Pham DT, Chan AB (1998) Control chart pattern recognition using a new type of self-organizing neural network. Proc Inst Mech Eng I J Syst Control Eng 212(2):115–127 Pham DT, Chan AB (1998) Control chart pattern recognition using a new type of self-organizing neural network. Proc Inst Mech Eng I J Syst Control Eng 212(2):115–127
30.
Zurück zum Zitat Roddick JF, Spiliopoulou M (2002) A survey of temporal knowledge discovery paradigms and methods. IEEE Trans Knowl Data Eng 14(4):750–767CrossRef Roddick JF, Spiliopoulou M (2002) A survey of temporal knowledge discovery paradigms and methods. IEEE Trans Knowl Data Eng 14(4):750–767CrossRef
31.
Zurück zum Zitat Saito N (1994) Local feature extraction and its applications using a library of bases. Ph.D. thesis, Yale University, New Haven, CT, USA Saito N (1994) Local feature extraction and its applications using a library of bases. Ph.D. thesis, Yale University, New Haven, CT, USA
32.
Zurück zum Zitat Salvador S, Chan P (2007) Toward accurate dynamic time warping in linear time and space. Intell Data Anal 11(5):561–580 Salvador S, Chan P (2007) Toward accurate dynamic time warping in linear time and space. Intell Data Anal 11(5):561–580
33.
Zurück zum Zitat Serrà J, Arcos JL (2014) An empirical evaluation of similarity measures for time series classification. Knowl Based Syst 67:305–314CrossRef Serrà J, Arcos JL (2014) An empirical evaluation of similarity measures for time series classification. Knowl Based Syst 67:305–314CrossRef
34.
Zurück zum Zitat Sheng VS, Ling CX (2006) Thresholding for making classifiers cost-sensitive. In: Proceedings of the 21st national conference on artificial intelligence, AAAI’06, vol 1, pp 476–481 Sheng VS, Ling CX (2006) Thresholding for making classifiers cost-sensitive. In: Proceedings of the 21st national conference on artificial intelligence, AAAI’06, vol 1, pp 476–481
35.
Zurück zum Zitat Tsochantaridis I, Joachims T, Hofmann T, Altun Y (2005) Large margin methods for structured and interdependent output variables. J Mach Learn Res 6:1453–1484MathSciNetMATH Tsochantaridis I, Joachims T, Hofmann T, Altun Y (2005) Large margin methods for structured and interdependent output variables. J Mach Learn Res 6:1453–1484MathSciNetMATH
36.
Zurück zum Zitat Uchida S, Amamoto K (2008) Early recognition of sequential patterns by classifier combination. In: Proceedings of the 19th international conference on pattern recognition (ICPR’08), pp 1–4 Uchida S, Amamoto K (2008) Early recognition of sequential patterns by classifier combination. In: Proceedings of the 19th international conference on pattern recognition (ICPR’08), pp 1–4
37.
Zurück zum Zitat Wang X, Mueen A, Ding H, Trajcevski G, Scheuermann P, Keogh E (2013) Experimental comparison of representation methods and distance measures for time series data. Data Min Knowl Discov 26(2):275–309MathSciNetCrossRef Wang X, Mueen A, Ding H, Trajcevski G, Scheuermann P, Keogh E (2013) Experimental comparison of representation methods and distance measures for time series data. Data Min Knowl Discov 26(2):275–309MathSciNetCrossRef
38.
Zurück zum Zitat Xi X, Keogh E, Shelton C, Wei L, Ratanamahatana CA (2006) Fast time series classification using numerosity reduction. In: Proceedings of the 23rd international conference on machine learning, ICML ’06, pp 1033–1040 Xi X, Keogh E, Shelton C, Wei L, Ratanamahatana CA (2006) Fast time series classification using numerosity reduction. In: Proceedings of the 23rd international conference on machine learning, ICML ’06, pp 1033–1040
39.
Zurück zum Zitat Xing Z, Pei J, Dong G, Yu PS (2008) Mining sequence classifiers for early prediction. In: Proceedings of the SIAM international conference on data mining, SDM 2008, pp 644–655 Xing Z, Pei J, Dong G, Yu PS (2008) Mining sequence classifiers for early prediction. In: Proceedings of the SIAM international conference on data mining, SDM 2008, pp 644–655
40.
Zurück zum Zitat Xing Z, Pei J, Keogh E (2010) A brief survey on sequence classification. SIGKDD Explor Newsl 12:40–48CrossRef Xing Z, Pei J, Keogh E (2010) A brief survey on sequence classification. SIGKDD Explor Newsl 12:40–48CrossRef
41.
Zurück zum Zitat Xing Z, Pei J, Yu P (2012) Early classification on time series. Knowl Inf Syst 31(1):105–127CrossRef Xing Z, Pei J, Yu P (2012) Early classification on time series. Knowl Inf Syst 31(1):105–127CrossRef
42.
Zurück zum Zitat Xing Z, Pei J, Yu P, Wang K (2011) Extracting interpretable features for early classification on time series. In: Proceedings of the 11th SIAM international conference on data mining (SDM11), pp 247–258 Xing Z, Pei J, Yu P, Wang K (2011) Extracting interpretable features for early classification on time series. In: Proceedings of the 11th SIAM international conference on data mining (SDM11), pp 247–258
43.
Zurück zum Zitat Xing Z, Pei J, Yu PS (2009) Early prediction on time series: a nearest neighbor approach. In: Proceedings of the 21st international joint conference on artificial intelligence, pp 1297–1302 Xing Z, Pei J, Yu PS (2009) Early prediction on time series: a nearest neighbor approach. In: Proceedings of the 21st international joint conference on artificial intelligence, pp 1297–1302
44.
Zurück zum Zitat Yuan M, Wegkamp M (2010) Classification methods with reject option based on convex risk minimization. J Mach Learn Res 11:111–130MathSciNetMATH Yuan M, Wegkamp M (2010) Classification methods with reject option based on convex risk minimization. J Mach Learn Res 11:111–130MathSciNetMATH
Metadaten
Titel
Minimizing response time in time series classification
verfasst von
Shin Ando
Einoshin Suzuki
Publikationsdatum
01.02.2016
Verlag
Springer London
Erschienen in
Knowledge and Information Systems / Ausgabe 2/2016
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-015-0826-7

Weitere Artikel der Ausgabe 2/2016

Knowledge and Information Systems 2/2016 Zur Ausgabe

Premium Partner