Skip to main content
Top

2020 | OriginalPaper | Chapter

Mining Massive Time Series Data: With Dimensionality Reduction Techniques

Authors : Justin Borg, Joseph G. Vella

Published in: Advances in Computing and Data Sciences

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A pre-processing step to reduce the volume of data but suffer an acceptable loss of data quality before applying data mining algorithms on time series data is needed to decrease the input data size. Input size reduction is an important step in optimizing time series processing, e.g. in data mining computations. During the last two decades various time series dimensionality reduction techniques have been proposed. However no study has been dedicated to gauge these time series dimensionality reduction techniques in terms of their effectiveness of producing a reduced representation of the input time series that when applied to various data mining algorithms produces good quality results. In this paper empirical evidence is given by comparing three reduction techniques on various data sets and applying their output to four different data mining algorithms. The results show that it is sometimes feasible to use these techniques instead of using the original time series data. The comparison is evaluated by running data mining methods over the original and reduced sets of data. It is shown that one dimensionality reduction technique managed to generate results of over 83% average accuracy when compared to its benchmark results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Fu, T.: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)CrossRef Fu, T.: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)CrossRef
2.
go back to reference Keogh, E., Kasetty, S.: On the need for time series data mining benchmarks: a survey and empirical demonstration. Data Min. Knowl. Discov. 7(4), 349–371 (2003)MathSciNetCrossRef Keogh, E., Kasetty, S.: On the need for time series data mining benchmarks: a survey and empirical demonstration. Data Min. Knowl. Discov. 7(4), 349–371 (2003)MathSciNetCrossRef
3.
go back to reference Esling, P., Agon, C.: Time-series data mining. ACM Comput. Surv. 45(1), 1–34 (2012)CrossRef Esling, P., Agon, C.: Time-series data mining. ACM Comput. Surv. 45(1), 1–34 (2012)CrossRef
4.
go back to reference Ding, H., Trajcevski, G., Scheuermann, P., Wang, X., Keogh, E.: Querying and mining of time series data: experimental comparison of representations and distance measures. Proc. VLDB Endowment 1(2), 1542–1552 (2008)CrossRef Ding, H., Trajcevski, G., Scheuermann, P., Wang, X., Keogh, E.: Querying and mining of time series data: experimental comparison of representations and distance measures. Proc. VLDB Endowment 1(2), 1542–1552 (2008)CrossRef
6.
go back to reference Chan, K., Fu, A.W.-c.: Efficient time series matching by wavelets. In: Proceedings of the 15th International Conference on Data Engineering, ICDE 1999, Washington DC (1999) Chan, K., Fu, A.W.-c.: Efficient time series matching by wavelets. In: Proceedings of the 15th International Conference on Data Engineering, ICDE 1999, Washington DC (1999)
7.
go back to reference Keogh, E., Chakrabarti, K., Pazzani, M., Mehrotra, S.: Dimensionality reduction for fast similarity search in large time series databases. Knowl. Inf. Syst. 3(3), 263–286 (2001)CrossRef Keogh, E., Chakrabarti, K., Pazzani, M., Mehrotra, S.: Dimensionality reduction for fast similarity search in large time series databases. Knowl. Inf. Syst. 3(3), 263–286 (2001)CrossRef
8.
go back to reference Vlachos, M., Gunopulos, D.: Indexing time-series under conditions of noise. In: Data Mining in Time Series Databases, pp. 67–100. World Scientific Press (2004) Vlachos, M., Gunopulos, D.: Indexing time-series under conditions of noise. In: Data Mining in Time Series Databases, pp. 67–100. World Scientific Press (2004)
9.
go back to reference Struzik, Z., Siebes, A.: Measuring time series similarity through large singular features revealed with wavelet transformation. In: Proceedings of the 10th International Workshop on Database and Expert System Applications (1999) Struzik, Z., Siebes, A.: Measuring time series similarity through large singular features revealed with wavelet transformation. In: Proceedings of the 10th International Workshop on Database and Expert System Applications (1999)
10.
go back to reference Megalooikonomou, V., Li, G., Wang, Q.: A dimensionality reduction technique for efficient similarity analysis of time series databases. In: Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management, CIKM 2004, Washington DC (2004) Megalooikonomou, V., Li, G., Wang, Q.: A dimensionality reduction technique for efficient similarity analysis of time series databases. In: Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management, CIKM 2004, Washington DC (2004)
11.
go back to reference Chakrabarti, K., Keogh, E., Mehrotra, S., Pazzani, M.: Locally Adaptive Dimensionality reduction for indexing large time series databases. ACM Trans. Database Syst. (TODS), pp. 188–228 (2002) Chakrabarti, K., Keogh, E., Mehrotra, S., Pazzani, M.: Locally Adaptive Dimensionality reduction for indexing large time series databases. ACM Trans. Database Syst. (TODS), pp. 188–228 (2002)
13.
go back to reference Bode, G., Schreiber, T., Baranski, M., Müller, D.: A time series clustering approach for Building Automation and Control Systems. Appl. Energy 238, 1337–1345 (2019)CrossRef Bode, G., Schreiber, T., Baranski, M., Müller, D.: A time series clustering approach for Building Automation and Control Systems. Appl. Energy 238, 1337–1345 (2019)CrossRef
14.
go back to reference Caiado, J., Crato, N., Poncela, P.: A fragmented-periodogram approach for clustering big data time series. Adv. Data Anal. Classif. 14, 117–146 (2020)MathSciNetCrossRef Caiado, J., Crato, N., Poncela, P.: A fragmented-periodogram approach for clustering big data time series. Adv. Data Anal. Classif. 14, 117–146 (2020)MathSciNetCrossRef
15.
go back to reference Wismuller, A., et al.: Cluster analysis of biomedical image time-series. Int. J. Comput. Vis. 46(2), 103–128 (2002)CrossRef Wismuller, A., et al.: Cluster analysis of biomedical image time-series. Int. J. Comput. Vis. 46(2), 103–128 (2002)CrossRef
16.
go back to reference Luo, W., Gallagher, M., Wiles, J.: Parameter-free search of time-series discord. J. Comput. Sci. Technol. 28(2), 300–310 (2013)CrossRef Luo, W., Gallagher, M., Wiles, J.: Parameter-free search of time-series discord. J. Comput. Sci. Technol. 28(2), 300–310 (2013)CrossRef
18.
go back to reference Keogh, E., Lin, J., Fu, A.W., Van Herle, H.: Finding unusual medical time-series subsequences: algorithms and applications. IEEE Trans. Inf Technol. Biomed. 10, 429–439 (2006)CrossRef Keogh, E., Lin, J., Fu, A.W., Van Herle, H.: Finding unusual medical time-series subsequences: algorithms and applications. IEEE Trans. Inf Technol. Biomed. 10, 429–439 (2006)CrossRef
19.
go back to reference Wei, L., Keogh, E., Xi, X.: SAXually explicit images: finding unusual shapes. In: Sixth International Conference on Data Mining, 2006, ICDM 2006, Hong Kong (2007) Wei, L., Keogh, E., Xi, X.: SAXually explicit images: finding unusual shapes. In: Sixth International Conference on Data Mining, 2006, ICDM 2006, Hong Kong (2007)
20.
go back to reference Yi, B., Faloutsos, C.: Fast time sequence indexing for arbitrary Lp norms. In: Proceedings of the 26th International Conference on Very Large Databases, San Francisco, VLDB 2000 (2000) Yi, B., Faloutsos, C.: Fast time sequence indexing for arbitrary Lp norms. In: Proceedings of the 26th International Conference on Very Large Databases, San Francisco, VLDB 2000 (2000)
21.
go back to reference Chaovalit, P., Gangopadhyay, A., Karabatis, G., Chen, Z.: Discrete wavelet transform-based time series analysis and mining. ACM Comput. Surv. (CSUR) 43(12), 1–37 (2011)CrossRef Chaovalit, P., Gangopadhyay, A., Karabatis, G., Chen, Z.: Discrete wavelet transform-based time series analysis and mining. ACM Comput. Surv. (CSUR) 43(12), 1–37 (2011)CrossRef
22.
go back to reference Gunopulos, D.: Tutorial Slides: Dimensionality Reduction Techniques (2001) Gunopulos, D.: Tutorial Slides: Dimensionality Reduction Techniques (2001)
23.
go back to reference Rand, W.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66, 846–850 (1971)CrossRef Rand, W.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66, 846–850 (1971)CrossRef
24.
go back to reference Fowlkes, E., Mallows, C.: A method for comparing two hierarchical clusterings. J. Am. Stat. Assoc. 78, 553–569 (1983)CrossRef Fowlkes, E., Mallows, C.: A method for comparing two hierarchical clusterings. J. Am. Stat. Assoc. 78, 553–569 (1983)CrossRef
25.
go back to reference Alcala-Fdez, J., et al.: KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J. Multiple-Valued Logic Soft Comput. 17, 255–287 (2011) Alcala-Fdez, J., et al.: KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J. Multiple-Valued Logic Soft Comput. 17, 255–287 (2011)
27.
go back to reference Fonollosa, J., Sheik, S., Huerta, R., Marco, S.: Reservoir Computing compensates slow response of chemosensor arrays exposed to fast varying gas concentrations in continuous monitoring. Sens. Actuators B: Chem. 215, 618–629 (2015)CrossRef Fonollosa, J., Sheik, S., Huerta, R., Marco, S.: Reservoir Computing compensates slow response of chemosensor arrays exposed to fast varying gas concentrations in continuous monitoring. Sens. Actuators B: Chem. 215, 618–629 (2015)CrossRef
29.
go back to reference Keogh, E., Lin, J., Fu, A.: HOT SAX: efficiently finding the most unusual time series subsequence. In: Proceedings of the Fifth IEEE International Conference on Data Mining, ICDM 2005, Washington (2005) Keogh, E., Lin, J., Fu, A.: HOT SAX: efficiently finding the most unusual time series subsequence. In: Proceedings of the Fifth IEEE International Conference on Data Mining, ICDM 2005, Washington (2005)
30.
go back to reference Bahadori, S., Charkari, N.M.: Increasing efficiency of time series clustering by dimension reduction techniques (2018) Bahadori, S., Charkari, N.M.: Increasing efficiency of time series clustering by dimension reduction techniques (2018)
31.
go back to reference Sirisambhand, K., Ratanamahatana, C.H.: A dimensionality reduction technique for time series classification using additive representation. In: Third International Congress on Information and Communication Technology. Advances in Intelligent Systems and Computing, Singapore (2019) Sirisambhand, K., Ratanamahatana, C.H.: A dimensionality reduction technique for time series classification using additive representation. In: Third International Congress on Information and Communication Technology. Advances in Intelligent Systems and Computing, Singapore (2019)
Metadata
Title
Mining Massive Time Series Data: With Dimensionality Reduction Techniques
Authors
Justin Borg
Joseph G. Vella
Copyright Year
2020
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-6634-9_45

Premium Partner