Skip to main content
Top
Published in: Neural Processing Letters 5/2022

15-03-2022

Time Series Classification Based on Image Transformation Using Feature Fusion Strategy

Authors: Wentao Jiang, Dabin Zhang, Liwen Ling, Ruibin Lin

Published in: Neural Processing Letters | Issue 5/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Time series classification is an important branch of data analysis. Scholars have proposed a large number of time series classification methods in recent years. However, time series classification remains a challenging problem due to feature selection in time series classification. In order to further simplify the feature selection procedure and improve time series classification accuracy, an automatic feature selection of a time series classification method based on an image feature fusion strategy and a deep learning algorithm is proposed. First, a time series is transformed into images using different types of image transformation methods, i.e. the recurrence plot, Gramian angle difference field, Gramian angle summation field and Markov transition field. Second, the above four images are encoded into a new image type, that is the combined image, by a feature fusion strategy. Finally, a convolutional neural network is used for combined image classification and forecasting model selection. Time series from the M1 and M3 competition datasets are used to verify the effectiveness of the proposed method. The experimental results show that the algorithm has a higher classification accuracy and smaller prediction error compared to the benchmark models. Moreover, the forecasting error MAPE of combined image method is reduced by 0.2020 and 1.7454 compared with the traditional image method and single forecasting methdd respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yang S , Zheng X , Ji C , et al (2021) Multi-layer representation learning and its application to electronic health records. Neural Process Lett 1–17 Yang S , Zheng X , Ji C , et al (2021) Multi-layer representation learning and its application to electronic health records. Neural Process Lett 1–17
2.
go back to reference Liu B , Zhang Z , Cui R (2020) Efficient time series augmentation methods. In: 2020 13th international congress on image and signal processing, BioMedical engineering and informatics (CISP-BMEI) Liu B , Zhang Z , Cui R (2020) Efficient time series augmentation methods. In: 2020 13th international congress on image and signal processing, BioMedical engineering and informatics (CISP-BMEI)
3.
go back to reference Auge D, Hille J, Mueller E et al (2021) A survey of encoding techniques for signal processing in spiking neural networks. Neural Process Lett 53:4693–4710CrossRef Auge D, Hille J, Mueller E et al (2021) A survey of encoding techniques for signal processing in spiking neural networks. Neural Process Lett 53:4693–4710CrossRef
4.
go back to reference Ghanem W, Jantan A (2019) Training a neural network for cyberattack classification applications using hybridization of an artificial bee colony and monarch butterfly optimization. Neural Process Lett 51:905–946CrossRef Ghanem W, Jantan A (2019) Training a neural network for cyberattack classification applications using hybridization of an artificial bee colony and monarch butterfly optimization. Neural Process Lett 51:905–946CrossRef
5.
go back to reference Zg A, Vk B, Mi B et al (2020) Weighted kNN and constrained elastic distances for time-series classification - ScienceDirect. Expert Syst Appl 162:113829CrossRef Zg A, Vk B, Mi B et al (2020) Weighted kNN and constrained elastic distances for time-series classification - ScienceDirect. Expert Syst Appl 162:113829CrossRef
6.
go back to reference Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Min Knowl Disc 29(3):565–592MathSciNetCrossRef Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Min Knowl Disc 29(3):565–592MathSciNetCrossRef
7.
go back to reference Xiao X, Lu Y, Huang X et al (2021) Temporal series crop classification study in rural china based on sentinel-1 SAR data. IEEE J Sel Top Appl Earth Obs Remote Sens 99:1–1 Xiao X, Lu Y, Huang X et al (2021) Temporal series crop classification study in rural china based on sentinel-1 SAR data. IEEE J Sel Top Appl Earth Obs Remote Sens 99:1–1
8.
go back to reference Geler Z , Kurbalija V , Ivanovic M , et al. (2020) Time-series classification with constrained DTW distance and inverse-square weighted k-NN. In: 2020 international conference on innovations in intelligent systems and applications (INISTA) Geler Z , Kurbalija V , Ivanovic M , et al. (2020) Time-series classification with constrained DTW distance and inverse-square weighted k-NN. In: 2020 international conference on innovations in intelligent systems and applications (INISTA)
9.
go back to reference Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Min Knowl Disc 29(3):565–592MathSciNetCrossRef Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Min Knowl Disc 29(3):565–592MathSciNetCrossRef
10.
go back to reference Buza K, Nanopoulos A, Schmidt-Thieme L (2011) Time-series classification based on individualised error prediction. In: IEEE international conference on computational science engineering. IEEE Buza K, Nanopoulos A, Schmidt-Thieme L (2011) Time-series classification based on individualised error prediction. In: IEEE international conference on computational science engineering. IEEE
11.
go back to reference Morchen F, Ultsch A, Thies M et al (2006) Modeling timbre distance with temporal statistics from polyphonic music. IEEE Trans Audio Speech Lang Process 14(1):81–90CrossRef Morchen F, Ultsch A, Thies M et al (2006) Modeling timbre distance with temporal statistics from polyphonic music. IEEE Trans Audio Speech Lang Process 14(1):81–90CrossRef
12.
go back to reference Wang X, Smith K, Hyndman R (2006) Characteristic-based clustering for time series data. Data Min knowl discov 13(3):335–364MathSciNetCrossRef Wang X, Smith K, Hyndman R (2006) Characteristic-based clustering for time series data. Data Min knowl discov 13(3):335–364MathSciNetCrossRef
13.
go back to reference Lin J, Keogh E, Wei L et al (2007) Experiencing SAX: a novel symbolic representation of time series. Data Min Knowl Discov 15(2):107–144MathSciNetCrossRef Lin J, Keogh E, Wei L et al (2007) Experiencing SAX: a novel symbolic representation of time series. Data Min Knowl Discov 15(2):107–144MathSciNetCrossRef
14.
go back to reference Baydogan MG, Runger G, Tuv E (2013) A bag-of-features framework to classify time series. IEEE Trans Pattern Anal Mach Intell 35(11):2796–2802CrossRef Baydogan MG, Runger G, Tuv E (2013) A bag-of-features framework to classify time series. IEEE Trans Pattern Anal Mach Intell 35(11):2796–2802CrossRef
15.
go back to reference Bagnall A, Lines J, Bostrom A, Large J, Keogh E (2017) The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min Knowl Disc 31(3):606–660MathSciNetCrossRef Bagnall A, Lines J, Bostrom A, Large J, Keogh E (2017) The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min Knowl Disc 31(3):606–660MathSciNetCrossRef
16.
18.
go back to reference Yang C, Jiang W, Guo Z (2019) Time series data classification based on dual path cnn-rnn cascade network. IEEE Access 7:155304–155312CrossRef Yang C, Jiang W, Guo Z (2019) Time series data classification based on dual path cnn-rnn cascade network. IEEE Access 7:155304–155312CrossRef
19.
go back to reference Gupta S, Kumar M, Garg A (2019) Improved object recognition results using SIFT and ORB feature detector. Multimed Tools Appl 78(23):34157–34171CrossRef Gupta S, Kumar M, Garg A (2019) Improved object recognition results using SIFT and ORB feature detector. Multimed Tools Appl 78(23):34157–34171CrossRef
20.
go back to reference Kumar M, Gupta S (2021) 2D-human face recognition using SIFT and SURF descriptors of face’s feature regions. Vis Comput 37(11) Kumar M, Gupta S (2021) 2D-human face recognition using SIFT and SURF descriptors of face’s feature regions. Vis Comput 37(11)
21.
go back to reference Chhabra P, Garg NK, Kumar M (2020) Content-based image retrieval system using ORB and SIFT features. Neural Comput Appl 32(7):2725–2733CrossRef Chhabra P, Garg NK, Kumar M (2020) Content-based image retrieval system using ORB and SIFT features. Neural Comput Appl 32(7):2725–2733CrossRef
22.
go back to reference Kumar M , Kumar R , Saluja K K , et al. (2021) Gait recognition based on vision systems: a systematic survey. J Vis Commun Image Represent 75(6) Kumar M , Kumar R , Saluja K K , et al. (2021) Gait recognition based on vision systems: a systematic survey. J Vis Commun Image Represent 75(6)
23.
go back to reference Goldberg Y (2016) A primer on neural network models for natural language processing. Artif Intell Res 57(1):345–420MathSciNetCrossRef Goldberg Y (2016) A primer on neural network models for natural language processing. Artif Intell Res 57(1):345–420MathSciNetCrossRef
24.
go back to reference Bansal M, Kumar M, Kumar M, et al. (2020) An efficient technique for object recognition using Shi-Tomasi corner detection algorithm. Soft Comput 1–10 Bansal M, Kumar M, Kumar M, et al. (2020) An efficient technique for object recognition using Shi-Tomasi corner detection algorithm. Soft Comput 1–10
25.
go back to reference Kumar M, Bansal M, Kumar M (2020) XGBoost: 2D-object recognition using shape descriptors and extreme gradient boosting classifier. In: International conference on computational methods and data engineering (ICMDE 2020) Kumar M, Bansal M, Kumar M (2020) XGBoost: 2D-object recognition using shape descriptors and extreme gradient boosting classifier. In: International conference on computational methods and data engineering (ICMDE 2020)
26.
go back to reference Kumar Munish, Chhabra et al (2018) An efficient content based image retrieval system using BayesNet and K-NN. Multimed Tools Appl 77(16):21557–21570CrossRef Kumar Munish, Chhabra et al (2018) An efficient content based image retrieval system using BayesNet and K-NN. Multimed Tools Appl 77(16):21557–21570CrossRef
27.
go back to reference Garg Diksha, Naresh et al (2018) Underwater image enhancement using blending of CLAHE and percentile methodologies[J]. Multimed Tools Appl 77(20):26545–26561CrossRef Garg Diksha, Naresh et al (2018) Underwater image enhancement using blending of CLAHE and percentile methodologies[J]. Multimed Tools Appl 77(20):26545–26561CrossRef
28.
go back to reference Lecun Y, Boser B, Denker J et al (2014) Backpropagation applied to handwritten zip code recognition. Neural Comput 1(4):541–551CrossRef Lecun Y, Boser B, Denker J et al (2014) Backpropagation applied to handwritten zip code recognition. Neural Comput 1(4):541–551CrossRef
29.
go back to reference Pereira S, Pinto A, Alves V, Silva CA (2016) Brain tumor segmentation using convolutional neural networks in mri images. IEEE Trans Med Imaging 35(5):1240–1251CrossRef Pereira S, Pinto A, Alves V, Silva CA (2016) Brain tumor segmentation using convolutional neural networks in mri images. IEEE Trans Med Imaging 35(5):1240–1251CrossRef
30.
go back to reference Campanharo ASLO, Sirer MI, Malmgren RD, Ramos FM, Amaral LAN (2011) Duality between time series and networks. PLoS ONE 6(8):1–13CrossRef Campanharo ASLO, Sirer MI, Malmgren RD, Ramos FM, Amaral LAN (2011) Duality between time series and networks. PLoS ONE 6(8):1–13CrossRef
31.
go back to reference Wang Z, Oates T (2015) Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. In: Workshops at the twenty-ninth aaai conference on artificial intelligence Wang Z, Oates T (2015) Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. In: Workshops at the twenty-ninth aaai conference on artificial intelligence
32.
go back to reference Li X, Kang Y, Li F (2020) Forecasting with time series imaging. Expert Syst Appl 1(3):113–130 Li X, Kang Y, Li F (2020) Forecasting with time series imaging. Expert Syst Appl 1(3):113–130
33.
go back to reference Akbar S, Ali F, Khan S et al (2020) Deep-AntiFP: prediction of antifungal peptides using distanct multi-information fusion incorporating with deep neural networks. Chemom Intell Lab Syst 208:104214 Akbar S, Ali F, Khan S et al (2020) Deep-AntiFP: prediction of antifungal peptides using distanct multi-information fusion incorporating with deep neural networks. Chemom Intell Lab Syst 208:104214
34.
go back to reference Zhang X, Zhao H (2021) Hyperspectral-cube-based mobile face recognition: a comprehensive review. Inf Fusion 74(24) Zhang X, Zhao H (2021) Hyperspectral-cube-based mobile face recognition: a comprehensive review. Inf Fusion 74(24)
35.
go back to reference Ye TA, Xm A, Hc A et al (2021) Using Z-number to measure the reliability of new information fusion method and its application in pattern recognition. Appl Soft Comput 111:107658CrossRef Ye TA, Xm A, Hc A et al (2021) Using Z-number to measure the reliability of new information fusion method and its application in pattern recognition. Appl Soft Comput 111:107658CrossRef
36.
go back to reference Campanharo AS, Sirer MI, Malmgren RD, Ramos FM, Amaral LAN (2011) Duality between time series and networks. PLoS ONE 6(8):233–248CrossRef Campanharo AS, Sirer MI, Malmgren RD, Ramos FM, Amaral LAN (2011) Duality between time series and networks. PLoS ONE 6(8):233–248CrossRef
37.
go back to reference Eckmann JP, Kamphorst SO, Ruelle D (1987) Recurrence plots of dynamical systems. Europhys Lett 4(9):973–977CrossRef Eckmann JP, Kamphorst SO, Ruelle D (1987) Recurrence plots of dynamical systems. Europhys Lett 4(9):973–977CrossRef
38.
go back to reference Thiel M, Romano MC, Jürgen Kurths (2004) How much information is contained in a recurrence plot? Phys Lett A 330(5):343–349MathSciNetCrossRef Thiel M, Romano MC, Jürgen Kurths (2004) How much information is contained in a recurrence plot? Phys Lett A 330(5):343–349MathSciNetCrossRef
39.
go back to reference Xu JL, Hugelier S, Zhu H et al (2020) Deep learning for classification of time series spectral images using combined multi-temporal and spectral features. Anal Chim Acta 1143:9–20CrossRef Xu JL, Hugelier S, Zhu H et al (2020) Deep learning for classification of time series spectral images using combined multi-temporal and spectral features. Anal Chim Acta 1143:9–20CrossRef
40.
go back to reference He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. IEEE Comput Soc 33(5):243–249 He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. IEEE Comput Soc 33(5):243–249
41.
go back to reference Jaworek-Korjakowska J, Kleczek P, Gorgon M (2019) Melanoma thickness prediction based on convolutional neural network with VGG-19 model transfer learning. In: 2019 IEEE/CVF conference on computer vision and pattern recognition workshops (CVPRW). IEEE Jaworek-Korjakowska J, Kleczek P, Gorgon M (2019) Melanoma thickness prediction based on convolutional neural network with VGG-19 model transfer learning. In: 2019 IEEE/CVF conference on computer vision and pattern recognition workshops (CVPRW). IEEE
42.
go back to reference Zhu Y, Newsam S (2017) DenseNet for dense flow. Comput Sci 6(2):790–794 Zhu Y, Newsam S (2017) DenseNet for dense flow. Comput Sci 6(2):790–794
Metadata
Title
Time Series Classification Based on Image Transformation Using Feature Fusion Strategy
Authors
Wentao Jiang
Dabin Zhang
Liwen Ling
Ruibin Lin
Publication date
15-03-2022
Publisher
Springer US
Published in
Neural Processing Letters / Issue 5/2022
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-022-10783-z

Other articles of this Issue 5/2022

Neural Processing Letters 5/2022 Go to the issue