Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Visualizing Student Engagement and Performance in Online Course: A Step to Smart Learning Environment Read chapter Read first chapter

2023 | OriginalPaper | Chapter

Highly Stochastic Time Series Modeling using HTM in Comparison with Commonly Used Methods

Authors : Filip Begiełło, Tomasz Bławucki

Published in: Proceedings of Seventh International Congress on Information and Communication Technology

Publisher: Springer Nature Singapore

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study compares the HTM models applicability in highly stochastic time series forecasting problems, to a range of commonly used approaches. The models were tested on a real-world data, representing raw material usage in a food processing company. The comparison was done on a set of 21 data series with a high disparity of underlying process characteristics. HTM models were evaluated against 6 other approaches. As a result, HTM models were able to outperform other models in 8 out of 21 cases, with an average improvement of around 20% of RMSE value, scoring in the first place as a most accurate approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter E-Managing the Pre-election Messages During the 2021 Parliamentary Campaigns in Bulgaria
next chapter Preliminary Results on Constraint Programming and Branch & Bound Algorithms for the Cyclic Bandwidth Sum Problem
Literature
1.
Adhikari R, Agrawal RK (2013) An introductory study on time series modeling and forecasting. Lambert Academic Publishing, Saarbrücken, Germany
2.
Ao S-I (2010) Applied time series analysis and innovative computing. In: Lecture notes in electrical engineering, vol 59
3.
Wei WWS (2013) Time series analysis. In: Little TD (ed) The Oxford handbook of quantitative methods in psychology, vol 2: statistical analysis. Oxford University Press, Inc., New York
4.
Clements MP, Franses PH, Swanson NR (2004) Forecasting economic and financial time-series with non-linear models. Int J Forecast 20(2):169–183CrossRef
5.
De Gooijer JG, Hyndman RJ (2006) 25 years of time series forecasting. Int J Forecast 22(3):443–473
6.
Wang W, Yang J, Xiao J, Li S, Zhou D (2015) Face recognition based on deep learning. In: Lecture notes in computer science, pp 812–820
7.
Xiao Y, Wu J, Lin Z, Zhao X (2018) A deep learning-based multi-model ensemble method for cancer prediction. Comput Methods Programs Biomed 153:1–9
8.
Villacrés JF, Auat Cheein F (2020) Detection and characterization of cherries: a deep learning usability case study in Chile. Agronomy 10(6):835
9.
Cui Y, Ahmad S, Hawkins J. Continuous online sequence learning with an unsupervised neural network model. Neural Comput 28(11):2474–2504
10.
Ahmad S, Scheinkman L (2019) How can we be so dense? The benefits of using highly sparse representations. Numenta, Redwood City, California
11.
Cui Y, Ahmad S, Hawkins J (2017) The HTM spatial pooler—A neocortical algorithm for online sparse distributed coding. Front Comput Neurosci 11
12.
Chen P, Niu A, Liu D, Jiang W, Ma B (2018) Time series forecasting of temperatures using SARIMA: an example from Nanjing. In: IOP conference series: materials science and engineering, vol 394, p 052024
13.
Vagropoulos SI, Chouliaras GI, Kardakos EG, Simoglou CK, Bakirtzis AG (2016) Comparison of SARIMAX, SARIMA, modified SARIMA and ANN-based models for short-term PV generation forecasting. In: 2016 IEEE international energy conference (ENERGYCON)
14.
Dabral PP, Murry MZ (2017) Modelling and forecasting of rainfall time series using SARIMA. Environ Process 4(2):399–419
15.
Valipour M (2015) Long-term runoff study using SARIMA and ARIMA models in the United States. Meteorol Appl 22(3):592–598
16.
Out AO, Osuji GA, Opara J, Mbachu HI, Iheagwara AI (2014) Application of Sarima models in modelling and forecasting Nigeria’s inflation rates. Am J Appl Math Stat 2(1):16–28
17.
Choi T-M, Yu Y, Au K-F (2011) A hybrid SARIMA wavelet transform method for sales forecasting. Decision Support Syst 51(1):130–140
18.
Billah B, King ML, Snyder RD, Koehler AB (2006) Exponential smoothing model selection for forecasting. Int J Forecast 22(2):239–247
19.
Chatfield C (1978) The Holt-Winters forecasting procedure. Appl Stat 27(3):264
20.
Gardner ES, Dannenbring DG (1980) Forecasting with exponential smoothing: some guidelines for model selection. Decision Sci 11(2):370–383
21.
Ostertagová E, Ostertag O (2012) Forecasting using simple exponential smoothing method. Acta Electrotechnica et Informatica 12(3)
22.
Taylor JW (2003) Short-term electricity demand forecasting using double seasonal exponential smoothing. J Oper Res Soc 54(8):799–805
23.
Athanasopoulos G, de Silva A (2012) Multivariate exponential smoothing for forecasting tourist arrivals. J Travel Res 51(5):640–652CrossRef
24.
Bodger PS, Brooks DRD, Moutter SP (1987) Spectral decomposition of variations in electricity loading using mixed radix fast Fourier transform. In: IEE Proc C Gener Trans Distrib 134(3):197
25.
Chen M-Y, Chen B-T (2014) Online fuzzy time series analysis based on entropy discretization and a fast Fourier transform. Appl Soft Comput 14:156–166
26.
Liu S, Shan T, Tao R, Zhang YD, Zhang G, Zhang F, Wang Y (2014) Sparse discrete fractional Fourier transform and its applications. IEEE Trans Signal Process 62(24):6582–6595 (2014).
27.
Chatfield C (1977) Some recent developments in time-series analysis. J Roy Stat Soc Ser A (Gen) 140(4):492
28.
Lukhyswara P, Putranto LM, Ariananda DD (2019) Solar irradiation forecasting uses time series analysis. In: 2019 11th International conference on information technology and electrical engineering (ICITEE)
29.
Lewisa BG, Herbertb RD, Bellc RD (2003) The application of Fourier analysis to forecasting the inbound call time series of a call centre
30.
Pritz PJ, Perez D, Leung KK (2020) Fast-Fourier-forecasting resource utilisation in distributed systems. In: 2020 29th International conference on computer communications and networks (ICCCN)
31.
Ahmed NK, Atiya AF, Gayar NE, El-Shishiny H (2010) An empirical comparison of machine learning models for time series forecasting. Econ Rev 29(5–6):594–621
32.
Qian X-Y (2017) Financial series prediction: comparison between precision of time series models and machine learning methods
33.
Pavlyshenko B (2019) Machine-learning models for sales time series forecasting. Data 4(1):15
34.
Bontempi G, Ben Taieb S, Le Borgne Y-A (2013) Machine learning strategies for time series forecasting. In: Lecture notes in business information processing, pp 62–77
35.
Lim B, Zohren S (2021) Time-series forecasting with deep learning: a survey. Philos Trans Roy Soc A: Math Phys Eng Sci 379(2194)
36.
Coulibaly P, Anctil F, Bobée B (2001) Multivariate reservoir inflow forecasting using temporal neural networks. J Hydrol Eng 6(5)
37.
Ho S, Xie M, Goh T (2002) A comparative study of neural network and Box-Jenkins ARIMA modeling in time series prediction. Comput Ind Eng 42(2–4):371–375
38.
Tokgoz A, Unal G (2018) A RNN based time series approach for forecasting Turkish electricity load. In: 2018 26th Signal processing and communications applications conference (SIU)
39.
Tsai Y-T, Zeng Y-R, Chang Y-S (2018) Air pollution forecasting using RNN with LSTM. In: 2018 IEEE 16th International conference on dependable, autonomic and secure computing, 16th International conference on pervasive intelligence and computing, 4th International conference on big data intelligence and computing and cyber science and technology congress
40.
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444CrossRef
41.
Miyajima R (2017) Deep learning triggers a new era in industrial robotics. IEEE MultiMedia 24(4):91–96
42.
Manaswi NK (2018) RNN and LSTM. In: Deep learning with applications using python, 115–126
43.
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30
44.
Wu N, Green B, Ben X, O’Banion S (2020) Deep transformer models for time series forecasting: the influenza prevalence case. arXiv:​200108317
45.
Zhou H, Zhang S, Peng J, Zhang S, Li J, Xiong H, Zhang W (2021) Informer: beyond efficient transformer for long sequence time-series forecasting. arXiv:​201207436
46.
Hole KJ, Ahmad S (2021) A thousand brains: toward biologically constrained AI. SN Appl Sci 3(8)
47.
Hawkins J, Ahmad S, Cui Y (2017) A theory of how columns in the neocortex enable learning the structure of the world. Front Neural Circ 11
48.
Wu J, Zeng W, Chen Z, Tang X-F (2016) Hierarchical temporal memory method for time-series-based anomaly detection. In: 2016 IEEE 16th international conference on data mining workshops (ICDMW)
49.
Hawkins J, Ahmad S (2016) Why neurons have thousands of synapses, a theory of sequence memory in neocortex. Front Neural Circ 10
50.
Ahmad S, Hawkins J (2016) How do neurons operate on sparse distributed representations? A mathematical theory of sparsity, neurons and active dendrites. arXiv:​160100720
Metadata
Title
Highly Stochastic Time Series Modeling using HTM in Comparison with Commonly Used Methods
Authors
Filip Begiełło
Tomasz Bławucki
Copyright Year
2023
Publisher
Springer Nature Singapore
Book
Proceedings of Seventh International Congress on Information and Communication Technology

Print ISBN: 978-981-19-1609-0

Electronic ISBN: 978-981-19-1610-6

Copyright Year: 2023

DOI
https://doi.org/10.1007/978-981-19-1610-6_10