Skip to main content
Top
Published in: OR Spectrum 3/2021

08-06-2021 | Original Article

Mathematical optimization for time series decomposition

Authors: Seyma Gozuyilmaz, O. Erhun Kundakcioglu

Published in: OR Spectrum | Issue 3/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Decomposing time series into trend and seasonality components reveals insights used in forecasting and anomaly detection. This study proposes a mathematical optimization approach that addresses several data-related issues in time series decomposition. Our approach does not only handle longer and multiple seasons but also identifies outliers and trend shifts. Numerical experiments on real-world and synthetic problem sets present the effectiveness of the proposed approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Footnotes
1
The user can purposefully set M value and limit trend shifts. We highlight even a large number does not lead to an unrealistic solution due to the rest of the constraints.
 
2
Similar to the trend shift, the user can set M value if spikes or dips are to be bounded.
 
3
The code that solves RobustSTL is available at https://​github.​com/​LeeDoYup/​RobustSTL.
 
Literature
go back to reference Arputhamary B, Lawrence DLA (2018) A pragmatic study on time series models for big data. Int J Emerg Res Manag Technol 6:67CrossRef Arputhamary B, Lawrence DLA (2018) A pragmatic study on time series models for big data. Int J Emerg Res Manag Technol 6:67CrossRef
go back to reference Bartholomew DJ (1971) Time series analysis forecasting and control. J Oper Res Soc 22(2):199–201CrossRef Bartholomew DJ (1971) Time series analysis forecasting and control. J Oper Res Soc 22(2):199–201CrossRef
go back to reference Bleikh H, Young W (2016) Time series analysis and adjustment: measuring, modelling and forecasting for business and economics. Taylor & Francis, ThamesCrossRef Bleikh H, Young W (2016) Time series analysis and adjustment: measuring, modelling and forecasting for business and economics. Taylor & Francis, ThamesCrossRef
go back to reference Brockwell PJ, Davis RA editors (2002) Nonstationary and seasonal time series models. Springer, New York, pp 179–221 Brockwell PJ, Davis RA editors (2002) Nonstationary and seasonal time series models. Springer, New York, pp 179–221
go back to reference Brockwell PJ, Davis RA, Calder MV (2002) Introduction to time series and forecasting, vol 2. Springer, BerlinCrossRef Brockwell PJ, Davis RA, Calder MV (2002) Introduction to time series and forecasting, vol 2. Springer, BerlinCrossRef
go back to reference Chen Z-G, Anderson OD (1998) Increment-vector methodology: transforming non-stationary series to stationary series. J Appl Prob 35(1):64–77CrossRef Chen Z-G, Anderson OD (1998) Increment-vector methodology: transforming non-stationary series to stationary series. J Appl Prob 35(1):64–77CrossRef
go back to reference Cleveland RB, Cleveland WS, McRae JE, Terpenning I (1990) STL: a seasonal-trend decomposition procedure based on loess (with discussion). J Off Stat 6:3–73 Cleveland RB, Cleveland WS, McRae JE, Terpenning I (1990) STL: a seasonal-trend decomposition procedure based on loess (with discussion). J Off Stat 6:3–73
go back to reference Cleveland WS, Dunn DM, Terpenning IJ (1978) SABL: A resistant seasonal adjustment procedure with graphical methods for interpretation and diagnosis. In: National Bureau of Economic Research, Inc, June Cleveland WS, Dunn DM, Terpenning IJ (1978) SABL: A resistant seasonal adjustment procedure with graphical methods for interpretation and diagnosis. In: National Bureau of Economic Research, Inc, June
go back to reference Dagum E (1980) The X-II-ARIMA seasonal adjustment method. In: Essays Collection of Estela Bee Dagum in Statistical Sciences, 01 Dagum E (1980) The X-II-ARIMA seasonal adjustment method. In: Essays Collection of Estela Bee Dagum in Statistical Sciences, 01
go back to reference Dokumentov A, Hyndman RJ (2015) STR: A seasonal-trend decomposition procedure based on regression. In: Monash econometrics and business statistics working papers 13/15, Monash University, Department of Econometrics and Business Statistics Dokumentov A, Hyndman RJ (2015) STR: A seasonal-trend decomposition procedure based on regression. In: Monash econometrics and business statistics working papers 13/15, Monash University, Department of Econometrics and Business Statistics
go back to reference Duarte FS, Rios RA, Hruschka ER, de Mello RF (2019) Decomposing time series into deterministic and stochastic influences: a survey. Digital Signal Process 95:102582CrossRef Duarte FS, Rios RA, Hruschka ER, de Mello RF (2019) Decomposing time series into deterministic and stochastic influences: a survey. Digital Signal Process 95:102582CrossRef
go back to reference Findley DF, Monsell BC, Bell WR, Otto MC, Chen B-C (1998) New capabilities and methods of the X-12-ARIMA seasonal-adjustment program. J Bus Econ Stat 16(2):127–152 Findley DF, Monsell BC, Bell WR, Otto MC, Chen B-C (1998) New capabilities and methods of the X-12-ARIMA seasonal-adjustment program. J Bus Econ Stat 16(2):127–152
go back to reference Gomes J, Velho L (2015) From Fourier analysis to wavelets, vol 01. Springer, BerlinCrossRef Gomes J, Velho L (2015) From Fourier analysis to wavelets, vol 01. Springer, BerlinCrossRef
go back to reference Gurobi Optimization (2020) Gurobi optimizer reference manual, Gurobi Optimization (2020) Gurobi optimizer reference manual,
go back to reference Hamilton JD (2017) Why you should never use the Hodrick–Prescott filter. In: Working paper 23429, National Bureau of Economic Research, May Hamilton JD (2017) Why you should never use the Hodrick–Prescott filter. In: Working paper 23429, National Bureau of Economic Research, May
go back to reference Hassani H (2007) Singular spectrum analysis: methodology and comparison. University Library of Munich, Germany, MPRA Paper, vol 5, p 01 Hassani H (2007) Singular spectrum analysis: methodology and comparison. University Library of Munich, Germany, MPRA Paper, vol 5, p 01
go back to reference Hodrick RJ, Prescott E. (1981) Post-War U.S. business cycles: an empirical investigation. In: Discussion papers 451, Northwestern University, Center for Mathematical Studies in Economics and Management Science, May Hodrick RJ, Prescott E. (1981) Post-War U.S. business cycles: an empirical investigation. In: Discussion papers 451, Northwestern University, Center for Mathematical Studies in Economics and Management Science, May
go back to reference Liu C-L (2010) A tutorial of the wavelet transform. Duke University Community, 01 Liu C-L (2010) A tutorial of the wavelet transform. Duke University Community, 01
go back to reference Mendez-Jimenez I, Cardenas-Montes M (2018) Time series decomposition for improving the forecasting performance of convolutional neural networks. In: 18th Conference of the Spanish association for artificial intelligence. Springer International Publishing, pp 87–97 Mendez-Jimenez I, Cardenas-Montes M (2018) Time series decomposition for improving the forecasting performance of convolutional neural networks. In: 18th Conference of the Spanish association for artificial intelligence. Springer International Publishing, pp 87–97
go back to reference Monsell B, Lytras D, Findley D (2013) Getting started with X-13ARIMA-SEATS input files (accessible version). United States Census Bureau, 08 Monsell B, Lytras D, Findley D (2013) Getting started with X-13ARIMA-SEATS input files (accessible version). United States Census Bureau, 08
go back to reference Montgomery DC, Jennings CL, Kulahci M (2015) Introduction to time series analysis and forecasting. John Wiley & Sons, London Montgomery DC, Jennings CL, Kulahci M (2015) Introduction to time series analysis and forecasting. John Wiley & Sons, London
go back to reference Ollech D (2018) Seasonal adjustment of daily time series. In: Bundesbank discussion paper 41/2018, Deutsche Bundesbank, Frankfurt a. M Ollech D (2018) Seasonal adjustment of daily time series. In: Bundesbank discussion paper 41/2018, Deutsche Bundesbank, Frankfurt a. M
go back to reference Persons WM (1919) Indices of business conditions. Rev Econ Stat, vol 1 Persons WM (1919) Indices of business conditions. Rev Econ Stat, vol 1
go back to reference Qin L, Li W, Li S (2019) Effective passenger flow forecasting using STL and ESN based on two improvement strategies. Neurocomputing 356:05CrossRef Qin L, Li W, Li S (2019) Effective passenger flow forecasting using STL and ESN based on two improvement strategies. Neurocomputing 356:05CrossRef
go back to reference Terrell C (2019) Predictions in time series using regression models. EDTECH Terrell C (2019) Predictions in time series using regression models. EDTECH
go back to reference Theodosiou M (2011) Forecasting monthly and quarterly time series using STL decomposition. Int J Forecast 27:1178–1195CrossRef Theodosiou M (2011) Forecasting monthly and quarterly time series using STL decomposition. Int J Forecast 27:1178–1195CrossRef
go back to reference Walker WE (1976) A heuristic adjacent extreme point algorithm for the fixed charge problem. Manag Sci 22(5):587–596CrossRef Walker WE (1976) A heuristic adjacent extreme point algorithm for the fixed charge problem. Manag Sci 22(5):587–596CrossRef
go back to reference Wen Q, Gao J, Song X, Sun L, Xu H, Zhu S (2019) RobustSTL: A robust seasonal-trend decomposition algorithm for long time series. In: The Thirty-Third AAAI Conference on Artificial Intelligence. AAAI Press, pp 5409–5416 Wen Q, Gao J, Song X, Sun L, Xu H, Zhu S (2019) RobustSTL: A robust seasonal-trend decomposition algorithm for long time series. In: The Thirty-Third AAAI Conference on Artificial Intelligence. AAAI Press, pp 5409–5416
go back to reference Yaffee RA, McGee M (2000) An introduction to time series analysis and forecasting with applications of SAS and SPSS. Elsevier, London Yaffee RA, McGee M (2000) An introduction to time series analysis and forecasting with applications of SAS and SPSS. Elsevier, London
go back to reference Zhigljavsky A (2011) Singular spectrum analysis for time series. Springer, Berlin, pp 1335–1337 Zhigljavsky A (2011) Singular spectrum analysis for time series. Springer, Berlin, pp 1335–1337
Metadata
Title
Mathematical optimization for time series decomposition
Authors
Seyma Gozuyilmaz
O. Erhun Kundakcioglu
Publication date
08-06-2021
Publisher
Springer Berlin Heidelberg
Published in
OR Spectrum / Issue 3/2021
Print ISSN: 0171-6468
Electronic ISSN: 1436-6304
DOI
https://doi.org/10.1007/s00291-021-00637-w

Other articles of this Issue 3/2021

OR Spectrum 3/2021 Go to the issue