Skip to main content

2017 | OriginalPaper | Buchkapitel

Arbitrated Ensemble for Time Series Forecasting

verfasst von : Vítor Cerqueira, Luís Torgo, Fábio Pinto, Carlos Soares

Erschienen in: Machine Learning and Knowledge Discovery in Databases

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes an ensemble method for time series forecasting tasks. Combining different forecasting models is a common approach to tackle these problems. State-of-the-art methods track the loss of the available models and adapt their weights accordingly. Metalearning strategies such as stacking are also used in these tasks. We propose a metalearning approach for adaptively combining forecasting models that specializes them across the time series. Our assumption is that different forecasting models have different areas of expertise and a varying relative performance. Moreover, many time series show recurring structures due to factors such as seasonality. Therefore, the ability of a method to deal with changes in relative performance of models as well as recurrent changes in the data distribution can be very useful in dynamic environments. Our approach is based on an ensemble of heterogeneous forecasters, arbitrated by a metalearning model. This strategy is designed to cope with the different dynamics of time series and quickly adapt the ensemble to regime changes. We validate our proposal using time series from several real world domains. Empirical results show the competitiveness of the method in comparison to state-of-the-art approaches for combining forecasters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Aiolfi, M., Timmermann, A.: Persistence in forecasting performance and conditional combination strategies. J. Econometr. 135(1), 31–53 (2006)MathSciNetCrossRefMATH Aiolfi, M., Timmermann, A.: Persistence in forecasting performance and conditional combination strategies. J. Econometr. 135(1), 31–53 (2006)MathSciNetCrossRefMATH
3.
Zurück zum Zitat Wilcox, S., Andreas, A.: Solar Radiation Monitoring Station (SoRMS): Humboldt State University, Arcata, California; NREL Rep DA-5500-56515 (2007) Wilcox, S., Andreas, A.: Solar Radiation Monitoring Station (SoRMS): Humboldt State University, Arcata, California; NREL Rep DA-5500-56515 (2007)
4.
Zurück zum Zitat Brazdil, P., Carrier, C.G., Soares, C., Vilalta, R.: Metalearning: Applications to Data Mining. Springer Science & Business Media, Heidelberg (2008)MATH Brazdil, P., Carrier, C.G., Soares, C., Vilalta, R.: Metalearning: Applications to Data Mining. Springer Science & Business Media, Heidelberg (2008)MATH
7.
Zurück zum Zitat Clemen, R.T., Winkler, R.L.: Combining economic forecasts. J. Bus. Econ. Stat. 4(1), 39–46 (1986) Clemen, R.T., Winkler, R.L.: Combining economic forecasts. J. Bus. Econ. Stat. 4(1), 39–46 (1986)
8.
Zurück zum Zitat Crane, D.B., Crotty, J.R.: A two-stage forecasting model: exponential smoothing and multiple regression. Manag. Sci. 13(8), B-501 (1967)CrossRef Crane, D.B., Crotty, J.R.: A two-stage forecasting model: exponential smoothing and multiple regression. Manag. Sci. 13(8), B-501 (1967)CrossRef
9.
Zurück zum Zitat Dawid, A.P.: Present position and potential developments: some personal views: statistical theory: the prequential approach. J. Roy. Stat. Soc. Ser. A (Gener.) 278–292 (1984) Dawid, A.P.: Present position and potential developments: some personal views: statistical theory: the prequential approach. J. Roy. Stat. Soc. Ser. A (Gener.) 278–292 (1984)
11.
Zurück zum Zitat Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1–22 (2010)CrossRef Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1–22 (2010)CrossRef
13.
Zurück zum Zitat Hyndman, R.J., with contributions from Athanasopoulos, G., Razbash, S., Schmidt, D., Zhou, Z., Khan, Y., Bergmeir, C., Wang, E.: forecast: Forecasting functions for time series and linear models (2014). R package version 5.6 Hyndman, R.J., with contributions from Athanasopoulos, G., Razbash, S., Schmidt, D., Zhou, Z., Khan, Y., Bergmeir, C., Wang, E.: forecast: Forecasting functions for time series and linear models (2014). R package version 5.6
14.
Zurück zum Zitat Jose, V.R.R., Winkler, R.L.: Simple robust averages of forecasts: some empirical results. Int. J. Forecast. 24(1), 163–169 (2008)CrossRef Jose, V.R.R., Winkler, R.L.: Simple robust averages of forecasts: some empirical results. Int. J. Forecast. 24(1), 163–169 (2008)CrossRef
15.
Zurück zum Zitat Karatzoglou, A., Smola, A., Hornik, K., Zeileis, A.: kernlab - an S4 package for kernel methods in R. J. Stat. Softw. 11(9), 1–20 (2004)CrossRef Karatzoglou, A., Smola, A., Hornik, K., Zeileis, A.: kernlab - an S4 package for kernel methods in R. J. Stat. Softw. 11(9), 1–20 (2004)CrossRef
16.
Zurück zum Zitat Kuhn, M., Weston, S., Keefer, C., Coulter, N., C code for Cubist by Ross Quinlan: Cubist: Rule- and Instance-Based Regression Modeling (2014). R package version 0.0.18 Kuhn, M., Weston, S., Keefer, C., Coulter, N., C code for Cubist by Ross Quinlan: Cubist: Rule- and Instance-Based Regression Modeling (2014). R package version 0.0.18
18.
Zurück zum Zitat Milborrow, S.: earth: Multivariate Adaptive Regression Spline Models. Derived from mda:mars by Trevor Hastie and Rob Tibshirani (2012) Milborrow, S.: earth: Multivariate Adaptive Regression Spline Models. Derived from mda:mars by Trevor Hastie and Rob Tibshirani (2012)
19.
Zurück zum Zitat Newbold, P., Granger, C.W.: Experience with forecasting univariate time series and the combination of forecasts. J. Roy. Stat. Soc. Ser. A (Gener.) 131–165 (1974) Newbold, P., Granger, C.W.: Experience with forecasting univariate time series and the combination of forecasts. J. Roy. Stat. Soc. Ser. A (Gener.) 131–165 (1974)
20.
Zurück zum Zitat Oliveira, M., Torgo, L.: Ensembles for time series forecasting. In: ACML Proceedings of Asian Conference on Machine Learning, JMLR: Workshop and Conference Proceedings (2014) Oliveira, M., Torgo, L.: Ensembles for time series forecasting. In: ACML Proceedings of Asian Conference on Machine Learning, JMLR: Workshop and Conference Proceedings (2014)
21.
Zurück zum Zitat Ortega, J., Koppel, M., Argamon, S.: Arbitrating among competing classifiers using learned referees. Knowl. Inf. Syst. 3(4), 470–490 (2001)CrossRefMATH Ortega, J., Koppel, M., Argamon, S.: Arbitrating among competing classifiers using learned referees. Knowl. Inf. Syst. 3(4), 470–490 (2001)CrossRefMATH
23.
Zurück zum Zitat R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2013) R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2013)
24.
Zurück zum Zitat Ridgeway, G.: GBM: Generalized Boosted Regression Models (2015). R package version 2.1.1 Ridgeway, G.: GBM: Generalized Boosted Regression Models (2015). R package version 2.1.1
25.
Zurück zum Zitat Sánchez, I.: Adaptive combination of forecasts with application to wind energy. Int. J. Forecast. 24(4), 679–693 (2008)CrossRef Sánchez, I.: Adaptive combination of forecasts with application to wind energy. Int. J. Forecast. 24(4), 679–693 (2008)CrossRef
26.
Zurück zum Zitat Timmermann, A.: Forecast combinations. In: Handbook of Economic Forecasting, vol. 1, pp. 135–196 (2006) Timmermann, A.: Forecast combinations. In: Handbook of Economic Forecasting, vol. 1, pp. 135–196 (2006)
27.
Zurück zum Zitat Timmermann, A.: Elusive return predictability. Int. J. Forecast. 24(1), 1–18 (2008)CrossRef Timmermann, A.: Elusive return predictability. Int. J. Forecast. 24(1), 1–18 (2008)CrossRef
28.
Zurück zum Zitat Torgo, L.: An Infra-structure for Performance Estimation and Experimental Comparison of Predictive Models (2013). R package version 0.1.1 Torgo, L.: An Infra-structure for Performance Estimation and Experimental Comparison of Predictive Models (2013). R package version 0.1.1
29.
Zurück zum Zitat Venables, W.N., Ripley, B.D.: Modern Applied Statistics with S, 4th edn. Springer, New York (2002). ISBN 0-387-95457-0CrossRefMATH Venables, W.N., Ripley, B.D.: Modern Applied Statistics with S, 4th edn. Springer, New York (2002). ISBN 0-387-95457-0CrossRefMATH
30.
Zurück zum Zitat Wolpert, D.H.: Stacked generalization. Neural Netw. 5(2), 241–259 (1992)CrossRef Wolpert, D.H.: Stacked generalization. Neural Netw. 5(2), 241–259 (1992)CrossRef
31.
Zurück zum Zitat Wright, M.N.: ranger: A Fast Implementation of Random Forests (2015). R package Wright, M.N.: ranger: A Fast Implementation of Random Forests (2015). R package
Metadaten
Titel
Arbitrated Ensemble for Time Series Forecasting
verfasst von
Vítor Cerqueira
Luís Torgo
Fábio Pinto
Carlos Soares
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-71246-8_29