Skip to main content
Top

2017 | OriginalPaper | Chapter

Forecasting and Granger Modelling with Non-linear Dynamical Dependencies

Authors : Magda Gregorová, Alexandros Kalousis, Stéphane Marchand-Maillet

Published in: Machine Learning and Knowledge Discovery in Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Traditional linear methods for forecasting multivariate time series are not able to satisfactorily model the non-linear dependencies that may exist in non-Gaussian series. We build on the theory of learning vector-valued functions in the reproducing kernel Hilbert space and develop a method for learning prediction functions that accommodate such non-linearities. The method not only learns the predictive function but also the matrix-valued kernel underlying the function search space directly from the data. Our approach is based on learning multiple matrix-valued kernels, each of those composed of a set of input kernels and a set of output kernels learned in the cone of positive semi-definite matrices. In addition to superior predictive performance in the presence of strong non-linearities, our method also recovers the hidden dynamic relationships between the series and thus is a new alternative to existing graphical Granger techniques.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We extend the function \(x^2/y : \mathbb {R} \times \mathbb {R}_{+} \rightarrow \mathbb {R}_+\) to the point (0, 0) by taking the convention \(0/0 = 0\).
 
Literature
1.
go back to reference Arnold, A., Liu, Y., Abe, N.: Temporal causal modeling with graphical granger methods. In: Proceedings of 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2007 (2007) Arnold, A., Liu, Y., Abe, N.: Temporal causal modeling with graphical granger methods. In: Proceedings of 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2007 (2007)
2.
go back to reference Bach, F.: Consistency of the group lasso and multiple kernel learning. J. Mach. Learn. Res. 9, 1179–1225 (2008)MathSciNetMATH Bach, F.: Consistency of the group lasso and multiple kernel learning. J. Mach. Learn. Res. 9, 1179–1225 (2008)MathSciNetMATH
3.
go back to reference Bach, F., Jenatton, R., Mairal, J., Obozinski, G.: Optimization with sparsity-inducing penalties. Found. Trends Mach. Learn. 4, 1–106 (2012)CrossRefMATH Bach, F., Jenatton, R., Mairal, J., Obozinski, G.: Optimization with sparsity-inducing penalties. Found. Trends Mach. Learn. 4, 1–106 (2012)CrossRefMATH
4.
go back to reference Bahadori, M., Liu, Y.: An examination of practical granger causality inference. In: SIAM Conference on Data Mining (2013) Bahadori, M., Liu, Y.: An examination of practical granger causality inference. In: SIAM Conference on Data Mining (2013)
5.
go back to reference Beck, A., Teboulle, M.: Gradient-based algorithms with applications to signal recovery. In: Convex Optimization in Signal Processing and Communications (2009) Beck, A., Teboulle, M.: Gradient-based algorithms with applications to signal recovery. In: Convex Optimization in Signal Processing and Communications (2009)
7.
go back to reference Caponnetto, A., Micchelli, C.A., Pontil, M., Ying, Y.: Universal multi-task kernels. Mach. Learn. Res. 9, 1615–1646 (2008)MathSciNetMATH Caponnetto, A., Micchelli, C.A., Pontil, M., Ying, Y.: Universal multi-task kernels. Mach. Learn. Res. 9, 1615–1646 (2008)MathSciNetMATH
8.
go back to reference Dinuzzo, F., Ong, C.: Learning output kernels with block coordinate descent. In: International Conference on Machine Learning (ICML) (2011) Dinuzzo, F., Ong, C.: Learning output kernels with block coordinate descent. In: International Conference on Machine Learning (ICML) (2011)
10.
go back to reference Franz, M.O., Schölkopf, B.: A unifying view of wiener and volterra theory and polynomial kernel regression. Neural Comput. 18, 3097–3118 (2006)MathSciNetCrossRefMATH Franz, M.O., Schölkopf, B.: A unifying view of wiener and volterra theory and polynomial kernel regression. Neural Comput. 18, 3097–3118 (2006)MathSciNetCrossRefMATH
11.
go back to reference Granger, C.W.J.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3), 424–438 (1969)CrossRefMATH Granger, C.W.J.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3), 424–438 (1969)CrossRefMATH
12.
go back to reference Jawanpuria, P., Lapin, M., Hein, M., Schiele, B.: Efficient output kernel learning for multiple tasks. In: NIPS (2015) Jawanpuria, P., Lapin, M., Hein, M., Schiele, B.: Efficient output kernel learning for multiple tasks. In: NIPS (2015)
13.
go back to reference Kadri, H., Rakotomamonjy, A., Bach, F., Preux, P.: Multiple operator-valued kernel learning. In: NIPS (2012) Kadri, H., Rakotomamonjy, A., Bach, F., Preux, P.: Multiple operator-valued kernel learning. In: NIPS (2012)
14.
go back to reference Lanckriet, G.G.R., Cristianini, N., Bartlett, P., Ghaoui, L.E., Jordan, M.I.: Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5, 27–72 (2004)MathSciNetMATH Lanckriet, G.G.R., Cristianini, N., Bartlett, P., Ghaoui, L.E., Jordan, M.I.: Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5, 27–72 (2004)MathSciNetMATH
16.
go back to reference Lozano, A.C., Abe, N., Liu, Y., Rosset, S.: Grouped graphical Granger modeling for gene expression regulatory networks discovery. Bioinformatics 25, i110–i118 (2009). (Oxford, England)CrossRef Lozano, A.C., Abe, N., Liu, Y., Rosset, S.: Grouped graphical Granger modeling for gene expression regulatory networks discovery. Bioinformatics 25, i110–i118 (2009). (Oxford, England)CrossRef
18.
go back to reference Pillonetto, G., Dinuzzo, F., Chen, T., De Nicolao, G., Ljung, L.: Kernel methods in system identification, machine learning and function estimation: a survey. Automatica 50, 657–682 (2014)MathSciNetCrossRefMATH Pillonetto, G., Dinuzzo, F., Chen, T., De Nicolao, G., Ljung, L.: Kernel methods in system identification, machine learning and function estimation: a survey. Automatica 50, 657–682 (2014)MathSciNetCrossRefMATH
19.
go back to reference Sindhwani, V., Minh, H.Q., Lozano, A.: Scalable matrix-valued kernel learning for high-dimensional nonlinear multivariate regression and granger causality. In: UAI (2013) Sindhwani, V., Minh, H.Q., Lozano, A.: Scalable matrix-valued kernel learning for high-dimensional nonlinear multivariate regression and granger causality. In: UAI (2013)
21.
go back to reference Xu, Z., Jin, R., Yang, H., King, I., Lyu, M.R.: Simple and efficient multiple kernel learning by group lasso. In: International Conference on Machine Learning (ICML) (2010) Xu, Z., Jin, R., Yang, H., King, I., Lyu, M.R.: Simple and efficient multiple kernel learning by group lasso. In: International Conference on Machine Learning (ICML) (2010)
22.
go back to reference Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 68, 49–67 (2006)MathSciNetCrossRefMATH Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 68, 49–67 (2006)MathSciNetCrossRefMATH
23.
go back to reference Zhao, P., Rocha, G.: Grouped and hierarchical model selection through composite absolute penalties (2006) Zhao, P., Rocha, G.: Grouped and hierarchical model selection through composite absolute penalties (2006)
Metadata
Title
Forecasting and Granger Modelling with Non-linear Dynamical Dependencies
Authors
Magda Gregorová
Alexandros Kalousis
Stéphane Marchand-Maillet
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-71246-8_33

Premium Partner