Skip to main content
Top

2023 | OriginalPaper | Chapter

Inferring Parsimonious Coupling Statistics in Nonlinear Dynamics with Variational Gaussian Processes

Authors : Ameer Ghouse, Gaetano Valenza

Published in: Complex Networks and Their Applications XI

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Falsification is the basis for testing existing hypotheses, and a great danger is posed when results incorrectly reject our prior notions (false positives). Though nonparametric and nonlinear exploratory methods of uncovering coupling provide a flexible framework to study network configurations and discover causal graphs, multiple comparisons analyses make false positives more likely, exacerbating the need for their control. We aim to robustify the Gaussian Processes Convergent Cross-Mapping (GP-CCM) method through Variational Bayesian Gaussian Process modeling (VGP-CCM). We alleviate computational costs of integrating with conditional hyperparameter distributions through mean field approximations. This approximation model, in conjunction with permutation sampling of the null distribution, permits significance statistics that are more robust than permutation sampling with point hyperparameters. Simulated unidirectional Lorenz-Rossler systems as well as mechanistic models of neurovascular systems are used to evaluate the method. The results demonstrate that the proposed method yields improved specificity, showing promise to combat false positives.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Stankovski, T., Pereira, T., McClintock, P.V.E., Stefanovska, A.: Coupling functions: universal insights into dynamical interaction mechanisms. Rev. Mod. Phys. 89, 045001 (2017)MathSciNetCrossRef Stankovski, T., Pereira, T., McClintock, P.V.E., Stefanovska, A.: Coupling functions: universal insights into dynamical interaction mechanisms. Rev. Mod. Phys. 89, 045001 (2017)MathSciNetCrossRef
3.
go back to reference Granger, C.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3), 424–38 (1969)CrossRefMATH Granger, C.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3), 424–38 (1969)CrossRefMATH
4.
go back to reference Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85, 461–464 (2000)CrossRef Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85, 461–464 (2000)CrossRef
5.
go back to reference Barnett, L., Barrett, A.B., Seth, A.K.: Granger causality and transfer entropy are equivalent for gaussian variables. Phys. Rev. Lett. 103, 238701 (2009)CrossRef Barnett, L., Barrett, A.B., Seth, A.K.: Granger causality and transfer entropy are equivalent for gaussian variables. Phys. Rev. Lett. 103, 238701 (2009)CrossRef
6.
go back to reference Marinazzo, D., Pellicoro, M., Stramaglia, S.: Kernel method for nonlinear granger causality. Phys. Rev. Lett. 100, 144103 (2008)CrossRef Marinazzo, D., Pellicoro, M., Stramaglia, S.: Kernel method for nonlinear granger causality. Phys. Rev. Lett. 100, 144103 (2008)CrossRef
7.
go back to reference Smirnov, D.A., Bezruchko, B.P.: Spurious causalities due to low temporal resolution: towards detection of bidirectional coupling from time series. 100, 10005 (Oct 2012) Smirnov, D.A., Bezruchko, B.P.: Spurious causalities due to low temporal resolution: towards detection of bidirectional coupling from time series. 100, 10005 (Oct 2012)
8.
go back to reference Smirnov, D.A.: Spurious causalities with transfer entropy. Phys. Rev. E 87, 042917 (2013)CrossRef Smirnov, D.A.: Spurious causalities with transfer entropy. Phys. Rev. E 87, 042917 (2013)CrossRef
9.
go back to reference Popper, K.R.: Science as falsification. Conjectures Refutations 1(1963), 33–39 (1963) Popper, K.R.: Science as falsification. Conjectures Refutations 1(1963), 33–39 (1963)
10.
go back to reference Sugihara, G., May, R., Ye, H., Hsieh, C.-H., Deyle, E., Fogarty, M., Munch, S.: Detecting causality in complex ecosystems. Science 338(6106), 496–500 (2012)CrossRefMATH Sugihara, G., May, R., Ye, H., Hsieh, C.-H., Deyle, E., Fogarty, M., Munch, S.: Detecting causality in complex ecosystems. Science 338(6106), 496–500 (2012)CrossRefMATH
11.
go back to reference Takens, F.: Detecting strange attractors in turbulence. In: Rand, D., Young, L.-S. (eds.) Dynamical Systems and Turbulence, Warwick 1980, pp. 366–381. Springer, Berlin, Heidelberg (1981) Takens, F.: Detecting strange attractors in turbulence. In: Rand, D., Young, L.-S. (eds.) Dynamical Systems and Turbulence, Warwick 1980, pp. 366–381. Springer, Berlin, Heidelberg (1981)
12.
go back to reference Feng, G., Yu, K., Wang, Y., Yuan, Y., Djurić, P.M.: Improving convergent cross mapping for causal discovery with gaussian processes. In: ICASSP 2020 — 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3692–3696 (2020) Feng, G., Yu, K., Wang, Y., Yuan, Y., Djurić, P.M.: Improving convergent cross mapping for causal discovery with gaussian processes. In: ICASSP 2020 — 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3692–3696 (2020)
13.
go back to reference Feng, G., Quirk, J.G., Djurić, P.M.: Detecting causality using deep gaussian processes. In: 2019 53rd Asilomar Conference on Signals, Systems, and Computers, pp. 472–476 (2019) Feng, G., Quirk, J.G., Djurić, P.M.: Detecting causality using deep gaussian processes. In: 2019 53rd Asilomar Conference on Signals, Systems, and Computers, pp. 472–476 (2019)
14.
go back to reference Ghouse, A., Faes, L., Valenza, G.: Inferring directionality of coupled dynamical systems using gaussian process priors: application on neurovascular systems. Phys. Rev. E 104, 064208 (2021)MathSciNetCrossRef Ghouse, A., Faes, L., Valenza, G.: Inferring directionality of coupled dynamical systems using gaussian process priors: application on neurovascular systems. Phys. Rev. E 104, 064208 (2021)MathSciNetCrossRef
15.
go back to reference Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press (2005) Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press (2005)
16.
go back to reference Chung, Y., Gelman, A., Rabe-Hesketh, S., Liu, J., Dorie, V.: Weakly informative prior for point estimation of covariance matrices in hierarchical models. J. Educ. Behav. Stat. 40(2), 136–157 (2015)CrossRef Chung, Y., Gelman, A., Rabe-Hesketh, S., Liu, J., Dorie, V.: Weakly informative prior for point estimation of covariance matrices in hierarchical models. J. Educ. Behav. Stat. 40(2), 136–157 (2015)CrossRef
17.
go back to reference Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112(518), 859–877 (2017)MathSciNetCrossRef Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112(518), 859–877 (2017)MathSciNetCrossRef
19.
go back to reference Sugihara, G., May, R.M.: Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature 344(6268), 734–741 (1990)CrossRef Sugihara, G., May, R.M.: Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature 344(6268), 734–741 (1990)CrossRef
20.
go back to reference Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)CrossRefMATH Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)CrossRefMATH
21.
go back to reference Beal, M.J.: Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, Gatsby Computational Neuroscience Unit. University College London (2003) Beal, M.J.: Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, Gatsby Computational Neuroscience Unit. University College London (2003)
23.
go back to reference MacKay, D.J.C.: Bayesian Methods for Backpropagation Networks, pp. 211–254. Springer, New York, NY (1996) MacKay, D.J.C.: Bayesian Methods for Backpropagation Networks, pp. 211–254. Springer, New York, NY (1996)
24.
go back to reference Snelson, E., Ghahramani, Z.: Sparse gaussian processes using pseudo-inputs. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, NIPS’05, (Cambridge, MA, USA), pp. 1257-1264. MIT Press (2005) Snelson, E., Ghahramani, Z.: Sparse gaussian processes using pseudo-inputs. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, NIPS’05, (Cambridge, MA, USA), pp. 1257-1264. MIT Press (2005)
25.
go back to reference Kingma, D.P., Welling, M.: Auto-encoding variational Bayes. In: 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14–16, 2014, Conference Track Proceedings (2014) Kingma, D.P., Welling, M.: Auto-encoding variational Bayes. In: 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14–16, 2014, Conference Track Proceedings (2014)
26.
go back to reference Lee, S.Y.: Gibbs sampler and coordinate ascent variational inference: a set-theoretical review. Commun. Stat. — Theory Methods. 1–21 (2021) Lee, S.Y.: Gibbs sampler and coordinate ascent variational inference: a set-theoretical review. Commun. Stat. — Theory Methods. 1–21 (2021)
27.
go back to reference Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., Lerer, A.: Automatic differentiation in Pytorch (2017) Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., Lerer, A.: Automatic differentiation in Pytorch (2017)
28.
go back to reference Kim, Y., Wiseman, S., Miller, A.C., Sontag, D.A., Rush, A.M.: Semi-amortized variational autoencoders. In: Dy, J.G., Krause, A. (eds.) ICML. Proceedings of Machine Learning Research, vol. 80, pp. 2683–2692. PMLR (2018) Kim, Y., Wiseman, S., Miller, A.C., Sontag, D.A., Rush, A.M.: Semi-amortized variational autoencoders. In: Dy, J.G., Krause, A. (eds.) ICML. Proceedings of Machine Learning Research, vol. 80, pp. 2683–2692. PMLR (2018)
29.
go back to reference Stephan, K.E., Weiskopf, N., Drysdale, P.M., Robinson, P.A., Friston, K.J.: Comparing hemodynamic models with DCM. Neuroimage 38(3), 387–401 (2007)CrossRef Stephan, K.E., Weiskopf, N., Drysdale, P.M., Robinson, P.A., Friston, K.J.: Comparing hemodynamic models with DCM. Neuroimage 38(3), 387–401 (2007)CrossRef
30.
go back to reference Friston, K.: Dynamic causal modeling and granger causality comments on: the identification of interacting networks in the brain using fMRI: model selection, causality and deconvolution. Neuroimage 58(2–2), 303 (2011)CrossRef Friston, K.: Dynamic causal modeling and granger causality comments on: the identification of interacting networks in the brain using fMRI: model selection, causality and deconvolution. Neuroimage 58(2–2), 303 (2011)CrossRef
31.
go back to reference Gaddis, G.M., Gaddis, M.L.: Introduction to biostatistics: part 3, sensitivity, specificity, predictive value, and hypothesis testing. Ann. Emerg. Med. 19(5), 591–597 (1990)CrossRef Gaddis, G.M., Gaddis, M.L.: Introduction to biostatistics: part 3, sensitivity, specificity, predictive value, and hypothesis testing. Ann. Emerg. Med. 19(5), 591–597 (1990)CrossRef
32.
go back to reference Friston, K., Harrison, L., Penny, W.: Dynamic causal modelling. NeuroImage 19(4), 1273–1302 (2003)CrossRef Friston, K., Harrison, L., Penny, W.: Dynamic causal modelling. NeuroImage 19(4), 1273–1302 (2003)CrossRef
33.
go back to reference Berline, N., Getzler, E., Michèle, V.: Heat Kernels and Dirac Operators. Springer (1996) Berline, N., Getzler, E., Michèle, V.: Heat Kernels and Dirac Operators. Springer (1996)
34.
go back to reference Papoulis, A., Pillai, S.U.: Probability, Random Variables, and Stochastic Processes, 4th edn. McGraw Hill, Boston (2002) Papoulis, A., Pillai, S.U.: Probability, Random Variables, and Stochastic Processes, 4th edn. McGraw Hill, Boston (2002)
Metadata
Title
Inferring Parsimonious Coupling Statistics in Nonlinear Dynamics with Variational Gaussian Processes
Authors
Ameer Ghouse
Gaetano Valenza
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-21127-0_31

Premium Partner