Skip to main content

2023 | OriginalPaper | Buchkapitel

Inferring Parsimonious Coupling Statistics in Nonlinear Dynamics with Variational Gaussian Processes

verfasst von : Ameer Ghouse, Gaetano Valenza

Erschienen in: Complex Networks and Their Applications XI

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Falsification is the basis for testing existing hypotheses, and a great danger is posed when results incorrectly reject our prior notions (false positives). Though nonparametric and nonlinear exploratory methods of uncovering coupling provide a flexible framework to study network configurations and discover causal graphs, multiple comparisons analyses make false positives more likely, exacerbating the need for their control. We aim to robustify the Gaussian Processes Convergent Cross-Mapping (GP-CCM) method through Variational Bayesian Gaussian Process modeling (VGP-CCM). We alleviate computational costs of integrating with conditional hyperparameter distributions through mean field approximations. This approximation model, in conjunction with permutation sampling of the null distribution, permits significance statistics that are more robust than permutation sampling with point hyperparameters. Simulated unidirectional Lorenz-Rossler systems as well as mechanistic models of neurovascular systems are used to evaluate the method. The results demonstrate that the proposed method yields improved specificity, showing promise to combat false positives.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Stankovski, T., Pereira, T., McClintock, P.V.E., Stefanovska, A.: Coupling functions: universal insights into dynamical interaction mechanisms. Rev. Mod. Phys. 89, 045001 (2017)MathSciNetCrossRef Stankovski, T., Pereira, T., McClintock, P.V.E., Stefanovska, A.: Coupling functions: universal insights into dynamical interaction mechanisms. Rev. Mod. Phys. 89, 045001 (2017)MathSciNetCrossRef
2.
3.
Zurück zum Zitat Granger, C.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3), 424–38 (1969)CrossRefMATH Granger, C.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3), 424–38 (1969)CrossRefMATH
4.
Zurück zum Zitat Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85, 461–464 (2000)CrossRef Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85, 461–464 (2000)CrossRef
5.
Zurück zum Zitat Barnett, L., Barrett, A.B., Seth, A.K.: Granger causality and transfer entropy are equivalent for gaussian variables. Phys. Rev. Lett. 103, 238701 (2009)CrossRef Barnett, L., Barrett, A.B., Seth, A.K.: Granger causality and transfer entropy are equivalent for gaussian variables. Phys. Rev. Lett. 103, 238701 (2009)CrossRef
6.
Zurück zum Zitat Marinazzo, D., Pellicoro, M., Stramaglia, S.: Kernel method for nonlinear granger causality. Phys. Rev. Lett. 100, 144103 (2008)CrossRef Marinazzo, D., Pellicoro, M., Stramaglia, S.: Kernel method for nonlinear granger causality. Phys. Rev. Lett. 100, 144103 (2008)CrossRef
7.
Zurück zum Zitat Smirnov, D.A., Bezruchko, B.P.: Spurious causalities due to low temporal resolution: towards detection of bidirectional coupling from time series. 100, 10005 (Oct 2012) Smirnov, D.A., Bezruchko, B.P.: Spurious causalities due to low temporal resolution: towards detection of bidirectional coupling from time series. 100, 10005 (Oct 2012)
8.
Zurück zum Zitat Smirnov, D.A.: Spurious causalities with transfer entropy. Phys. Rev. E 87, 042917 (2013)CrossRef Smirnov, D.A.: Spurious causalities with transfer entropy. Phys. Rev. E 87, 042917 (2013)CrossRef
9.
Zurück zum Zitat Popper, K.R.: Science as falsification. Conjectures Refutations 1(1963), 33–39 (1963) Popper, K.R.: Science as falsification. Conjectures Refutations 1(1963), 33–39 (1963)
10.
Zurück zum Zitat Sugihara, G., May, R., Ye, H., Hsieh, C.-H., Deyle, E., Fogarty, M., Munch, S.: Detecting causality in complex ecosystems. Science 338(6106), 496–500 (2012)CrossRefMATH Sugihara, G., May, R., Ye, H., Hsieh, C.-H., Deyle, E., Fogarty, M., Munch, S.: Detecting causality in complex ecosystems. Science 338(6106), 496–500 (2012)CrossRefMATH
11.
Zurück zum Zitat Takens, F.: Detecting strange attractors in turbulence. In: Rand, D., Young, L.-S. (eds.) Dynamical Systems and Turbulence, Warwick 1980, pp. 366–381. Springer, Berlin, Heidelberg (1981) Takens, F.: Detecting strange attractors in turbulence. In: Rand, D., Young, L.-S. (eds.) Dynamical Systems and Turbulence, Warwick 1980, pp. 366–381. Springer, Berlin, Heidelberg (1981)
12.
Zurück zum Zitat Feng, G., Yu, K., Wang, Y., Yuan, Y., Djurić, P.M.: Improving convergent cross mapping for causal discovery with gaussian processes. In: ICASSP 2020 — 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3692–3696 (2020) Feng, G., Yu, K., Wang, Y., Yuan, Y., Djurić, P.M.: Improving convergent cross mapping for causal discovery with gaussian processes. In: ICASSP 2020 — 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3692–3696 (2020)
13.
Zurück zum Zitat Feng, G., Quirk, J.G., Djurić, P.M.: Detecting causality using deep gaussian processes. In: 2019 53rd Asilomar Conference on Signals, Systems, and Computers, pp. 472–476 (2019) Feng, G., Quirk, J.G., Djurić, P.M.: Detecting causality using deep gaussian processes. In: 2019 53rd Asilomar Conference on Signals, Systems, and Computers, pp. 472–476 (2019)
14.
Zurück zum Zitat Ghouse, A., Faes, L., Valenza, G.: Inferring directionality of coupled dynamical systems using gaussian process priors: application on neurovascular systems. Phys. Rev. E 104, 064208 (2021)MathSciNetCrossRef Ghouse, A., Faes, L., Valenza, G.: Inferring directionality of coupled dynamical systems using gaussian process priors: application on neurovascular systems. Phys. Rev. E 104, 064208 (2021)MathSciNetCrossRef
15.
Zurück zum Zitat Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press (2005) Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press (2005)
16.
Zurück zum Zitat Chung, Y., Gelman, A., Rabe-Hesketh, S., Liu, J., Dorie, V.: Weakly informative prior for point estimation of covariance matrices in hierarchical models. J. Educ. Behav. Stat. 40(2), 136–157 (2015)CrossRef Chung, Y., Gelman, A., Rabe-Hesketh, S., Liu, J., Dorie, V.: Weakly informative prior for point estimation of covariance matrices in hierarchical models. J. Educ. Behav. Stat. 40(2), 136–157 (2015)CrossRef
17.
Zurück zum Zitat Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112(518), 859–877 (2017)MathSciNetCrossRef Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112(518), 859–877 (2017)MathSciNetCrossRef
19.
Zurück zum Zitat Sugihara, G., May, R.M.: Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature 344(6268), 734–741 (1990)CrossRef Sugihara, G., May, R.M.: Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature 344(6268), 734–741 (1990)CrossRef
20.
Zurück zum Zitat Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)CrossRefMATH Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)CrossRefMATH
21.
Zurück zum Zitat Beal, M.J.: Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, Gatsby Computational Neuroscience Unit. University College London (2003) Beal, M.J.: Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, Gatsby Computational Neuroscience Unit. University College London (2003)
23.
Zurück zum Zitat MacKay, D.J.C.: Bayesian Methods for Backpropagation Networks, pp. 211–254. Springer, New York, NY (1996) MacKay, D.J.C.: Bayesian Methods for Backpropagation Networks, pp. 211–254. Springer, New York, NY (1996)
24.
Zurück zum Zitat Snelson, E., Ghahramani, Z.: Sparse gaussian processes using pseudo-inputs. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, NIPS’05, (Cambridge, MA, USA), pp. 1257-1264. MIT Press (2005) Snelson, E., Ghahramani, Z.: Sparse gaussian processes using pseudo-inputs. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, NIPS’05, (Cambridge, MA, USA), pp. 1257-1264. MIT Press (2005)
25.
Zurück zum Zitat Kingma, D.P., Welling, M.: Auto-encoding variational Bayes. In: 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14–16, 2014, Conference Track Proceedings (2014) Kingma, D.P., Welling, M.: Auto-encoding variational Bayes. In: 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14–16, 2014, Conference Track Proceedings (2014)
26.
Zurück zum Zitat Lee, S.Y.: Gibbs sampler and coordinate ascent variational inference: a set-theoretical review. Commun. Stat. — Theory Methods. 1–21 (2021) Lee, S.Y.: Gibbs sampler and coordinate ascent variational inference: a set-theoretical review. Commun. Stat. — Theory Methods. 1–21 (2021)
27.
Zurück zum Zitat Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., Lerer, A.: Automatic differentiation in Pytorch (2017) Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., Lerer, A.: Automatic differentiation in Pytorch (2017)
28.
Zurück zum Zitat Kim, Y., Wiseman, S., Miller, A.C., Sontag, D.A., Rush, A.M.: Semi-amortized variational autoencoders. In: Dy, J.G., Krause, A. (eds.) ICML. Proceedings of Machine Learning Research, vol. 80, pp. 2683–2692. PMLR (2018) Kim, Y., Wiseman, S., Miller, A.C., Sontag, D.A., Rush, A.M.: Semi-amortized variational autoencoders. In: Dy, J.G., Krause, A. (eds.) ICML. Proceedings of Machine Learning Research, vol. 80, pp. 2683–2692. PMLR (2018)
29.
Zurück zum Zitat Stephan, K.E., Weiskopf, N., Drysdale, P.M., Robinson, P.A., Friston, K.J.: Comparing hemodynamic models with DCM. Neuroimage 38(3), 387–401 (2007)CrossRef Stephan, K.E., Weiskopf, N., Drysdale, P.M., Robinson, P.A., Friston, K.J.: Comparing hemodynamic models with DCM. Neuroimage 38(3), 387–401 (2007)CrossRef
30.
Zurück zum Zitat Friston, K.: Dynamic causal modeling and granger causality comments on: the identification of interacting networks in the brain using fMRI: model selection, causality and deconvolution. Neuroimage 58(2–2), 303 (2011)CrossRef Friston, K.: Dynamic causal modeling and granger causality comments on: the identification of interacting networks in the brain using fMRI: model selection, causality and deconvolution. Neuroimage 58(2–2), 303 (2011)CrossRef
31.
Zurück zum Zitat Gaddis, G.M., Gaddis, M.L.: Introduction to biostatistics: part 3, sensitivity, specificity, predictive value, and hypothesis testing. Ann. Emerg. Med. 19(5), 591–597 (1990)CrossRef Gaddis, G.M., Gaddis, M.L.: Introduction to biostatistics: part 3, sensitivity, specificity, predictive value, and hypothesis testing. Ann. Emerg. Med. 19(5), 591–597 (1990)CrossRef
32.
Zurück zum Zitat Friston, K., Harrison, L., Penny, W.: Dynamic causal modelling. NeuroImage 19(4), 1273–1302 (2003)CrossRef Friston, K., Harrison, L., Penny, W.: Dynamic causal modelling. NeuroImage 19(4), 1273–1302 (2003)CrossRef
33.
Zurück zum Zitat Berline, N., Getzler, E., Michèle, V.: Heat Kernels and Dirac Operators. Springer (1996) Berline, N., Getzler, E., Michèle, V.: Heat Kernels and Dirac Operators. Springer (1996)
34.
Zurück zum Zitat Papoulis, A., Pillai, S.U.: Probability, Random Variables, and Stochastic Processes, 4th edn. McGraw Hill, Boston (2002) Papoulis, A., Pillai, S.U.: Probability, Random Variables, and Stochastic Processes, 4th edn. McGraw Hill, Boston (2002)
Metadaten
Titel
Inferring Parsimonious Coupling Statistics in Nonlinear Dynamics with Variational Gaussian Processes
verfasst von
Ameer Ghouse
Gaetano Valenza
Copyright-Jahr
2023
DOI
https://doi.org/10.1007/978-3-031-21127-0_31

Premium Partner