Skip to main content
Top
Published in: International Journal of Data Science and Analytics 2/2022

07-09-2021 | Regular Paper

Repetitive causal discovery of linear non-Gaussian acyclic models in the presence of latent confounders

Authors: Takashi Nicholas Maeda, Shohei Shimizu

Published in: International Journal of Data Science and Analytics | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Causal discovery from data affected by latent confounders is an important and difficult challenge. Causal functional model-based approaches have not been used to present variables whose relationships are affected by latent confounders, while some constraint-based methods can present them. This paper proposes a causal functional model-based method called repetitive causal discovery (RCD) to discover the causal structure of observed variables affected by latent confounders. RCD repeats inferring the causal directions between a small number of observed variables and determines whether the relationships are affected by latent confounders. RCD finally produces a causal graph where a bidirected arrow indicates the pair of variables that have the same latent confounders and a directed arrow indicates the causal direction of a pair of variables that are not affected by the same latent confounder. The results of experimental validation using simulated data and real-world data confirmed that RCD is effective in identifying latent confounders and causal directions between observed variables.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chickering, D.M.: Optimal structure identification with greedy search. J. Mach. Learn. Res. 3, 507–554 (2002)MathSciNetMATH Chickering, D.M.: Optimal structure identification with greedy search. J. Mach. Learn. Res. 3, 507–554 (2002)MathSciNetMATH
3.
go back to reference Darmois, G.: Analyse générale des liaisons stochastiques: etude particuliére de l’analyse factorielle linéaire. Rev. Int. Stat. Inst. 21, 2–8 (1953)MathSciNetCrossRef Darmois, G.: Analyse générale des liaisons stochastiques: etude particuliére de l’analyse factorielle linéaire. Rev. Int. Stat. Inst. 21, 2–8 (1953)MathSciNetCrossRef
4.
go back to reference Duncan OD, Featherman DL, Duncan B (1972) Socioeconomic background and achievement. New York Duncan OD, Featherman DL, Duncan B (1972) Socioeconomic background and achievement. New York
5.
go back to reference Gretton, A., Fukumizu, K., Teo, C.H., Song, L., Schölkopf, B., Smola, A.J.: A kernel statistical test of independence. In: Platt, J.C., Koller, D., Singer, Y., Roweis, S.T. (eds.) Advances in Neural Information Processing Systems, pp. 585–592. Curran Associates, Inc, USA (2008) Gretton, A., Fukumizu, K., Teo, C.H., Song, L., Schölkopf, B., Smola, A.J.: A kernel statistical test of independence. In: Platt, J.C., Koller, D., Singer, Y., Roweis, S.T. (eds.) Advances in Neural Information Processing Systems, pp. 585–592. Curran Associates, Inc, USA (2008)
6.
go back to reference Hoyer, P.O., Janzing, D., Mooij, J.M., Peters, J., Schölkopf, B.: Nonlinear causal discovery with additive noise models. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) Advances in Neural Information Processing Systems, pp. 689–696. Curran Associates, Inc, USA (2009) Hoyer, P.O., Janzing, D., Mooij, J.M., Peters, J., Schölkopf, B.: Nonlinear causal discovery with additive noise models. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) Advances in Neural Information Processing Systems, pp. 689–696. Curran Associates, Inc, USA (2009)
9.
go back to reference Maeda, T.N., Shimizu, S.: RCD: Repetitive causal discovery of linear non-Gaussian acyclic models with latent confounders. In: Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (AISTATS2020), pp. 735–745 (2020) Maeda, T.N., Shimizu, S.: RCD: Repetitive causal discovery of linear non-Gaussian acyclic models with latent confounders. In: Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (AISTATS2020), pp. 735–745 (2020)
10.
go back to reference Mooij, J., Janzing, D., Peters, J., Schölkopf, B.: Regression by dependence minimization and its application to causal inference in additive noise models. In: Proceedings of the 26th Annual International Conference on Machine Learning, ICML ’09, pp. 745–752. ACM, New York, NY, USA (2009). doi: 10.1145/1553374.1553470 Mooij, J., Janzing, D., Peters, J., Schölkopf, B.: Regression by dependence minimization and its application to causal inference in additive noise models. In: Proceedings of the 26th Annual International Conference on Machine Learning, ICML ’09, pp. 745–752. ACM, New York, NY, USA (2009). doi: 10.1145/1553374.1553470
11.
go back to reference Ogarrio, J.M., Spirtes, P., Ramsey, J.: A hybrid causal search algorithm for latent variable models. In: Conference on Probabilistic Graphical Models, pp. 368–379 (2016) Ogarrio, J.M., Spirtes, P., Ramsey, J.: A hybrid causal search algorithm for latent variable models. In: Conference on Probabilistic Graphical Models, pp. 368–379 (2016)
12.
go back to reference Pearl, J.: Comment: graphical models, causality and intervention. Stat. Sci. 8(3), 266–269 (1993)CrossRef Pearl, J.: Comment: graphical models, causality and intervention. Stat. Sci. 8(3), 266–269 (1993)CrossRef
13.
go back to reference Pearl, J.: Causality: models, reasoning and inference. Cambridge University Press, Cambridge (2000)MATH Pearl, J.: Causality: models, reasoning and inference. Cambridge University Press, Cambridge (2000)MATH
14.
go back to reference Peters, J., Mooij, J.M., Janzing, D., Schölkopf, B.: Causal discovery with continuous additive noise models. J. Mach. Learn. Res. 15(1), 2009–2053 (2014)MathSciNetMATH Peters, J., Mooij, J.M., Janzing, D., Schölkopf, B.: Causal discovery with continuous additive noise models. J. Mach. Learn. Res. 15(1), 2009–2053 (2014)MathSciNetMATH
15.
go back to reference Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3/4), 591–611 (1965)MathSciNetCrossRef Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3/4), 591–611 (1965)MathSciNetCrossRef
16.
go back to reference Shimizu, S., Hoyer, P.O., Hyvärinen, A., Kerminen, A.: A linear non-Gaussian acyclic model for causal discovery. J. Mach. Learn. Res. 7, 2003–2030 (2006)MathSciNetMATH Shimizu, S., Hoyer, P.O., Hyvärinen, A., Kerminen, A.: A linear non-Gaussian acyclic model for causal discovery. J. Mach. Learn. Res. 7, 2003–2030 (2006)MathSciNetMATH
17.
go back to reference Shimizu, S., Inazumi, T., Sogawa, Y., Hyvärinen, A., Kawahara, Y., Washio, T., Hoyer, P.O., Bollen, K.: DirectLiNGAM: a direct method for learning a linear non-Gaussian structural equation model. J. Mach. Learn. Res. 12, 1225–1248 (2011)MathSciNetMATH Shimizu, S., Inazumi, T., Sogawa, Y., Hyvärinen, A., Kawahara, Y., Washio, T., Hoyer, P.O., Bollen, K.: DirectLiNGAM: a direct method for learning a linear non-Gaussian structural equation model. J. Mach. Learn. Res. 12, 1225–1248 (2011)MathSciNetMATH
18.
go back to reference Skitovitch, V.P.: On a property of the normal distribution. Doklady Akademii Nauk SSSR 89, 217–219 (1953)MathSciNet Skitovitch, V.P.: On a property of the normal distribution. Doklady Akademii Nauk SSSR 89, 217–219 (1953)MathSciNet
19.
go back to reference Spirtes, P., Glymour, C.: An algorithm for fast recovery of sparse causal graphs. Social Sci. Comput. Rev. 9(1), 62–72 (1991)CrossRef Spirtes, P., Glymour, C.: An algorithm for fast recovery of sparse causal graphs. Social Sci. Comput. Rev. 9(1), 62–72 (1991)CrossRef
20.
go back to reference Spirtes, P., Meek, C., Richardson, T.: Causal discovery in the presence of latent variables and selection bias. In: Cooper, G.F., Glymour, C.N. (eds.) Computation, causality, and discovery, pp. 211–252. AAAI Press, USA (1999) Spirtes, P., Meek, C., Richardson, T.: Causal discovery in the presence of latent variables and selection bias. In: Cooper, G.F., Glymour, C.N. (eds.) Computation, causality, and discovery, pp. 211–252. AAAI Press, USA (1999)
21.
go back to reference Yamada, M., Sugiyama, M.: Dependence minimizing regression with model selection for non-linear causal inference under non-Gaussian noise. In: Twenty-Fourth AAAI Conference on Artificial Intelligence (2010) Yamada, M., Sugiyama, M.: Dependence minimizing regression with model selection for non-linear causal inference under non-Gaussian noise. In: Twenty-Fourth AAAI Conference on Artificial Intelligence (2010)
22.
go back to reference Zhang, H., Zhou, S., Zhang, K., Guan, J.: Causal discovery using regression-based conditional independence tests. In: Thirty-First AAAI Conference on Artificial Intelligence (2017) Zhang, H., Zhou, S., Zhang, K., Guan, J.: Causal discovery using regression-based conditional independence tests. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)
Metadata
Title
Repetitive causal discovery of linear non-Gaussian acyclic models in the presence of latent confounders
Authors
Takashi Nicholas Maeda
Shohei Shimizu
Publication date
07-09-2021
Publisher
Springer International Publishing
Published in
International Journal of Data Science and Analytics / Issue 2/2022
Print ISSN: 2364-415X
Electronic ISSN: 2364-4168
DOI
https://doi.org/10.1007/s41060-021-00282-0

Other articles of this Issue 2/2022

International Journal of Data Science and Analytics 2/2022 Go to the issue

Premium Partner