Skip to main content

2015 | OriginalPaper | Buchkapitel

Learning Bounded Tree-Width Bayesian Networks via Sampling

verfasst von : Siqi Nie, Cassio P. de Campos, Qiang Ji

Erschienen in: Symbolic and Quantitative Approaches to Reasoning with Uncertainty

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Learning Bayesian networks with bounded tree-width has attracted much attention recently, because low tree-width allows exact inference to be performed efficiently. Some existing methods [12, 14] tackle the problem by using k-trees to learn the optimal Bayesian network with tree-width up to k. In this paper, we propose a sampling method to efficiently find representative k-trees by introducing an Informative score function to characterize the quality of a k-tree. The proposed algorithm can efficiently learn a Bayesian network with tree-width at most k. Experiment results indicate that our approach is comparable with exact methods, but is much more computationally efficient.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arnborg, S., Corneil, D.G., Proskurowski, A.: Complexity of finding embeddings in ak-tree. SIAM J. Algebraic Discrete Methods 8(2), 277–284 (1987)MathSciNetCrossRefMATH Arnborg, S., Corneil, D.G., Proskurowski, A.: Complexity of finding embeddings in ak-tree. SIAM J. Algebraic Discrete Methods 8(2), 277–284 (1987)MathSciNetCrossRefMATH
3.
Zurück zum Zitat Berg, J., Järvisalo, M., Malone, B.: Learning optimal bounded treewidth bayesian networks via maximum satisfiability. In: Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, pp. 86–95 (2014) Berg, J., Järvisalo, M., Malone, B.: Learning optimal bounded treewidth bayesian networks via maximum satisfiability. In: Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, pp. 86–95 (2014)
4.
Zurück zum Zitat Buntine, W.: Theory refinement on Bayesian networks. In: Proceedings of the 7th Conference on Uncertainty in AI, pp. 52–60 (1991) Buntine, W.: Theory refinement on Bayesian networks. In: Proceedings of the 7th Conference on Uncertainty in AI, pp. 52–60 (1991)
5.
Zurück zum Zitat Caminiti, S., Fusco, E.G., Petreschi, R.: Bijective linear time coding and decoding for k-trees. Theory Comp. Syst. 46(2), 284–300 (2010)MathSciNetCrossRefMATH Caminiti, S., Fusco, E.G., Petreschi, R.: Bijective linear time coding and decoding for k-trees. Theory Comp. Syst. 46(2), 284–300 (2010)MathSciNetCrossRefMATH
6.
Zurück zum Zitat Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9(4), 309–347 (1992)MATH Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9(4), 309–347 (1992)MATH
7.
Zurück zum Zitat de Campos, C.P., Ji, Q.: Efficient structure learning of Bayesian networks using constraints. J. Mach. Learn. Res. 12, 663–689 (2011)MathSciNetMATH de Campos, C.P., Ji, Q.: Efficient structure learning of Bayesian networks using constraints. J. Mach. Learn. Res. 12, 663–689 (2011)MathSciNetMATH
8.
Zurück zum Zitat de Campos, C.P., Zeng, Z., Ji, Q.: Structure learning of Bayesian networks using constraints. In: Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, Quebec, Canada, pp. 113–120 (2009) de Campos, C.P., Zeng, Z., Ji, Q.: Structure learning of Bayesian networks using constraints. In: Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, Quebec, Canada, pp. 113–120 (2009)
9.
Zurück zum Zitat Eaton, D., Murphy, K.: Bayesian structure learning using dynamic programming and MCMC. In: Proceedings of the 23rd Conference on Uncertainty in AI, pp. 101–108 (2007) Eaton, D., Murphy, K.: Bayesian structure learning using dynamic programming and MCMC. In: Proceedings of the 23rd Conference on Uncertainty in AI, pp. 101–108 (2007)
10.
Zurück zum Zitat Elidan, G., Gould, S.: Learning bounded treewidth Bayesian networks. J. Mach. Learn. Res. 9, 2699–2731 (2008)MathSciNetMATH Elidan, G., Gould, S.: Learning bounded treewidth Bayesian networks. J. Mach. Learn. Res. 9, 2699–2731 (2008)MathSciNetMATH
11.
Zurück zum Zitat Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian networks: the combination of knowledge and statistical data. Mach. Learn. 20(3), 197–243 (1995)MATH Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian networks: the combination of knowledge and statistical data. Mach. Learn. 20(3), 197–243 (1995)MATH
12.
Zurück zum Zitat Korhonen, J.H., Parviainen, P.: Exact learning of bounded tree-width Bayesian networks. In: Proceedings of the 16th International Conference on AI and Statistics. JMLR W&CP, vol. 31, pp. 370–378 (2013) Korhonen, J.H., Parviainen, P.: Exact learning of bounded tree-width Bayesian networks. In: Proceedings of the 16th International Conference on AI and Statistics. JMLR W&CP, vol. 31, pp. 370–378 (2013)
13.
Zurück zum Zitat Kwisthout, J.H.P., Bodlaender, H.L., van der Gaag, L.C.: The necessity of bounded treewidth for efficient inference in Bayesian networks. In: Proceedings of the 19th European Conference on AI, pp. 237–242 (2010) Kwisthout, J.H.P., Bodlaender, H.L., van der Gaag, L.C.: The necessity of bounded treewidth for efficient inference in Bayesian networks. In: Proceedings of the 19th European Conference on AI, pp. 237–242 (2010)
14.
Zurück zum Zitat Nie, S., Mauá, D.D., de Campos, C.P., Ji, Q.: Advances in learning Bayesian networks of bounded treewidth. In: Advances in Neural Information Processing Systems, pp. 2285–2293 (2014) Nie, S., Mauá, D.D., de Campos, C.P., Ji, Q.: Advances in learning Bayesian networks of bounded treewidth. In: Advances in Neural Information Processing Systems, pp. 2285–2293 (2014)
15.
Zurück zum Zitat Parviainen, P., Farahani, H.S., Lagergren, J.: Learning bounded tree-width Bayesian networks using integer linear programming. In: Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, pp. 751–759 (2014) Parviainen, P., Farahani, H.S., Lagergren, J.: Learning bounded tree-width Bayesian networks using integer linear programming. In: Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, pp. 751–759 (2014)
16.
Metadaten
Titel
Learning Bounded Tree-Width Bayesian Networks via Sampling
verfasst von
Siqi Nie
Cassio P. de Campos
Qiang Ji
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-20807-7_35