Skip to main content
Erschienen in: Artificial Intelligence Review 1/2019

29.01.2018

Bayesian network hybrid learning using an elite-guided genetic algorithm

verfasst von: Carlo Contaldi, Fatemeh Vafaee, Peter C. Nelson

Erschienen in: Artificial Intelligence Review | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Bayesian networks (BNs) constitute a powerful framework for probabilistic reasoning and have been extensively used in different research domains. This paper presents an improved hybrid learning strategy that features parameterized genetic algorithms (GAs) to learn the structure of BNs underlying a set of data samples. The performance of GAs is influenced by the choice of multiple initial parameters. This work is concerned with designing a series of parameter-less hybrid methods on a build-up basis: first the standard implementation is refined with the previously-developed data-informed evolutionary strategies. Then, two novel knowledge-driven parent controlling enhancements are presented. The first improvement works upon the parent limitation setting. BN structure learning algorithms typically set a bound for the maximum number of parents a BN node can possess to comply with the computational feasibility of the learning process. Our proposed method carefully selects the parents to rule out based on a knowledge-driven strategy. The second enhancement aims at reducing the sensitivity of the parent control setting by dynamically adjusting the maximum number of parents each node can hold. In the experimental section, it is shown how the adopted baseline outperforms the competitor algorithms included in the benchmark: thanks to its global search capabilities, the genetic methodology can efficiently prevail over other state-of-the-art structural learners on large networks. Presented experiments also prove how the proposed methods enhance the algorithmic efficiency and sensitivity to parameter setting, and address the problem of data fragmentation with respect to the baseline, with the advantage of higher performances in some cases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Berzan C (2012) An exploration of structure learning in Bayesian networks. Ph.D. thesis, Department of Computer Science, Tufts University, Medford Berzan C (2012) An exploration of structure learning in Bayesian networks. Ph.D. thesis, Department of Computer Science, Tufts University, Medford
Zurück zum Zitat Bromley J, Jackson N, Clymer O, Giacomello A, Jensen F (2005) The use of Hugin to develop Bayesian networks as an aid to integrated water resource planning. Environ Model Soft 20:231–242CrossRef Bromley J, Jackson N, Clymer O, Giacomello A, Jensen F (2005) The use of Hugin to develop Bayesian networks as an aid to integrated water resource planning. Environ Model Soft 20:231–242CrossRef
Zurück zum Zitat Chickering DM, Heckerman D, Meek C (2004) Large-sample learning of Bayesian networks is NP-hard. J Mach Learn Res 5:1287–1330MathSciNetMATH Chickering DM, Heckerman D, Meek C (2004) Large-sample learning of Bayesian networks is NP-hard. J Mach Learn Res 5:1287–1330MathSciNetMATH
Zurück zum Zitat Contaldi C, Vafaee F, Nelson PC (2017) The role of crossover operator in Bayesian network structure learning performance: a comprehensive comparative study and new insights. In: Proceedings of the genetic and evolutionary computation conference, GECCO ’17. ACM, New York, pp 769–776. https://doi.org/10.1145/3071178.3071240 Contaldi C, Vafaee F, Nelson PC (2017) The role of crossover operator in Bayesian network structure learning performance: a comprehensive comparative study and new insights. In: Proceedings of the genetic and evolutionary computation conference, GECCO ’17. ACM, New York, pp 769–776. https://​doi.​org/​10.​1145/​3071178.​3071240
Zurück zum Zitat de Campos LM, Fernández-Luna JM, Huete JF (2004) Bayesian networks and information retrieval: an introduction to the special issue. Inf Process Manag 40:727–733CrossRef de Campos LM, Fernández-Luna JM, Huete JF (2004) Bayesian networks and information retrieval: an introduction to the special issue. Inf Process Manag 40:727–733CrossRef
Zurück zum Zitat Friedman N, Nachman I, Peér D (1999) Learning Bayesian network structure from massive datasets: the “sparse candidate” algorithm. In: Proceedings of the fifteenth conference on uncertainty in artificial intelligence, association for uncertainty in artificial intelligence (AUAI), Stockholm, pp 206–215 Friedman N, Nachman I, Peér D (1999) Learning Bayesian network structure from massive datasets: the “sparse candidate” algorithm. In: Proceedings of the fifteenth conference on uncertainty in artificial intelligence, association for uncertainty in artificial intelligence (AUAI), Stockholm, pp 206–215
Zurück zum Zitat Hill SM, Lu Y, Molina J, Heiser LM, Spellman PT, Speed TP, Gray JW, Mills GB, Mukherjee S (2012) Bayesian inference of signaling network topology in a cancer cell line. Bioinformatics 28:2804–2810CrossRef Hill SM, Lu Y, Molina J, Heiser LM, Spellman PT, Speed TP, Gray JW, Mills GB, Mukherjee S (2012) Bayesian inference of signaling network topology in a cancer cell line. Bioinformatics 28:2804–2810CrossRef
Zurück zum Zitat Kahn CE, Roberts LM, Shaffer KA, Haddawy P (1997) Construction of a Bayesian network for mammographic diagnosis of breast cancer. Comput Biol Med 27:19–29CrossRef Kahn CE, Roberts LM, Shaffer KA, Haddawy P (1997) Construction of a Bayesian network for mammographic diagnosis of breast cancer. Comput Biol Med 27:19–29CrossRef
Zurück zum Zitat Leray P, Francois O (2004) BNT structure learning package: documentation and experiments. Technical report, Laboratoire PSI, Universitè et INSA de Rouen Leray P, Francois O (2004) BNT structure learning package: documentation and experiments. Technical report, Laboratoire PSI, Universitè et INSA de Rouen
Zurück zum Zitat McDonald JH (2014) Handbook of biological statistics, 3rd edn. Sparky House Publishing, Baltimore McDonald JH (2014) Handbook of biological statistics, 3rd edn. Sparky House Publishing, Baltimore
Zurück zum Zitat Pearl J (2000) Causality: models, reasoning, and inference. Cambridge University Press, New YorkMATH Pearl J (2000) Causality: models, reasoning, and inference. Cambridge University Press, New YorkMATH
Zurück zum Zitat Pellet J, Elisseeff A (2008) Using Markov blankets for causal structure learning. J Mach Learn Res 9:1295–1342MathSciNetMATH Pellet J, Elisseeff A (2008) Using Markov blankets for causal structure learning. J Mach Learn Res 9:1295–1342MathSciNetMATH
Zurück zum Zitat Rudolph G (1994) Convergence analysis of canonical genetic algorithms. IEEE Trans Neural Netw 5:96–101CrossRef Rudolph G (1994) Convergence analysis of canonical genetic algorithms. IEEE Trans Neural Netw 5:96–101CrossRef
Zurück zum Zitat Sachs K, Perez O, Pe’er D (2005) Causal protein-signaling networks derived from multiparameter single-cell data. Science 308:523–529CrossRef Sachs K, Perez O, Pe’er D (2005) Causal protein-signaling networks derived from multiparameter single-cell data. Science 308:523–529CrossRef
Zurück zum Zitat Teyssier M, Koller D (2005) Ordering-based search: a simple and effective algorithm for learning Bayesian networks. In: Proceedings of the twenty-first conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., Edinburgh, pp 584–590 Teyssier M, Koller D (2005) Ordering-based search: a simple and effective algorithm for learning Bayesian networks. In: Proceedings of the twenty-first conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., Edinburgh, pp 584–590
Zurück zum Zitat Uusitalo L, Kuikka S, Romakkaniemi A (2005) Estimation of Atlantic salmon smolt carrying capacity of rivers using expert knowledge. ICES J Mar Sci 62:708–722CrossRef Uusitalo L, Kuikka S, Romakkaniemi A (2005) Estimation of Atlantic salmon smolt carrying capacity of rivers using expert knowledge. ICES J Mar Sci 62:708–722CrossRef
Zurück zum Zitat Vafaee F, Turán G, Nelson PC, Berger-Wolf TY (2014a) Among-site rate variation: adaptation of genetic algorithm mutation rates at each single site. In: Proceedings of the 2014 annual conference on genetic and evolutionary computation. ACM, New York. https://doi.org/10.1145/2576768.2598216 Vafaee F, Turán G, Nelson PC, Berger-Wolf TY (2014a) Among-site rate variation: adaptation of genetic algorithm mutation rates at each single site. In: Proceedings of the 2014 annual conference on genetic and evolutionary computation. ACM, New York. https://​doi.​org/​10.​1145/​2576768.​2598216
Zurück zum Zitat Van Rijsbergen CJ (1979) Information retrieval, 2nd edn. Butterworths, LondonMATH Van Rijsbergen CJ (1979) Information retrieval, 2nd edn. Butterworths, LondonMATH
Zurück zum Zitat Wooldridge S, Done T (2004) Learning to predict large-scale coral bleaching from past events: a Bayesian approach using remotely sensed data, in-situ data, and environmental proxies. Coral Reefs 23:96–108CrossRef Wooldridge S, Done T (2004) Learning to predict large-scale coral bleaching from past events: a Bayesian approach using remotely sensed data, in-situ data, and environmental proxies. Coral Reefs 23:96–108CrossRef
Zurück zum Zitat Xia J, Neapolitan R, Barmadaand MM, Visweswaran S (2011) Learning genetic epistasis using Bayesian network scoring criteria. BMC Bioinform 12:89CrossRef Xia J, Neapolitan R, Barmadaand MM, Visweswaran S (2011) Learning genetic epistasis using Bayesian network scoring criteria. BMC Bioinform 12:89CrossRef
Metadaten
Titel
Bayesian network hybrid learning using an elite-guided genetic algorithm
verfasst von
Carlo Contaldi
Fatemeh Vafaee
Peter C. Nelson
Publikationsdatum
29.01.2018
Verlag
Springer Netherlands
Erschienen in
Artificial Intelligence Review / Ausgabe 1/2019
Print ISSN: 0269-2821
Elektronische ISSN: 1573-7462
DOI
https://doi.org/10.1007/s10462-018-9615-5

Weitere Artikel der Ausgabe 1/2019

Artificial Intelligence Review 1/2019 Zur Ausgabe

Premium Partner