Skip to main content
Erschienen in: Soft Computing 6/2013

01.06.2013 | Methodologies and Application

An artificial bee colony algorithm for learning Bayesian networks

verfasst von: Junzhong Ji, Hongkai Wei, Chunnian Liu

Erschienen in: Soft Computing | Ausgabe 6/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

One basic approach to learn Bayesian networks (BNs) from data is to apply a search procedure to explore the set of candidate networks for the database in light of a scoring metric, where the most popular stochastic methods are based on some meta-heuristic mechanisms, such as Genetic Algorithm, Evolutionary Programming and Ant Colony Optimization. In this paper, we have developed a new algorithm for learning BNs which employs a recently introduced meta-heuristic: artificial bee colony (ABC). All the phases necessary to tackle our learning problem using this meta-heuristic are described, and some experimental results to compare the performance of our ABC-based algorithm with other algorithms are given in the paper.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Beinlich IA, Suermondt HJ, Chavez RM, Cooper GF (1989) The case study with two probabilistic inference techniques for Bayesian networks. In: Proceedings of the Second European Conference on Artificial Intelligence in Medicine, Springer, Berlin, pp 247–256 Beinlich IA, Suermondt HJ, Chavez RM, Cooper GF (1989) The case study with two probabilistic inference techniques for Bayesian networks. In: Proceedings of the Second European Conference on Artificial Intelligence in Medicine, Springer, Berlin, pp 247–256
Zurück zum Zitat Binder J, Koller D, Russell S, Kanazawa K (1997) Adaptive probabilistic networks with hidden variables. Mach Learn 29 (2):213–244MATHCrossRef Binder J, Koller D, Russell S, Kanazawa K (1997) Adaptive probabilistic networks with hidden variables. Mach Learn 29 (2):213–244MATHCrossRef
Zurück zum Zitat Cheng J, Greiner R, Kelly J, Bell D, Liu W (2002) Learning belief networks from data: an information theory based approach. Artif Intell 137:43–90MathSciNetMATHCrossRef Cheng J, Greiner R, Kelly J, Bell D, Liu W (2002) Learning belief networks from data: an information theory based approach. Artif Intell 137:43–90MathSciNetMATHCrossRef
Zurück zum Zitat Colace F, Santo MD, Vento M (2010) A multiexpert approach for Bayesian network structural learning. In: Proceedings of the 43rd Hawaii International Conference on System Sciences (HICSS ’10). IEEE Computer Society, Washington, pp 1–11 Colace F, Santo MD, Vento M (2010) A multiexpert approach for Bayesian network structural learning. In: Proceedings of the 43rd Hawaii International Conference on System Sciences (HICSS ’10). IEEE Computer Society, Washington, pp 1–11
Zurück zum Zitat Cooper GF, Herskovits E, Bayesian A (1992) Method for the induction of probabilistic networks from data. Mach Learn 9:309–347MATH Cooper GF, Herskovits E, Bayesian A (1992) Method for the induction of probabilistic networks from data. Mach Learn 9:309–347MATH
Zurück zum Zitat Friedman N, Nachman I, Peer D (1999) Learning bayesian network structure from massive datasets: the "sparse candidate" algorithm. In: Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence (UAI’99), Morgan Kaufmann Publishers Inc., San Francisco, pp 206–215 Friedman N, Nachman I, Peer D (1999) Learning bayesian network structure from massive datasets: the "sparse candidate" algorithm. In: Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence (UAI’99), Morgan Kaufmann Publishers Inc., San Francisco, pp 206–215
Zurück zum Zitat Heckerman D (1996) A tutorial on learning Bayesian networks. In: Jordan MI (ed) Learning in graphical models, pp 301–354 Heckerman D (1996) A tutorial on learning Bayesian networks. In: Jordan MI (ed) Learning in graphical models, pp 301–354
Zurück zum Zitat Ji JZ, Zhang HX, Hu RB, Liu CN (2008) A Tabu-search based Bayesian network structure learning algorithm. Beijing Gongye Daxue Xuebao 37(8):1274–1280 Ji JZ, Zhang HX, Hu RB, Liu CN (2008) A Tabu-search based Bayesian network structure learning algorithm. Beijing Gongye Daxue Xuebao 37(8):1274–1280
Zurück zum Zitat Ji JZ, Zhang HX, Hu RB, Liu CN, Bayesian A (2009) Network learning algorithm based on independence test and ant colony optimization. Acta Autom Sinica 35(3):281–288MATHCrossRef Ji JZ, Zhang HX, Hu RB, Liu CN, Bayesian A (2009) Network learning algorithm based on independence test and ant colony optimization. Acta Autom Sinica 35(3):281–288MATHCrossRef
Zurück zum Zitat Ji JZ, Hu RB, Zhang HX, Liu CN (2011) A hybrid method for learning Bayesian networks based on ant colony optimization. Appl Soft Comput 11(4):3373–3384CrossRef Ji JZ, Hu RB, Zhang HX, Liu CN (2011) A hybrid method for learning Bayesian networks based on ant colony optimization. Appl Soft Comput 11(4):3373–3384CrossRef
Zurück zum Zitat Ji JZ, Wei HK, Liu CN, Yin BC (2012) A new artificial bee colony algorithm for the 0–1 multidimensional knapsack problem. Comput Optim Appl (reviewing) Ji JZ, Wei HK, Liu CN, Yin BC (2012) A new artificial bee colony algorithm for the 0–1 multidimensional knapsack problem. Comput Optim Appl (reviewing)
Zurück zum Zitat Jose AG, Jose MP (2002) Searching the best elimination sequence in Bayesian networks by using ant colony optimization. Pattern Recognit Lett 23(1–3):261–277MATH Jose AG, Jose MP (2002) Searching the best elimination sequence in Bayesian networks by using ant colony optimization. Pattern Recognit Lett 23(1–3):261–277MATH
Zurück zum Zitat Karaboga D (2005) An idea based on honey bee swarm for numerical optimization. In: Technical Report TR06, Computer Engineering Department, Erciyes University, Turkey, 2005 Karaboga D (2005) An idea based on honey bee swarm for numerical optimization. In: Technical Report TR06, Computer Engineering Department, Erciyes University, Turkey, 2005
Zurück zum Zitat Karaboga D, Basturk B (2008) On the performance of artificial bee colony (ABC) algorithm. Appl Soft Comput 8(2):687–697CrossRef Karaboga D, Basturk B (2008) On the performance of artificial bee colony (ABC) algorithm. Appl Soft Comput 8(2):687–697CrossRef
Zurück zum Zitat Larranaga P, Poza M, Yurramendi Y, Murga RH, Kuijpers MH (1996) Structure learning of Bayesian networks by genetic algorithms: a performance analysis of control parameters. IEEE Transact Pattern Anal Mach Intell 18(9):912–925CrossRef Larranaga P, Poza M, Yurramendi Y, Murga RH, Kuijpers MH (1996) Structure learning of Bayesian networks by genetic algorithms: a performance analysis of control parameters. IEEE Transact Pattern Anal Mach Intell 18(9):912–925CrossRef
Zurück zum Zitat Liu DY, Wang F, Lu YN, Xue WX, Wang SX (2001) Research on learning Bayesian network structure based on genetic algorithms. J Comput Res Dev 38(8):916–922 Liu DY, Wang F, Lu YN, Xue WX, Wang SX (2001) Research on learning Bayesian network structure based on genetic algorithms. J Comput Res Dev 38(8):916–922
Zurück zum Zitat Luis M, Campos D, Huete J (2000) A new approach for learning belief networks using independence criteria. Int J Approx Reason 24(1):11–37MATHCrossRef Luis M, Campos D, Huete J (2000) A new approach for learning belief networks using independence criteria. Int J Approx Reason 24(1):11–37MATHCrossRef
Zurück zum Zitat Luis MC, Juan MF, Jose AG, Jose MP (2002) Ant colony optimization for learning Bayesian networks. Int J Approx Reason 31:291–311MATHCrossRef Luis MC, Juan MF, Jose AG, Jose MP (2002) Ant colony optimization for learning Bayesian networks. Int J Approx Reason 31:291–311MATHCrossRef
Zurück zum Zitat Pinto PC, Nagele A, Dejori M, Runkler TA, Sousa JMC (2009) Using a local discovery ant algorithm for Bayesian network structure learning. IEEE Transact Evolutionary Comput 13(4):767–778CrossRef Pinto PC, Nagele A, Dejori M, Runkler TA, Sousa JMC (2009) Using a local discovery ant algorithm for Bayesian network structure learning. IEEE Transact Evolutionary Comput 13(4):767–778CrossRef
Zurück zum Zitat Singh A (2009) An artificial bee colony (ABC) algorithm for the leaf-constrained minimum spanning tree problem. Appl Soft Comput 9(2):625–631CrossRef Singh A (2009) An artificial bee colony (ABC) algorithm for the leaf-constrained minimum spanning tree problem. Appl Soft Comput 9(2):625–631CrossRef
Zurück zum Zitat Suzuki J (1999) Learning Bayesian belief networks based on the minimum description length principle: basic properties. IEICE Transact Fundam E82(10):2237–2245 Suzuki J (1999) Learning Bayesian belief networks based on the minimum description length principle: basic properties. IEICE Transact Fundam E82(10):2237–2245
Zurück zum Zitat Tsamardinos I, Brown LE, Alieris CF (2006) The max-min hill-climbing Bayesian network structure learning algorithm. Mach Learn 65(1):31–78CrossRef Tsamardinos I, Brown LE, Alieris CF (2006) The max-min hill-climbing Bayesian network structure learning algorithm. Mach Learn 65(1):31–78CrossRef
Zurück zum Zitat VanderMeer RK, Breed MD, Espelie KE, Winston ML (1998) Pheromone communication in social insects, Westview Press, Boulder, pp 3–33 VanderMeer RK, Breed MD, Espelie KE, Winston ML (1998) Pheromone communication in social insects, Westview Press, Boulder, pp 3–33
Zurück zum Zitat Wong ML, Leung KS (1999) Using evolutionary programming and minimum description length principle for data mining of Bayesian networks. IEEE Transact Pattern Anal Mach Intell 21(2):174–178CrossRef Wong ML, Leung KS (1999) Using evolutionary programming and minimum description length principle for data mining of Bayesian networks. IEEE Transact Pattern Anal Mach Intell 21(2):174–178CrossRef
Zurück zum Zitat Wong ML, Leung KS (2004) An efficient data mining method for learning Bayesian networks using an evolutionary algorithm-based hybrid approach. IEEE Transact Evolutionary Comput 8(4):378–404CrossRef Wong ML, Leung KS (2004) An efficient data mining method for learning Bayesian networks using an evolutionary algorithm-based hybrid approach. IEEE Transact Evolutionary Comput 8(4):378–404CrossRef
Metadaten
Titel
An artificial bee colony algorithm for learning Bayesian networks
verfasst von
Junzhong Ji
Hongkai Wei
Chunnian Liu
Publikationsdatum
01.06.2013
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 6/2013
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-012-0966-6

Weitere Artikel der Ausgabe 6/2013

Soft Computing 6/2013 Zur Ausgabe

Premium Partner