Skip to main content
Erschienen in: Soft Computing 4/2015

01.04.2015 | Methodologies and Application

Abductive inference in Bayesian networks using distributed overlapping swarm intelligence

verfasst von: Nathan Fortier, John Sheppard, Shane Strasser

Erschienen in: Soft Computing | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we propose several approximation algorithms for the problems of full and partial abductive inference in Bayesian belief networks. Full abductive inference is the problem of finding the \(k\) most probable state assignments to all non-evidence variables in the network while partial abductive inference is the problem of finding the \(k\) most probable state assignments for a subset of the non-evidence variables in the network, called the explanation set. We developed several multi-swarm algorithms based on the overlapping swarm intelligence framework to find approximate solutions to these problems. For full abductive inference a swarm is associated with each node in the network. For partial abductive inference, a swarm is associated with each node in the explanation set and each node in the Markov blankets of the explanation set variables. Each swarm learns the value assignments for the variables in the Markov blanket associated with that swarm’s node. Swarms learning state assignments for the same variable compete for inclusion in the final solution.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Belding T (1995) The distributed genetic algorithm revisited. In: Proceedings of the International Conference on genetic algorithms, pp 114–121 Belding T (1995) The distributed genetic algorithm revisited. In: Proceedings of the International Conference on genetic algorithms, pp 114–121
Zurück zum Zitat van den Bergh F, Engelbrecht A (2000) Cooperative learning in neural networks using particle swarm optimizers. South African Computer J 26:90–94 van den Bergh F, Engelbrecht A (2000) Cooperative learning in neural networks using particle swarm optimizers. South African Computer J 26:90–94
Zurück zum Zitat Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122CrossRef Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122CrossRef
Zurück zum Zitat de Campos L, Gamez J, Moral S (1999) Partial abductive inference in Bayesian belief networks using a genetic algorithm. Pattern Recogn Lett 20:1211–1217CrossRef de Campos L, Gamez J, Moral S (1999) Partial abductive inference in Bayesian belief networks using a genetic algorithm. Pattern Recogn Lett 20:1211–1217CrossRef
Zurück zum Zitat de Campos L, Gamez J, Moral S (2001) Partial abductive inference in Bayesian belief networks by simulated annealing. Int J Approx Reason 27(3):263–283CrossRefMATH de Campos L, Gamez J, Moral S (2001) Partial abductive inference in Bayesian belief networks by simulated annealing. Int J Approx Reason 27(3):263–283CrossRefMATH
Zurück zum Zitat Dagum P, Luby M (1993) Approximating probabilistic inference in Bayesian belief networks is NP-hard. Artif Intell 60(1):141–153CrossRefMATHMathSciNet Dagum P, Luby M (1993) Approximating probabilistic inference in Bayesian belief networks is NP-hard. Artif Intell 60(1):141–153CrossRefMATHMathSciNet
Zurück zum Zitat Dawid A (1992) Applications of a general propagation algorithm for probabilistic expert systems. Stat Comput 2(1):25–36CrossRef Dawid A (1992) Applications of a general propagation algorithm for probabilistic expert systems. Stat Comput 2(1):25–36CrossRef
Zurück zum Zitat Dechter R (1996) Bucket elimination: a unifying framework for probabilistic inference. In: Proceedings of the Twelfth international conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., pp 211–219 Dechter R (1996) Bucket elimination: a unifying framework for probabilistic inference. In: Proceedings of the Twelfth international conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., pp 211–219
Zurück zum Zitat Dechter R, Irina R (2003) Mini-buckets: a general scheme for bounded inference. J ACM 50(2):107–153 Dechter R, Irina R (2003) Mini-buckets: a general scheme for bounded inference. J ACM 50(2):107–153
Zurück zum Zitat Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. Comput Intell Magazine IEEE 1(4):28–39CrossRef Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. Comput Intell Magazine IEEE 1(4):28–39CrossRef
Zurück zum Zitat Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Micro machine and human science, 1995. MHS’95., Proceedings of the Sixth International Symposium on, IEEE, pp 39–43 Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Micro machine and human science, 1995. MHS’95., Proceedings of the Sixth International Symposium on, IEEE, pp 39–43
Zurück zum Zitat Elvira Consortium (2002) Elvira: an environment for creating and using probabilistic graphical models. In: Proceedings of the first European workshop on probabilistic graphical models, pp 222–230 Elvira Consortium (2002) Elvira: an environment for creating and using probabilistic graphical models. In: Proceedings of the first European workshop on probabilistic graphical models, pp 222–230
Zurück zum Zitat Fortier N, Sheppard JW, Pillai KG (2012) DOSI: training artificial neural networks using overlapping swarm intelligence with local credit assignment. In: Soft computing and intelligent systems (SCIS) and 13th International Symposium on advanced intelligent systems (ISIS), 2012 Joint 6th International Conference on, IEEE, pp 1420–1425 Fortier N, Sheppard JW, Pillai KG (2012) DOSI: training artificial neural networks using overlapping swarm intelligence with local credit assignment. In: Soft computing and intelligent systems (SCIS) and 13th International Symposium on advanced intelligent systems (ISIS), 2012 Joint 6th International Conference on, IEEE, pp 1420–1425
Zurück zum Zitat Fortier N, Sheppard JW, Pillai KG (2013) Bayesian abductive inference using overlapping swarm intelligence. In: 2013 IEEE Symposium on swarm intelligence (SIS 2013), pp 263–270 Fortier N, Sheppard JW, Pillai KG (2013) Bayesian abductive inference using overlapping swarm intelligence. In: 2013 IEEE Symposium on swarm intelligence (SIS 2013), pp 263–270
Zurück zum Zitat Gamez J (1998) Inferencia abductiva en redes causales. In: Thesis. Departamento de Ciencias de la Computacin e I.A. Escuela Tcnica Superior de Ingeniera Informtica Gamez J (1998) Inferencia abductiva en redes causales. In: Thesis. Departamento de Ciencias de la Computacin e I.A. Escuela Tcnica Superior de Ingeniera Informtica
Zurück zum Zitat Gandomi AH, Alavi AH (2012) Krill herd: a new bio-inspired optimization algorithm. Commun Nonlinear Sci Numer Simul 17(12):4831–4845CrossRefMATHMathSciNet Gandomi AH, Alavi AH (2012) Krill herd: a new bio-inspired optimization algorithm. Commun Nonlinear Sci Numer Simul 17(12):4831–4845CrossRefMATHMathSciNet
Zurück zum Zitat Gandomi AH, Yang XS, Alavi AH (2013) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng Computers 29(1):17–35CrossRefMathSciNet Gandomi AH, Yang XS, Alavi AH (2013) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng Computers 29(1):17–35CrossRefMathSciNet
Zurück zum Zitat Gelsema E (1995) Abductive reasoning in Bayesian belief networks using a genetic algorithm. Pattern Recogn Lett 16:865–871CrossRef Gelsema E (1995) Abductive reasoning in Bayesian belief networks using a genetic algorithm. Pattern Recogn Lett 16:865–871CrossRef
Zurück zum Zitat Haberman BK, Sheppard JW (2012) Overlapping particle swarms for energy-efficient routing in sensor networks. Wireless Netw 18(4):351–363CrossRef Haberman BK, Sheppard JW (2012) Overlapping particle swarms for energy-efficient routing in sensor networks. Wireless Netw 18(4):351–363CrossRef
Zurück zum Zitat Karaboga D, Basturk B (2008) On the performance of artificial bee colony (abc) algorithm. Appl Soft Comput 8(1):687–697CrossRef Karaboga D, Basturk B (2008) On the performance of artificial bee colony (abc) algorithm. Appl Soft Comput 8(1):687–697CrossRef
Zurück zum Zitat Kask K, Dechter R (1999) Stochastic local search for Bayesian networks. In: Workshop on AI and statistics. Morgan Kaufman Publishers, pp 113–122 Kask K, Dechter R (1999) Stochastic local search for Bayesian networks. In: Workshop on AI and statistics. Morgan Kaufman Publishers, pp 113–122
Zurück zum Zitat Kennedy J, Eberhart R (1997) A discrete binary version of the particle swarm algorithm. In: Systems, man, and cybernetics, 1997. Computational cybernetics and simulation., 1997 IEEE International Conference on, vol 5, pp 4104–4108 Kennedy J, Eberhart R (1997) A discrete binary version of the particle swarm algorithm. In: Systems, man, and cybernetics, 1997. Computational cybernetics and simulation., 1997 IEEE International Conference on, vol 5, pp 4104–4108
Zurück zum Zitat Koller D, Friedman N (2009) Probabilistic graphical models—principles and techniques. MIT Press, New York Koller D, Friedman N (2009) Probabilistic graphical models—principles and techniques. MIT Press, New York
Zurück zum Zitat Langley P (1988) Machine learning as an experimental science. Mach Learn 3(1):5–8MathSciNet Langley P (1988) Machine learning as an experimental science. Mach Learn 3(1):5–8MathSciNet
Zurück zum Zitat Neapolitan RE (2004) Learning bayesian networks. Pearson Prentice Hall, Upper Saddle River Neapolitan RE (2004) Learning bayesian networks. Pearson Prentice Hall, Upper Saddle River
Zurück zum Zitat Nilsson D (1998) An efficient algorithm for finding the m most probable configurations in probabilistic expert systems. Stat Comput 8(2):159–173CrossRef Nilsson D (1998) An efficient algorithm for finding the m most probable configurations in probabilistic expert systems. Stat Comput 8(2):159–173CrossRef
Zurück zum Zitat Olfati-Saber R, Fax JA, Murray RM (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233CrossRef Olfati-Saber R, Fax JA, Murray RM (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233CrossRef
Zurück zum Zitat Patterson S, Bamieh B, El Abbadi A (2010) Convergence rates of distributed average consensus with stochastic link failures. Autom Control IEEE Trans 55(4):880–892CrossRef Patterson S, Bamieh B, El Abbadi A (2010) Convergence rates of distributed average consensus with stochastic link failures. Autom Control IEEE Trans 55(4):880–892CrossRef
Zurück zum Zitat Pillai KG, Sheppard JW (2011) Overlapping swarm intelligence for training artificial neural networks. In: Proceedings of the IEEE swarm intelligence symposium, pp 1–8 Pillai KG, Sheppard JW (2011) Overlapping swarm intelligence for training artificial neural networks. In: Proceedings of the IEEE swarm intelligence symposium, pp 1–8
Zurück zum Zitat Pillai KG, Sheppard JW (2012) Abductive inference in Bayesian belief networks using swarm intelligence. In: Soft computing and intelligent systems (SCIS) and 13th International Symposium on advanced intelligent systems (ISIS), 2012 Joint 6th International Conference on, pp 375–380 Pillai KG, Sheppard JW (2012) Abductive inference in Bayesian belief networks using swarm intelligence. In: Soft computing and intelligent systems (SCIS) and 13th International Symposium on advanced intelligent systems (ISIS), 2012 Joint 6th International Conference on, pp 375–380
Zurück zum Zitat Rabbat M, Nowak R (2004) Distributed optimization in sensor networks. In: Proceedings of the 3rd international symposium on Information processing in sensor networks, ACM, pp 20–27 Rabbat M, Nowak R (2004) Distributed optimization in sensor networks. In: Proceedings of the 3rd international symposium on Information processing in sensor networks, ACM, pp 20–27
Zurück zum Zitat Rojas-Guzman C, Kramer MA (1993) Galgo: a genetic algorithm decision support tool for complex uncertain systems modeled with bayesian belief networks. In: Proceedings of the Ninth international conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., pp 368–375 Rojas-Guzman C, Kramer MA (1993) Galgo: a genetic algorithm decision support tool for complex uncertain systems modeled with bayesian belief networks. In: Proceedings of the Ninth international conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., pp 368–375
Zurück zum Zitat Sriwachirawat N, Auwatanamongkol S (2006) On approximating k-MPE of Bayesian networks using genetic algorithm. In: Cybernetics and intelligent systems, pp 1–6 Sriwachirawat N, Auwatanamongkol S (2006) On approximating k-MPE of Bayesian networks using genetic algorithm. In: Cybernetics and intelligent systems, pp 1–6
Zurück zum Zitat Tanese R, Co-Chairman-Holland J, Co-Chairman-Stout Q (1989) Distributed genetic algorithms for function optimization. In: Proceedings of the International Conference on genetic algorithms, University of Michigan, pp 434–439 Tanese R, Co-Chairman-Holland J, Co-Chairman-Stout Q (1989) Distributed genetic algorithms for function optimization. In: Proceedings of the International Conference on genetic algorithms, University of Michigan, pp 434–439
Zurück zum Zitat Veeramachaneni K, Osadciw L, Kamath G (2007) Probabilistically driven particle swarms for optimization of multi-valued discrete problems: design and analysis. In: Proceedings of the IEEE swarm intelligence symposium, pp 141–149 Veeramachaneni K, Osadciw L, Kamath G (2007) Probabilistically driven particle swarms for optimization of multi-valued discrete problems: design and analysis. In: Proceedings of the IEEE swarm intelligence symposium, pp 141–149
Zurück zum Zitat Whitley D, Starkweather T (1990) Genitor ii: a distributed genetic algorithm. J Exp Theor Artif Intell 2(3):189–214CrossRef Whitley D, Starkweather T (1990) Genitor ii: a distributed genetic algorithm. J Exp Theor Artif Intell 2(3):189–214CrossRef
Zurück zum Zitat Whitley D, Rana S, Heckendorn R (1999) The island model genetic algorithm: on separability, population size and convergence. J Comput Inf Technol 7:33–48 Whitley D, Rana S, Heckendorn R (1999) The island model genetic algorithm: on separability, population size and convergence. J Comput Inf Technol 7:33–48
Zurück zum Zitat Yang XS, Cui Z, Xiao R, Gandomi AH, Karamanoglu M (2013) Swarm intelligence and bio-inspired computation: theory and applications. Newnes, vol. 1, pp 13–20 Yang XS, Cui Z, Xiao R, Gandomi AH, Karamanoglu M (2013) Swarm intelligence and bio-inspired computation: theory and applications. Newnes, vol. 1, pp 13–20
Zurück zum Zitat Yang XS (2009) Firefly algorithms for multimodal optimization. In: Stochastic algorithms: foundations and applications. Springer, pp 169–178 Yang XS (2009) Firefly algorithms for multimodal optimization. In: Stochastic algorithms: foundations and applications. Springer, pp 169–178
Metadaten
Titel
Abductive inference in Bayesian networks using distributed overlapping swarm intelligence
verfasst von
Nathan Fortier
John Sheppard
Shane Strasser
Publikationsdatum
01.04.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 4/2015
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-014-1310-0

Weitere Artikel der Ausgabe 4/2015

Soft Computing 4/2015 Zur Ausgabe

Premium Partner