Skip to main content
Top

2015 | OriginalPaper | Chapter

4. Bayesian Classifiers

Author : Luis Enrique Sucar

Published in: Probabilistic Graphical Models

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter covers Bayesian classifiers. After a brief introduction to the classification problem, the Naive Bayesian classifier is presented, as well as its main variants: TAN and BAN. Then the semi-Naive Bayesian classifier is described. A multidimensional classifier may assign several classes to the same object. Two alternatives for multidimensional classification are analyzed: the multidimensional Bayesian network classifier and the Bayesian chain classifier. Then an introduction to hierarchical classification is presented. The chapter concludes by illustrating the application of Bayesian classifiers in two domains: skin pixel detection in images and drug selection for HIV treatment.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For an introduction and comparison of different types of classifiers we refer the interested reader to [10].
 
2
The posterior probabilities of the classes will be affected by a constant as we are not considering the denominator in Eq. (4.6), that is, they will not add to one; however, they can be easily normalized by dividing each one by the sum for all classes.
 
3
We will cover parameter estimation in detail in the chapter on Bayesian Networks.
 
4
This assumes that the misclassification cost is the same for all classes; if these costs are not the same, the class the minimizes the misclassification cost should be selected.
 
5
Bayesian networks are introduced in Chap. 7.
 
Literature
2.
go back to reference Bielza, C., Li, G., Larrañaga, P.: Multi-dimensional classification with bayesian networks. Int. J. Approx. Reason. 52, 705–727 (2011)MATHCrossRef Bielza, C., Li, G., Larrañaga, P.: Multi-dimensional classification with bayesian networks. Int. J. Approx. Reason. 52, 705–727 (2011)MATHCrossRef
3.
go back to reference Borchani, H., Bielza, C., Toro, C., Larrañaga, P.: Predicting human immunodeficiency virus inhibitors using multi-dimensional Bayesian network classifiers. Artif. Intell. Med. 57, 219–229 (2013)CrossRef Borchani, H., Bielza, C., Toro, C., Larrañaga, P.: Predicting human immunodeficiency virus inhibitors using multi-dimensional Bayesian network classifiers. Artif. Intell. Med. 57, 219–229 (2013)CrossRef
4.
go back to reference Cheng, J., Greiner, R.: Comparing Bayesian network classifiers. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pp. 101–108 (1999) Cheng, J., Greiner, R.: Comparing Bayesian network classifiers. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pp. 101–108 (1999)
5.
go back to reference Drummond, C., Holte, R.C.: Explicitly representing expected cost: an alternative to the ROC representation. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 198–207 (2000) Drummond, C., Holte, R.C.: Explicitly representing expected cost: an alternative to the ROC representation. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 198–207 (2000)
6.
go back to reference Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29, 131–163 (1997)MATHCrossRef Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29, 131–163 (1997)MATHCrossRef
7.
go back to reference Hall, M., Frank, E., Holmes, G., Pfahringer, B. and Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. In: ACM SIGKDD Explorations Newsletter. ACM, pp. 10–18 (2009) Hall, M., Frank, E., Holmes, G., Pfahringer, B. and Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. In: ACM SIGKDD Explorations Newsletter. ACM, pp. 10–18 (2009)
8.
go back to reference Kwoh, C.K., Gillies, D.F.: Using hidden nodes in Bayesian networks. Artificial Intelligence, vol. 88, pp. 1–38. Elsevier, Essex (1996) Kwoh, C.K., Gillies, D.F.: Using hidden nodes in Bayesian networks. Artificial Intelligence, vol. 88, pp. 1–38. Elsevier, Essex (1996)
9.
go back to reference Martinez, M., Sucar, L.E.: Learning an optimal naive Bayes classifier. In: International Conference on Pattern Recognition (ICPR), vol. 3, pp. 1236–1239 (2006) Martinez, M., Sucar, L.E.: Learning an optimal naive Bayes classifier. In: International Conference on Pattern Recognition (ICPR), vol. 3, pp. 1236–1239 (2006)
10.
go back to reference Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Ellis Howard, England (2004) Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Ellis Howard, England (2004)
11.
go back to reference Pazzani, M.J.: Searching for Dependencies in Bayesian Classifiers. Artificial Intelligence and Statistics IV. Lecture Notes in Statistics, Springer-Verlag, New York (1997) Pazzani, M.J.: Searching for Dependencies in Bayesian Classifiers. Artificial Intelligence and Statistics IV. Lecture Notes in Statistics, Springer-Verlag, New York (1997)
12.
go back to reference Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. In: Proceedings ECML/PKDD, pp. 254–269 (2009) Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. In: Proceedings ECML/PKDD, pp. 254–269 (2009)
13.
go back to reference Ramírez, M., Sucar, L.E., Morales, E.: Path evaluation for hierarchical multi-label classification. In: Proceedings of the Twenty-Seventh International Florida Artificial Intelligence Research Society Conference (FLAIRS), pp. 502–507 (2014) Ramírez, M., Sucar, L.E., Morales, E.: Path evaluation for hierarchical multi-label classification. In: Proceedings of the Twenty-Seventh International Florida Artificial Intelligence Research Society Conference (FLAIRS), pp. 502–507 (2014)
14.
go back to reference Silla Jr., C.N., Freitas, A.A.: Novel top-down approaches for hierarchical classification and their application to automatic music genre classification. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 3499–3504. October 2009 Silla Jr., C.N., Freitas, A.A.: Novel top-down approaches for hierarchical classification and their application to automatic music genre classification. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 3499–3504. October 2009
15.
go back to reference Silla Jr, C.N., Freitas, A.A.: A survey of hierarchical classification across different application domains. Data Min. Knowl. Discov. 22(1–2), 31–72 (2011)MATHMathSciNetCrossRef Silla Jr, C.N., Freitas, A.A.: A survey of hierarchical classification across different application domains. Data Min. Knowl. Discov. 22(1–2), 31–72 (2011)MATHMathSciNetCrossRef
16.
go back to reference Sucar, L.E., Gillies, D.F., Gillies, D.A.: Objective probabilities in expert systems. Artif. Intell. 61, 187–208 (1993)MathSciNetCrossRef Sucar, L.E., Gillies, D.F., Gillies, D.A.: Objective probabilities in expert systems. Artif. Intell. 61, 187–208 (1993)MathSciNetCrossRef
17.
go back to reference Sucar, L.E., Bielza, C., Morales, E., Hernandez, P., Zaragoza, J., Larrañaga, P.: Multi-label classification with Bayesian network-based chain classifiers. Pattern Recognit. Lett. 41, 14–22 (2014)CrossRef Sucar, L.E., Bielza, C., Morales, E., Hernandez, P., Zaragoza, J., Larrañaga, P.: Multi-label classification with Bayesian network-based chain classifiers. Pattern Recognit. Lett. 41, 14–22 (2014)CrossRef
18.
go back to reference Tsoumakas, G., Katakis, I.: Multi-label classification: an overview. Int. J. Data Wareh. Min. 3, 1–13 (2007)CrossRef Tsoumakas, G., Katakis, I.: Multi-label classification: an overview. Int. J. Data Wareh. Min. 3, 1–13 (2007)CrossRef
19.
go back to reference van der Gaag L.C., de Waal, P.R.: Multi-dimensional Bayesian network classifiers. In: Third European Conference on Probabilistic Graphic Models, pp. 107–114. Prague, Czech Republic (2006) van der Gaag L.C., de Waal, P.R.: Multi-dimensional Bayesian network classifiers. In: Third European Conference on Probabilistic Graphic Models, pp. 107–114. Prague, Czech Republic (2006)
Metadata
Title
Bayesian Classifiers
Author
Luis Enrique Sucar
Copyright Year
2015
Publisher
Springer London
DOI
https://doi.org/10.1007/978-1-4471-6699-3_4

Premium Partner