Skip to main content
Top

2016 | OriginalPaper | Chapter

A Double Weighted Naive Bayes for Multi-label Classification

Authors : Xuesong Yan, Wei Li, Qinghua Wu, Victor S. Sheng

Published in: Computational Intelligence and Intelligent Systems

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-label classification is to assign an instance to multiple classes. Naive Bayes (NB) is one of the most popular algorithms for pattern recognition and classification. It has a high performance in single label classification. It is naturally extended for multi-label classification under the assumption of label independence. As we know, NB is based on a simple but unrealistic assumption that attributes are conditionally independent given the class. Therefore, a double weighted NB (DWNB) is proposed to demonstrate the influences of predicting different labels based on different attributes. Our DWNB utilizes the niching cultural algorithm to determine the weight configuration automatically. Our experimental results show that our proposed DWNB outperforms NB and its extensions significantly in multi-label classification.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Reasoning. Morgan Kaufmann Publishers, Los Altos (1988) Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Reasoning. Morgan Kaufmann Publishers, Los Altos (1988)
2.
go back to reference Langley, P., Iba, W., Thompson, K.: An analysis of Bayesian classifiers. AAAI 90, 223–228 (1992) Langley, P., Iba, W., Thompson, K.: An analysis of Bayesian classifiers. AAAI 90, 223–228 (1992)
3.
go back to reference Xie, Z., Hsu, W., Liu, Z., Li Lee, M.: SNNB: a selective neighborhood based Naive Bayes for lazy learning. In: Chen, M.-S., Yu, P.S., Liu, B. (eds.) PAKDD 2002. LNCS (LNAI), vol. 2336, pp. 104–114. Springer, Heidelberg (2002)CrossRef Xie, Z., Hsu, W., Liu, Z., Li Lee, M.: SNNB: a selective neighborhood based Naive Bayes for lazy learning. In: Chen, M.-S., Yu, P.S., Liu, B. (eds.) PAKDD 2002. LNCS (LNAI), vol. 2336, pp. 104–114. Springer, Heidelberg (2002)CrossRef
4.
go back to reference Langley, P., Sage, S.: Induction of selective Bayesian classifiers. In: Proceedings of the 10th International Conference on Uncertainty in Artificial Intelligence, pp. 399–406. Morgan Kaufmann Publishers Inc (1994) Langley, P., Sage, S.: Induction of selective Bayesian classifiers. In: Proceedings of the 10th International Conference on Uncertainty in Artificial Intelligence, pp. 399–406. Morgan Kaufmann Publishers Inc (1994)
5.
go back to reference Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2–3), 131–163 (1997)CrossRefMATH Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2–3), 131–163 (1997)CrossRefMATH
6.
go back to reference Kohavi, R.: Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree hybrid. In: KDD, pp. 202–207 (1996) Kohavi, R.: Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree hybrid. In: KDD, pp. 202–207 (1996)
7.
go back to reference Sucar, L.E., Bielza, C., Morales, E.F., et al.: Multi-label classification with Bayesian network-based chain classifiers. Pattern Recogn. Lett. 41, 14–22 (2014)CrossRef Sucar, L.E., Bielza, C., Morales, E.F., et al.: Multi-label classification with Bayesian network-based chain classifiers. Pattern Recogn. Lett. 41, 14–22 (2014)CrossRef
8.
go back to reference Qu, G., Zhang, H., Hartrick, C.T.: Multi-label classification with Bayesian theorem. In: 4th International Conference on Biomedical Engineering and Informatics (BMEI), vol. 4, pp. 2281–2285. IEEE (2011) Qu, G., Zhang, H., Hartrick, C.T.: Multi-label classification with Bayesian theorem. In: 4th International Conference on Biomedical Engineering and Informatics (BMEI), vol. 4, pp. 2281–2285. IEEE (2011)
9.
go back to reference Zhang, H., Sheng, S.: Learning weighted Naive Bayes with accurate ranking. In: 4th IEEE International Conference on Data Mining, pp. 567–570. IEEE (2004) Zhang, H., Sheng, S.: Learning weighted Naive Bayes with accurate ranking. In: 4th IEEE International Conference on Data Mining, pp. 567–570. IEEE (2004)
10.
go back to reference Hall, M.: Correlation-based feature selection for discrete and numeric class machine‎ learning. In: ‎Proceedings‎ of‎ the 7th‎ Intentional‎ Conference‎ on‎ Machine‎ Learning,‎ Stanford University (2000) Hall, M.: Correlation-based feature selection for discrete and numeric class machine‎ learning. In: ‎Proceedings‎ of‎ the 7th‎ Intentional‎ Conference‎ on‎ Machine‎ Learning,‎ Stanford University (2000)
11.
go back to reference Jiang, L., Zhang, H.: Weightily averaged one-dependence estimators. In: Yang, Q., Webb, G. (eds.) PRICAI 2006. LNCS (LNAI), vol. 4099, pp. 970–974. Springer, Heidelberg (2006)CrossRef Jiang, L., Zhang, H.: Weightily averaged one-dependence estimators. In: Yang, Q., Webb, G. (eds.) PRICAI 2006. LNCS (LNAI), vol. 4099, pp. 970–974. Springer, Heidelberg (2006)CrossRef
12.
go back to reference Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn. 53(1–2), 23–69 (2003)CrossRefMATH Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn. 53(1–2), 23–69 (2003)CrossRefMATH
13.
go back to reference Hall, M.: A decision tree-based attribute weighting filter for Naive Bayes. Knowl.-Based Syst. 20(2), 120–126 (2007)CrossRef Hall, M.: A decision tree-based attribute weighting filter for Naive Bayes. Knowl.-Based Syst. 20(2), 120–126 (2007)CrossRef
14.
go back to reference Wu, J., Cai, Z.: Attribute weighting via differential evolution algorithm for attribute weighted Naive Bayes (wnb). J. Comput. Inf. Syst. 7(5), 1672–1679 (2011) Wu, J., Cai, Z.: Attribute weighting via differential evolution algorithm for attribute weighted Naive Bayes (wnb). J. Comput. Inf. Syst. 7(5), 1672–1679 (2011)
15.
go back to reference Wu, J., Pan, S., Cai, Z., et al.: Dual instance and attribute weighting for Naive Bayes classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1675–1679. IEEE (2014) Wu, J., Pan, S., Cai, Z., et al.: Dual instance and attribute weighting for Naive Bayes classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1675–1679. IEEE (2014)
16.
go back to reference Reynoids, R.: An introduction to cultural algorithms. In: Sebald, A.X., Fogel, L.J. (eds.) Proceedings of the 3rd Annual Conference on Evolutionary Programming, pp. 13 1–139. World Scientific Publishing, River Edge, NJ (1994) Reynoids, R.: An introduction to cultural algorithms. In: Sebald, A.X., Fogel, L.J. (eds.) Proceedings of the 3rd Annual Conference on Evolutionary Programming, pp. 13 1–139. World Scientific Publishing, River Edge, NJ (1994)
17.
go back to reference Chung, C.: Knowledge-based approaches to self-adaptation in cultural algorithms. Ph.D thesis, Wayne State University, Detroit, Michigan, USA (1997) Chung, C.: Knowledge-based approaches to self-adaptation in cultural algorithms. Ph.D thesis, Wayne State University, Detroit, Michigan, USA (1997)
18.
go back to reference Zhang, Y.: Cultural algorithm and its application in the portfolio. Master thesis, Harbin University of Science and Technology, Harbin, China (2008) Zhang, Y.: Cultural algorithm and its application in the portfolio. Master thesis, Harbin University of Science and Technology, Harbin, China (2008)
19.
go back to reference Horn, J., Nafpliotis, N., Goldberg, D.E.: A niched Pareto genetic algorithm for multi-objective optimization. In: Proceedings of the IEEE World Congress on Computational Intelligence, pp. 82–87 (1994) Horn, J., Nafpliotis, N., Goldberg, D.E.: A niched Pareto genetic algorithm for multi-objective optimization. In: Proceedings of the IEEE World Congress on Computational Intelligence, pp. 82–87 (1994)
Metadata
Title
A Double Weighted Naive Bayes for Multi-label Classification
Authors
Xuesong Yan
Wei Li
Qinghua Wu
Victor S. Sheng
Copyright Year
2016
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-0356-1_40

Premium Partner