Skip to main content

2016 | OriginalPaper | Buchkapitel

A Double Weighted Naive Bayes for Multi-label Classification

verfasst von : Xuesong Yan, Wei Li, Qinghua Wu, Victor S. Sheng

Erschienen in: Computational Intelligence and Intelligent Systems

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-label classification is to assign an instance to multiple classes. Naive Bayes (NB) is one of the most popular algorithms for pattern recognition and classification. It has a high performance in single label classification. It is naturally extended for multi-label classification under the assumption of label independence. As we know, NB is based on a simple but unrealistic assumption that attributes are conditionally independent given the class. Therefore, a double weighted NB (DWNB) is proposed to demonstrate the influences of predicting different labels based on different attributes. Our DWNB utilizes the niching cultural algorithm to determine the weight configuration automatically. Our experimental results show that our proposed DWNB outperforms NB and its extensions significantly in multi-label classification.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Reasoning. Morgan Kaufmann Publishers, Los Altos (1988) Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Reasoning. Morgan Kaufmann Publishers, Los Altos (1988)
2.
Zurück zum Zitat Langley, P., Iba, W., Thompson, K.: An analysis of Bayesian classifiers. AAAI 90, 223–228 (1992) Langley, P., Iba, W., Thompson, K.: An analysis of Bayesian classifiers. AAAI 90, 223–228 (1992)
3.
Zurück zum Zitat Xie, Z., Hsu, W., Liu, Z., Li Lee, M.: SNNB: a selective neighborhood based Naive Bayes for lazy learning. In: Chen, M.-S., Yu, P.S., Liu, B. (eds.) PAKDD 2002. LNCS (LNAI), vol. 2336, pp. 104–114. Springer, Heidelberg (2002)CrossRef Xie, Z., Hsu, W., Liu, Z., Li Lee, M.: SNNB: a selective neighborhood based Naive Bayes for lazy learning. In: Chen, M.-S., Yu, P.S., Liu, B. (eds.) PAKDD 2002. LNCS (LNAI), vol. 2336, pp. 104–114. Springer, Heidelberg (2002)CrossRef
4.
Zurück zum Zitat Langley, P., Sage, S.: Induction of selective Bayesian classifiers. In: Proceedings of the 10th International Conference on Uncertainty in Artificial Intelligence, pp. 399–406. Morgan Kaufmann Publishers Inc (1994) Langley, P., Sage, S.: Induction of selective Bayesian classifiers. In: Proceedings of the 10th International Conference on Uncertainty in Artificial Intelligence, pp. 399–406. Morgan Kaufmann Publishers Inc (1994)
5.
Zurück zum Zitat Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2–3), 131–163 (1997)CrossRefMATH Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2–3), 131–163 (1997)CrossRefMATH
6.
Zurück zum Zitat Kohavi, R.: Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree hybrid. In: KDD, pp. 202–207 (1996) Kohavi, R.: Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree hybrid. In: KDD, pp. 202–207 (1996)
7.
Zurück zum Zitat Sucar, L.E., Bielza, C., Morales, E.F., et al.: Multi-label classification with Bayesian network-based chain classifiers. Pattern Recogn. Lett. 41, 14–22 (2014)CrossRef Sucar, L.E., Bielza, C., Morales, E.F., et al.: Multi-label classification with Bayesian network-based chain classifiers. Pattern Recogn. Lett. 41, 14–22 (2014)CrossRef
8.
Zurück zum Zitat Qu, G., Zhang, H., Hartrick, C.T.: Multi-label classification with Bayesian theorem. In: 4th International Conference on Biomedical Engineering and Informatics (BMEI), vol. 4, pp. 2281–2285. IEEE (2011) Qu, G., Zhang, H., Hartrick, C.T.: Multi-label classification with Bayesian theorem. In: 4th International Conference on Biomedical Engineering and Informatics (BMEI), vol. 4, pp. 2281–2285. IEEE (2011)
9.
Zurück zum Zitat Zhang, H., Sheng, S.: Learning weighted Naive Bayes with accurate ranking. In: 4th IEEE International Conference on Data Mining, pp. 567–570. IEEE (2004) Zhang, H., Sheng, S.: Learning weighted Naive Bayes with accurate ranking. In: 4th IEEE International Conference on Data Mining, pp. 567–570. IEEE (2004)
10.
Zurück zum Zitat Hall, M.: Correlation-based feature selection for discrete and numeric class machine‎ learning. In: ‎Proceedings‎ of‎ the 7th‎ Intentional‎ Conference‎ on‎ Machine‎ Learning,‎ Stanford University (2000) Hall, M.: Correlation-based feature selection for discrete and numeric class machine‎ learning. In: ‎Proceedings‎ of‎ the 7th‎ Intentional‎ Conference‎ on‎ Machine‎ Learning,‎ Stanford University (2000)
11.
Zurück zum Zitat Jiang, L., Zhang, H.: Weightily averaged one-dependence estimators. In: Yang, Q., Webb, G. (eds.) PRICAI 2006. LNCS (LNAI), vol. 4099, pp. 970–974. Springer, Heidelberg (2006)CrossRef Jiang, L., Zhang, H.: Weightily averaged one-dependence estimators. In: Yang, Q., Webb, G. (eds.) PRICAI 2006. LNCS (LNAI), vol. 4099, pp. 970–974. Springer, Heidelberg (2006)CrossRef
12.
Zurück zum Zitat Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn. 53(1–2), 23–69 (2003)CrossRefMATH Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn. 53(1–2), 23–69 (2003)CrossRefMATH
13.
Zurück zum Zitat Hall, M.: A decision tree-based attribute weighting filter for Naive Bayes. Knowl.-Based Syst. 20(2), 120–126 (2007)CrossRef Hall, M.: A decision tree-based attribute weighting filter for Naive Bayes. Knowl.-Based Syst. 20(2), 120–126 (2007)CrossRef
14.
Zurück zum Zitat Wu, J., Cai, Z.: Attribute weighting via differential evolution algorithm for attribute weighted Naive Bayes (wnb). J. Comput. Inf. Syst. 7(5), 1672–1679 (2011) Wu, J., Cai, Z.: Attribute weighting via differential evolution algorithm for attribute weighted Naive Bayes (wnb). J. Comput. Inf. Syst. 7(5), 1672–1679 (2011)
15.
Zurück zum Zitat Wu, J., Pan, S., Cai, Z., et al.: Dual instance and attribute weighting for Naive Bayes classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1675–1679. IEEE (2014) Wu, J., Pan, S., Cai, Z., et al.: Dual instance and attribute weighting for Naive Bayes classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1675–1679. IEEE (2014)
16.
Zurück zum Zitat Reynoids, R.: An introduction to cultural algorithms. In: Sebald, A.X., Fogel, L.J. (eds.) Proceedings of the 3rd Annual Conference on Evolutionary Programming, pp. 13 1–139. World Scientific Publishing, River Edge, NJ (1994) Reynoids, R.: An introduction to cultural algorithms. In: Sebald, A.X., Fogel, L.J. (eds.) Proceedings of the 3rd Annual Conference on Evolutionary Programming, pp. 13 1–139. World Scientific Publishing, River Edge, NJ (1994)
17.
Zurück zum Zitat Chung, C.: Knowledge-based approaches to self-adaptation in cultural algorithms. Ph.D thesis, Wayne State University, Detroit, Michigan, USA (1997) Chung, C.: Knowledge-based approaches to self-adaptation in cultural algorithms. Ph.D thesis, Wayne State University, Detroit, Michigan, USA (1997)
18.
Zurück zum Zitat Zhang, Y.: Cultural algorithm and its application in the portfolio. Master thesis, Harbin University of Science and Technology, Harbin, China (2008) Zhang, Y.: Cultural algorithm and its application in the portfolio. Master thesis, Harbin University of Science and Technology, Harbin, China (2008)
19.
Zurück zum Zitat Horn, J., Nafpliotis, N., Goldberg, D.E.: A niched Pareto genetic algorithm for multi-objective optimization. In: Proceedings of the IEEE World Congress on Computational Intelligence, pp. 82–87 (1994) Horn, J., Nafpliotis, N., Goldberg, D.E.: A niched Pareto genetic algorithm for multi-objective optimization. In: Proceedings of the IEEE World Congress on Computational Intelligence, pp. 82–87 (1994)
Metadaten
Titel
A Double Weighted Naive Bayes for Multi-label Classification
verfasst von
Xuesong Yan
Wei Li
Qinghua Wu
Victor S. Sheng
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-0356-1_40