Skip to main content

2015 | OriginalPaper | Buchkapitel

SEIR Immune Strategy for Instance Weighted Naive Bayes Classification

verfasst von : Shan Xue, Jie Lu, Guangquan Zhang, Li Xiong

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Naive Bayes (NB) has been popularly applied in many classification tasks. However, in real-world applications, the pronounced advantage of NB is often challenged by insufficient training samples. Specifically, the high variance may occur with respect to the limited number of training samples. The estimated class distribution of a NB classier is inaccurate if the number of training instances is small. To handle this issue, in this paper, we proposed a SEIR (Susceptible, Exposed, Infectious and Recovered) immune-strategy-based instance weighting algorithm for naive Bayes classification, namely SWNB. The immune instance weighting allows the SWNB algorithm adjust itself to the data without explicit specification of functional or distributional forms of the underlying model. Experiments and comparisons on 20 benchmark datasets demonstrated that the proposed SWNB algorithm outperformed existing state-of-the-art instance weighted NB algorithm and other related computational intelligence methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Mach. Learn. 6(1), 37–66 (1991) Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Mach. Learn. 6(1), 37–66 (1991)
3.
Zurück zum Zitat Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2–3), 131–163 (1997)CrossRefMATH Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2–3), 131–163 (1997)CrossRefMATH
4.
Zurück zum Zitat Jiang, L., Cai, Z., Wang, D.: Learning averaged one-dependence estimators by instance weighting. J. Comput. Inf. Syst. 4, 2753–2760 (2008) Jiang, L., Cai, Z., Wang, D.: Learning averaged one-dependence estimators by instance weighting. J. Comput. Inf. Syst. 4, 2753–2760 (2008)
5.
Zurück zum Zitat Jiang, L., Zhang, H.: Learning instance greedily cloning naive bayes for ranking. In: Proceedings of ICDM, pp. 202–209 (2005) Jiang, L., Zhang, H.: Learning instance greedily cloning naive bayes for ranking. In: Proceedings of ICDM, pp. 202–209 (2005)
6.
Zurück zum Zitat Jiang, L., Zhang, H., Cai, Z.: A novel bayes model: hidden naive bayes. IEEE Trans. Knowl. Data Eng. 21(10), 1361–1371 (2009)CrossRef Jiang, L., Zhang, H., Cai, Z.: A novel bayes model: hidden naive bayes. IEEE Trans. Knowl. Data Eng. 21(10), 1361–1371 (2009)CrossRef
7.
Zurück zum Zitat Kim, S.B., Han, K.S., Rim, H.C., Myaeng, S.H.: Some effective techniques for naive bayes text classification. IEEE Trans. Knowl. Data Eng. 18(11), 1457–1466 (2006)CrossRef Kim, S.B., Han, K.S., Rim, H.C., Myaeng, S.H.: Some effective techniques for naive bayes text classification. IEEE Trans. Knowl. Data Eng. 18(11), 1457–1466 (2006)CrossRef
8.
Zurück zum Zitat Kohavi, R.: Scaling up the accuracy of naive-bayes classifiers:a decision-tree hybrid. In: Proceedings of KDD, pp. 202–207 (1996) Kohavi, R.: Scaling up the accuracy of naive-bayes classifiers:a decision-tree hybrid. In: Proceedings of KDD, pp. 202–207 (1996)
9.
Zurück zum Zitat Langley, P., Sage, S.: Induction of selective bayesian classifiers. In: Proceedings of UAI, pp. 339–406 (1994) Langley, P., Sage, S.: Induction of selective bayesian classifiers. In: Proceedings of UAI, pp. 339–406 (1994)
10.
Zurück zum Zitat Naderpour, M., Lu, J., Zhang, G.: A fuzzy dynamic bayesian network-based situation assessment approach. In: Proceedings of IEEE FUZZ, pp. 1–8 (2013) Naderpour, M., Lu, J., Zhang, G.: A fuzzy dynamic bayesian network-based situation assessment approach. In: Proceedings of IEEE FUZZ, pp. 1–8 (2013)
11.
Zurück zum Zitat Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993) Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993)
12.
Zurück zum Zitat Webb, G.I., Boughton, J.R., Wang, Z.: Not so naive bayes: aggregating one-dependence estimators. Mach. Learn. 58(1), 5–24 (2005)CrossRefMATH Webb, G.I., Boughton, J.R., Wang, Z.: Not so naive bayes: aggregating one-dependence estimators. Mach. Learn. 58(1), 5–24 (2005)CrossRefMATH
14.
Zurück zum Zitat Wu, J., Cai, Z.: A naive bayes probability estimation model based on self-adaptive differential evolution. J. Intell. Inf. Syst. 42(3), 671–694 (2014)MathSciNetCrossRef Wu, J., Cai, Z.: A naive bayes probability estimation model based on self-adaptive differential evolution. J. Intell. Inf. Syst. 42(3), 671–694 (2014)MathSciNetCrossRef
15.
Zurück zum Zitat Wu, J., Pan, S., Cai, Z., Zhu, X., Zhang, C.: Dual instance and attribute weighting for naive bayes classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1675–1679, IEEE (2014) Wu, J., Pan, S., Cai, Z., Zhu, X., Zhang, C.: Dual instance and attribute weighting for naive bayes classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1675–1679, IEEE (2014)
16.
Zurück zum Zitat Wu, J., Pan, S., Zhu, X., Cai, Z.: Boosting for multi-graph classification. IEEE Trans. Cybern. 45(3), 430–443 (2015)CrossRef Wu, J., Pan, S., Zhu, X., Cai, Z.: Boosting for multi-graph classification. IEEE Trans. Cybern. 45(3), 430–443 (2015)CrossRef
17.
Zurück zum Zitat Wu, J., Pan, S., Zhu, X., Cai, Z., Zhang, P., Zhang, C.: Self-adaptive attribute weighting for naive bayes classification. Expert Syst. Appl. 42(3), 1487–1502 (2015)CrossRef Wu, J., Pan, S., Zhu, X., Cai, Z., Zhang, P., Zhang, C.: Self-adaptive attribute weighting for naive bayes classification. Expert Syst. Appl. 42(3), 1487–1502 (2015)CrossRef
18.
Zurück zum Zitat Wu, J., Zhu, X., Zhang, C., Yu, P.S.: Bag constrained structure pattern mining for multi-graph classification. IEEE Trans. Knowl. Data Eng. 26(10), 2382–2396 (2014)CrossRef Wu, J., Zhu, X., Zhang, C., Yu, P.S.: Bag constrained structure pattern mining for multi-graph classification. IEEE Trans. Knowl. Data Eng. 26(10), 2382–2396 (2014)CrossRef
19.
Zurück zum Zitat Zhang, C., Xue, G.R., Yu, Y., Zha, H.: Web-scale classification with naive bayes. In: Proceedings of WWW, pp. 1083–1084 (2009) Zhang, C., Xue, G.R., Yu, Y., Zha, H.: Web-scale classification with naive bayes. In: Proceedings of WWW, pp. 1083–1084 (2009)
20.
Zurück zum Zitat Zhang, T., Liu, J., Teng, Z.: Existence of positive periodic solutions of an seir model with periodic coefficients. Appl. Math. 57(6), 601–616 (2012)MathSciNetCrossRefMATH Zhang, T., Liu, J., Teng, Z.: Existence of positive periodic solutions of an seir model with periodic coefficients. Appl. Math. 57(6), 601–616 (2012)MathSciNetCrossRefMATH
Metadaten
Titel
SEIR Immune Strategy for Instance Weighted Naive Bayes Classification
verfasst von
Shan Xue
Jie Lu
Guangquan Zhang
Li Xiong
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-26532-2_31