Skip to main content

2015 | OriginalPaper | Buchkapitel

Fuzzy Rough Decision Trees for Multi-label Classification

verfasst von : Xiaoxue Wang, Shuang An, Hong Shi, Qinghua Hu

Erschienen in: Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-label classification exists widely in medical analysis or image annotation. Although there are some algorithms to train models for multi-label classification, few of them are able to extract comprehensible rules. In this paper, we propose a multi-label decision tree algorithm based on fuzzy rough sets, named ML-FRDT. This method can tackle with symbolic, continuous and fuzzy data. We conduct experiments on two multi-label datasets. And the experiment results show that ML-FRDT achieves good performance than some well-established multi-label classification algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat McCallum., A.: Multi-label text classification with a mixture model trained by EM. In: AAAI\({^{\prime }}\)99 Workshop on Text Learning, pp. 1–7 (1999) McCallum., A.: Multi-label text classification with a mixture model trained by EM. In: AAAI\({^{\prime }}\)99 Workshop on Text Learning, pp. 1–7 (1999)
2.
Zurück zum Zitat Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: Rcv1: A new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361–397 (2004) Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: Rcv1: A new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361–397 (2004)
3.
Zurück zum Zitat Gao, S., Wu, W., Lee C.H., et al.: A MFoM learning approach to robust multiclass multi-label text categorization. In: Proceedings of the Twenty-first International Conference on Machine Learning (ICML 2004), pp. 42. ACM (2004) Gao, S., Wu, W., Lee C.H., et al.: A MFoM learning approach to robust multiclass multi-label text categorization. In: Proceedings of the Twenty-first International Conference on Machine Learning (ICML 2004), pp. 42. ACM (2004)
4.
Zurück zum Zitat Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37, 1757–1771 (2004)CrossRef Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37, 1757–1771 (2004)CrossRef
5.
Zurück zum Zitat Wu, F., Han, Y., Tian, Q., Zhuang, Y.: Multi-label boosting for image annotation by structural grouping sparsity. In: Proceedings of the International Conference on Multimedia (MM 2010), pp. 15–24. ACM (2010) Wu, F., Han, Y., Tian, Q., Zhuang, Y.: Multi-label boosting for image annotation by structural grouping sparsity. In: Proceedings of the International Conference on Multimedia (MM 2010), pp. 15–24. ACM (2010)
6.
Zurück zum Zitat Wang, Z., Hu, Y., Chia, L.T.: Multi-label learning by image-to-class distance for scene classification and image annotation. In: Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR 2010), pp. 105–112. ACM (2010) Wang, Z., Hu, Y., Chia, L.T.: Multi-label learning by image-to-class distance for scene classification and image annotation. In: Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR 2010), pp. 105–112. ACM (2010)
7.
Zurück zum Zitat Snoek, C.G., Worring, M., Van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of the 14th Annual ACM International Conference on Multimedia, pp. 421–430. ACM (2006) Snoek, C.G., Worring, M., Van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of the 14th Annual ACM International Conference on Multimedia, pp. 421–430. ACM (2006)
8.
Zurück zum Zitat Sanden, C., Zhang, J.Z.: Enhancing multi-label music genre classification through ensemble techniques. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2011), pp. 705–714. ACM (2011) Sanden, C., Zhang, J.Z.: Enhancing multi-label music genre classification through ensemble techniques. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2011), pp. 705–714. ACM (2011)
9.
Zurück zum Zitat Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26, 1819–1837 (2013)CrossRef Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26, 1819–1837 (2013)CrossRef
10.
Zurück zum Zitat Clare, A.J., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 42–53. Springer, Heidelberg (2001) CrossRefMATH Clare, A.J., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 42–53. Springer, Heidelberg (2001) CrossRefMATH
11.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40, 2038–2048 (2007)CrossRefMATH Zhang, M.L., Zhou, Z.H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40, 2038–2048 (2007)CrossRefMATH
12.
Zurück zum Zitat Zhang, M.L.: ML-RBF: RBF neural networks for multi-label learning. Neural Process. Lett. 29, 61–74 (2009)CrossRef Zhang, M.L.: ML-RBF: RBF neural networks for multi-label learning. Neural Process. Lett. 29, 61–74 (2009)CrossRef
13.
Zurück zum Zitat Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets\({^{*}}\). Int. J. Gen. Syst. 17, 191–209 (1990)CrossRefMATH Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets\({^{*}}\). Int. J. Gen. Syst. 17, 191–209 (1990)CrossRefMATH
14.
15.
Zurück zum Zitat An, S., Hu, Q.: Fuzzy rough decision trees. In: Yao, J.T., Yang, Y., Słowiński, R., Greco, S., Li, H., Mitra, S., Polkowski, L. (eds.) RSCTC 2012. LNCS, vol. 7413, pp. 397–404. Springer, Heidelberg (2012) CrossRef An, S., Hu, Q.: Fuzzy rough decision trees. In: Yao, J.T., Yang, Y., Słowiński, R., Greco, S., Li, H., Mitra, S., Polkowski, L. (eds.) RSCTC 2012. LNCS, vol. 7413, pp. 397–404. Springer, Heidelberg (2012) CrossRef
16.
Zurück zum Zitat Zhang, L., Hu, Q., Duan, J., Wang, X.: Multi-label feature selection with fuzzy rough sets. In: Miao, D., Pedrycz, W., Slezak, D., Peters, G., Hu, Q., Wang, R. (eds.) RSKT 2014. LNCS, vol. 8818, pp. 121–128. Springer, Heidelberg (2014) CrossRef Zhang, L., Hu, Q., Duan, J., Wang, X.: Multi-label feature selection with fuzzy rough sets. In: Miao, D., Pedrycz, W., Slezak, D., Peters, G., Hu, Q., Wang, R. (eds.) RSKT 2014. LNCS, vol. 8818, pp. 121–128. Springer, Heidelberg (2014) CrossRef
17.
Zurück zum Zitat Quinlan, J.R.: C4. 5: Programs for Machine Learning. Elsevier, Burlington (1993) Quinlan, J.R.: C4. 5: Programs for Machine Learning. Elsevier, Burlington (1993)
18.
Zurück zum Zitat Godbole, S., Sarawagi, S.: Discriminative methods for multi-labeled classification. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 22–30. Springer, Heidelberg (2004) CrossRef Godbole, S., Sarawagi, S.: Discriminative methods for multi-labeled classification. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 22–30. Springer, Heidelberg (2004) CrossRef
19.
Zurück zum Zitat Correa, G.E., Plastino, A., Freitas, A.A.: A genetic algorithm for optimizing the label ordering in multi-label classifier chains. In: IEEE 25th International Conference on Tools with Artificial Intelligence (ICTAI) 2013, pp. 469–476. IEEE (2013) Correa, G.E., Plastino, A., Freitas, A.A.: A genetic algorithm for optimizing the label ordering in multi-label classifier chains. In: IEEE 25th International Conference on Tools with Artificial Intelligence (ICTAI) 2013, pp. 469–476. IEEE (2013)
20.
Zurück zum Zitat Briggs, F., Huang, Y., Raich, R., Eftaxias, K., Lei, Z., Cukierski, W., et al.: The 9th annual MLSP competition: new methods for acoustic classification of multiple simultaneous bird species in a noisy environment. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP) 2013, pp. 1–8. IEEE (2013) Briggs, F., Huang, Y., Raich, R., Eftaxias, K., Lei, Z., Cukierski, W., et al.: The 9th annual MLSP competition: new methods for acoustic classification of multiple simultaneous bird species in a noisy environment. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP) 2013, pp. 1–8. IEEE (2013)
Metadaten
Titel
Fuzzy Rough Decision Trees for Multi-label Classification
verfasst von
Xiaoxue Wang
Shuang An
Hong Shi
Qinghua Hu
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-25783-9_19