Skip to main content

2016 | OriginalPaper | Buchkapitel

6. Ensemble-Based Classifiers

verfasst von : Francisco Herrera, Francisco Charte, Antonio J. Rivera, María J. del Jesus

Erschienen in: Multilabel Classification

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Classification methods founded on training several models with a certain heterogeneity degree, and then aggregating their predictions according to a particular strategy tends to be a very effective solution. Ensembles have been also used to tackle some specific obstacles, such as imbalanced class distribution. The goal in this chapter is to present several multilabel ensemble-based solutions. Section 6.1 introduces this approach. Ensembles of binary classifiers are described in Sect. 6.2, while those based on multiclass methods are outlined in Sect. 6.3. Other kinds of ensembles will be briefly portrayed in Sect. 6.4. Some of these solutions are experimentally tested in Sect. 6.5, analyzing their predictive performance and running time. Lastly, Sect. 6.6 summarizes the chapter.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The version of this MLD having the 500 most relevant features selected was used.
 
Literatur
1.
Zurück zum Zitat Tsoumakas, G., Dimou, A., Spyromitros, E., Mezaris, V., Kompatsiaris, I., Vlahavas, I.: Correlation-based pruning of stacked binary relevance models for multi-label learning. In: Proceedings of 1st International Workshop on Learning from Multi-Label Data, MLD’09, pp. 101–116 (2009) Tsoumakas, G., Dimou, A., Spyromitros, E., Mezaris, V., Kompatsiaris, I., Vlahavas, I.: Correlation-based pruning of stacked binary relevance models for multi-label learning. In: Proceedings of 1st International Workshop on Learning from Multi-Label Data, MLD’09, pp. 101–116 (2009)
2.
Zurück zum Zitat Alvares-Cherman, E., Metz, J., Monard, M.C.: Incorporating label dependency into the binary relevance framework for multi-label classification. Expert Syst. Appl. 39(2), 1647–1655 (2012)CrossRef Alvares-Cherman, E., Metz, J., Monard, M.C.: Incorporating label dependency into the binary relevance framework for multi-label classification. Expert Syst. Appl. 39(2), 1647–1655 (2012)CrossRef
3.
Zurück zum Zitat Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333–359 (2011)MathSciNetCrossRef Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333–359 (2011)MathSciNetCrossRef
4.
Zurück zum Zitat Hüllermeier, E., Fürnkranz, J., Cheng, W., Brinker, K.: Label ranking by learning pairwise preferences. Artif. Intell. 172(16), 1897–1916 (2008)MathSciNetCrossRefMATH Hüllermeier, E., Fürnkranz, J., Cheng, W., Brinker, K.: Label ranking by learning pairwise preferences. Artif. Intell. 172(16), 1897–1916 (2008)MathSciNetCrossRefMATH
5.
Zurück zum Zitat Fürnkranz, J., Hüllermeier, E., Loza Mencía, E., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73, 133–153 (2008) Fürnkranz, J., Hüllermeier, E., Loza Mencía, E., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73, 133–153 (2008)
6.
Zurück zum Zitat Read, J., Pfahringer, B., Holmes, G.: Multi-label classification using ensembles of pruned sets. In: Proceedings of 8th IEEE International Conference on Data Mining, ICDM’08, pp. 995–1000. IEEE (2008) Read, J., Pfahringer, B., Holmes, G.: Multi-label classification using ensembles of pruned sets. In: Proceedings of 8th IEEE International Conference on Data Mining, ICDM’08, pp. 995–1000. IEEE (2008)
7.
Zurück zum Zitat Tsoumakas, G., Vlahavas, I.: Random k-Labelsets: An ensemble method for multilabel classification. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, vol. 4701, pp. 406–417. Springer (2007) Tsoumakas, G., Vlahavas, I.: Random k-Labelsets: An ensemble method for multilabel classification. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, vol. 4701, pp. 406–417. Springer (2007)
8.
Zurück zum Zitat Tsoumakas, G., Katakis, I., Vlahavas, I.: Effective and efficient multilabel classification in domains with large number of labels. In: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, MMD’08, pp. 30–44 (2008) Tsoumakas, G., Katakis, I., Vlahavas, I.: Effective and efficient multilabel classification in domains with large number of labels. In: Proceedings of ECML/PKDD Workshop on Mining Multidimensional Data, MMD’08, pp. 30–44 (2008)
9.
Zurück zum Zitat Tenenboim-Chekina, L., Rokach, L., Shapira, B.: Identification of label dependencies for multi-label classification. In: Working Notes of the Second International Workshop on Learning from Multi-Label Data, MLD’10, pp. 53–60 (2010) Tenenboim-Chekina, L., Rokach, L., Shapira, B.: Identification of label dependencies for multi-label classification. In: Working Notes of the Second International Workshop on Learning from Multi-Label Data, MLD’10, pp. 53–60 (2010)
10.
Zurück zum Zitat Kocev, D., Vens, C., Struyf, J., Džeroski, S.: Ensembles of multi-objective decision trees. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, pp. 624–631. Springer (2007) Kocev, D., Vens, C., Struyf, J., Džeroski, S.: Ensembles of multi-objective decision trees. In: Proceedings of 18th European Conference on Machine Learning, ECML’07, pp. 624–631. Springer (2007)
11.
Zurück zum Zitat Tahir, M.A., Kittler, J., Bouridane, A.: Multilabel classification using heterogeneous ensemble of multi-label classifiers. Pattern Recogn. Lett. 33(5), 513–523 (2012)CrossRef Tahir, M.A., Kittler, J., Bouridane, A.: Multilabel classification using heterogeneous ensemble of multi-label classifiers. Pattern Recogn. Lett. 33(5), 513–523 (2012)CrossRef
12.
Zurück zum Zitat Read, J., Martino, L., Olmos, P.M., Luengo, D.: Scalable multi-output label prediction: from classifier chains to classifier trellises. Pattern Recogn. 48(6), 2096–2109 (2015)CrossRef Read, J., Martino, L., Olmos, P.M., Luengo, D.: Scalable multi-output label prediction: from classifier chains to classifier trellises. Pattern Recogn. 48(6), 2096–2109 (2015)CrossRef
13.
Zurück zum Zitat Madjarov, G., Gjorgjevikj, D., Džeroski, S.: Dual layer voting method for efficient multi-label classification. In: Proceedings of 5th Iberian Conference, IbPRIA’11, pp. 232–239. Springer (2011) Madjarov, G., Gjorgjevikj, D., Džeroski, S.: Dual layer voting method for efficient multi-label classification. In: Proceedings of 5th Iberian Conference, IbPRIA’11, pp. 232–239. Springer (2011)
14.
Zurück zum Zitat Mencía, E.L., Park, S., Fürnkranz, J.: Efficient voting prediction for pairwise multilabel classification. Neurocomputing 73(7), 1164–1176 (2010)CrossRef Mencía, E.L., Park, S., Fürnkranz, J.: Efficient voting prediction for pairwise multilabel classification. Neurocomputing 73(7), 1164–1176 (2010)CrossRef
15.
Zurück zum Zitat Quevedo, J.R., Luaces, O., Bahamonde, A.: Multilabel classifiers with a probabilistic thresholding strategy. Pattern Recogn. 45(2), 876–883 (2012)MATH Quevedo, J.R., Luaces, O., Bahamonde, A.: Multilabel classifiers with a probabilistic thresholding strategy. Pattern Recogn. 45(2), 876–883 (2012)MATH
16.
Zurück zum Zitat Quinlan, J.R.: C4.5: Programs for machine learning (1993) Quinlan, J.R.: C4.5: Programs for machine learning (1993)
Metadaten
Titel
Ensemble-Based Classifiers
verfasst von
Francisco Herrera
Francisco Charte
Antonio J. Rivera
María J. del Jesus
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-41111-8_6

Premium Partner