Skip to main content
Erschienen in: Progress in Artificial Intelligence 4/2016

06.08.2016 | Regular Paper

An ensemble-based approach for multi-view multi-label classification

verfasst von: Eva L. Gibaja, Jose M. Moyano, Sebastián Ventura

Erschienen in: Progress in Artificial Intelligence | Ausgabe 4/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-label classification with multiple data views is a recent research field not much explored. This more flexible learning approach allows each pattern to be represented by several sets of attributes and each pattern can have simultaneously associated several labels. In this work, an ensemble-based approach, which enables the fusion of views at decision level by majority voting, is proposed. The study carried out on four data sets considering 27 multi-label evaluation metrics shows that our proposal overcomes and improves the results obtained by the individual views as well as the execution time and the performance of the classic approach which concatenates all the views in a single set of features.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Charte, F., Rivera, A.J., Del Jesus, M.J., Herrera, F.: LI-MLC: a label inference methodology for addressing high dimensionality in the label space for multilabel classification. IEEE Trans. Neural Netw. Learn. Syst. 25(10), 1842–1854 (2014)CrossRef Charte, F., Rivera, A.J., Del Jesus, M.J., Herrera, F.: LI-MLC: a label inference methodology for addressing high dimensionality in the label space for multilabel classification. IEEE Trans. Neural Netw. Learn. Syst. 25(10), 1842–1854 (2014)CrossRef
2.
Zurück zum Zitat Chen, Q., Sun, S.: Hierarchical multi-view fisher discriminant analysis. In: Leung, C.-S. Lee, M. Chan, J.H. (eds.) Neural Information Processing, pp. 289–298. Springer, Berlin (2009) Chen, Q., Sun, S.: Hierarchical multi-view fisher discriminant analysis. In: Leung, C.-S. Lee, M. Chan, J.H. (eds.) Neural Information Processing, pp. 289–298. Springer, Berlin (2009)
3.
Zurück zum Zitat Cheng, W., Hüllermeier, E.: Combining instance-based learning and logistic regression for multilabel classification. Mach. Learn. 76(2–3), 211–225 (2009)CrossRef Cheng, W., Hüllermeier, E.: Combining instance-based learning and logistic regression for multilabel classification. Mach. Learn. 76(2–3), 211–225 (2009)CrossRef
4.
Zurück zum Zitat Clare, A., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery, pp. 42–53. PKDD ’01, Springer-Verlag, London, UK (2001) Clare, A., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery, pp. 42–53. PKDD ’01, Springer-Verlag, London, UK (2001)
5.
Zurück zum Zitat Elisseeff, A., Weston, J.: Kernel methods for multi-labelled classification and categorical regression problems. Adv. Neural Inform. Process. Syst. 14, 681–687 (2001) Elisseeff, A., Weston, J.: Kernel methods for multi-labelled classification and categorical regression problems. Adv. Neural Inform. Process. Syst. 14, 681–687 (2001)
6.
Zurück zum Zitat Farquhar, J., Hardoon, D., Meng, H., Shawe-taylor, J.S., Szedmak, S.: Two view learning: SVM-2K, theory and practice. In: Weiss, Y., Sch ölkopf B., Platt J.C. (eds.) Advances in Neural Information Processing Systems, 18, pp. 355–362. MIT Press (2005) Farquhar, J., Hardoon, D., Meng, H., Shawe-taylor, J.S., Szedmak, S.: Two view learning: SVM-2K, theory and practice. In: Weiss, Y., Sch ölkopf B., Platt J.C. (eds.) Advances in Neural Information Processing Systems, 18, pp. 355–362. MIT Press (2005)
7.
Zurück zum Zitat Fürnkranz, J., Hüllermeier, E., Mencía, E.L., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73(2), 133–153 (2008)CrossRef Fürnkranz, J., Hüllermeier, E., Mencía, E.L., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73(2), 133–153 (2008)CrossRef
8.
Zurück zum Zitat Gibaja, E., Ventura, S.: Multi-label learning: a review of the state of the art and ongoing research. Wiley Interdiscip. Rev. Data Mining Knowl. Discov. 4(6), 411–444 (2014)CrossRef Gibaja, E., Ventura, S.: Multi-label learning: a review of the state of the art and ongoing research. Wiley Interdiscip. Rev. Data Mining Knowl. Discov. 4(6), 411–444 (2014)CrossRef
9.
Zurück zum Zitat Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newslett. 11(1), 10–18 (2009)CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newslett. 11(1), 10–18 (2009)CrossRef
10.
Zurück zum Zitat He, J., Lawrence, R.: A graph-based framework for multi-task multi-view learning. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 25–32 (2011) He, J., Lawrence, R.: A graph-based framework for multi-task multi-view learning. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 25–32 (2011)
11.
Zurück zum Zitat Jin, X., Zhuang, F., Wang, S., He, Q., Shi, Z.: Shared structure learning for multiple tasks with multiple views. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) Machine Learning and Knowledge Discovery in Databases. Lecture Notes in Computer Science, vol. 8189, pp. 353–368. Springer, Berlin (2013) Jin, X., Zhuang, F., Wang, S., He, Q., Shi, Z.: Shared structure learning for multiple tasks with multiple views. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) Machine Learning and Knowledge Discovery in Databases. Lecture Notes in Computer Science, vol. 8189, pp. 353–368. Springer, Berlin (2013)
12.
Zurück zum Zitat Luo, Y., Tao, D., Xu, C., Xu, C., Liu, H., Wen, Y.: Multiview vector-valued manifold regularization for multilabel image classification. IEEE Trans. Neural Netw. Learn. Syst. 24(5), 709–722 (2013)CrossRef Luo, Y., Tao, D., Xu, C., Xu, C., Liu, H., Wen, Y.: Multiview vector-valued manifold regularization for multilabel image classification. IEEE Trans. Neural Netw. Learn. Syst. 24(5), 709–722 (2013)CrossRef
13.
Zurück zum Zitat Madjarov, G., Kocev, D., Gjorgjevikj, D., Džeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recognit. 45(9), 3084–3104 (2012)CrossRef Madjarov, G., Kocev, D., Gjorgjevikj, D., Džeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recognit. 45(9), 3084–3104 (2012)CrossRef
14.
Zurück zum Zitat Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008)CrossRefMATH Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008)CrossRefMATH
15.
Zurück zum Zitat Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85(3), 1–27 (2011)MathSciNetCrossRef Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85(3), 1–27 (2011)MathSciNetCrossRef
16.
Zurück zum Zitat Read, J.: A pruned problem transformation method for multi-label classification. In: Proceedings of the NZ Computer Science Research Student Conference, pp. 143–150 (2008) Read, J.: A pruned problem transformation method for multi-label classification. In: Proceedings of the NZ Computer Science Research Student Conference, pp. 143–150 (2008)
17.
Zurück zum Zitat Sechidis, K., Tsoumakas, G., Vlahavas, I.: On the stratification of multi-label data. In: Gunopulos, D., Hofmann, T., Malerba, D., Vazirgiannis, M. (eds.) Machine Learning and Knowledge Discovery in Databases, pp. 145–158. Springer, Berlin (2011) Sechidis, K., Tsoumakas, G., Vlahavas, I.: On the stratification of multi-label data. In: Gunopulos, D., Hofmann, T., Malerba, D., Vazirgiannis, M. (eds.) Machine Learning and Knowledge Discovery in Databases, pp. 145–158. Springer, Berlin (2011)
18.
Zurück zum Zitat Snoek, C.G., Worring, M., Smeulders, A.W.: Early versus late fusion in semantic video analysis. In: Proceedings of the 13th annual ACM international conference on Multimedia, pp. 399–402. ACM (2005) Snoek, C.G., Worring, M., Smeulders, A.W.: Early versus late fusion in semantic video analysis. In: Proceedings of the 13th annual ACM international conference on Multimedia, pp. 399–402. ACM (2005)
19.
Zurück zum Zitat Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23(7–8), 2031–2038 (2013)CrossRef Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23(7–8), 2031–2038 (2013)CrossRef
20.
Zurück zum Zitat Sun, S., Zhang, Q.: Multiple-view multiple-learner semi-supervised learning. Neural Process. Lett. 34(3), 229–240 (2011)CrossRef Sun, S., Zhang, Q.: Multiple-view multiple-learner semi-supervised learning. Neural Process. Lett. 34(3), 229–240 (2011)CrossRef
21.
Zurück zum Zitat Szedmak, S., Shawe-Taylor, J.: Synthesis of maximum margin and multiview learning using unlabeled data. Neurocomputing 70(7), 1254–1264 (2007)CrossRef Szedmak, S., Shawe-Taylor, J.: Synthesis of maximum margin and multiview learning using unlabeled data. Neurocomputing 70(7), 1254–1264 (2007)CrossRef
22.
Zurück zum Zitat Trohidis, K., Tsoumakas, G., Kalliris, G., Vlahavas, I.: Multi-label classification of music into emotions. EURASIP J. Audio Speech Music Process. 2011(1), 4 (2011)CrossRef Trohidis, K., Tsoumakas, G., Kalliris, G., Vlahavas, I.: Multi-label classification of music into emotions. EURASIP J. Audio Speech Music Process. 2011(1), 4 (2011)CrossRef
23.
Zurück zum Zitat Tsoumakas, G., Katakis, I., Vlahavas, I.: Random k-labelsets for multi-label classification. IEEE Trans. Knowl. Data Eng. 23(7), 1079–1089 (2010)CrossRef Tsoumakas, G., Katakis, I., Vlahavas, I.: Random k-labelsets for multi-label classification. IEEE Trans. Knowl. Data Eng. 23(7), 1079–1089 (2010)CrossRef
24.
Zurück zum Zitat Tsoumakas, G., Dimou, A., Spyromitros, E., Mezaris, V., Kompatsiaris, I., Vlahavas, I.: Correlation-based pruning of stacked binary relevance models for multi-label learning. In: Proceedings of the 1st International Workshop on Learning from Multi-Label Data, pp. 101–116 (2009) Tsoumakas, G., Dimou, A., Spyromitros, E., Mezaris, V., Kompatsiaris, I., Vlahavas, I.: Correlation-based pruning of stacked binary relevance models for multi-label learning. In: Proceedings of the 1st International Workshop on Learning from Multi-Label Data, pp. 101–116 (2009)
25.
Zurück zum Zitat Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: a java library for multi-label learning. J. Mach. Learn. Res. 12, 2411–2414 (2011)MathSciNetMATH Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: a java library for multi-label learning. J. Mach. Learn. Res. 12, 2411–2414 (2011)MathSciNetMATH
27.
Zurück zum Zitat Xu, C., Tao, D., Xu, C.: A survey on multi-view learning. ArXiv.org (Cornell University) (2013) Xu, C., Tao, D., Xu, C.: A survey on multi-view learning. ArXiv.org (Cornell University) (2013)
28.
Zurück zum Zitat Xu, J.: Fast multi-label core vector machine. Pattern Recognit. 46(3), 885–898 (2013)CrossRefMATH Xu, J.: Fast multi-label core vector machine. Pattern Recognit. 46(3), 885–898 (2013)CrossRefMATH
30.
Zurück zum Zitat Xu, Z., Sun, S.: An algorithm on multi-view adaboost. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds.) Neural Information Processing. Theory and Algorithms, pp. 355–362. Springer, Berlin (2010) Xu, Z., Sun, S.: An algorithm on multi-view adaboost. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds.) Neural Information Processing. Theory and Algorithms, pp. 355–362. Springer, Berlin (2010)
31.
Zurück zum Zitat Zhang, J., Huan, J.: Inductive multi-task learning with multiple view data. In: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 543–551. ACM (2012) Zhang, J., Huan, J.: Inductive multi-task learning with multiple view data. In: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 543–551. ACM (2012)
32.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: Multilabel neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 18(10), 1338–1351 (2006)CrossRef Zhang, M.L., Zhou, Z.H.: Multilabel neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 18(10), 1338–1351 (2006)CrossRef
33.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: ML-KNN: a lazy learning approach to multi-label learning. Pattern Recognit. 40(7), 2038–2048 (2007)CrossRefMATH Zhang, M.L., Zhou, Z.H.: ML-KNN: a lazy learning approach to multi-label learning. Pattern Recognit. 40(7), 2038–2048 (2007)CrossRefMATH
34.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)CrossRef Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)CrossRef
35.
Zurück zum Zitat Zhang, Q., Sun, S.: Multiple-view multiple-learner active learning. Pattern Recognit. 43(9), 3113–3119 (2010)CrossRefMATH Zhang, Q., Sun, S.: Multiple-view multiple-learner active learning. Pattern Recognit. 43(9), 3113–3119 (2010)CrossRefMATH
36.
Zurück zum Zitat Zhou, T., Tao, D., Wu, X.: Compressed labeling on distilled labelsets for multi-label learning. Mach. Learn. 88(1–2), 69–126 (2012)MathSciNetCrossRefMATH Zhou, T., Tao, D., Wu, X.: Compressed labeling on distilled labelsets for multi-label learning. Mach. Learn. 88(1–2), 69–126 (2012)MathSciNetCrossRefMATH
37.
Zurück zum Zitat Zou, F., Liu, Y., Wang, H., Song, J., Shao, J., Zhou, K., Zheng, S.: Multi-view multi-label learning for image annotation. Multimed. Tools Appl. 1–18 (2015). doi:10.1007/s11042-014-2423-2 Zou, F., Liu, Y., Wang, H., Song, J., Shao, J., Zhou, K., Zheng, S.: Multi-view multi-label learning for image annotation. Multimed. Tools Appl. 1–18 (2015). doi:10.​1007/​s11042-014-2423-2
Metadaten
Titel
An ensemble-based approach for multi-view multi-label classification
verfasst von
Eva L. Gibaja
Jose M. Moyano
Sebastián Ventura
Publikationsdatum
06.08.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Progress in Artificial Intelligence / Ausgabe 4/2016
Print ISSN: 2192-6352
Elektronische ISSN: 2192-6360
DOI
https://doi.org/10.1007/s13748-016-0098-9

Weitere Artikel der Ausgabe 4/2016

Progress in Artificial Intelligence 4/2016 Zur Ausgabe