Skip to main content

2016 | OriginalPaper | Buchkapitel

A Label Correlation Based Weighting Feature Selection Approach for Multi-label Data

verfasst von : Lu Liu, Jing Zhang, Peipei Li, Yuhong Zhang, Xuegang Hu

Erschienen in: Web-Age Information Management

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Exploiting label correlation is important for multi-label learning, where each instance is associated with a set of labels. However, most of existing multi-label feature selection methods ignore the label correlation. Therefore, we propose a Label Correlation Based Weighting Feature Selection Approach for Multi-Label Data, called MLLCWFS. It is a framework developed from traditional filtering feature selection methods for single-label data. To exploit the label correlation, we compute the importance of each label in mutual information, and adopt three weighting strategies to evaluate the correlation between features and labels. Extensive experiments conducted on four benchmark data sets using two base classifiers demonstrate that our approach is superior to the state-of-the-art feature selection algorithms for multi-label data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gu, Q.-Q., Li, Z.-H., Han, J.-W.: Correlated multi-label feature selection. In: Proceedings of the 20th ACM International Conference on Information And Knowledge management, pp. 1087–1096 (2011) Gu, Q.-Q., Li, Z.-H., Han, J.-W.: Correlated multi-label feature selection. In: Proceedings of the 20th ACM International Conference on Information And Knowledge management, pp. 1087–1096 (2011)
2.
Zurück zum Zitat Jungjit, S., Freitas, A.A., Michaelis, M., Cinatl, J.: Two extensions to multi-label correlation-based feature selection: a case study in bioinformatics. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp. 1519–1524 (2013) Jungjit, S., Freitas, A.A., Michaelis, M., Cinatl, J.: Two extensions to multi-label correlation-based feature selection: a case study in bioinformatics. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp. 1519–1524 (2013)
3.
Zurück zum Zitat Zhang, M.-L., Zhou, Z.-H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Date Eng. 26(8), 1819–1837 (2014)CrossRef Zhang, M.-L., Zhou, Z.-H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Date Eng. 26(8), 1819–1837 (2014)CrossRef
4.
Zurück zum Zitat Boutell, M.R., Luo, J.-B., Shen, X.-P., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)CrossRef Boutell, M.R., Luo, J.-B., Shen, X.-P., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)CrossRef
5.
Zurück zum Zitat McCallum, A.K.: Multi-label text classification with a mixture model trained by EM. In: Proceedings of the AAAI 1999 Workshop Text Learning (1999) McCallum, A.K.: Multi-label text classification with a mixture model trained by EM. In: Proceedings of the AAAI 1999 Workshop Text Learning (1999)
6.
Zurück zum Zitat Ueda, N., Saito, K.: Parametric mixture models for multi-labeled text. Adv. neural Inf. Process. Syst. 15, 721–728 (2003) Ueda, N., Saito, K.: Parametric mixture models for multi-labeled text. Adv. neural Inf. Process. Syst. 15, 721–728 (2003)
7.
Zurück zum Zitat Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. Adv. Neural Inf. Process. Syst. 14, 681–687 (2002) Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. Adv. Neural Inf. Process. Syst. 14, 681–687 (2002)
8.
Zurück zum Zitat Zhang, Y., Zhou, Z.-H.: Multilabel dimensionality reduction via dependence maximization. ACM Trans. Knowl. Discov. Data 4(3), 1–21 (2010). Article 14CrossRef Zhang, Y., Zhou, Z.-H.: Multilabel dimensionality reduction via dependence maximization. ACM Trans. Knowl. Discov. Data 4(3), 1–21 (2010). Article 14CrossRef
9.
Zurück zum Zitat Lee, J., Kim, D.-W.: Feature selection for multi-label classification using multivariate mutual information. Pattern Recogn. Lett. 34(3), 349–357 (2013)CrossRef Lee, J., Kim, D.-W.: Feature selection for multi-label classification using multivariate mutual information. Pattern Recogn. Lett. 34(3), 349–357 (2013)CrossRef
10.
Zurück zum Zitat Huang, S.-J., Zhou, Z.-H.: “Multi-label Learning by Exploiting Label Correlations Locally. In: Proceedings of the 26th AAAI Conference on Artificial Intelligence, pp. 949–955 (2012) Huang, S.-J., Zhou, Z.-H.: “Multi-label Learning by Exploiting Label Correlations Locally. In: Proceedings of the 26th AAAI Conference on Artificial Intelligence, pp. 949–955 (2012)
11.
Zurück zum Zitat Spolaôr, N., Cherman, E.A., Lee, H.D.: ReliefF for multi-label feature selection. In: Brazilian Conference on Intelligent Systems, pp. 6–11 (2013) Spolaôr, N., Cherman, E.A., Lee, H.D.: ReliefF for multi-label feature selection. In: Brazilian Conference on Intelligent Systems, pp. 6–11 (2013)
12.
Zurück zum Zitat Zhang, Z.-H., Li, S.-N., Li, Z.-G., Chen, H.: Multi-label feature selection algorithm based on information entropy. J. Comput. Res. Dev. 50(6), 1177–1184 (2013). (in Chinese) Zhang, Z.-H., Li, S.-N., Li, Z.-G., Chen, H.: Multi-label feature selection algorithm based on information entropy. J. Comput. Res. Dev. 50(6), 1177–1184 (2013). (in Chinese)
13.
Zurück zum Zitat Liu, H., Motoda, H.: Computational Methods of Feature Selection (Chapman & Hall/Crc Data Mining and Knowledge Discovery Series). Chapman & Hall/CRC, New York (2008) Liu, H., Motoda, H.: Computational Methods of Feature Selection (Chapman & Hall/Crc Data Mining and Knowledge Discovery Series). Chapman & Hall/CRC, New York (2008)
14.
Zurück zum Zitat Spolaôr, N., Monard, M.C., Lee, H.D., Tsoumakas, G.: Label construction for multi-label feature selection. In: Brazilian Conference on Intelligent Systems, pp. 247–252 (2014) Spolaôr, N., Monard, M.C., Lee, H.D., Tsoumakas, G.: Label construction for multi-label feature selection. In: Brazilian Conference on Intelligent Systems, pp. 247–252 (2014)
15.
Zurück zum Zitat Peng, H.-C., Long, F.-H., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1226–1238 (2005)CrossRef Peng, H.-C., Long, F.-H., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1226–1238 (2005)CrossRef
16.
Zurück zum Zitat Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 667–685. Springer, Heidelberg (2010) Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 667–685. Springer, Heidelberg (2010)
17.
Zurück zum Zitat Doquire, G., Verleysen, M.: Feature selection for multi-label classification problems. In: Advances in Computational Intelligence, pp. 9–16 (2011) Doquire, G., Verleysen, M.: Feature selection for multi-label classification problems. In: Advances in Computational Intelligence, pp. 9–16 (2011)
18.
Zurück zum Zitat Li, S.-N., Zhang, Z.-H., Duan, J.-Q.: An ensemble multi-label feature selection algorithm based on information entropy. Int. Arab J. Inf. Technol. 11(4), 379–386 (2014) Li, S.-N., Zhang, Z.-H., Duan, J.-Q.: An ensemble multi-label feature selection algorithm based on information entropy. Int. Arab J. Inf. Technol. 11(4), 379–386 (2014)
19.
Zurück zum Zitat Zhang, M.-L., Zhou, Z.-H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)CrossRefMATH Zhang, M.-L., Zhou, Z.-H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)CrossRefMATH
20.
Zurück zum Zitat Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the 17th International Conference on Machine Learning, ICML-2000, pp. 359–366 (2000) Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the 17th International Conference on Machine Learning, ICML-2000, pp. 359–366 (2000)
21.
Zurück zum Zitat Hoque, N., Bhattacharyya, D.K., Kalita, J.K.: MIFS-ND: A mutual information-based feature selection method. Expert Syst. Appl. 41(14), 6371–6385 (2014)CrossRef Hoque, N., Bhattacharyya, D.K., Kalita, J.K.: MIFS-ND: A mutual information-based feature selection method. Expert Syst. Appl. 41(14), 6371–6385 (2014)CrossRef
22.
Zurück zum Zitat Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of relief and RReliefF. Mach. Learn. 53(1), 23–69 (2003)CrossRefMATH Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of relief and RReliefF. Mach. Learn. 53(1), 23–69 (2003)CrossRefMATH
23.
Zurück zum Zitat Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993) Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993)
24.
Zurück zum Zitat Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: A java library for multi-label learning. J. Mach. Learn. Res. 12, 2411–2414 (2011)MathSciNetMATH Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: A java library for multi-label learning. J. Mach. Learn. Res. 12, 2411–2414 (2011)MathSciNetMATH
Metadaten
Titel
A Label Correlation Based Weighting Feature Selection Approach for Multi-label Data
verfasst von
Lu Liu
Jing Zhang
Peipei Li
Yuhong Zhang
Xuegang Hu
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-39958-4_29

Neuer Inhalt