Skip to main content

2016 | OriginalPaper | Buchkapitel

Robust Multi-label Feature Selection with Missing Labels

verfasst von : Qian Xu, Pengfei Zhu, Qinghua Hu, Changqing Zhang

Erschienen in: Pattern Recognition

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the fast development of social networks, high-dimensionality is becoming an intractable problem in many machine learning and computer vision tasks. This phenomenon also exists in the field of multi-label classification. So far many supervised or semi-supervised multi-label feature selection methods have been proposed to reduce the feature dimension of training samples. However, almost all existing feature selection works focus on multi-label learning with complete labels. In fact, labels are very expensive to obtain and the training instances usually have an incomplete/partial set of labels (some labels are randomly missed). Very few researchers pay attention to the problem of multi-label feature selection with missing labels. In this paper, we propose a robust model to solve the above problem. We recover the missing labels by a linear regression model and select the most discriminative feature subsets simultaneously. The effective \(l_{2,p}\)-norm \(\left( {0 < p \le 1} \right) \) regularization is imposed on the feature selection matrix. The iterative reweighted least squares (IRLS) algorithm is used to solve the optimization problem. To verify the effectiveness of the proposed method, we conduct experiments on five benchmark datasets. Experimental results show that our method has superior performance over the state-of-the-art algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cai, D., Zhang, C., He, X.: Unsupervised feature selection for multi-cluster data. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, July, pp. 333–342 (2010) Cai, D., Zhang, C., He, X.: Unsupervised feature selection for multi-cluster data. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, July, pp. 333–342 (2010)
2.
Zurück zum Zitat Cai, X., Nie, F., Cai, W., Huang, H.: New graph structured sparsity model for multi-label image annotations. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 801–808 (2013) Cai, X., Nie, F., Cai, W., Huang, H.: New graph structured sparsity model for multi-label image annotations. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 801–808 (2013)
3.
Zurück zum Zitat Chang, X., Nie, F., Yang, Y., Huang, H.: A convex formulation for semi-supervised multi-label feature selection. In: Twenty-Eighth AAAI Conference on Artificial Intelligence, the Twenty-Sixth Innovative Applications of Artificial Intelligence Conference, the Symposium on Educational Advances in Artificial Intelligence, pp. 1171–1177 (2014) Chang, X., Nie, F., Yang, Y., Huang, H.: A convex formulation for semi-supervised multi-label feature selection. In: Twenty-Eighth AAAI Conference on Artificial Intelligence, the Twenty-Sixth Innovative Applications of Artificial Intelligence Conference, the Symposium on Educational Advances in Artificial Intelligence, pp. 1171–1177 (2014)
5.
Zurück zum Zitat Ding, C., Zhou, D., He, X., Zha, H.: R1-pca: rotational invariant L1-norm principal component analysis for robust subspace factorization. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 281–288. ACM (2006) Ding, C., Zhou, D., He, X., Zha, H.: R1-pca: rotational invariant L1-norm principal component analysis for robust subspace factorization. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 281–288. ACM (2006)
6.
Zurück zum Zitat Goldberg, A.B., Zhu, X., Recht, B., Xu, J., Nowak, R.D.: Transduction with matrix completion: three birds with one stone. In: Conference on Neural Information Processing Systems 2010, Proceedings of a Meeting Held 6–9 December 2010, Vancouver, British Columbia, Canada, vol. 23, pp. 757–765 (2010) Goldberg, A.B., Zhu, X., Recht, B., Xu, J., Nowak, R.D.: Transduction with matrix completion: three birds with one stone. In: Conference on Neural Information Processing Systems 2010, Proceedings of a Meeting Held 6–9 December 2010, Vancouver, British Columbia, Canada, vol. 23, pp. 757–765 (2010)
7.
Zurück zum Zitat Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Appl. Phys. Lett. 3(6), 1157–1182 (2002)MATH Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Appl. Phys. Lett. 3(6), 1157–1182 (2002)MATH
8.
Zurück zum Zitat He, X., Cai, D., Niyogi, P.: Laplacian score for feature selection. Adv. Neural Inf. Process. Syst. 18, 507–514 (2005) He, X., Cai, D., Niyogi, P.: Laplacian score for feature selection. Adv. Neural Inf. Process. Syst. 18, 507–514 (2005)
9.
Zurück zum Zitat Lee, J., Kim, D.W.: Feature selection for multi-label classification using multivariate mutual information. Pattern Recogn. Lett. 34(3), 349–357 (2013)CrossRef Lee, J., Kim, D.W.: Feature selection for multi-label classification using multivariate mutual information. Pattern Recogn. Lett. 34(3), 349–357 (2013)CrossRef
10.
Zurück zum Zitat Li, X., Zhao, F., Guo, Y.: Conditional restricted boltzmann machines for multi-label learning with incomplete labels. In: AISTATS (2015) Li, X., Zhao, F., Guo, Y.: Conditional restricted boltzmann machines for multi-label learning with incomplete labels. In: AISTATS (2015)
11.
Zurück zum Zitat Li, Z., Yang, Y., Liu, J., Zhou, X., Lu, H.: Unsupervised feature selection using nonnegative spectral analysis. In: Proceedings of the National Conference on Artificial Intelligence, pp. 1026–1032 (2012) Li, Z., Yang, Y., Liu, J., Zhou, X., Lu, H.: Unsupervised feature selection using nonnegative spectral analysis. In: Proceedings of the National Conference on Artificial Intelligence, pp. 1026–1032 (2012)
12.
Zurück zum Zitat Lin, Y., Hu, Q., Liu, J., Duan, J.: Multi-label feature selection based on max-dependency and min-redundancy. Neurocomputing 168, 92–103 (2015)CrossRef Lin, Y., Hu, Q., Liu, J., Duan, J.: Multi-label feature selection based on max-dependency and min-redundancy. Neurocomputing 168, 92–103 (2015)CrossRef
13.
Zurück zum Zitat Ma, Z., Nie, F., Yang, Y., Uijlings, J.R.R., Sebe, N.: Web image annotation via subspace-sparsity collaborated feature selection. IEEE Trans. Multimedia 14(4), 1021–1030 (2012)CrossRef Ma, Z., Nie, F., Yang, Y., Uijlings, J.R.R., Sebe, N.: Web image annotation via subspace-sparsity collaborated feature selection. IEEE Trans. Multimedia 14(4), 1021–1030 (2012)CrossRef
14.
Zurück zum Zitat Nie, F., Huang, H., Cai, X., Ding, C.H.: Efficient and robust feature selection via joint l2, 1-norms minimization. In: Advances in Neural Information Processing Systems, pp. 1813–1821 (2010) Nie, F., Huang, H., Cai, X., Ding, C.H.: Efficient and robust feature selection via joint l2, 1-norms minimization. In: Advances in Neural Information Processing Systems, pp. 1813–1821 (2010)
15.
Zurück zum Zitat Qian, M., Zhai, C.: Robust unsupervised feature selection. In: International Joint Conference on Artificial Intelligence, pp. 1621–1627 (2013) Qian, M., Zhai, C.: Robust unsupervised feature selection. In: International Joint Conference on Artificial Intelligence, pp. 1621–1627 (2013)
16.
Zurück zum Zitat Song, L., Smola, A., Gretton, A., Borgwardt, K.M., Bedo, J.: Supervised feature selection via dependence estimation. In: ICML, pp. 823–830 (2007) Song, L., Smola, A., Gretton, A., Borgwardt, K.M., Bedo, J.: Supervised feature selection via dependence estimation. In: ICML, pp. 823–830 (2007)
17.
Zurück zum Zitat Sun, Y.Y., Zhang, Y., Zhou, Z.H.: Multi-label learning with weak label. In: Twenty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2010, Atlanta, Georgia, USA, July (2010) Sun, Y.Y., Zhang, Y., Zhou, Z.H.: Multi-label learning with weak label. In: Twenty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2010, Atlanta, Georgia, USA, July (2010)
18.
Zurück zum Zitat Wang, S., Tang, J., Liu, H.: Embedded unsupervised feature selection (2015) Wang, S., Tang, J., Liu, H.: Embedded unsupervised feature selection (2015)
19.
Zurück zum Zitat Wolf, L., Shashua, A.: Feature selection for unsupervised and supervised inference: the emergence of sparsity in a weight-based approach. J. Mach. Learn. Res. 6(3), 1855–1887 (2005)MathSciNetMATH Wolf, L., Shashua, A.: Feature selection for unsupervised and supervised inference: the emergence of sparsity in a weight-based approach. J. Mach. Learn. Res. 6(3), 1855–1887 (2005)MathSciNetMATH
20.
Zurück zum Zitat Wu, B., Lyu, S., Hu, B.G., Ji, Q.: Multi-label learning with missing labels for image annotation and facial action unit recognition. Pattern Recogn. 48(7), 2279–2289 (2015)CrossRef Wu, B., Lyu, S., Hu, B.G., Ji, Q.: Multi-label learning with missing labels for image annotation and facial action unit recognition. Pattern Recogn. 48(7), 2279–2289 (2015)CrossRef
21.
Zurück zum Zitat Xu, L., Wang, Z., Shen, Z., Wang, Y., Chen, E.: Learning low-rank label correlations for multi-label classification with missing labels, vol. 36, pp. 1067–1072 (2014) Xu, L., Wang, Z., Shen, Z., Wang, Y., Chen, E.: Learning low-rank label correlations for multi-label classification with missing labels, vol. 36, pp. 1067–1072 (2014)
22.
Zurück zum Zitat Zhai, Y., Ong, Y.S., Tsang, I.W.: The emerging “big dimensionality”. IEEE Comput. Intell. Mag. 9(3), 14–26 (2014)CrossRef Zhai, Y., Ong, Y.S., Tsang, I.W.: The emerging “big dimensionality”. IEEE Comput. Intell. Mag. 9(3), 14–26 (2014)CrossRef
23.
Zurück zum Zitat Zhang, M., Ding, C., Zhang, Y., Nie, F.: Feature selection at the discrete limit. In: AAAI Conference on Artificial Intelligence (2014) Zhang, M., Ding, C., Zhang, Y., Nie, F.: Feature selection at the discrete limit. In: AAAI Conference on Artificial Intelligence (2014)
24.
Zurück zum Zitat Zhang, M.L., Pena, J.M., Robles, V.: Feature selection for multi-label naive bayes classification. Inf. Sci. 179(19), 3218–3229 (2009)CrossRefMATH Zhang, M.L., Pena, J.M., Robles, V.: Feature selection for multi-label naive bayes classification. Inf. Sci. 179(19), 3218–3229 (2009)CrossRefMATH
25.
Zurück zum Zitat Zhang, Y., Zhou, Z.H.: Multilabel dimensionality reduction via dependence maximization. ACM Trans. Knowl. Discov. Data 4(3), 1503–1505 (2010)CrossRef Zhang, Y., Zhou, Z.H.: Multilabel dimensionality reduction via dependence maximization. ACM Trans. Knowl. Discov. Data 4(3), 1503–1505 (2010)CrossRef
26.
Zurück zum Zitat Zhu, P., Hu, Q., Zhang, C., Zuo, W.: Coupled dictionary learning for unsupervised feature selection. In: AAAI (2016) Zhu, P., Hu, Q., Zhang, C., Zuo, W.: Coupled dictionary learning for unsupervised feature selection. In: AAAI (2016)
Metadaten
Titel
Robust Multi-label Feature Selection with Missing Labels
verfasst von
Qian Xu
Pengfei Zhu
Qinghua Hu
Changqing Zhang
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-3002-4_61

Premium Partner