Skip to main content

2016 | OriginalPaper | Buchkapitel

Unsupervised Feature Selection with Graph Regularized Nonnegative Self-representation

verfasst von : Yugen Yi, Wei Zhou, Yuanlong Cao, Qinghua Liu, Jianzhong Wang

Erschienen in: Biometric Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a novel algorithm called Graph Regularized Nonnegative Self Representation (GRNSR) for unsupervised feature selection. In our proposed GRNSR, each feature is first represented as a linear combination of its relevant features. Then, an affinity graph is constructed based on nonnegative least squares to capture the inherent local structure information of data. Finally, the l 2,1-norm and nonnegative constraint are imposed on the representation coefficient matrix to achieve feature selection in batch mode. Moreover, we develop a simple yet efficient iterative update algorithm to solve GRNSR. Extensive experiments are conducted on three publicly available databases (Extended YaleB, CMU PIE and AR) to demonstrate the efficiency of the proposed algorithm. Experimental results show that GRNSR obtains better recognition performance than some other state-of-the-art approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alelyani, S., Tang, J., Liu, H.: Feature selection for clustering: a review. Data Clustering: Algorithms Appl. 29, 59 (2013) Alelyani, S., Tang, J., Liu, H.: Feature selection for clustering: a review. Data Clustering: Algorithms Appl. 29, 59 (2013)
3.
Zurück zum Zitat Zhang, B., Perina, A., Murino, V., et al.: Sparse representation classification with manifold constraints transfer. IEEE Conf. on Comput. Vis. Pattern Recognit., 4557–4565 (2015) Zhang, B., Perina, A., Murino, V., et al.: Sparse representation classification with manifold constraints transfer. IEEE Conf. on Comput. Vis. Pattern Recognit., 4557–4565 (2015)
4.
Zurück zum Zitat Zhao, Z., Wang, L., Liu, H., et al.: On similarity preserving feature selection. IEEE Trans. Knowl. Data Eng. 25(3), 619–632 (2013)CrossRef Zhao, Z., Wang, L., Liu, H., et al.: On similarity preserving feature selection. IEEE Trans. Knowl. Data Eng. 25(3), 619–632 (2013)CrossRef
5.
Zurück zum Zitat Wang, J., Wu, L., Kong, J., et al.: Maximum weight and minimum redundancy: a novel framework for feature subset selection. Pattern Recognit. 46(6), 1616–1627 (2013)CrossRefMATH Wang, J., Wu, L., Kong, J., et al.: Maximum weight and minimum redundancy: a novel framework for feature subset selection. Pattern Recognit. 46(6), 1616–1627 (2013)CrossRefMATH
6.
Zurück zum Zitat Xu, Z., King, I., Lyu, M.R.T., et al.: Discriminative semi-supervised feature selection via manifold regularization. IEEE Trans. Neural Networks 21(7), 1033–1047 (2010)CrossRef Xu, Z., King, I., Lyu, M.R.T., et al.: Discriminative semi-supervised feature selection via manifold regularization. IEEE Trans. Neural Networks 21(7), 1033–1047 (2010)CrossRef
7.
Zurück zum Zitat Han, Y., Yang, Y., Yan, Y., et al.: Semi-supervised feature selection via spline regression for video semantic recognition. IEEE Trans. Neural Networks. Learn. Syst. 26(2), 252–264 (2014)MathSciNet Han, Y., Yang, Y., Yan, Y., et al.: Semi-supervised feature selection via spline regression for video semantic recognition. IEEE Trans. Neural Networks. Learn. Syst. 26(2), 252–264 (2014)MathSciNet
8.
Zurück zum Zitat He, X., Cai, D., Niyogi, P.: Laplacian score for feature selection. Adv. Neural Inf. Process. Syst. 18, 507–514 (2005) He, X., Cai, D., Niyogi, P.: Laplacian score for feature selection. Adv. Neural Inf. Process. Syst. 18, 507–514 (2005)
9.
Zurück zum Zitat Zhao, Z., Liu, H.: Spectral feature selection for supervised and unsupervised learning. In: Proceedings of the 24th International Conference on Machine Learning, pp. 1151−1157. ACM, New York (2007) Zhao, Z., Liu, H.: Spectral feature selection for supervised and unsupervised learning. In: Proceedings of the 24th International Conference on Machine Learning, pp. 1151−1157. ACM, New York (2007)
10.
Zurück zum Zitat Cai, D., Zhang, C., He, X.: Unsupervised feature selection for multi-cluster data. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 333−342. ACM, New York (2010) Cai, D., Zhang, C., He, X.: Unsupervised feature selection for multi-cluster data. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 333−342. ACM, New York (2010)
11.
Zurück zum Zitat Yang, Y., Shen, H.T., Ma, Z., et al.: L2, 1-Norm regularized discriminative feature selection for unsupervised learning. In: Proceedings of International Joint Conference on Artificial Intelligence, vol. 22(1), p. 1589 (2011) Yang, Y., Shen, H.T., Ma, Z., et al.: L2, 1-Norm regularized discriminative feature selection for unsupervised learning. In: Proceedings of International Joint Conference on Artificial Intelligence, vol. 22(1), p. 1589 (2011)
12.
Zurück zum Zitat Qian, M., Zhai, C.: Robust unsupervised feature selection. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, pp. 1621–1627. AAAI Press, Menlo Park (2013) Qian, M., Zhai, C.: Robust unsupervised feature selection. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, pp. 1621–1627. AAAI Press, Menlo Park (2013)
13.
Zurück zum Zitat Zhu, P., Zuo, W., Zhang, L., et al.: Unsupervised feature selection by regularized self-representation. Pattern Recognit. 48(2), 438–446 (2015)CrossRef Zhu, P., Zuo, W., Zhang, L., et al.: Unsupervised feature selection by regularized self-representation. Pattern Recognit. 48(2), 438–446 (2015)CrossRef
14.
Zurück zum Zitat Yan, H., Yang, J., Yang, J.: Robust joint feature weights learning framework. IEEE Trans. Know. Data Eng. 28(5), 1327–1339 (2016)MathSciNetCrossRef Yan, H., Yang, J., Yang, J.: Robust joint feature weights learning framework. IEEE Trans. Know. Data Eng. 28(5), 1327–1339 (2016)MathSciNetCrossRef
15.
Zurück zum Zitat Lee, K., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)CrossRef Lee, K., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)CrossRef
16.
Zurück zum Zitat Terence, S., Simon, B., Maan, B.: The CMU pose, illumination, and expression (PIE) database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2003)CrossRef Terence, S., Simon, B., Maan, B.: The CMU pose, illumination, and expression (PIE) database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2003)CrossRef
17.
Zurück zum Zitat Martinez A M. The AR face database. CVC Technical report 24 (1998) Martinez A M. The AR face database. CVC Technical report 24 (1998)
18.
Zurück zum Zitat Nie, F., Huang, H., Cai, X., et al.: Efficient and robust feature selection via joint l2,1 norms minimization. Adv. Neural Inform. Process. Syst. 378, 1813–1821 (2010) Nie, F., Huang, H., Cai, X., et al.: Efficient and robust feature selection via joint l2,1 norms minimization. Adv. Neural Inform. Process. Syst. 378, 1813–1821 (2010)
19.
Zurück zum Zitat Ding, C., Li, T.: Jordan MI convex and semi-nonnegative matrix factorizations. IEEE Trans. Pattern Anal. Mach. Intell. 32(1), 45–55 (2010)CrossRef Ding, C., Li, T.: Jordan MI convex and semi-nonnegative matrix factorizations. IEEE Trans. Pattern Anal. Mach. Intell. 32(1), 45–55 (2010)CrossRef
Metadaten
Titel
Unsupervised Feature Selection with Graph Regularized Nonnegative Self-representation
verfasst von
Yugen Yi
Wei Zhou
Yuanlong Cao
Qinghua Liu
Jianzhong Wang
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46654-5_65