Skip to main content
Top

2016 | OriginalPaper | Chapter

Discriminative Sparse Coding by Nuclear Norm-Driven Semi-Supervised Dictionary Learning

Authors : Weiming Jiang, Zhao Zhang, Yan Zhang, Fanzhang Li

Published in: Advances in Multimedia Information Processing - PCM 2016

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a Nuclear norm-driven Semi-Supervised Dictionary Learning (N-SSDL) approach for classification. N-SSDL incorporates the idea of the recent label consistent KSVD with the label propagation process that propagates label information from labeled data to unlabeled data via balancing the neighborhood reconstruction error and the label fitness error. To provide a more reliable distance metric for measuring the neighborhood reconstruction error, we apply the nuclear-norm that is proved to be suitable for modeling the reconstruction error, where the reconstruction coefficients are computed based on the sparsely reconstructed training data rather than original ones. Besides, we also use the robust l 2,1 -norm regularization on the label fitness error so that the measurement is robust to noise and outliers. Extensive simulations on several datasets show that N-SSDL can deliver enhanced performance over other state-of-the-arts for classification.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Elad, M., Aharon, M.: Image denosing via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Proces. 54(12), 3736–3745 (2006)MathSciNetCrossRef Elad, M., Aharon, M.: Image denosing via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Proces. 54(12), 3736–3745 (2006)MathSciNetCrossRef
2.
go back to reference Wright, J., Yang, M., Ganesh, A., Sastry, S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 210–227 (2009)CrossRef Wright, J., Yang, M., Ganesh, A., Sastry, S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 210–227 (2009)CrossRef
3.
go back to reference Yang, J., Yu, K., Gong, Y., Huang, T.: Linear spatial pyramid matching using sparse coding for image classification. In: Proceedings of IEEE Conference on Computer Vision & Pattern Recognition (2009) Yang, J., Yu, K., Gong, Y., Huang, T.: Linear spatial pyramid matching using sparse coding for image classification. In: Proceedings of IEEE Conference on Computer Vision & Pattern Recognition (2009)
4.
go back to reference Bradley, D., Bagnell, J.: Differential sparse coding. In: Proceedings Conference on Neural Information Processing System (2008) Bradley, D., Bagnell, J.: Differential sparse coding. In: Proceedings Conference on Neural Information Processing System (2008)
5.
go back to reference Lim, T.S., Loh, W.Y., Shih, Y.S.: A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach. Learn. 40(3), 203–228 (1999)CrossRefMATH Lim, T.S., Loh, W.Y., Shih, Y.S.: A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach. Learn. 40(3), 203–228 (1999)CrossRefMATH
6.
go back to reference Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54(1), 4311–4322 (2006)MathSciNetCrossRef Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54(1), 4311–4322 (2006)MathSciNetCrossRef
7.
go back to reference Hou, C., Nie, F., Li, X., Yi, D., Wu, Y.: Joint embedding learning and sparse regression: a framework for unsupervised feature selection. IEEE Trans. Cybern. 44, 793–804 (2014)CrossRef Hou, C., Nie, F., Li, X., Yi, D., Wu, Y.: Joint embedding learning and sparse regression: a framework for unsupervised feature selection. IEEE Trans. Cybern. 44, 793–804 (2014)CrossRef
8.
go back to reference Fornasier, M., Rauhut, H., Ward, R.: Low-rank matrix recovery via iteratively reweighted least squares minimization. SIAM J. Optim. 21(4), 1614–1640 (2011)MathSciNetCrossRefMATH Fornasier, M., Rauhut, H., Ward, R.: Low-rank matrix recovery via iteratively reweighted least squares minimization. SIAM J. Optim. 21(4), 1614–1640 (2011)MathSciNetCrossRefMATH
9.
go back to reference Zhang, Q., Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2010) Zhang, Q., Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2010)
10.
go back to reference Chen, J., Ye, J., Li, Q.: Integrating global and local structures: a least squares framework for dimensionality reduction. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2007) Chen, J., Ye, J., Li, Q.: Integrating global and local structures: a least squares framework for dimensionality reduction. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2007)
11.
go back to reference Jiang, Z., Lin, Z., Davis, L.: Label consistent K-SVD: learning a discriminative dictionary for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2651–2664 (2013)CrossRef Jiang, Z., Lin, Z., Davis, L.: Label consistent K-SVD: learning a discriminative dictionary for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2651–2664 (2013)CrossRef
12.
go back to reference Zhang, F., Yang, J., Qian, J., Xu, Y.: Nuclear norm-based 2-DPCA for extracting features from images. IEEE Trans. Neural Netw. Learn. Syst. 26(10), 2247–2260 (2015)MathSciNetCrossRef Zhang, F., Yang, J., Qian, J., Xu, Y.: Nuclear norm-based 2-DPCA for extracting features from images. IEEE Trans. Neural Netw. Learn. Syst. 26(10), 2247–2260 (2015)MathSciNetCrossRef
13.
go back to reference Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning. MIT Press, Cambridge (2006)CrossRef Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning. MIT Press, Cambridge (2006)CrossRef
14.
go back to reference Zhang, Z., Zhang, L., Zhao, M., Jiang, W., Liang, Y., Li, F.: Semi-supervised image classification by nonnegative sparse neighborhood prediction. In: Proceedings of ACM International Conference on Multimedia Retrieval, Shanghai, pp. 139–146 (2015) Zhang, Z., Zhang, L., Zhao, M., Jiang, W., Liang, Y., Li, F.: Semi-supervised image classification by nonnegative sparse neighborhood prediction. In: Proceedings of ACM International Conference on Multimedia Retrieval, Shanghai, pp. 139–146 (2015)
15.
go back to reference Zhu X.: Semi-supervised learning literature survey. Technical report 1530, University of Wisconsin-Madison (2005) Zhu X.: Semi-supervised learning literature survey. Technical report 1530, University of Wisconsin-Madison (2005)
16.
go back to reference Zhang, Z., Chow, T.W.S., Zhao, M.B.: Trace ratio optimization based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization. IEEE Trans. Knowl. Data Eng. 25(5), 1148–1161 (2013)CrossRef Zhang, Z., Chow, T.W.S., Zhao, M.B.: Trace ratio optimization based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization. IEEE Trans. Knowl. Data Eng. 25(5), 1148–1161 (2013)CrossRef
17.
go back to reference Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R.: An efficient K-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24, 881–892 (2002)CrossRef Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R.: An efficient K-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24, 881–892 (2002)CrossRef
19.
go back to reference Jiang, W., Zhang, Z., Li, F., Zhang, L., Zhao, M., Jin, X.: Joint label consistent dictionary learning and adaptive label prediction for semi-supervised machine fault classification. IEEE Trans. Ind. Inform. 12(1), 248–256 (2016)CrossRef Jiang, W., Zhang, Z., Li, F., Zhang, L., Zhao, M., Jin, X.: Joint label consistent dictionary learning and adaptive label prediction for semi-supervised machine fault classification. IEEE Trans. Ind. Inform. 12(1), 248–256 (2016)CrossRef
20.
go back to reference Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)CrossRef Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)CrossRef
21.
go back to reference Zhao, M., Jin, X., Zhang, Z., Li, B.: Fault diagnosis of rolling element bearings via discriminative subspace learning: visualization and classification. Expert Syst. Appl. 41, 3391–3401 (2014)CrossRef Zhao, M., Jin, X., Zhang, Z., Li, B.: Fault diagnosis of rolling element bearings via discriminative subspace learning: visualization and classification. Expert Syst. Appl. 41, 3391–3401 (2014)CrossRef
Metadata
Title
Discriminative Sparse Coding by Nuclear Norm-Driven Semi-Supervised Dictionary Learning
Authors
Weiming Jiang
Zhao Zhang
Yan Zhang
Fanzhang Li
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48890-5_30