Skip to main content
Top

2016 | OriginalPaper | Chapter

Transductive Classification by Robust Linear Neighborhood Propagation

Authors : Lei Jia, Zhao Zhang, Weiming Jiang

Published in: Advances in Multimedia Information Processing - PCM 2016

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose an enhanced label prediction method termed Transductive Classification Robust Linear Neighborhood Propagation (R-LNP). To encode the neighborhood reconstruction error more accurately, we apply the L2,1-norm that is proved to be very robust to noise for characterizing the manifold smoothing term. Since L2,1-norm can also enforce the neighborhood reconstruction error to be sparse in rows, i.e., entries of some rows are zeros. In addition, to enhance robustness in the process of modeling the difference between the initial labels and predicted ones, we also regularize the weighted L2,1-norm on the label fitting term, so the resulted measures would be more accurate. Compared with several transductive label propagation models, our proposed algorithm obtains state-of-the-art performance over extensive representation and classification experiments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wang, F., Zhang, C.: Label propagation through linear neighborhoods. IEEE Trans. Knowl. Data Eng. 20(1), 55–67 (2008)CrossRef Wang, F., Zhang, C.: Label propagation through linear neighborhoods. IEEE Trans. Knowl. Data Eng. 20(1), 55–67 (2008)CrossRef
2.
go back to reference Wang, Y., Chen, S., Zhou, Z.H.: New semi-supervised classification method based on modified cluster assumption. IEEE Trans. Neural Netw. Learn. Syst. 23(5), 689–702 (2012)MathSciNetCrossRef Wang, Y., Chen, S., Zhou, Z.H.: New semi-supervised classification method based on modified cluster assumption. IEEE Trans. Neural Netw. Learn. Syst. 23(5), 689–702 (2012)MathSciNetCrossRef
3.
go back to reference Zhang, F., Yang, J., Qian, J.: Nuclear norm-based 2-DPCA for extracting features from images. IEEE Trans. Neural Netw. Learn. Syst. 26(10), 2247–2260 (2015)MathSciNetCrossRef Zhang, F., Yang, J., Qian, J.: Nuclear norm-based 2-DPCA for extracting features from images. IEEE Trans. Neural Netw. Learn. Syst. 26(10), 2247–2260 (2015)MathSciNetCrossRef
4.
go back to reference Yang, Y., Shen, H.T.: L2,1-norm regularized discriminative feature selection for unsupervised learning. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, vol. 2, pp. 1589–1594 (2011) Yang, Y., Shen, H.T.: L2,1-norm regularized discriminative feature selection for unsupervised learning. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, vol. 2, pp. 1589–1594 (2011)
5.
go back to reference Data, C., Mining, D.: Concepts and techniques. San Franc. 29(1), 1–18 (2010) Data, C., Mining, D.: Concepts and techniques. San Franc. 29(1), 1–18 (2010)
6.
go back to reference Zhang, F., Zhang, J.S.: Label propagation through sparse neighborhood and its applications. Neurocomputing 97, 267–277 (2012)CrossRef Zhang, F., Zhang, J.S.: Label propagation through sparse neighborhood and its applications. Neurocomputing 97, 267–277 (2012)CrossRef
8.
go back to reference Zhang, C., Wang, S., Li, D.: Prior class dissimilarity based linear neighborhood propagation. Knowl. Based Syst. 83, 58–65 (2015)CrossRef Zhang, C., Wang, S., Li, D.: Prior class dissimilarity based linear neighborhood propagation. Knowl. Based Syst. 83, 58–65 (2015)CrossRef
9.
go back to reference Nie, F., Xiang, S., Liu, Y.: A general graph-based semi-supervised learning with novel class discovery. Neural Comput. Appl. 19(4), 549–555 (2010)CrossRef Nie, F., Xiang, S., Liu, Y.: A general graph-based semi-supervised learning with novel class discovery. Neural Comput. Appl. 19(4), 549–555 (2010)CrossRef
10.
go back to reference Zhang, Z., Zhang, L., Zhao, M.B., Jiang, W.M., Liang, Y.C., Li, F.Z.: Semi-supervised image classification by nonnegative sparse neighborhood propagation. In: Proceedings of the ACM International Conference on Multimedia Retrieval, Shanghai, pp. 139–146 (2015) Zhang, Z., Zhang, L., Zhao, M.B., Jiang, W.M., Liang, Y.C., Li, F.Z.: Semi-supervised image classification by nonnegative sparse neighborhood propagation. In: Proceedings of the ACM International Conference on Multimedia Retrieval, Shanghai, pp. 139–146 (2015)
11.
go back to reference Tang, H., Fang, T., Shi, P.F.: Laplacian linear discriminant analysis. Pattern Recognit. 39(1), 136–139 (2006)CrossRefMATH Tang, H., Fang, T., Shi, P.F.: Laplacian linear discriminant analysis. Pattern Recognit. 39(1), 136–139 (2006)CrossRefMATH
12.
go back to reference Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with local and global consistency. Adv. Neural Inf. Proces. Syst. 17(4), 321–328 (2004) Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with local and global consistency. Adv. Neural Inf. Proces. Syst. 17(4), 321–328 (2004)
13.
go back to reference Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using gaussian fields and harmonic functions. In: Proceedings of 20th International Conference on Machine Learning, pp. 912–919 (2003) Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using gaussian fields and harmonic functions. In: Proceedings of 20th International Conference on Machine Learning, pp. 912–919 (2003)
14.
go back to reference Hou, C.P., Nie, F.P., Li, X.L., Yi, D.Y., Wu, Y.: Joint embedding learning and sparse regression: a framework for unsupervised feature selection. IEEE Trans. Cybern. 44(6), 793–804 (2014)CrossRef Hou, C.P., Nie, F.P., Li, X.L., Yi, D.Y., Wu, Y.: Joint embedding learning and sparse regression: a framework for unsupervised feature selection. IEEE Trans. Cybern. 44(6), 793–804 (2014)CrossRef
15.
go back to reference Nie, F., Huang, H., Cai, X., Ding, C.: Efficient and robust feature selection via joint L2,1-norms minimization. In: Advances in Neural Information Processing Systems, pp. 1813–121 (2010) Nie, F., Huang, H., Cai, X., Ding, C.: Efficient and robust feature selection via joint L2,1-norms minimization. In: Advances in Neural Information Processing Systems, pp. 1813–121 (2010)
16.
go back to reference Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Technical report CUCS-005-96 (1996) Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Technical report CUCS-005-96 (1996)
17.
go back to reference Yang, S.Z., Hou, C.P., Nie, F.P., Wu, Y.: Unsupervised maximum margin feature selection via L2,1-norm minimization. Neural Comput. Appl. 21(7), 1791–1799 (2012)CrossRef Yang, S.Z., Hou, C.P., Nie, F.P., Wu, Y.: Unsupervised maximum margin feature selection via L2,1-norm minimization. Neural Comput. Appl. 21(7), 1791–1799 (2012)CrossRef
18.
go back to reference Zhang, Z., Jiang, W., Li, F., Zhang, L., Zhao, M., Jia, L.: Projective Label Propagation by Label Embedding. In: Azzopardi, G., Petkov, N. (eds.) CAIP 2015. LNCS, vol. 9257, pp. 470–481. Springer, Heidelberg (2015). doi:10.1007/978-3-319-23117-4_41 CrossRef Zhang, Z., Jiang, W., Li, F., Zhang, L., Zhao, M., Jia, L.: Projective Label Propagation by Label Embedding. In: Azzopardi, G., Petkov, N. (eds.) CAIP 2015. LNCS, vol. 9257, pp. 470–481. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-23117-4_​41 CrossRef
19.
go back to reference Zhao, M.B., Chow, T.W.S., Zhang, Z., Li, B.: Automatic image annotation via compact graph based semi-supervised learning. Know. Based Syst. 76, 148–165 (2015)CrossRef Zhao, M.B., Chow, T.W.S., Zhang, Z., Li, B.: Automatic image annotation via compact graph based semi-supervised learning. Know. Based Syst. 76, 148–165 (2015)CrossRef
20.
go back to reference Liang, Y.C., Zhang, Z., Jiang, W.M., Zhao, M.B., Li, F.Z.: Bilinear embedding label propagation: towards scalable prediction of image labels. IEEE Signal Process. Lett. 22(12), 2411–2415 (2015)CrossRef Liang, Y.C., Zhang, Z., Jiang, W.M., Zhao, M.B., Li, F.Z.: Bilinear embedding label propagation: towards scalable prediction of image labels. IEEE Signal Process. Lett. 22(12), 2411–2415 (2015)CrossRef
Metadata
Title
Transductive Classification by Robust Linear Neighborhood Propagation
Authors
Lei Jia
Zhao Zhang
Weiming Jiang
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48890-5_29