Skip to main content
Erschienen in: Multimedia Systems 1/2017

12.09.2014 | Special Issue Paper

Semi-supervised tensor learning for image classification

verfasst von: Jianguang Zhang, Yahong Han, Jianmin Jiang

Erschienen in: Multimedia Systems | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a new tensor-based representation algorithm for image classification. The algorithm is realized by learning the parameter tensor for image tensors. One novelty is that the parameter tensor is learned according to the Tucker tensor decomposition as the multiplication of a core tensor with a group of matrices for each order, which endows that the algorithm preserved the spatial information of image. We further extend the proposed tensor algorithm to a semi-supervised framework, in order to utilize both labeled and unlabeled images. The objective function can be solved by using the alternative optimization method, where at each iteration, we solve the typical ridge regression problem to obtain the closed form solution of the parameter along the corresponding order. Experimental results of gray and color image datasets show that our method outperforms several classification approaches. In particular, we find that our method can implement a high-quality classification performance when only few labeled training samples are provided.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hao, Z., He, L., Chen, B., Yang, X.: A linear support higher-order tensor machine for classification. IEEE Trans. Image Process. 22(7), 2911–2920 (2013) Hao, Z., He, L., Chen, B., Yang, X.: A linear support higher-order tensor machine for classification. IEEE Trans. Image Process. 22(7), 2911–2920 (2013)
2.
Zurück zum Zitat Cao, X., Wei, X., Han, Y., Yang, Y., Lin, D.: Robust tensor clustering with non-greedy maximization. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence(AAAI), pp. 1254–1259. AAAI Press (2013) Cao, X., Wei, X., Han, Y., Yang, Y., Lin, D.: Robust tensor clustering with non-greedy maximization. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence(AAAI), pp. 1254–1259. AAAI Press (2013)
3.
Zurück zum Zitat Guo, W., Kotsia, I., Patras, I.: Tensor learning for regression. IEEE Trans. Image Process.21(2), 816–827 (2012) Guo, W., Kotsia, I., Patras, I.: Tensor learning for regression. IEEE Trans. Image Process.21(2), 816–827 (2012)
4.
Zurück zum Zitat Han, Y., Yang, Y., Zhou, X.: Co-regularized ensemble for feature selection. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (AAAI), pp. 1380–1386. AAAI Press (2013) Han, Y., Yang, Y., Zhou, X.: Co-regularized ensemble for feature selection. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (AAAI), pp. 1380–1386. AAAI Press (2013)
5.
Zurück zum Zitat Yang, Y., Song, J., Huang, Z., Ma, Z., Sebe, N., Hauptmann, A.G.: Multi-feature fusion via hierarchical regression for multimedia analysis. IEEE Trans. Multimed. 15(3), 572–581 (2013) Yang, Y., Song, J., Huang, Z., Ma, Z., Sebe, N., Hauptmann, A.G.: Multi-feature fusion via hierarchical regression for multimedia analysis. IEEE Trans. Multimed. 15(3), 572–581 (2013)
6.
Zurück zum Zitat Zhang, L., Yang, Y., Zimmermann, R.: Discriminative cellets discovery for fine-grained image categories retrieval. In: Proceedings of the ACM ICMR (2014) Zhang, L., Yang, Y., Zimmermann, R.: Discriminative cellets discovery for fine-grained image categories retrieval. In: Proceedings of the ACM ICMR (2014)
7.
Zurück zum Zitat Shakhnarovich, G., Darrell, T., Indyk, P.: Nearest-Neighbor Methods in Learning and Vision: Theory and Practice, vol. 3. MIT press, Cambridge (2005) Shakhnarovich, G., Darrell, T., Indyk, P.: Nearest-Neighbor Methods in Learning and Vision: Theory and Practice, vol. 3. MIT press, Cambridge (2005)
8.
Zurück zum Zitat Zhang, L., Han, Y., Yang, Y., Song, M., Yan, S., Tian, Q.: Discovering discrminative graphlets for aerial image categories recognition. IEEE Trans. Image Process. 22(12), 5071–5084 (2013) Zhang, L., Han, Y., Yang, Y., Song, M., Yan, S., Tian, Q.: Discovering discrminative graphlets for aerial image categories recognition. IEEE Trans. Image Process. 22(12), 5071–5084 (2013)
9.
Zurück zum Zitat Zhang, L., Song, M., Liu, X.., Bu, J., Chen, C..: Recognizing architecture styles by hierarchical sparse coding of blocklets. Inf. Sci. 254, 141–154 (2014) Zhang, L., Song, M., Liu, X.., Bu, J., Chen, C..: Recognizing architecture styles by hierarchical sparse coding of blocklets. Inf. Sci. 254, 141–154 (2014)
10.
Zurück zum Zitat Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1), 55–67 (1970) Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1), 55–67 (1970)
11.
Zurück zum Zitat Vasilescu, M.A.O., Terzopoulos, D..: Multilinear subspace analysis of image ensembles. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 93–99. IEEE (2003) Vasilescu, M.A.O., Terzopoulos, D..: Multilinear subspace analysis of image ensembles. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 93–99. IEEE (2003)
12.
Zurück zum Zitat Pang, Y., Li, X., Yuan, Y.: Robust tensor analysis with l1-norm. IEEE Trans. Circuits Syst. Video Technol. (T-CSVT) 20(2), 172–178 (2010) Pang, Y., Li, X., Yuan, Y.: Robust tensor analysis with l1-norm. IEEE Trans. Circuits Syst. Video Technol. (T-CSVT) 20(2), 172–178 (2010)
13.
Zurück zum Zitat Cai, D., He, X., Han, J.: Subspace learning based on tensor analysis. Department of Computer Science, Tech. Report No. 2572, Univ. of Illinois at Urbana-Champaign (UIUCDCS-R-2005-2572) (2005) Cai, D., He, X., Han, J.: Subspace learning based on tensor analysis. Department of Computer Science, Tech. Report No. 2572, Univ. of Illinois at Urbana-Champaign (UIUCDCS-R-2005-2572) (2005)
14.
Zurück zum Zitat Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., Zhang, H.-J.: Multilinear discriminant analysis for face recognition. IEEE Trans. Image Process. 16(1), 212–220 (2007) Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., Zhang, H.-J.: Multilinear discriminant analysis for face recognition. IEEE Trans. Image Process. 16(1), 212–220 (2007)
15.
Zurück zum Zitat Ma, Z., Yang, Y., Nie, F., Sebe, N.: Thinking of images as what they are: compound matrix regression for image classification. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (IJCAI) (2013) Ma, Z., Yang, Y., Nie, F., Sebe, N.: Thinking of images as what they are: compound matrix regression for image classification. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (IJCAI) (2013)
16.
Zurück zum Zitat Shashua, A., Levin, A.: Linear image coding for regression and classification using the tensor-rank principle. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 42–49. IEEE (2001) Shashua, A., Levin, A.: Linear image coding for regression and classification using the tensor-rank principle. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 42–49. IEEE (2001)
17.
Zurück zum Zitat Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Rev. 51(3), 455–500 (2009) Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Rev. 51(3), 455–500 (2009)
18.
Zurück zum Zitat Cai, D., He, X., Han, J.: Learning with tensor representation. Technical Report UIUCDCS- R-2006-2716 (2006) Cai, D., He, X., Han, J.: Learning with tensor representation. Technical Report UIUCDCS- R-2006-2716 (2006)
19.
Zurück zum Zitat Tao, D., Li, X., Hu, W., Maybank, S., Wu, X.: Supervised tensor learning. In: Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM), pp. 450–457. IEEE (2005) Tao, D., Li, X., Hu, W., Maybank, S., Wu, X.: Supervised tensor learning. In: Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM), pp. 450–457. IEEE (2005)
20.
Zurück zum Zitat Tichavsky, P., Phan, A.H., Koldovsky, Z.: Cramér-rao-induced bounds for candecomp/parafac tensor decomposition. IEEE Trans. Signal Process. 61(8), 1986–1997 (2013) Tichavsky, P., Phan, A.H., Koldovsky, Z.: Cramér-rao-induced bounds for candecomp/parafac tensor decomposition. IEEE Trans. Signal Process. 61(8), 1986–1997 (2013)
21.
Zurück zum Zitat Haoquan, S., Yan, Y., Shicheng, X., Nicolas, B., Wenzhi, C.: Evaluation of semi-supervised learning method on action recognition. Multimed. Tools Appl. (2014). doi:10.1007/s11042-014-1936-z Haoquan, S., Yan, Y., Shicheng, X., Nicolas, B., Wenzhi, C.: Evaluation of semi-supervised learning method on action recognition. Multimed. Tools Appl. (2014). doi:10.​1007/​s11042-014-1936-z
22.
Zurück zum Zitat Kotsia, I., Patras, I.: Support tucker machines. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 633–640. IEEE (2011) Kotsia, I., Patras, I.: Support tucker machines. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 633–640. IEEE (2011)
23.
Zurück zum Zitat Cai, D., He, X., Han, J.: Semi-supervised discriminant analysis. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2007) Cai, D., He, X., Han, J.: Semi-supervised discriminant analysis. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2007)
24.
Zurück zum Zitat Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., Pan, Y.: A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans. Pattern Anal. Mach. Intell. 34(4), 723–742 (2012) Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., Pan, Y.: A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans. Pattern Anal. Mach. Intell. 34(4), 723–742 (2012)
25.
Zurück zum Zitat Fung, G., Mangasarian, O.L.: Multicategory proximal support vector machine classifiers. Mach. Learn. 59(1–2), 77–97 (2005) Fung, G., Mangasarian, O.L.: Multicategory proximal support vector machine classifiers. Mach. Learn. 59(1–2), 77–97 (2005)
26.
Zurück zum Zitat Nie, F., Dong, X., Tsang, I.W.H., Zhang, C.: Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans. Image Process. 19(7), 1921–1932 (2010) Nie, F., Dong, X., Tsang, I.W.H., Zhang, C.: Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans. Image Process. 19(7), 1921–1932 (2010)
27.
Zurück zum Zitat Liu, W., He, J., Chang, S.-F.: Large graph construction for scalable semi-supervised learning. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 679–686 (2010) Liu, W., He, J., Chang, S.-F.: Large graph construction for scalable semi-supervised learning. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 679–686 (2010)
28.
Zurück zum Zitat Yu-Feng, L., Kwok J., T., Zhou, Z.-H.: Cost-sensitive semi-supervised support vector machine. In: Proceedings of the International Joint Conference on Artificial Intelligence(AAAI), pp. 500–505. AAAI Press (2010) Yu-Feng, L., Kwok J., T., Zhou, Z.-H.: Cost-sensitive semi-supervised support vector machine. In: Proceedings of the International Joint Conference on Artificial Intelligence(AAAI), pp. 500–505. AAAI Press (2010)
Metadaten
Titel
Semi-supervised tensor learning for image classification
verfasst von
Jianguang Zhang
Yahong Han
Jianmin Jiang
Publikationsdatum
12.09.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 1/2017
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-014-0416-7

Weitere Artikel der Ausgabe 1/2017

Multimedia Systems 1/2017 Zur Ausgabe

Neuer Inhalt