Skip to main content
Top
Published in: Multimedia Systems 6/2020

14-09-2020 | Regular Paper

Multi-nonlinear multi-view locality-preserving projection with similarity learning for random cross-view gait recognition

Authors: Xiaoyun Chen, Yeyuan Kang, Zhiping Chen

Published in: Multimedia Systems | Issue 6/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

View variation is one of the greatest challenges in the field of gait recognition. Subspace learning approaches are designed to solve this issue by projecting cross-view features into a common subspace before recognition. However, similarity measures are data-dependent, which results in low accuracy when cross-view gait samples are randomly arranged. Inspired by the recent developments of data-driven similarity learning and multi-nonlinear projection, we propose a new unsupervised projection approach, called multi-nonlinear multi-view locality-preserving projections with similarity learning (M2LPP-SL). The similarity information among cross-view samples can be learned adaptively in our M2LPP-SL. Besides, the complex nonlinear structure of original data can be well preserved through multiple explicit nonlinear projection functions. Nevertheless, its performance is largely affected by the choice of nonlinear projection functions. Considering the excellent ability of kernel trick for capturing nonlinear structure information, we further extend M2LPP-SL into kernel space, and propose its multiple kernel version MKMLPP-SL. As a result, our approaches can capture linear and nonlinear structure more precisely, and also learn similarity information hidden in the multi-view gait dataset. The proposed models can be solved efficiently by alternating direction optimization method. Extensive experimental results over various view combinations on the multi-view gait database CASIA-B have demonstrated the superiority of the proposed algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Sugandhi, K., Wahid, F.F., Raju, G.: Feature extraction methods for human gait recognition—a survey. Adv. Comput. Data Sci. 721, 377–385 (2017)CrossRef Sugandhi, K., Wahid, F.F., Raju, G.: Feature extraction methods for human gait recognition—a survey. Adv. Comput. Data Sci. 721, 377–385 (2017)CrossRef
2.
go back to reference Nie, F., Cai, G., Li, J., et al.: Auto-weighted multi-view learning for image clustering and semi-supervised classification. IEEE Trans. Image Process. 3(27), 1501–1511 (2017)MathSciNetMATH Nie, F., Cai, G., Li, J., et al.: Auto-weighted multi-view learning for image clustering and semi-supervised classification. IEEE Trans. Image Process. 3(27), 1501–1511 (2017)MathSciNetMATH
3.
go back to reference Wu, X., Li, Q., Xu, L., Chen, K., Yao, L.: Multi-feature kernel discriminant dictionary learning for face recognition. Pattern Recogn. 66, 404–411 (2017)CrossRef Wu, X., Li, Q., Xu, L., Chen, K., Yao, L.: Multi-feature kernel discriminant dictionary learning for face recognition. Pattern Recogn. 66, 404–411 (2017)CrossRef
4.
go back to reference Pan, H., He, J., Ling, Y., et al.: Graph regularized multiview marginal discriminant projection. J. Vis. Commun. Image Represent. 57, 12–22 (2018)CrossRef Pan, H., He, J., Ling, Y., et al.: Graph regularized multiview marginal discriminant projection. J. Vis. Commun. Image Represent. 57, 12–22 (2018)CrossRef
5.
go back to reference Wan, C.S., Wang, L., Phoha, V.V.: A survey on gait recognition. ACM Comput. Surv. 51(5), 89 (2018) Wan, C.S., Wang, L., Phoha, V.V.: A survey on gait recognition. ACM Comput. Surv. 51(5), 89 (2018)
6.
go back to reference Adeli-Mosabbeb, E., Fathy, M., Zargari, F.: Model-based human gait tracking, 3D reconstruction and recognition in uncalibrated monocular video. Imaging Sci. J. 60(1), 9–28 (2012)CrossRef Adeli-Mosabbeb, E., Fathy, M., Zargari, F.: Model-based human gait tracking, 3D reconstruction and recognition in uncalibrated monocular video. Imaging Sci. J. 60(1), 9–28 (2012)CrossRef
7.
go back to reference Sun, J., Wang, Y., Li, J., et al.: View-invariant gait recognition based on kinect skeleton feature. Multimedia Tools Appl. 77(19), 24909–24935 (2018)CrossRef Sun, J., Wang, Y., Li, J., et al.: View-invariant gait recognition based on kinect skeleton feature. Multimedia Tools Appl. 77(19), 24909–24935 (2018)CrossRef
8.
go back to reference Tang, J., Luo, J., Tjahjadi, T., et al.: Robust arbitrary-view gait recognition based on 3D partial similarity matching. IEEE Trans. Image Process. 26(1), 7–22 (2016)MathSciNetMATHCrossRef Tang, J., Luo, J., Tjahjadi, T., et al.: Robust arbitrary-view gait recognition based on 3D partial similarity matching. IEEE Trans. Image Process. 26(1), 7–22 (2016)MathSciNetMATHCrossRef
9.
go back to reference Jean, F., Bergevin, R., Albu, A.B.: Computing and evaluating view-normalized body part trajectories. Image Vis. Comput. 27(9), 1272–1284 (2009)MATHCrossRef Jean, F., Bergevin, R., Albu, A.B.: Computing and evaluating view-normalized body part trajectories. Image Vis. Comput. 27(9), 1272–1284 (2009)MATHCrossRef
10.
go back to reference Kusakunniran, W., Wu, Q., Zhang, J., et al.: A new view-invariant feature for cross-view gait recognition. IEEE Trans. Inf. Forensics Secur. 8(10), 1642–1653 (2013)CrossRef Kusakunniran, W., Wu, Q., Zhang, J., et al.: A new view-invariant feature for cross-view gait recognition. IEEE Trans. Inf. Forensics Secur. 8(10), 1642–1653 (2013)CrossRef
11.
go back to reference Tafazzoli, F., Safabakhsh, R.: Model-based human gait recognition using leg and arm movements. Eng. Appl. Artif. Intell. 23(8), 1237–1246 (2010)CrossRef Tafazzoli, F., Safabakhsh, R.: Model-based human gait recognition using leg and arm movements. Eng. Appl. Artif. Intell. 23(8), 1237–1246 (2010)CrossRef
12.
go back to reference Wang, H., Fan, Y.Y., Fang, B.F., et al.: Generalized linear discriminant analysis based on euclidean norm for gait recognition. Int. J. Mach. Learn. Cybern. 9(4), 569–576 (2018)CrossRef Wang, H., Fan, Y.Y., Fang, B.F., et al.: Generalized linear discriminant analysis based on euclidean norm for gait recognition. Int. J. Mach. Learn. Cybern. 9(4), 569–576 (2018)CrossRef
13.
go back to reference Xing, X., Wang, K., Yan, T., et al.: Complete canonical correlation analysis with application to multi-view gait recognition. Pattern Recogn. 50, 107–117 (2015)CrossRef Xing, X., Wang, K., Yan, T., et al.: Complete canonical correlation analysis with application to multi-view gait recognition. Pattern Recogn. 50, 107–117 (2015)CrossRef
14.
go back to reference Xu, W., Zhu, C., Wang, Z.: Multiview max-margin subspace learning for cross-view gait recognition. Pattern Recogn. Lett. 107, 75–82 (2018)CrossRef Xu, W., Zhu, C., Wang, Z.: Multiview max-margin subspace learning for cross-view gait recognition. Pattern Recogn. Lett. 107, 75–82 (2018)CrossRef
15.
go back to reference Wu, Z., Huang, Y., Wang, L., et al.: A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Trans. Pattern Anal. Mach. Intell. 39(2), 209–226 (2017)CrossRef Wu, Z., Huang, Y., Wang, L., et al.: A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Trans. Pattern Anal. Mach. Intell. 39(2), 209–226 (2017)CrossRef
16.
go back to reference Li, B., Chang, H., Shan, S.G., et al.: Coupled metric learning for face recognition with degraded images. Adv. Mach. Learn. Proc. 5828, 220–233 (2009) Li, B., Chang, H., Shan, S.G., et al.: Coupled metric learning for face recognition with degraded images. Adv. Mach. Learn. Proc. 5828, 220–233 (2009)
17.
go back to reference Xu, W., Luo, C., Ji, A., et al.: Coupled locality preserving projections for cross-view gait recognition. Neurocomputing 224, 37–44 (2017)CrossRef Xu, W., Luo, C., Ji, A., et al.: Coupled locality preserving projections for cross-view gait recognition. Neurocomputing 224, 37–44 (2017)CrossRef
18.
go back to reference He, X.F., Niyogi, P.: Locality preserving projections. Adv. Neural Inf. Process. Syst. 16, 153–160 (2004) He, X.F., Niyogi, P.: Locality preserving projections. Adv. Neural Inf. Process. Syst. 16, 153–160 (2004)
19.
go back to reference Bashir, K., Xiang, T., Gong, S.: Cross-view gait recognition using correlation strength. Proc. Br. Mach. Vis. Conf. 109, 1–11 (2010) Bashir, K., Xiang, T., Gong, S.: Cross-view gait recognition using correlation strength. Proc. Br. Mach. Vis. Conf. 109, 1–11 (2010)
20.
go back to reference Hardoon, D.R., Szedmak, S., Shawe-Taylor, J.: Canonical correlation analysis: an overview with application to learning methods. Neural Comput. 16(12), 2639–2664 (2004)MATHCrossRef Hardoon, D.R., Szedmak, S., Shawe-Taylor, J.: Canonical correlation analysis: an overview with application to learning methods. Neural Comput. 16(12), 2639–2664 (2004)MATHCrossRef
21.
go back to reference Ben, X.Y., Meng, W.X., Yan, R., et al.: An improved biometrics technique based on metric learning approach. Neurocomputing 97(1), 44–51 (2012)CrossRef Ben, X.Y., Meng, W.X., Yan, R., et al.: An improved biometrics technique based on metric learning approach. Neurocomputing 97(1), 44–51 (2012)CrossRef
22.
go back to reference Ben, X.Y., Meng, W.X., Yan, R., et al.: Kernel coupled distance metric learning for gait recognition and face recognition. Neurocomputing 120(10), 577–589 (2013)CrossRef Ben, X.Y., Meng, W.X., Yan, R., et al.: Kernel coupled distance metric learning for gait recognition and face recognition. Neurocomputing 120(10), 577–589 (2013)CrossRef
23.
go back to reference Huang, G.B.: An insight into extreme learning machines: random neurons, random features and kernels. Cognit. Comput. 6(3), 376–390 (2014)MathSciNetCrossRef Huang, G.B.: An insight into extreme learning machines: random neurons, random features and kernels. Cognit. Comput. 6(3), 376–390 (2014)MathSciNetCrossRef
24.
go back to reference Wang, Q., Dou, Y., Liu, X.W., et al.: Multi-view clustering with extreme learning machine. Neurocomputing 214, 483–494 (2016)CrossRef Wang, Q., Dou, Y., Liu, X.W., et al.: Multi-view clustering with extreme learning machine. Neurocomputing 214, 483–494 (2016)CrossRef
25.
go back to reference Zhao, Z., Feng, G., Zhu, J., et al.: Manifold learning: dimensionality reduction and high dimensional data reconstruction via dictionary learning. Neurocomputing 216, 268–285 (2016)CrossRef Zhao, Z., Feng, G., Zhu, J., et al.: Manifold learning: dimensionality reduction and high dimensional data reconstruction via dictionary learning. Neurocomputing 216, 268–285 (2016)CrossRef
26.
go back to reference Chen, X.Y., Jian, C.R.: Gene expression data clustering based on graph regularized subspace segmentation. Neurocomputing 143, 44–50 (2014)CrossRef Chen, X.Y., Jian, C.R.: Gene expression data clustering based on graph regularized subspace segmentation. Neurocomputing 143, 44–50 (2014)CrossRef
27.
go back to reference Lu, C.Y., Min, H., Zhao, Z.Q., et al.: Robust and efficient subspace segmentation via least squares regression. Eur. Conf. Comput. Vis. 7578(1), 347–360 (2012) Lu, C.Y., Min, H., Zhao, Z.Q., et al.: Robust and efficient subspace segmentation via least squares regression. Eur. Conf. Comput. Vis. 7578(1), 347–360 (2012)
28.
go back to reference Lu, C., Feng, J., Yan, S., et al.: A unified alternating direction method of multipliers by majorization minimization. IEEE Trans. Pattern Anal. Mach. Intell. 40(3), 527–541 (2018)CrossRef Lu, C., Feng, J., Yan, S., et al.: A unified alternating direction method of multipliers by majorization minimization. IEEE Trans. Pattern Anal. Mach. Intell. 40(3), 527–541 (2018)CrossRef
29.
go back to reference Bezdek, J.C., Hathaway, R.J.: Convergence of alternating optimization. Neural Parallel Sci. Comp. 11(4), 351–368 (2003)MathSciNetMATH Bezdek, J.C., Hathaway, R.J.: Convergence of alternating optimization. Neural Parallel Sci. Comp. 11(4), 351–368 (2003)MathSciNetMATH
30.
go back to reference Shawe-Taylor, J., Cristianini, N.: Kernel Method for Pattern Analysis. Cambridge University Press, Cambridge (2004)MATHCrossRef Shawe-Taylor, J., Cristianini, N.: Kernel Method for Pattern Analysis. Cambridge University Press, Cambridge (2004)MATHCrossRef
31.
32.
go back to reference Yu, S., Tan, D., Tan, T.: A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. Int. Conf. Pattern Recogn. 4, 441–444 (2006) Yu, S., Tan, D., Tan, T.: A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. Int. Conf. Pattern Recogn. 4, 441–444 (2006)
33.
go back to reference Han, J., Bhanu, B.: Individual recognition using gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316–322 (2006)CrossRef Han, J., Bhanu, B.: Individual recognition using gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316–322 (2006)CrossRef
Metadata
Title
Multi-nonlinear multi-view locality-preserving projection with similarity learning for random cross-view gait recognition
Authors
Xiaoyun Chen
Yeyuan Kang
Zhiping Chen
Publication date
14-09-2020
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 6/2020
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-020-00685-2

Other articles of this Issue 6/2020

Multimedia Systems 6/2020 Go to the issue