Skip to main content
Erschienen in: Neural Computing and Applications 6/2016

01.08.2016 | Original Article

Video-based face recognition and image synthesis from rotating head frames using nonlinear manifold learning by neural networks

verfasst von: Kian Hamedani, Seyyed Ali Seyyedsalehi, Reza Ahamdi

Erschienen in: Neural Computing and Applications | Ausgabe 6/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a new video-based face recognition method that uses video frames of a subject rotating his/her head. In the experiment discussed here, the manifolds of video frames embedded in a high-dimensional video space were extracted using neural network (NN)-based models. This increased the recognition rate in comparison with a simple NN architecture (from 72.9 to 81.3 %). These models were inspired by manifold interpretations of the brain’s visual perception. Next, the pose and person manifolds were separated using the neurons trained in the hidden or bottleneck layer of the network. Finally, the separated manifolds were used to synthesize face images at different angles from a single frontal image. Using video frames to extract these manifolds produces higher-quality images than using manifolds extracted from single images. This improvement in image quality was verified using the structural similarity index measure.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arandjelović O, Cipolla R (2013) Achieving robust face recognition from video by combining a weak photometric model and a learnt generic face invariant. Pattern Recogn 46(1):9–23CrossRef Arandjelović O, Cipolla R (2013) Achieving robust face recognition from video by combining a weak photometric model and a learnt generic face invariant. Pattern Recogn 46(1):9–23CrossRef
2.
Zurück zum Zitat Mian A (2011) Online learning from local features for video-based face recognition. Pattern Recogn 44(5):1068–1075CrossRefMATH Mian A (2011) Online learning from local features for video-based face recognition. Pattern Recogn 44(5):1068–1075CrossRefMATH
3.
Zurück zum Zitat Cui Z, Chang H, Shan S, Ma B, Chen X (2014) Joint sparse representation for video-based face recognition. Neurocomputing 135:306–312CrossRef Cui Z, Chang H, Shan S, Ma B, Chen X (2014) Joint sparse representation for video-based face recognition. Neurocomputing 135:306–312CrossRef
4.
Zurück zum Zitat Zhao W et al (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRef Zhao W et al (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRef
5.
Zurück zum Zitat Satoh SI (2000) Comparative evaluation of face sequence matching for content-based video access. In: Proceedings of fourth IEEE international conference on automatic face and gesture recognition, 2000. IEEE Satoh SI (2000) Comparative evaluation of face sequence matching for content-based video access. In: Proceedings of fourth IEEE international conference on automatic face and gesture recognition, 2000. IEEE
6.
Zurück zum Zitat Belhumeur PN, Hespanha JP, Kriegman D (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intel 19(7):711–720 Belhumeur PN, Hespanha JP, Kriegman D (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intel 19(7):711–720
7.
Zurück zum Zitat Liu X, Cheng T (2003) Video-based face recognition using adaptive hidden markov models. In: Proceedings of 2003 IEEE computer society conference on computer vision and pattern recognition. IEEE Liu X, Cheng T (2003) Video-based face recognition using adaptive hidden markov models. In: Proceedings of 2003 IEEE computer society conference on computer vision and pattern recognition. IEEE
8.
Zurück zum Zitat Liu X, Chen T (2003) Video-based face recognition using adaptive hidden markov models. In: Proceedings of 2003 IEEE computer society conference on computer vision and pattern recognition. IEEE Liu X, Chen T (2003) Video-based face recognition using adaptive hidden markov models. In: Proceedings of 2003 IEEE computer society conference on computer vision and pattern recognition. IEEE
9.
Zurück zum Zitat Hadid A, Pietikäinen M (2009) Manifold learning for video-to video face recognition. In: Biometric ID management and multimodal communication. Springer, Berlin. pp 9–16 Hadid A, Pietikäinen M (2009) Manifold learning for video-to video face recognition. In: Biometric ID management and multimodal communication. Springer, Berlin. pp 9–16
10.
Zurück zum Zitat Hamedani K, Seyyedsalehi SA (2012) Video-based face recognition using manifold learning by neural networks. In: 2012 20th Iranian conference on electrical engineering (ICEE). IEEE Hamedani K, Seyyedsalehi SA (2012) Video-based face recognition using manifold learning by neural networks. In: 2012 20th Iranian conference on electrical engineering (ICEE). IEEE
11.
Zurück zum Zitat Seung HS, Lee DD (2000) The manifold ways of perception. Science 290(5500):2268–2269CrossRef Seung HS, Lee DD (2000) The manifold ways of perception. Science 290(5500):2268–2269CrossRef
12.
Zurück zum Zitat Hadid A, Pietikäinen M (2013) Demographic classification from face videos using manifold learning. Neurocomputing 100:197–205CrossRef Hadid A, Pietikäinen M (2013) Demographic classification from face videos using manifold learning. Neurocomputing 100:197–205CrossRef
13.
Zurück zum Zitat Hira ZM, Trigeorgis G, Gillies DF (2014) An algorithm for finding biologically significant features in microarray data based on a priori manifold learning. PLoS ONE 9(3):e90562CrossRef Hira ZM, Trigeorgis G, Gillies DF (2014) An algorithm for finding biologically significant features in microarray data based on a priori manifold learning. PLoS ONE 9(3):e90562CrossRef
14.
Zurück zum Zitat Qiao Hong, Zhang Peng, Wang Di, Zhang Bo (2013) An explicit nonlinear mapping for manifold learning. IEEE Trans Cybern 43(1):51–63CrossRef Qiao Hong, Zhang Peng, Wang Di, Zhang Bo (2013) An explicit nonlinear mapping for manifold learning. IEEE Trans Cybern 43(1):51–63CrossRef
15.
Zurück zum Zitat Wang C, Song X (2014) Robust head pose estimation via supervised manifold learning. Neural Networks 53:15–25CrossRefMATH Wang C, Song X (2014) Robust head pose estimation via supervised manifold learning. Neural Networks 53:15–25CrossRefMATH
16.
Zurück zum Zitat Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH
17.
Zurück zum Zitat Tenenbaum JB, De Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum JB, De Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
18.
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
19.
Zurück zum Zitat Saul LK, Roweis ST (2003) Think globally, fit locally: unsupervised learning of low dimensional manifolds. J Mach Learn Res 4:119–155MathSciNetMATH Saul LK, Roweis ST (2003) Think globally, fit locally: unsupervised learning of low dimensional manifolds. J Mach Learn Res 4:119–155MathSciNetMATH
20.
Zurück zum Zitat Hou Chenping, Nie Feiping, Wang Hua, Yi Dongyun, Zhang Changshui (2014) Learning high-dimensional correspondence via manifold learning and local approximation. Neural Comput Appl 24(7–8):1555–1568CrossRef Hou Chenping, Nie Feiping, Wang Hua, Yi Dongyun, Zhang Changshui (2014) Learning high-dimensional correspondence via manifold learning and local approximation. Neural Comput Appl 24(7–8):1555–1568CrossRef
21.
Zurück zum Zitat Wang L, Suter D (2007) Learning and matching of dynamic shape manifolds for human action recognition. IEEE Trans Image Process 16(6):1646–1661MathSciNetCrossRef Wang L, Suter D (2007) Learning and matching of dynamic shape manifolds for human action recognition. IEEE Trans Image Process 16(6):1646–1661MathSciNetCrossRef
22.
Zurück zum Zitat Chen J et al (2007) Enhancing human face detection by resampling examples through manifolds. IEEE Trans Syst Man Cybern A Syst Humans 37(6):1017–1028CrossRef Chen J et al (2007) Enhancing human face detection by resampling examples through manifolds. IEEE Trans Syst Man Cybern A Syst Humans 37(6):1017–1028CrossRef
23.
Zurück zum Zitat Wang Q, Xu G, Ai H (2003) Learning object intrinsic structure for robust visual tracking. In: Proceedings of 2003 IEEE computer society conference on computer vision and pattern recognition. IEEE Wang Q, Xu G, Ai H (2003) Learning object intrinsic structure for robust visual tracking. In: Proceedings of 2003 IEEE computer society conference on computer vision and pattern recognition. IEEE
24.
Zurück zum Zitat Du M, Sankaranarayanan AC, Chellappa R (2014) Robust face recognition from multi-view videos Du M, Sankaranarayanan AC, Chellappa R (2014) Robust face recognition from multi-view videos
25.
Zurück zum Zitat Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef
26.
Zurück zum Zitat Sanderson C, Paliwal KK (2002) Polynomial features for robust face authentication. In: Proceedings of 2002 international conference on image processing. IEEE Sanderson C, Paliwal KK (2002) Polynomial features for robust face authentication. In: Proceedings of 2002 international conference on image processing. IEEE
27.
Zurück zum Zitat Ren Y, Iftekharuddin KM, White WE (2009) Recurrent network-based face recognition using image sequences. In: Computational intelligence for multimedia signal and vision processing, 2009. CIMSVP'09. IEEE Symposium, pp 41–46 Ren Y, Iftekharuddin KM, White WE (2009) Recurrent network-based face recognition using image sequences. In: Computational intelligence for multimedia signal and vision processing, 2009. CIMSVP'09. IEEE Symposium, pp 41–46
28.
Zurück zum Zitat Seyyedsalehi SZ, Seyyedsalehi SA (2014) Simultaneous learning of nonlinear manifolds based on the bottleneck neural network. Neural Process Lett 40(2):191–209CrossRef Seyyedsalehi SZ, Seyyedsalehi SA (2014) Simultaneous learning of nonlinear manifolds based on the bottleneck neural network. Neural Process Lett 40(2):191–209CrossRef
29.
Zurück zum Zitat Aghajanian J, Prince S (2009) Face pose estimation in uncontrolled environments. In: BMVC Aghajanian J, Prince S (2009) Face pose estimation in uncontrolled environments. In: BMVC
Metadaten
Titel
Video-based face recognition and image synthesis from rotating head frames using nonlinear manifold learning by neural networks
verfasst von
Kian Hamedani
Seyyed Ali Seyyedsalehi
Reza Ahamdi
Publikationsdatum
01.08.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 6/2016
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-1975-z

Weitere Artikel der Ausgabe 6/2016

Neural Computing and Applications 6/2016 Zur Ausgabe