Skip to main content

2018 | OriginalPaper | Buchkapitel

Efficient and Effective Face Frontalization for Face Recognition in the Wild

verfasst von : Nelson Méndez, Luis A. Bouza, Leonardo Chang, Heydi Méndez-Vázquez

Erschienen in: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face image alignment is one of the most important steps in a face recognition system, being directly linked to its accuracy. In this work we propose a method for face frontalization based on the use of 3D models obtained from 2D images. We first extend the 3D Generic Elastic Model method in order to make it suitable for real applications, and once we have the 3D dense model of a face image, we obtain its frontal projection, introducing a new method for the synthesis of occluded regions. We evaluate the proposal by frontalizing the face images on LFW database and compare it with other frontalization techniques using different face recognition methods. We show that the proposed method allows to effectively align the images in an efficient way.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. Techical Report SIGGRAPH (1999) Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. Techical Report SIGGRAPH (1999)
3.
Zurück zum Zitat Deng, W., Hu, J., Wu, Z., Guo, J.: Lighting-aware face frontalization for unconstrained face recognition. Pattern Recogn. 68, 260–271 (2017)CrossRef Deng, W., Hu, J., Wu, Z., Guo, J.: Lighting-aware face frontalization for unconstrained face recognition. Pattern Recogn. 68, 260–271 (2017)CrossRef
4.
Zurück zum Zitat Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. ACM Trans. Intell. Syst. Technol. (TIST) 7(3), 37 (2016) Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. ACM Trans. Intell. Syst. Technol. (TIST) 7(3), 37 (2016)
5.
Zurück zum Zitat Ding, L., Ding, X., Fang, C.: Continuous pose normalization for pose-robust face recognition. IEEE Sig. Process. Lett. 19(11), 721–724 (2012)CrossRef Ding, L., Ding, X., Fang, C.: Continuous pose normalization for pose-robust face recognition. IEEE Sig. Process. Lett. 19(11), 721–724 (2012)CrossRef
6.
Zurück zum Zitat Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4295–4304 (2015) Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4295–4304 (2015)
7.
Zurück zum Zitat Heo, J.: 3D generic elastic models for 2D pose synthesis and face recognition. Technical Report (2009) Heo, J.: 3D generic elastic models for 2D pose synthesis and face recognition. Technical Report (2009)
8.
Zurück zum Zitat Heo, J., Savvides, M.: 3-D generic elastic models for fast and texture preserving 2-D novel pose synthesis. Trans. Inf. Forensics Secur. 7(2), 563–576 (2012)CrossRef Heo, J., Savvides, M.: 3-D generic elastic models for fast and texture preserving 2-D novel pose synthesis. Trans. Inf. Forensics Secur. 7(2), 563–576 (2012)CrossRef
9.
Zurück zum Zitat Heo, J., Savvides, M.: Gender and ethnicity specific generic elastic models from a single 2D image for novel 2D pose face synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2341–2350 (2012)CrossRef Heo, J., Savvides, M.: Gender and ethnicity specific generic elastic models from a single 2D image for novel 2D pose face synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2341–2350 (2012)CrossRef
10.
Zurück zum Zitat Huang, G., Mattar, M., Lee, H., Learned-Miller, E.G.: Learning to align from scratch. In: NIPS, pp. 764–772 (2012) Huang, G., Mattar, M., Lee, H., Learned-Miller, E.G.: Learning to align from scratch. In: NIPS, pp. 764–772 (2012)
11.
Zurück zum Zitat Huang, G.B., Jain, V., Learned-Miller, E.: Unsupervised joint alignment of complex images. In: ICCV, pp. 1–8. IEEE (2007) Huang, G.B., Jain, V., Learned-Miller, E.: Unsupervised joint alignment of complex images. In: ICCV, pp. 1–8. IEEE (2007)
12.
Zurück zum Zitat Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical Report 07–49, University of Massachusetts, Amherst (2007) Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical Report 07–49, University of Massachusetts, Amherst (2007)
13.
Zurück zum Zitat Jacobson, A.: Algorithms and interfaces for real-time deformation of 2D and 3D shapes. Ph.D. Thesis, ETH Zurich (2013) Jacobson, A.: Algorithms and interfaces for real-time deformation of 2D and 3D shapes. Ph.D. Thesis, ETH Zurich (2013)
14.
Zurück zum Zitat Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recogn. 48(1), 73–85 (2015)CrossRef Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recogn. 48(1), 73–85 (2015)CrossRef
15.
Zurück zum Zitat Moeini, A., Moeini, H., Faez, K.: Pose-invariant facial expression recognition based on 3D face reconstruction and synthesis from a single 2D image. In: ICPR, pp. 1746–1751 (2014) Moeini, A., Moeini, H., Faez, K.: Pose-invariant facial expression recognition based on 3D face reconstruction and synthesis from a single 2D image. In: ICPR, pp. 1746–1751 (2014)
16.
Zurück zum Zitat Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: BMVC, vol. 1, p. 6 (2015) Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: BMVC, vol. 1, p. 6 (2015)
17.
Zurück zum Zitat Prabhu, U., Heo, J., Savvides, M.: Unconstrained pose-invariant face recognition using 3D generic elastic models. Trans. Pattern Anal. Mach. Intell. 33(10), 1952–1961 (2011)CrossRef Prabhu, U., Heo, J., Savvides, M.: Unconstrained pose-invariant face recognition using 3D generic elastic models. Trans. Pattern Anal. Mach. Intell. 33(10), 1952–1961 (2011)CrossRef
18.
Zurück zum Zitat Sagonas, C., Panagakis, Y., Zafeiriou, S., Pantic, M.: Robust statistical face frontalization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3871–3879 (2015) Sagonas, C., Panagakis, Y., Zafeiriou, S., Pantic, M.: Robust statistical face frontalization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3871–3879 (2015)
19.
Zurück zum Zitat Simonyan, K., Parkhi, O.M., Vedaldi, A., Zisserman, A.: Fisher vector faces in the wild. In: BMVC, vol. 2, p. 4 (2013) Simonyan, K., Parkhi, O.M., Vedaldi, A., Zisserman, A.: Fisher vector faces in the wild. In: BMVC, vol. 2, p. 4 (2013)
20.
Zurück zum Zitat Wolf, L., Hassner, T., Taigman, Y.: Effective unconstrained face recognition by combining multiple descriptors and learned background statistics. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1978–1990 (2011)CrossRef Wolf, L., Hassner, T., Taigman, Y.: Effective unconstrained face recognition by combining multiple descriptors and learned background statistics. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1978–1990 (2011)CrossRef
21.
Zurück zum Zitat Yin, X., Yu, X., Sohn, K., Liu, X., Chandraker, M.: Towards large-pose face frontalization in the wild. arXiv preprint arXiv:1704.06244 (2017) Yin, X., Yu, X., Sohn, K., Liu, X., Chandraker, M.: Towards large-pose face frontalization in the wild. arXiv preprint arXiv:​1704.​06244 (2017)
Metadaten
Titel
Efficient and Effective Face Frontalization for Face Recognition in the Wild
verfasst von
Nelson Méndez
Luis A. Bouza
Leonardo Chang
Heydi Méndez-Vázquez
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-75193-1_47

Premium Partner