Skip to main content

2019 | OriginalPaper | Buchkapitel

Efficient 3D Face Recognition in Uncontrolled Environment

verfasst von : Yuqi Ding, Nianyi Li, S. Susan Young, Jinwei Ye

Erschienen in: Advances in Visual Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face recognition in an uncontrolled environment is challenging as body movement and pose variation can result in missing facial features. In this paper, we tackle this problem by fusing multiple RGB-D images with varying poses. In particular, we develop an efficient pose fusion algorithm that frontalizes the faces and combines the multiple inputs. We then introduce a new 3D registration method based on the unified coordinate system (UCS) to compensate for pose and scale variations and normalize the probe and gallery face. To perform 3D face recognition, we train a Support Vector Machine (SVM) with both 2D color and 3D geometric features. Experimental results on a RGB-D dataset show that our method can achieve a high recognition rate and is robust in the presence of pose and expression variations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abate, A.F., Nappi, M., Riccio, D., Sabatino, G.: 2D and 3D face recognition: a survey. Pattern Recogn. Lett. 28(14), 1885–1906 (2007)CrossRef Abate, A.F., Nappi, M., Riccio, D., Sabatino, G.: 2D and 3D face recognition: a survey. Pattern Recogn. Lett. 28(14), 1885–1906 (2007)CrossRef
2.
Zurück zum Zitat Aldrian, O., Smith, W.A.P.: Inverse rendering of faces with a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1080–1093 (2013)CrossRef Aldrian, O., Smith, W.A.P.: Inverse rendering of faces with a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1080–1093 (2013)CrossRef
3.
Zurück zum Zitat Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239–256 (1992)CrossRef Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239–256 (1992)CrossRef
4.
Zurück zum Zitat Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Conference on Computer Graphics and Interactive Techniques. ACM Press (1999) Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Conference on Computer Graphics and Interactive Techniques. ACM Press (1999)
5.
Zurück zum Zitat Corneanu, C.A., et al.: Survey on RGB, 3D, thermal, and multimodal approaches for facial expression recognition: history, trends, and affect-related applications. IEEE Trans. Pattern Anal. Mach. Intell. 38(8), 1548–1568 (2016)CrossRef Corneanu, C.A., et al.: Survey on RGB, 3D, thermal, and multimodal approaches for facial expression recognition: history, trends, and affect-related applications. IEEE Trans. Pattern Anal. Mach. Intell. 38(8), 1548–1568 (2016)CrossRef
6.
Zurück zum Zitat Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. ACM Trans. Intell. Syst. Technol. (TIST) 7(3), 37 (2016) Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. ACM Trans. Intell. Syst. Technol. (TIST) 7(3), 37 (2016)
7.
Zurück zum Zitat Emambakhsh, M., Evans, A.: Nasal patches and curves for expression-robust 3D face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(5), 995–1007 (2017)CrossRef Emambakhsh, M., Evans, A.: Nasal patches and curves for expression-robust 3D face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(5), 995–1007 (2017)CrossRef
8.
Zurück zum Zitat Gilani, S.Z., Mian, A., Shafait, F., Reid, I.: Dense 3D face correspondence. IEEE Trans. Pattern Anal. Mach. Intell. 40(7), 1584–1598 (2017)CrossRef Gilani, S.Z., Mian, A., Shafait, F., Reid, I.: Dense 3D face correspondence. IEEE Trans. Pattern Anal. Mach. Intell. 40(7), 1584–1598 (2017)CrossRef
9.
Zurück zum Zitat Gökberk, B., et al.: 3D shape-based face representation and feature extraction for face recognition. Image Vis. Comput. 24(8), 857–869 (2006)CrossRef Gökberk, B., et al.: 3D shape-based face representation and feature extraction for face recognition. Image Vis. Comput. 24(8), 857–869 (2006)CrossRef
10.
Zurück zum Zitat Gupta, S., Markey, M.K., Bovik, A.C.: Anthropometric 3D face recognition. Int. J. Comput. Vis. 90(3), 331–349 (2010)CrossRef Gupta, S., Markey, M.K., Bovik, A.C.: Anthropometric 3D face recognition. Int. J. Comput. Vis. 90(3), 331–349 (2010)CrossRef
11.
Zurück zum Zitat Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: IEEE Conference on CVPR (2015) Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: IEEE Conference on CVPR (2015)
12.
Zurück zum Zitat Kakadiaris, I.A., et al.: Three-dimensional Face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 640–649 (2007)CrossRef Kakadiaris, I.A., et al.: Three-dimensional Face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 640–649 (2007)CrossRef
13.
Zurück zum Zitat Kan, M., Shan, S., Chen, X.: Multi-view deep network for cross-view classification. In: IEEE Conference on CVPR, pp. 4847–4855 (2016) Kan, M., Shan, S., Chen, X.: Multi-view deep network for cross-view classification. In: IEEE Conference on CVPR, pp. 4847–4855 (2016)
14.
Zurück zum Zitat Kim, D., Hernandez, M., Choi, J., Medioni, G.: Deep 3D face identification. In: IEEE International Joint Conference on Biometrics (IJCB) (2017) Kim, D., Hernandez, M., Choi, J., Medioni, G.: Deep 3D face identification. In: IEEE International Joint Conference on Biometrics (IJCB) (2017)
15.
Zurück zum Zitat Kimmel, R., Sethian, J.A.: Computing geodesic paths on manifolds. Proc. Nat. Acad. Sci. 95(15), 8431–8435 (1998)MathSciNetCrossRef Kimmel, R., Sethian, J.A.: Computing geodesic paths on manifolds. Proc. Nat. Acad. Sci. 95(15), 8431–8435 (1998)MathSciNetCrossRef
16.
Zurück zum Zitat Li, B.Y.L., et al.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: IEEE Workshop on Applications of Computer Vision (WACV), pp. 186–192 (2013) Li, B.Y.L., et al.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: IEEE Workshop on Applications of Computer Vision (WACV), pp. 186–192 (2013)
17.
Zurück zum Zitat Li, X., Zhang, H.: Adapting geometric attributes for expression-invariant 3D face recognition. In: IEEE Conference on Shape Modeling and Applications (2007) Li, X., Zhang, H.: Adapting geometric attributes for expression-invariant 3D face recognition. In: IEEE Conference on Shape Modeling and Applications (2007)
18.
Zurück zum Zitat Mian, A.S., Bennamoun, M., Owens, R.: Keypoint detection and local feature matching for textured 3D face recognition. Int. J. Comput. Vis. 79(1), 1–12 (2008)CrossRef Mian, A.S., Bennamoun, M., Owens, R.: Keypoint detection and local feature matching for textured 3D face recognition. Int. J. Comput. Vis. 79(1), 1–12 (2008)CrossRef
19.
Zurück zum Zitat Parkhi, O.M., Vedaldi, A., Zisserman, A., et al.: Deep face recognition. In: British Machine Vision Conference, vol. 1, p. 6 (2015) Parkhi, O.M., Vedaldi, A., Zisserman, A., et al.: Deep face recognition. In: British Machine Vision Conference, vol. 1, p. 6 (2015)
20.
Zurück zum Zitat Passalis, G., et al.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1938–1951 (2011)CrossRef Passalis, G., et al.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1938–1951 (2011)CrossRef
21.
Zurück zum Zitat Patil, H., Kothari, A., Bhurchandi, K.: 3-D face recognition: features, databases, algorithms and challenges. Artif. Intell. Rev. 44(3), 393–441 (2015)CrossRef Patil, H., Kothari, A., Bhurchandi, K.: 3-D face recognition: features, databases, algorithms and challenges. Artif. Intell. Rev. 44(3), 393–441 (2015)CrossRef
22.
Zurück zum Zitat Phillips, P.J., et al.: Overview of the face recognition grand challenge. In: IEEE Conference on CVPR, vol. 1, pp. 947–954 (2005) Phillips, P.J., et al.: Overview of the face recognition grand challenge. In: IEEE Conference on CVPR, vol. 1, pp. 947–954 (2005)
23.
Zurück zum Zitat Queirolo, C.C., Silva, L., Bellon, O.R., Segundo, M.P.: 3D face recognition using simulated annealing and the surface interpenetration measure. IEEE Trans. Pattern Anal. Mach. Intell. 32(2), 206–219 (2009)CrossRef Queirolo, C.C., Silva, L., Bellon, O.R., Segundo, M.P.: 3D face recognition using simulated annealing and the surface interpenetration measure. IEEE Trans. Pattern Anal. Mach. Intell. 32(2), 206–219 (2009)CrossRef
24.
Zurück zum Zitat Ranjan, R., et al.: Deep learning for understanding faces: machines may be just as good, or better, than humans. IEEE Signal Process. Mag. 35(1), 66–83 (2018)MathSciNetCrossRef Ranjan, R., et al.: Deep learning for understanding faces: machines may be just as good, or better, than humans. IEEE Signal Process. Mag. 35(1), 66–83 (2018)MathSciNetCrossRef
25.
Zurück zum Zitat Sang, G., Li, J., Zhao, Q.: Pose-invariant face recognition via RGB-D images. Comput. Intell. Neurosci. 2016, 13 (2016)CrossRef Sang, G., Li, J., Zhao, Q.: Pose-invariant face recognition via RGB-D images. Comput. Intell. Neurosci. 2016, 13 (2016)CrossRef
26.
Zurück zum Zitat Sariyanidi, E., Gunes, H., Cavallaro, A.: Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1113–1133 (2015)CrossRef Sariyanidi, E., Gunes, H., Cavallaro, A.: Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1113–1133 (2015)CrossRef
27.
Zurück zum Zitat Soltanpour, S., Boufama, B., Wu, Q.J.: A survey of local feature methods for 3D face recognition. Pattern Recogn. 72, 391–406 (2017)CrossRef Soltanpour, S., Boufama, B., Wu, Q.J.: A survey of local feature methods for 3D face recognition. Pattern Recogn. 72, 391–406 (2017)CrossRef
28.
Zurück zum Zitat Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: DeepFace: closing the gap to human-level performance in face verification. In: IEEE Conference on CVPR, pp. 1701–1708 (2014) Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: DeepFace: closing the gap to human-level performance in face verification. In: IEEE Conference on CVPR, pp. 1701–1708 (2014)
29.
Zurück zum Zitat Tang, X., Chen, J., Moon, Y.S.: Accurate 3D face registration based on the symmetry plane analysis on nose regions. In: European Signal Processing Conference, pp. 1–5 (2008) Tang, X., Chen, J., Moon, Y.S.: Accurate 3D face registration based on the symmetry plane analysis on nose regions. In: European Signal Processing Conference, pp. 1–5 (2008)
31.
Zurück zum Zitat Wang, N., Gao, X., Tao, D., Yang, H., Li, X.: Facial feature point detection: a comprehensive survey. Neurocomputing 275, 50–65 (2018)CrossRef Wang, N., Gao, X., Tao, D., Yang, H., Li, X.: Facial feature point detection: a comprehensive survey. Neurocomputing 275, 50–65 (2018)CrossRef
32.
Zurück zum Zitat Yi, D., Lei, Z., Li, S.Z.: Towards pose robust face recognition. In: IEEE Conference on CVPR (2013) Yi, D., Lei, Z., Li, S.Z.: Towards pose robust face recognition. In: IEEE Conference on CVPR (2013)
33.
Zurück zum Zitat Yu, Y., Mora, K.A.F., Odobez, J.: HeadFusion: 360\({^\circ }\) head pose tracking combining 3D morphable model and 3D reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 40(11), 2653–2667 (2018)CrossRef Yu, Y., Mora, K.A.F., Odobez, J.: HeadFusion: 360\({^\circ }\) head pose tracking combining 3D morphable model and 3D reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 40(11), 2653–2667 (2018)CrossRef
34.
Zurück zum Zitat Zafeiriou, S., Zhang, C., Zhang, Z.: A survey on face detection in the wild: past, present and future. Comput. Vis. Image Underst. 138, 1–24 (2015)CrossRef Zafeiriou, S., Zhang, C., Zhang, Z.: A survey on face detection in the wild: past, present and future. Comput. Vis. Image Underst. 138, 1–24 (2015)CrossRef
35.
Zurück zum Zitat Zhu, X., Lei, Z., Yan, J., Yi, D., Li, S.Z.: High-fidelity pose and expression normalization for face recognition in the wild. In: IEEE Conference on CVPR, pp. 787–796 (2015) Zhu, X., Lei, Z., Yan, J., Yi, D., Li, S.Z.: High-fidelity pose and expression normalization for face recognition in the wild. In: IEEE Conference on CVPR, pp. 787–796 (2015)
36.
Zurück zum Zitat Zulqarnain Gilani, S., Mian, A.: Learning from millions of 3D scans for large-scale 3D face recognition. In: IEEE Conference on CVPR, pp. 1896–1905 (2018) Zulqarnain Gilani, S., Mian, A.: Learning from millions of 3D scans for large-scale 3D face recognition. In: IEEE Conference on CVPR, pp. 1896–1905 (2018)
Metadaten
Titel
Efficient 3D Face Recognition in Uncontrolled Environment
verfasst von
Yuqi Ding
Nianyi Li
S. Susan Young
Jinwei Ye
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-33720-9_33

Premium Partner