Skip to main content
Erschienen in:
Buchtitelbild

2021 | OriginalPaper | Buchkapitel

Subject Identification Across Large Expression Variations Using 3D Facial Landmarks

verfasst von : SK Rahatul Jannat, Diego Fabiano, Shaun Canavan, Tempestt Neal

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work, we propose to use 3D facial landmarks for the task of subject identification, over a range of expressed emotion. Landmarks are detected, using a Temporal Deformable Shape Model and used to train a Support Vector Machine (SVM), Random Forest (RF), and Long Short-term Memory (LSTM) neural network for subject identification. As we are interested in subject identification with large variations in expression, we conducted experiments on 3 emotion-based databases, namely the BU-4DFE, BP4D, and BP4D+ 3D/4D face databases. We show that our proposed method outperforms current state of the art methods for subject identification on BU-4DFE and BP4D. To the best of our knowledge, this is the first work to investigate subject identification on the BP4D+, resulting in a baseline for the community.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Berretti, S., Del Bimbo, A., Pala, P.: 3D face recognition using isogeodesic stripes. IEEE Trans. PAMI 32(12), 2162–2177 (2010)CrossRef Berretti, S., Del Bimbo, A., Pala, P.: 3D face recognition using isogeodesic stripes. IEEE Trans. PAMI 32(12), 2162–2177 (2010)CrossRef
2.
Zurück zum Zitat Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. PAMI 32(12), 1063–1074 (2003)CrossRef Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. PAMI 32(12), 1063–1074 (2003)CrossRef
3.
Zurück zum Zitat Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+ 2D face recognition. CVIU 101(1), 1–15 (2006) Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+ 2D face recognition. CVIU 101(1), 1–15 (2006)
4.
5.
Zurück zum Zitat de Bruijne, M., et al.: Adapting active shape models for 3D segmentation of tubular structures in medical images. In: BICIPMI de Bruijne, M., et al.: Adapting active shape models for 3D segmentation of tubular structures in medical images. In: BICIPMI
6.
Zurück zum Zitat Canavan, S., Zhang, X., Yin, L.: Fitting and tracking 3D/4D facial data using a temporal deformable shape model. In: ICME (2013) Canavan, S., Zhang, X., Yin, L.: Fitting and tracking 3D/4D facial data using a temporal deformable shape model. In: ICME (2013)
7.
Zurück zum Zitat Canavan, S., et al.: Evaluation of multi-frame fusion based face classification under shadow. In: ICPR, pp. 1265–1268 (2010) Canavan, S., et al.: Evaluation of multi-frame fusion based face classification under shadow. In: ICPR, pp. 1265–1268 (2010)
8.
Zurück zum Zitat Canavan, S., et al.: Landmark local on 3D/4D range data using a shape index-based stat shape model with global and local constraints. CVIU 139, 136–148 (2015) Canavan, S., et al.: Landmark local on 3D/4D range data using a shape index-based stat shape model with global and local constraints. CVIU 139, 136–148 (2015)
9.
Zurück zum Zitat Cheng, S., et al.: 4DFAB: a large scale 4D database for facial expression analysis and biometric applications. In: CVPR, pp. 5117–5126 (2018) Cheng, S., et al.: 4DFAB: a large scale 4D database for facial expression analysis and biometric applications. In: CVPR, pp. 5117–5126 (2018)
10.
Zurück zum Zitat Daoudi, M., et al.: SHREC 2008-shape retrieval contest of 3D face scans (2008) Daoudi, M., et al.: SHREC 2008-shape retrieval contest of 3D face scans (2008)
11.
Zurück zum Zitat Echeagaray-Patron, B., Kober, V., Karnaukhov, V., Kuznetsov, V.: A method of face recognition using 3D facial surfaces. J. CTE 62(6), 648–652 (2017) Echeagaray-Patron, B., Kober, V., Karnaukhov, V., Kuznetsov, V.: A method of face recognition using 3D facial surfaces. J. CTE 62(6), 648–652 (2017)
12.
Zurück zum Zitat Emambakhsh, M., Evans, A.: Nasal patches and curves for expression-robust 3D face recognition. IEEE Trans. PAMI 39(5), 995–1007 (2016)CrossRef Emambakhsh, M., Evans, A.: Nasal patches and curves for expression-robust 3D face recognition. IEEE Trans. PAMI 39(5), 995–1007 (2016)CrossRef
13.
Zurück zum Zitat Hochreiter, S., Schmidhuber, J.: LSTM. Neural computation 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: LSTM. Neural computation 9(8), 1735–1780 (1997)CrossRef
14.
Zurück zum Zitat Huang, J., Heisele, B., Blanz, V.: Component-based face recognition with 3D morphable models. In: ICAVPA (2003) Huang, J., Heisele, B., Blanz, V.: Component-based face recognition with 3D morphable models. In: ICAVPA (2003)
15.
Zurück zum Zitat Kakadiaris, I., et al.: 3D face recognition. In: BMVC (2006) Kakadiaris, I., et al.: 3D face recognition. In: BMVC (2006)
16.
Zurück zum Zitat Kakadiaris, I., et al.: 3D face recognition in the presence of facial expression: an annotated deformable model approach. IEEE Trans. PAMI 29(4), 640–649 (2007)CrossRef Kakadiaris, I., et al.: 3D face recognition in the presence of facial expression: an annotated deformable model approach. IEEE Trans. PAMI 29(4), 640–649 (2007)CrossRef
17.
Zurück zum Zitat Kakadiaris, I.O.: Multimodal face recognition: combination of geometry with physiological information. In: CVPR, vol. 2, pp. 1022–1029 (2005) Kakadiaris, I.O.: Multimodal face recognition: combination of geometry with physiological information. In: CVPR, vol. 2, pp. 1022–1029 (2005)
18.
Zurück zum Zitat Kemelmacher-Shlizerman, I., et al.: In: CVPR, pp. 4873–4882 (2016) Kemelmacher-Shlizerman, I., et al.: In: CVPR, pp. 4873–4882 (2016)
19.
Zurück zum Zitat Fernandes, S.L., Bala, G.J.: 3D and 4D face recognition: a comprehensive review. Recent Pat. Eng. 8(2), 112–119 (2014)CrossRef Fernandes, S.L., Bala, G.J.: 3D and 4D face recognition: a comprehensive review. Recent Pat. Eng. 8(2), 112–119 (2014)CrossRef
20.
Zurück zum Zitat Lei, Y., et al.: An efficient 3D face recognition approach using local geometrical signatures. Pattern Recogn. 47(2), 509–524 (2014)CrossRef Lei, Y., et al.: An efficient 3D face recognition approach using local geometrical signatures. Pattern Recogn. 47(2), 509–524 (2014)CrossRef
21.
Zurück zum Zitat Liu, W., et al.: SphereFace: deep hypersphere embedding for face recognition. In: CVPR, pp. 212–220 (2017) Liu, W., et al.: SphereFace: deep hypersphere embedding for face recognition. In: CVPR, pp. 212–220 (2017)
22.
Zurück zum Zitat Parkhi, O., et al.: Deep face recognition. In: BMVC (2015) Parkhi, O., et al.: Deep face recognition. In: BMVC (2015)
23.
Zurück zum Zitat Phillips, P., et al.: Overview of the face recognition grand challenge. In: CVPR (2005) Phillips, P., et al.: Overview of the face recognition grand challenge. In: CVPR (2005)
24.
Zurück zum Zitat Saragih, J., Lucey, S., Cohn, J.: Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vis. 91(2), 200–215 (2011)MathSciNetCrossRef Saragih, J., Lucey, S., Cohn, J.: Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vis. 91(2), 200–215 (2011)MathSciNetCrossRef
25.
Zurück zum Zitat Singh, S., Prasad, S.: Techniques and challenges of face recognition: a critical review. Procedia Comput. Sci. 143, 536–543 (2018)CrossRef Singh, S., Prasad, S.: Techniques and challenges of face recognition: a critical review. Procedia Comput. Sci. 143, 536–543 (2018)CrossRef
26.
Zurück zum Zitat Soltanpour, S., Boufama, B., Wu, Q.J.: A survey of local feature methods for 3D face recognition. Pattern Recogn. 72, 391–406 (2017)CrossRef Soltanpour, S., Boufama, B., Wu, Q.J.: A survey of local feature methods for 3D face recognition. Pattern Recogn. 72, 391–406 (2017)CrossRef
27.
Zurück zum Zitat Sun, Y., Yin, L.: 3D spatio-temporal face recognition using dynamic range model sequences. In: CVPRW (2008) Sun, Y., Yin, L.: 3D spatio-temporal face recognition using dynamic range model sequences. In: CVPRW (2008)
28.
Zurück zum Zitat Sun, Y., et al.: Deep learning face representation by joint identification-verification. In: Advances in Neural Information Processing Systems, pp. 1988–1996 (2014) Sun, Y., et al.: Deep learning face representation by joint identification-verification. In: Advances in Neural Information Processing Systems, pp. 1988–1996 (2014)
29.
Zurück zum Zitat Tieleman, T., Hinton, G.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA 4(2), 26–31 (2012) Tieleman, T., Hinton, G.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA 4(2), 26–31 (2012)
30.
Zurück zum Zitat Tran, A.T., et al.: Regressing robust and discriminative 3D morphable models with a very deep neural network. In: CVPR, pp. 5163–5172 (2017) Tran, A.T., et al.: Regressing robust and discriminative 3D morphable models with a very deep neural network. In: CVPR, pp. 5163–5172 (2017)
31.
Zurück zum Zitat Turk, M., Pentland, A.: Face recognition using Eigenfaces. In: CVPR, pp. 586–591 (1991) Turk, M., Pentland, A.: Face recognition using Eigenfaces. In: CVPR, pp. 586–591 (1991)
32.
Zurück zum Zitat Vapnik, V.: The support vector method of function estimation. In: Nonlinear Modeling, pp. 55–85 (1998) Vapnik, V.: The support vector method of function estimation. In: Nonlinear Modeling, pp. 55–85 (1998)
33.
Zurück zum Zitat Wen, Y., et al.: A discriminative feature learning approach for deep face recognition. In: ECCV, pp. 499–515 (2016) Wen, Y., et al.: A discriminative feature learning approach for deep face recognition. In: ECCV, pp. 499–515 (2016)
34.
Zurück zum Zitat Yin, L., et al.: A high-red 3D dynamic facial expression database. In: FG (2008) Yin, L., et al.: A high-red 3D dynamic facial expression database. In: FG (2008)
35.
Zurück zum Zitat Zhang, L., et al.: Sparse representation or collaborative representation: which helps face recognition? In: ICCV, pp. 471–478 (2011) Zhang, L., et al.: Sparse representation or collaborative representation: which helps face recognition? In: ICCV, pp. 471–478 (2011)
36.
Zurück zum Zitat Zhang, X., et al.: BP4D-spontaneous: a high-resolution spontaneous 3D dynamic facial expression database. Image Vis. Comput. 32(10), 692–706 (2014)CrossRef Zhang, X., et al.: BP4D-spontaneous: a high-resolution spontaneous 3D dynamic facial expression database. Image Vis. Comput. 32(10), 692–706 (2014)CrossRef
37.
Zurück zum Zitat Zhao, W., et al.: Discriminant analysis of principal components for face recognition. In: Face Recognition, pp. 73–85 (1998) Zhao, W., et al.: Discriminant analysis of principal components for face recognition. In: Face Recognition, pp. 73–85 (1998)
38.
Zurück zum Zitat Zhao, W., et al.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)CrossRef Zhao, W., et al.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)CrossRef
39.
Zurück zum Zitat Zheng, Z., et al.: Multimodal spontaneous emotion corpus for human behavior analysis. In: CVPR (2016) Zheng, Z., et al.: Multimodal spontaneous emotion corpus for human behavior analysis. In: CVPR (2016)
40.
Zurück zum Zitat Zhong, C., et al.: Robust 3D face recognition using learned visual codebook. In: CVPR (2007) Zhong, C., et al.: Robust 3D face recognition using learned visual codebook. In: CVPR (2007)
41.
Zurück zum Zitat Zhu, X., et al.: High-fidelity pose and expression normalization for face recognition in the wild. In: CVPR, pp. 787–796 (2015) Zhu, X., et al.: High-fidelity pose and expression normalization for face recognition in the wild. In: CVPR, pp. 787–796 (2015)
Metadaten
Titel
Subject Identification Across Large Expression Variations Using 3D Facial Landmarks
verfasst von
SK Rahatul Jannat
Diego Fabiano
Shaun Canavan
Tempestt Neal
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68763-2_1