Skip to main content

2015 | OriginalPaper | Buchkapitel

An Automatic Landmark Localization Method for 2D and 3D Face

verfasst von : Junquan Liu, Feipeng Da, Xing Deng, Yi Yu, Pu Zhang

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose an automatically and accurately facial landmark localization algorithm based on Active Shape Model (ASM) and Gabor Wavelets Transformation (GWT), which can be applied to both 2D and 3D facial data. First, ASM is implemented to acquire landmarks’ coarse areas. Then similarity maps are obtained by calculating the similarity between sets of Gabor jets at initial coarse positions and sets of Gabor bunches modeled by its corresponding manually marked landmarks in the training set. The point with the maximum value in each similarity map is extracted as its final facial landmark location. It is showed in our laboratory databases and FRGC v2.0 that the algorithm could achieve accurate localization of facial landmarks with state-of-the-art accuracy and robustness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cootes, T.F., Taylor, C.J., Hill, A., Halsam, J.: The use of active shape models for locating structures in media images. Image Vis. Comput. 12(6), 355–366 (1994)CrossRef Cootes, T.F., Taylor, C.J., Hill, A., Halsam, J.: The use of active shape models for locating structures in media images. Image Vis. Comput. 12(6), 355–366 (1994)CrossRef
2.
Zurück zum Zitat Cootes, T.F., Edwards, G., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)CrossRef Cootes, T.F., Edwards, G., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)CrossRef
3.
Zurück zum Zitat Cootes, T.F., Taylor, C.J.: Active shape models-smartsnakes. In: Proceedings of British Machine Vision Conference, Leeds, pp. 266–275. BMVC, UK (1992) Cootes, T.F., Taylor, C.J.: Active shape models-smartsnakes. In: Proceedings of British Machine Vision Conference, Leeds, pp. 266–275. BMVC, UK (1992)
4.
Zurück zum Zitat Clark, M., Bovik, A., Geisler, W.: Texture segmentation using Gabor modulation/demodulation. Pattern Recognit. Lett. 6(4), 261–267 (1987)CrossRef Clark, M., Bovik, A., Geisler, W.: Texture segmentation using Gabor modulation/demodulation. Pattern Recognit. Lett. 6(4), 261–267 (1987)CrossRef
5.
Zurück zum Zitat Cristinacce, T., Cootes, D.: A comparison of shape constrained facial feature detectors. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004, pp. 375–380 May 17–19 (2004) Cristinacce, T., Cootes, D.: A comparison of shape constrained facial feature detectors. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004, pp. 375–380 May 17–19 (2004)
6.
Zurück zum Zitat Zhao, X., Dellandréa, E., Chen, L.: A 3D statistical facial feature model and its application on locating facial landmarks. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2009. LNCS, vol. 5807, pp. 686–697. Springer, Heidelberg (2009)CrossRef Zhao, X., Dellandréa, E., Chen, L.: A 3D statistical facial feature model and its application on locating facial landmarks. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2009. LNCS, vol. 5807, pp. 686–697. Springer, Heidelberg (2009)CrossRef
7.
Zurück zum Zitat Berretti, S., Amor, B.B., Daoudi, M., et al.: 3D facial expression recognition using SIFT descriptor so automatically detected keypoints. Visual Comput. 27(11), 1021–1036 (2011)CrossRef Berretti, S., Amor, B.B., Daoudi, M., et al.: 3D facial expression recognition using SIFT descriptor so automatically detected keypoints. Visual Comput. 27(11), 1021–1036 (2011)CrossRef
8.
Zurück zum Zitat Ancuti, C.O., Ancuti, C.: Single image dehazing by multi-scale fusion. IEEE Trans. Image Process. 22(8), 3271–3282 (2013)CrossRef Ancuti, C.O., Ancuti, C.: Single image dehazing by multi-scale fusion. IEEE Trans. Image Process. 22(8), 3271–3282 (2013)CrossRef
9.
Zurück zum Zitat Jahanbin, S., Choi, H., Bovik, A.C.: Passive multimodal 2-D + 3-D face recognition using Gabor features and landmark distances. IEEE Trans. Inf. Forensics Secur. 6(4), 1287–1304 (2011)CrossRef Jahanbin, S., Choi, H., Bovik, A.C.: Passive multimodal 2-D + 3-D face recognition using Gabor features and landmark distances. IEEE Trans. Inf. Forensics Secur. 6(4), 1287–1304 (2011)CrossRef
10.
Zurück zum Zitat Daugman, J.G.: Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J. Opt. Soc. Am. B 2(7), 1160–1169 (1985)CrossRef Daugman, J.G.: Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J. Opt. Soc. Am. B 2(7), 1160–1169 (1985)CrossRef
11.
Zurück zum Zitat Hj Wan Yussof, W.N.J., Hitam, M.S.: Invariant gabor-based interest points detector under geometric transformation. Digt. Sig. Proc. 25(10), 190–197 (2014)CrossRef Hj Wan Yussof, W.N.J., Hitam, M.S.: Invariant gabor-based interest points detector under geometric transformation. Digt. Sig. Proc. 25(10), 190–197 (2014)CrossRef
12.
Zurück zum Zitat Wiskott, L., Fellous, J.M., Kuiger, N., der Malsburg von, C.: Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 775–779 (1997)CrossRef Wiskott, L., Fellous, J.M., Kuiger, N., der Malsburg von, C.: Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 775–779 (1997)CrossRef
13.
Zurück zum Zitat Jahanbin, S., Jahanbin, R., Bovik, A.C.: Passive three dimensional face recognition using iso-geodesic contours and procrustes analysis. Int. J. Comput. Vis. 105(1), 87–108 (2013)CrossRef Jahanbin, S., Jahanbin, R., Bovik, A.C.: Passive three dimensional face recognition using iso-geodesic contours and procrustes analysis. Int. J. Comput. Vis. 105(1), 87–108 (2013)CrossRef
14.
Zurück zum Zitat Phillips, P.J., Flynn, P.J., Scruggs, T. et al.: Overview of the face recognition grand challenge. In: Computer Vision and Pattern Recognition CVPR, 2005, pp. 947–954. San Diego, CA, USA (2005) Phillips, P.J., Flynn, P.J., Scruggs, T. et al.: Overview of the face recognition grand challenge. In: Computer Vision and Pattern Recognition CVPR, 2005, pp. 947–954. San Diego, CA, USA (2005)
15.
Zurück zum Zitat Cristinacce. T., Cootes, D.A.: Comparison of shape constrained facial feature detectors. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 375–380. Los Alamitos, CA, USA (2004) Cristinacce. T., Cootes, D.A.: Comparison of shape constrained facial feature detectors. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 375–380. Los Alamitos, CA, USA (2004)
16.
Zurück zum Zitat Perakis, P., Passalis, G., Theoharis, T., et al.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1552–1564 (2013)CrossRef Perakis, P., Passalis, G., Theoharis, T., et al.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1552–1564 (2013)CrossRef
17.
Zurück zum Zitat Lei, Y., Bennamoun, M., Hayat, M., et al.: An efficient 3D face recognition approach using local geometrical signatures. Pattern Recognit. 47(2), 509–524 (2014)CrossRef Lei, Y., Bennamoun, M., Hayat, M., et al.: An efficient 3D face recognition approach using local geometrical signatures. Pattern Recognit. 47(2), 509–524 (2014)CrossRef
18.
Zurück zum Zitat Creusot, C., Pears, N., Austin, J.: A machine-learning approach to keypoint detection and landmarking on 3D meshes. Int. J. Comput. Vis. 102(1–3), 146–179 (2013)CrossRef Creusot, C., Pears, N., Austin, J.: A machine-learning approach to keypoint detection and landmarking on 3D meshes. Int. J. Comput. Vis. 102(1–3), 146–179 (2013)CrossRef
Metadaten
Titel
An Automatic Landmark Localization Method for 2D and 3D Face
verfasst von
Junquan Liu
Feipeng Da
Xing Deng
Yi Yu
Pu Zhang
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21978-3_47

Premium Partner