Skip to main content

2020 | OriginalPaper | Buchkapitel

Analysing Facial Features Using CNNs and Computer Vision

verfasst von : Diana Borza, Razvan Itu, Radu Danescu, Ioana Barbantan

Erschienen in: Modelling and Development of Intelligent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents an automatic facial analysis system which is able to perform gender detection, hair segmentation and geometry detection, color attributes extraction (hair, skin, eyebrows, eyes and lips), accessories (eyeglasses) analysis from facial images. For the more complex tasks (gender detection, hair segmentation, eyeglasses detection) we used state of the art convolutional neural networks, and for the other tasks we used classical image processing algorithms based on geometry and appearance models. When data was available, the proposed system was evaluated on public datasets. An acceptance study was also performed to assess the performance on the system in real life scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Borza, D., Itu, R., Danescu, R.: In the eye of the deceiver: analyzing eye movements as a cue to deception. J. Imaging 4(10), 120 (2018)CrossRef Borza, D., Itu, R., Danescu, R.: In the eye of the deceiver: analyzing eye movements as a cue to deception. J. Imaging 4(10), 120 (2018)CrossRef
2.
Zurück zum Zitat Dantcheva, A., Erdogmus, N., Dugelay, J.L.: On the reliability of eye color classification as a soft biometrics trait. In: Proceedings of WACV (2011, to appear) Dantcheva, A., Erdogmus, N., Dugelay, J.L.: On the reliability of eye color classification as a soft biometrics trait. In: Proceedings of WACV (2011, to appear)
3.
Zurück zum Zitat Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unfiltered faces. IEEE Trans. Inf. Forensics Secur. 9(12), 2170–2179 (2014)CrossRef Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unfiltered faces. IEEE Trans. Inf. Forensics Secur. 9(12), 2170–2179 (2014)CrossRef
4.
Zurück zum Zitat Everingham, M., Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The Pascal visual object classes (VOC) challenge. Int. J. Comput. Vision 88(2), 303–338 (2010)CrossRef Everingham, M., Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The Pascal visual object classes (VOC) challenge. Int. J. Comput. Vision 88(2), 303–338 (2010)CrossRef
5.
Zurück zum Zitat Hansen, D.W., Ji, Q.: In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 478–500 (2010)CrossRef Hansen, D.W., Ji, Q.: In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 478–500 (2010)CrossRef
6.
Zurück zum Zitat Harville, M., Baker, H., Bhatti, N., Susstrunk, S.: Consistent image-based measurement and classification of skin color. In: IEEE International Conference on Image Processing 2005, vol. 2, pp. II–374. IEEE (2005) Harville, M., Baker, H., Bhatti, N., Susstrunk, S.: Consistent image-based measurement and classification of skin color. In: IEEE International Conference on Image Processing 2005, vol. 2, pp. II–374. IEEE (2005)
7.
Zurück zum Zitat Hollingsworth, K.P., Bowyer, K.W., Flynn, P.J.: The importance of small pupils: a study of how pupil dilation affects iris biometrics. In: 2008 IEEE Conference on Biometrics: Theory, Applications and Systems. pp. 1–6. IEEE (2008) Hollingsworth, K.P., Bowyer, K.W., Flynn, P.J.: The importance of small pupils: a study of how pupil dilation affects iris biometrics. In: 2008 IEEE Conference on Biometrics: Theory, Applications and Systems. pp. 1–6. IEEE (2008)
8.
Zurück zum Zitat Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017) Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861 (2017)
9.
Zurück zum Zitat Jmal, M., Mseddi, W.S., Attia, R., Youssef, A.: Classification of human skin color and its application to face recognition. In: The Sixth International Conferences on Advances in Multimedia, MMEDIA. Citeseer (2014) Jmal, M., Mseddi, W.S., Attia, R., Youssef, A.: Classification of human skin color and its application to face recognition. In: The Sixth International Conferences on Advances in Multimedia, MMEDIA. Citeseer (2014)
10.
Zurück zum Zitat Kae, A., Sohn, K., Lee, H., Learned-Miller, E.: Augmenting CRFs with Boltzmann machine shape priors for image labeling (2013) Kae, A., Sohn, K., Lee, H., Learned-Miller, E.: Augmenting CRFs with Boltzmann machine shape priors for image labeling (2013)
11.
Zurück zum Zitat Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1867–1874 (2014) Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1867–1874 (2014)
12.
Zurück zum Zitat King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009) King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009)
13.
Zurück zum Zitat Liu, Z., Luo, P., Wang, X., Tang, X.: Large-scale CelebFaces attributes (CelebA) dataset (2018). Accessed 15 Aug 2018 Liu, Z., Luo, P., Wang, X., Tang, X.: Large-scale CelebFaces attributes (CelebA) dataset (2018). Accessed 15 Aug 2018
14.
Zurück zum Zitat Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
15.
Zurück zum Zitat Ma, D.S., Correll, J., Wittenbrink, B.: The Chicago face database: a free stimulus set of faces and norming data. Behav. Res. Methods 47(4), 1122–1135 (2015)CrossRef Ma, D.S., Correll, J., Wittenbrink, B.: The Chicago face database: a free stimulus set of faces and norming data. Behav. Res. Methods 47(4), 1122–1135 (2015)CrossRef
16.
Zurück zum Zitat Muhammad, U.R., Svanera, M., Leonardi, R., Benini, S.: Hair detection, segmentation, and hairstyle classification in the wild. Image Vis. Comput. 71, 25–37 (2018)CrossRef Muhammad, U.R., Svanera, M., Leonardi, R., Benini, S.: Hair detection, segmentation, and hairstyle classification in the wild. Image Vis. Comput. 71, 25–37 (2018)CrossRef
17.
Zurück zum Zitat Rousset, C., Coulon, P.Y.: Frequential and color analysis for hair mask segmentation. In: 15th IEEE International Conference on Image Processing, ICIP 2008, pp. 2276–2279. IEEE (2008) Rousset, C., Coulon, P.Y.: Frequential and color analysis for hair mask segmentation. In: 15th IEEE International Conference on Image Processing, ICIP 2008, pp. 2276–2279. IEEE (2008)
18.
Zurück zum Zitat Shen, Y., Peng, Z., Zhang, Y.: Image based hair segmentation algorithm for the application of automatic facial caricature synthesis. Sci. World J. 2014 (2014) Shen, Y., Peng, Z., Zhang, Y.: Image based hair segmentation algorithm for the application of automatic facial caricature synthesis. Sci. World J. 2014 (2014)
19.
Zurück zum Zitat Yacoob, Y., Davis, L.: Detection, analysis and matching of hair. In: Tenth IEEE International Conference on Computer Vision, ICCV 2005, vol. 1, pp. 741–748. IEEE (2005) Yacoob, Y., Davis, L.: Detection, analysis and matching of hair. In: Tenth IEEE International Conference on Computer Vision, ICCV 2005, vol. 1, pp. 741–748. IEEE (2005)
20.
Zurück zum Zitat Yoon, S., Harville, M., Baker, H., Bhatii, N.: Automatic skin pixel selection and skin color classification. In: 2006 International Conference on Image Processing, pp. 941–944. IEEE (2006) Yoon, S., Harville, M., Baker, H., Bhatii, N.: Automatic skin pixel selection and skin color classification. In: 2006 International Conference on Image Processing, pp. 941–944. IEEE (2006)
Metadaten
Titel
Analysing Facial Features Using CNNs and Computer Vision
verfasst von
Diana Borza
Razvan Itu
Radu Danescu
Ioana Barbantan
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-39237-6_10