Skip to main content
Top
Published in: International Journal of Multimedia Information Retrieval 3/2019

09-07-2019 | Regular Paper

Hybrid descriptors and Weighted PCA-EFMNet for Face Verification in the Wild

Authors: Bilel Ameur, Mebarka Belahcene, Sabeur Masmoudi, Ahmed Ben Hamida

Published in: International Journal of Multimedia Information Retrieval | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Unconstrained face recognition is a complex task because of the numerous intra-class changes caused by lighting, occlusion, facial expressions and poses changes. Such variations affect considerably the performance of facial recognition systems, particularly those based on 2D information. In this research work, an efficient feature extraction method, called Gabor Local Binarized Statistical Image Features, is introduced. A new deep learning network is also developed to extract features relying on data processing components: (1) Cascaded Weighted Principal Component Analysis (WPCA) with Enhanced Fisher Model (WPCA-EFM); (2) binary hashing; and (3) Block-wise Histograms. The suggested architecture (Weighted PCA-EFM) is employed to learn multistage filter banks. Simple block histogram and binary hashing are applied for indexing and pooling, which facilitate the design and learning of our architecture for Face Verification in the Wild. Classification is finally performed using distance measure Cosine and support vector machine. Our experiments are carried out in real-world dataset: Labeled Faces in the Wild. Experimental findings demonstrate that the developed technique achieved high accuracy of 95%.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cordea M, Ionescu B, Gadea C, Ionescu D (2019) DynFace: a multi-label, dynamic-margin-softmax face recognition model. In: Science and information conference. Springer, pp 535–550 Cordea M, Ionescu B, Gadea C, Ionescu D (2019) DynFace: a multi-label, dynamic-margin-softmax face recognition model. In: Science and information conference. Springer, pp 535–550
3.
go back to reference Yadav SK, Singh DP, Choudhary J (2018) A survey: comparative analysis of different variants of local binary pattern. In: Second international conference on inventive communication and computational technologies (ICICCT). IEEE, pp 1878–1887 Yadav SK, Singh DP, Choudhary J (2018) A survey: comparative analysis of different variants of local binary pattern. In: Second international conference on inventive communication and computational technologies (ICICCT). IEEE, pp 1878–1887
4.
go back to reference Ning C, Liu W, Wang X (2018) Infrared object recognition based on monogenic features and multiple kernel learning. In: IEEE 3rd international conference on image, vision and computing (ICIVC). IEEE, pp 204–208 Ning C, Liu W, Wang X (2018) Infrared object recognition based on monogenic features and multiple kernel learning. In: IEEE 3rd international conference on image, vision and computing (ICIVC). IEEE, pp 204–208
5.
go back to reference Ouamane A, Bengherabi M, Hadid A, Cheriet M (2015) Side-information based exponential discriminant analysis for face verification in the wild. In: 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–6 Ouamane A, Bengherabi M, Hadid A, Cheriet M (2015) Side-information based exponential discriminant analysis for face verification in the wild. In: 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–6
6.
go back to reference Ameur B, Masmoudi S, Derbel AG, Hamida AB (2016) Fusing gabor and LBP feature sets for KNN and SRC-based face recognition. In: 2nd international conference on advanced technologies for signal and image Processing (ATSIP). IEEE, pp 453–458 Ameur B, Masmoudi S, Derbel AG, Hamida AB (2016) Fusing gabor and LBP feature sets for KNN and SRC-based face recognition. In: 2nd international conference on advanced technologies for signal and image Processing (ATSIP). IEEE, pp 453–458
7.
go back to reference Ameur B, Belahcene M, Masmoudi S, Derbel AG, Hamida AB (2017) A new GLBSIF descriptor for face recognition in the uncontrolled environments. In: International conference on advanced technologies for signal and image processing (ATSIP). IEEE, pp 1–6 Ameur B, Belahcene M, Masmoudi S, Derbel AG, Hamida AB (2017) A new GLBSIF descriptor for face recognition in the uncontrolled environments. In: International conference on advanced technologies for signal and image processing (ATSIP). IEEE, pp 1–6
9.
go back to reference Zhai Y, He D (2019) Video-based face recognition based on deep convolutional neural network. In: Proceedings of the international conference on image, video and signal processing. ACM, pp 23–27 Zhai Y, He D (2019) Video-based face recognition based on deep convolutional neural network. In: Proceedings of the international conference on image, video and signal processing. ACM, pp 23–27
11.
go back to reference Arefin MMN (2019) Face reconstruction using non-negative matrix factorization and ℓ1 constrained optimization. In: International conference on robotics, electrical and signal processing techniques (ICREST). IEEE, pp 389–394 Arefin MMN (2019) Face reconstruction using non-negative matrix factorization and ℓ1 constrained optimization. In: International conference on robotics, electrical and signal processing techniques (ICREST). IEEE, pp 389–394
13.
go back to reference Dang L, Hassan S, Im S, Lee J, Lee S, Moon H (2018) Deep learning based computer generated face identification using convolutional neural network. Appl Sci 8(12):2610CrossRef Dang L, Hassan S, Im S, Lee J, Lee S, Moon H (2018) Deep learning based computer generated face identification using convolutional neural network. Appl Sci 8(12):2610CrossRef
14.
go back to reference Chauhan NK, Singh K (2018) A review on conventional machine learning vs deep learning. In: International conference on computing, power and communication technologies (GUCON). IEEE, pp 347–352 Chauhan NK, Singh K (2018) A review on conventional machine learning vs deep learning. In: International conference on computing, power and communication technologies (GUCON). IEEE, pp 347–352
15.
go back to reference Anderson R, Gema AP, Isa SM (2018) Facial attractiveness classification using deep learning. In: Indonesian association for pattern recognition international conference (INAPR). IEEE, pp 34–38 Anderson R, Gema AP, Isa SM (2018) Facial attractiveness classification using deep learning. In: Indonesian association for pattern recognition international conference (INAPR). IEEE, pp 34–38
16.
go back to reference Sun X, Wu P, Hoi SC (2018) Face detection using deep learning: an improved faster RCNN approach. Neurocomputing 299:42–50CrossRef Sun X, Wu P, Hoi SC (2018) Face detection using deep learning: an improved faster RCNN approach. Neurocomputing 299:42–50CrossRef
17.
go back to reference Kazak N, Koc M (2018) Improved multi-spiral local binary pattern in texture recognition. In: Conference on computer science and information technologies. Springer, pp 28–37 Kazak N, Koc M (2018) Improved multi-spiral local binary pattern in texture recognition. In: Conference on computer science and information technologies. Springer, pp 28–37
18.
go back to reference Wang Q, Ding Y-D (2018) A novel fine-grained method for vehicle type recognition based on the locally enhanced PCANet neural network. J Comput Sci Technol 33(2):335–350MathSciNetCrossRef Wang Q, Ding Y-D (2018) A novel fine-grained method for vehicle type recognition based on the locally enhanced PCANet neural network. J Comput Sci Technol 33(2):335–350MathSciNetCrossRef
19.
go back to reference Sun Z, Hu Z-P, Chiong R, Wang M, He W (2018) Combining the kernel collaboration representation and deep subspace learning for facial expression recognition. J Circuits Syst Comput 27(08):1850121CrossRef Sun Z, Hu Z-P, Chiong R, Wang M, He W (2018) Combining the kernel collaboration representation and deep subspace learning for facial expression recognition. J Circuits Syst Comput 27(08):1850121CrossRef
20.
go back to reference Li Y-K, Wu X-J, Kittler J (2019) L1-2D 2 PCANet: a deep learning network for face recognition. J Electron Imaging 28(2):023016 Li Y-K, Wu X-J, Kittler J (2019) L1-2D 2 PCANet: a deep learning network for face recognition. J Electron Imaging 28(2):023016
21.
go back to reference Geng T, Yang M, You Z, Cai Y, Huang F (2018) Multiscale overlapping blocks binarized statistical image features descriptor with flip-free distance for face verification in the wild. Neural Comput Appl 30(10):3243–3252CrossRef Geng T, Yang M, You Z, Cai Y, Huang F (2018) Multiscale overlapping blocks binarized statistical image features descriptor with flip-free distance for face verification in the wild. Neural Comput Appl 30(10):3243–3252CrossRef
22.
23.
go back to reference Bessaoudi M, Ouamane A, Belahcene M, Chouchane A, Boutellaa E, Bourennane S (2019) Multilinear side-information based discriminant analysis for face and kinship verification in the wild. Neurocomputing 329:267–278CrossRef Bessaoudi M, Ouamane A, Belahcene M, Chouchane A, Boutellaa E, Bourennane S (2019) Multilinear side-information based discriminant analysis for face and kinship verification in the wild. Neurocomputing 329:267–278CrossRef
24.
go back to reference Lu J, Hu J, Tan Y-P (2017) Discriminative deep metric learning for face and kinship verification. IEEE Trans Image Process 26(9):4269–4282MathSciNetCrossRefMATH Lu J, Hu J, Tan Y-P (2017) Discriminative deep metric learning for face and kinship verification. IEEE Trans Image Process 26(9):4269–4282MathSciNetCrossRefMATH
25.
go back to reference Chong S-C, Ong T-S, Teoh ABJ (2018) Discriminative kernel-based metric learning for face verification. J Vis Commun Image Represent 56:207–219CrossRef Chong S-C, Ong T-S, Teoh ABJ (2018) Discriminative kernel-based metric learning for face verification. J Vis Commun Image Represent 56:207–219CrossRef
26.
go back to reference Deng W, Hu J, Guo J (2019) Compressive binary patterns: designing a robust binary face descriptor with random-field eigenfilters. IEEE Trans Pattern Anal Mach Intell 41(3):758–767CrossRef Deng W, Hu J, Guo J (2019) Compressive binary patterns: designing a robust binary face descriptor with random-field eigenfilters. IEEE Trans Pattern Anal Mach Intell 41(3):758–767CrossRef
27.
go back to reference Mohammed NN, Khaleel MI, Latif M, Khalid Z (2018) Face recognition based on PCA with weighted and normalized Mahalanobis distance. In: International conference on intelligent informatics and biomedical sciences (ICIIBMS). IEEE, pp 267–267 Mohammed NN, Khaleel MI, Latif M, Khalid Z (2018) Face recognition based on PCA with weighted and normalized Mahalanobis distance. In: International conference on intelligent informatics and biomedical sciences (ICIIBMS). IEEE, pp 267–267
28.
go back to reference Zafaruddin GM, Fadewar HS (2019) Face recognition using eigenfaces. In: Iyer B, Nalbalwar S, Pathak N (eds) Computing, communication and signal processing. Springer, Singapore, pp 855–864CrossRef Zafaruddin GM, Fadewar HS (2019) Face recognition using eigenfaces. In: Iyer B, Nalbalwar S, Pathak N (eds) Computing, communication and signal processing. Springer, Singapore, pp 855–864CrossRef
29.
go back to reference Lal M, Kumar K, Arain RH, Maitlo A, Ruk SA, Shaikh H (2018) Study of face recognition techniques: a survey. Int J Adv Comput Sci Appl 9(6):42–49 Lal M, Kumar K, Arain RH, Maitlo A, Ruk SA, Shaikh H (2018) Study of face recognition techniques: a survey. Int J Adv Comput Sci Appl 9(6):42–49
30.
go back to reference Zheng L, Idrissi K, Garcia C, Duffner S, Baskurt A (2015) Triangular similarity metric learning for face verification. In: 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–7 Zheng L, Idrissi K, Garcia C, Duffner S, Baskurt A (2015) Triangular similarity metric learning for face verification. In: 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–7
31.
go back to reference Barkan O, Weill J, Wolf L, Aronowitz H (2013) Fast high dimensional vector multiplication face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 1960–1967 Barkan O, Weill J, Wolf L, Aronowitz H (2013) Fast high dimensional vector multiplication face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 1960–1967
32.
go back to reference Huang GB, Jones MJ, Learned-Miller E (2008) LFW results using a combined Nowak plus MERL recognizer. In: Workshop on faces in ‘real-life’ images: detection, alignment, and recognition Huang GB, Jones MJ, Learned-Miller E (2008) LFW results using a combined Nowak plus MERL recognizer. In: Workshop on faces in ‘real-life’ images: detection, alignment, and recognition
33.
go back to reference Guillaumin M, Verbeek J, Schmid C (2009) Is that you? Metric learning approaches for face identification. In: IEEE 12th international conference on computer vision. IEEE, pp 498–505 Guillaumin M, Verbeek J, Schmid C (2009) Is that you? Metric learning approaches for face identification. In: IEEE 12th international conference on computer vision. IEEE, pp 498–505
34.
go back to reference Hussain SU, Napoléon T, Jurie F (2012) Face recognition using local quantized patterns. In: British machine vision conference. p 11 Hussain SU, Napoléon T, Jurie F (2012) Face recognition using local quantized patterns. In: British machine vision conference. p 11
35.
go back to reference Cox D, Pinto N (2011) Beyond simple features: a large-scale feature search approach to unconstrained face recognition. In: Face and gesture. IEEE, pp 8–15 Cox D, Pinto N (2011) Beyond simple features: a large-scale feature search approach to unconstrained face recognition. In: Face and gesture. IEEE, pp 8–15
36.
go back to reference Ying Y, Li P (2012) Distance metric learning with eigenvalue optimization. J Mach Learn Res 13(Jan):1–26MathSciNetMATH Ying Y, Li P (2012) Distance metric learning with eigenvalue optimization. J Mach Learn Res 13(Jan):1–26MathSciNetMATH
37.
go back to reference Huang GB, Lee H, Learned-Miller E (2012) Learning hierarchical representations for face verification with convolutional deep belief networks. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 2518–2525 Huang GB, Lee H, Learned-Miller E (2012) Learning hierarchical representations for face verification with convolutional deep belief networks. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 2518–2525
38.
go back to reference Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3554–3561 Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3554–3561
39.
go back to reference Yi D, Lei Z, Li SZ (2013) Towards pose robust face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3539–3545 Yi D, Lei Z, Li SZ (2013) Towards pose robust face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3539–3545
40.
go back to reference Cao Q, Ying Y, Li P (2013) Similarity metric learning for face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 2408–2415 Cao Q, Ying Y, Li P (2013) Similarity metric learning for face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 2408–2415
41.
go back to reference Hu J, Lu J, Tan Y-P (2014) Discriminative deep metric learning for face verification in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1875–1882 Hu J, Lu J, Tan Y-P (2014) Discriminative deep metric learning for face verification in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1875–1882
42.
go back to reference Hu J, Lu J, Yuan J, Tan Y-P (2014) Large margin multi-metric learning for face and kinship verification in the wild. In: Asian conference on computer vision. Springer, pp 252–267 Hu J, Lu J, Yuan J, Tan Y-P (2014) Large margin multi-metric learning for face and kinship verification in the wild. In: Asian conference on computer vision. Springer, pp 252–267
43.
go back to reference Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4295–4304 Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4295–4304
44.
go back to reference Zhu X, Lei Z, Yan J, Yi D, Li SZ (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 787–796 Zhu X, Lei Z, Yan J, Yi D, Li SZ (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 787–796
45.
go back to reference Juefei-Xu F, Luu K, Savvides M (2015) Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans Image Process 24(12):4780–4795MathSciNetCrossRefMATH Juefei-Xu F, Luu K, Savvides M (2015) Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans Image Process 24(12):4780–4795MathSciNetCrossRefMATH
46.
go back to reference Ouamane A, Messaoud B, Guessoum A, Hadid A, Cheriet M (2014) Multi scale multi descriptor local binary features and exponential discriminant analysis for robust face authentication. In: IEEE international conference on image processing (ICIP). IEEE, pp 313–317 Ouamane A, Messaoud B, Guessoum A, Hadid A, Cheriet M (2014) Multi scale multi descriptor local binary features and exponential discriminant analysis for robust face authentication. In: IEEE international conference on image processing (ICIP). IEEE, pp 313–317
47.
go back to reference Chengeta K, Viriri S (2019) A review of local, holistic and deep learning approaches in facial expressions Recognition. In: Conference on information communications technology and society (ICTAS). IEEE, pp 1–7 Chengeta K, Viriri S (2019) A review of local, holistic and deep learning approaches in facial expressions Recognition. In: Conference on information communications technology and society (ICTAS). IEEE, pp 1–7
48.
go back to reference Ameur B, Belahcene M, Masmoudi S, Hamida AB (2018) Weighted PCA-EFMNet: a deep learning network for face verification in the wild. In: 4th International conference on advanced technologies for signal and image processing (ATSIP). IEEE, pp 1–6 Ameur B, Belahcene M, Masmoudi S, Hamida AB (2018) Weighted PCA-EFMNet: a deep learning network for face verification in the wild. In: 4th International conference on advanced technologies for signal and image processing (ATSIP). IEEE, pp 1–6
49.
go back to reference Chan T-H, Jia K, Gao S, Lu J, Zeng Z, Ma Y (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24(12):5017–5032MathSciNetCrossRefMATH Chan T-H, Jia K, Gao S, Lu J, Zeng Z, Ma Y (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24(12):5017–5032MathSciNetCrossRefMATH
Metadata
Title
Hybrid descriptors and Weighted PCA-EFMNet for Face Verification in the Wild
Authors
Bilel Ameur
Mebarka Belahcene
Sabeur Masmoudi
Ahmed Ben Hamida
Publication date
09-07-2019
Publisher
Springer London
Published in
International Journal of Multimedia Information Retrieval / Issue 3/2019
Print ISSN: 2192-6611
Electronic ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-019-00175-w

Other articles of this Issue 3/2019

International Journal of Multimedia Information Retrieval 3/2019 Go to the issue

Premium Partner