Skip to main content
Erschienen in: Neural Computing and Applications 10/2018

02.03.2017 | Original Article

Multiscale overlapping blocks binarized statistical image features descriptor with flip-free distance for face verification in the wild

verfasst von: Tianyu Geng, Menglong Yang, Zhisheng You, Ying Cai, Feihu Huang

Erschienen in: Neural Computing and Applications | Ausgabe 10/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work, an effective face verification system based on a fusion of the multiscale overlapping blocks binarized statistical image features (BSIF) descriptor and a flip-free distance is proposed. First, we propose a BSIF with overlapping blocks descriptor and extend it to a multiscale framework. Then, after applying dimensionality reduction, the projected vectors for each scale are scored using two prevalent face verification classifiers: triangular similarity metric learning and the Joint Bayesian method. Moreover, a flip-free distance is applied to boost overall performance. Finally, the different scores for different scales are fused using a support vector machine to further improve performance. We evaluate the proposed face verification system under restricted and unrestricted protocols, for which, in both cases, we achieve very competitive results (90.05 and 93.41%) for the problem of face verification on the Labeled Faces in the Wild dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Tech Rep, University of Massachusetts, Amherst, pp 7–49 Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Tech Rep, University of Massachusetts, Amherst, pp 7–49
2.
Zurück zum Zitat Ding C, Choi J, Tao D et al (2016) Multi-directional multi-level dual-cross patterns for robust face recognition. IEEE Trans Pattern Anal Mach Intell 38(3):518–531CrossRef Ding C, Choi J, Tao D et al (2016) Multi-directional multi-level dual-cross patterns for robust face recognition. IEEE Trans Pattern Anal Mach Intell 38(3):518–531CrossRef
3.
Zurück zum Zitat Zhu X, Lei Z, Yan J, Yi D, Li S (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 787–796 Zhu X, Lei Z, Yan J, Yi D, Li S (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 787–796
4.
Zurück zum Zitat Ouamane A et al (2014) Multi scale multi descriptor local binary features and exponential discriminant analysis for robust face authentication. In: International conference on image processing, pp 313-317 Ouamane A et al (2014) Multi scale multi descriptor local binary features and exponential discriminant analysis for robust face authentication. In: International conference on image processing, pp 313-317
5.
Zurück zum Zitat Huang C, Zhu S, Yu K et al (2011) Large scale strongly supervised ensemble metric learning, with applications to face verification and retrieval. In: NEC Technical Report TR115, p 8 Huang C, Zhu S, Yu K et al (2011) Large scale strongly supervised ensemble metric learning, with applications to face verification and retrieval. In: NEC Technical Report TR115, p 8
6.
Zurück zum Zitat Chen D, Cao X, Wen F, Sun J (2013) Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: Computer Vision and Pattern Recognition (CVPR), pp 3025–3032 Chen D, Cao X, Wen F, Sun J (2013) Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: Computer Vision and Pattern Recognition (CVPR), pp 3025–3032
7.
Zurück zum Zitat Simonyan K, Parkhi O M, Vedaldi A, Zisserman A (2013) Fisher vector faces in the wild. In: Proceedings of the British Machine Vision Conference (BMVC), vol 1, p 7 Simonyan K, Parkhi O M, Vedaldi A, Zisserman A (2013) Fisher vector faces in the wild. In: Proceedings of the British Machine Vision Conference (BMVC), vol 1, p 7
8.
Zurück zum Zitat Nguyen HV, Bai L (2010) Cosine similarity metric learning for face verification. In: Asian Conference on Computer Vision. Springer, Heidelberg, pp 709–720CrossRef Nguyen HV, Bai L (2010) Cosine similarity metric learning for face verification. In: Asian Conference on Computer Vision. Springer, Heidelberg, pp 709–720CrossRef
9.
Zurück zum Zitat Zheng L, Idrissi K, Garcia C et al (2015) Triangular similarity metric learning for face verification. In: The 11th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2015) Zheng L, Idrissi K, Garcia C et al (2015) Triangular similarity metric learning for face verification. In: The 11th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2015)
10.
Zurück zum Zitat Ouamane A, Bengherabi M, Hadid A, Cheriet M (2015) Side-information based exponential discriminant analysis for face verification in the wild. In: Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on IEEE, vol 2, pp 1–6 Ouamane A, Bengherabi M, Hadid A, Cheriet M (2015) Side-information based exponential discriminant analysis for face verification in the wild. In: Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on IEEE, vol 2, pp 1–6
11.
Zurück zum Zitat Juefeixu F, Luu K, Savvides M et al (2015) Spartans : single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans Image Process 24(12):4780–4795MathSciNetCrossRef Juefeixu F, Luu K, Savvides M et al (2015) Spartans : single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans Image Process 24(12):4780–4795MathSciNetCrossRef
12.
Zurück zum Zitat Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: Computer Vision and Pattern Recognition (CVPR), pp 4295–4304 Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: Computer Vision and Pattern Recognition (CVPR), pp 4295–4304
13.
Zurück zum Zitat Hu J, Lu J, Yuan J, Tan YP (2015) Large Margin multi-metric learning for face and Kinship verification in the Wild. In: Cremers D, Reid I, Saito H, Yang MH (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science, vol 9005. Springer, Cham, pp 252–267 Hu J, Lu J, Yuan J, Tan YP (2015) Large Margin multi-metric learning for face and Kinship verification in the Wild. In: Cremers D, Reid I, Saito H, Yang MH (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science, vol 9005. Springer, Cham, pp 252–267
14.
Zurück zum Zitat Hu J, Lu J, Yuan J, Tan YP (2014) Discriminative deep metric learning for face verification in the wild. In: Computer Vision and Pattern Recognition (CVPR), pp 1875–1882 Hu J, Lu J, Yuan J, Tan YP (2014) Discriminative deep metric learning for face verification in the wild. In: Computer Vision and Pattern Recognition (CVPR), pp 1875–1882
15.
Zurück zum Zitat Cao Z, Yin Q, Tang X, Sun J (2010) Face recognition with learning-based descriptor. In: Computer Vision and Pattern Recognition (CVPR), pp 2707–2714 Cao Z, Yin Q, Tang X, Sun J (2010) Face recognition with learning-based descriptor. In: Computer Vision and Pattern Recognition (CVPR), pp 2707–2714
16.
Zurück zum Zitat Seo HJ, Milanfar P (2011) Face verification using the LARK representation. IEEE Trans Inf Forensic Secur 6(4):1275–1286CrossRef Seo HJ, Milanfar P (2011) Face verification using the LARK representation. IEEE Trans Inf Forensic Secur 6(4):1275–1286CrossRef
17.
Zurück zum Zitat Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: Computer Vision and Pattern Recognition (CVPR), pp 3554–3561 Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: Computer Vision and Pattern Recognition (CVPR), pp 3554–3561
18.
Zurück zum Zitat Chen D, Cao X, Wang L, Wen F, Sun J (2012) Bayesian face revisited: a joint formulation. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) ECCV, vol 7574. Springer, Heidelberg, pp 566–579CrossRef Chen D, Cao X, Wang L, Wen F, Sun J (2012) Bayesian face revisited: a joint formulation. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) ECCV, vol 7574. Springer, Heidelberg, pp 566–579CrossRef
19.
Zurück zum Zitat Prince S, Li P, Fu Y, Mohammed U, Elder JH (2012) Probabilistic models for inference about identity. IEEE Trans Pattern Anal Mach Intell 34(1):144–157CrossRef Prince S, Li P, Fu Y, Mohammed U, Elder JH (2012) Probabilistic models for inference about identity. IEEE Trans Pattern Anal Mach Intell 34(1):144–157CrossRef
20.
Zurück zum Zitat Guillaumin M, Verbeek J, Schmid C (2009) Is that you? Metric learning approaches for face identification. In: ICCV, pp 498–505 Guillaumin M, Verbeek J, Schmid C (2009) Is that you? Metric learning approaches for face identification. In: ICCV, pp 498–505
21.
Zurück zum Zitat Barkan O, Weill J, Wolf L, Aronowitz H (2013) Fast high dimensional vector multiplication face recognition. In: Proceedings of the 2013 IEEE International Conference on Computer Vision Barkan O, Weill J, Wolf L, Aronowitz H (2013) Fast high dimensional vector multiplication face recognition. In: Proceedings of the 2013 IEEE International Conference on Computer Vision
22.
Zurück zum Zitat Sun Y, Wang X, Tang X (2013) Hybrid deep learning for face verification. In: Proceeding International Conference on Computer Vision, pp 1489–1496 Sun Y, Wang X, Tang X (2013) Hybrid deep learning for face verification. In: Proceeding International Conference on Computer Vision, pp 1489–1496
23.
Zurück zum Zitat Liang Y, Ding X, Xue J, Xue J-H (2015) Advanced joint Bayesian method for face verification. IEEE Trans Inf Forens Secur 10(2):346–354.CrossRef Liang Y, Ding X, Xue J, Xue J-H (2015) Advanced joint Bayesian method for face verification. IEEE Trans Inf Forens Secur 10(2):346–354.CrossRef
24.
Zurück zum Zitat Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1701–1708 Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1701–1708
25.
Zurück zum Zitat Sun Y, Chen X, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. In: Ghahramani Z, Welling M, Cortes C, Lawrence N, Weinberger K (eds) Advances in neural information processing systems. Curran associates, Inc., New York, pp 1988–1996 Sun Y, Chen X, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. In: Ghahramani Z, Welling M, Cortes C, Lawrence N, Weinberger K (eds) Advances in neural information processing systems. Curran associates, Inc., New York, pp 1988–1996
26.
Zurück zum Zitat Lu C, Tang X (2014) Surpassing human-level face verification performance on LFW with GaussianFace. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. arXiv:1404.3840 Lu C, Tang X (2014) Surpassing human-level face verification performance on LFW with GaussianFace. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. arXiv:1404.​3840
27.
Zurück zum Zitat Kannala J, Rahtu E (2012) BSIF: binarized statistical image features. In: Pattern Recognition (ICPR), 2012 21st International Conference on IEEE, pp 1363–1366 Kannala J, Rahtu E (2012) BSIF: binarized statistical image features. In: Pattern Recognition (ICPR), 2012 21st International Conference on IEEE, pp 1363–1366
28.
Zurück zum Zitat Huang D, Shan CX, Ardabilian M et al (2011) Local binary patterns and its application to facial image analysis: a survey. IEEE Trans Syst Man Cybern 41(6):765–781CrossRef Huang D, Shan CX, Ardabilian M et al (2011) Local binary patterns and its application to facial image analysis: a survey. IEEE Trans Syst Man Cybern 41(6):765–781CrossRef
29.
Zurück zum Zitat Ahonen T et al (2008) Recognition of blurred faces using Local phase quantization. In: international conference on pattern recognition, pp 1–4 Ahonen T et al (2008) Recognition of blurred faces using Local phase quantization. In: international conference on pattern recognition, pp 1–4
30.
Zurück zum Zitat Chan CH, Tahir MA, Kittler J et al (2013) Multiscale local phase quantization for robust component-based face recognition using Kernel fusion of multiple descriptors. IEEE Trans Pattern Anal Mach Intell 35(5):1164–1177. doi:10.1109/TPAMI.2012.199 CrossRef Chan CH, Tahir MA, Kittler J et al (2013) Multiscale local phase quantization for robust component-based face recognition using Kernel fusion of multiple descriptors. IEEE Trans Pattern Anal Mach Intell 35(5):1164–1177. doi:10.​1109/​TPAMI.​2012.​199 CrossRef
31.
Zurück zum Zitat Chan C H, Kittler J, Messer K (2007) Multi-scale local binary pattern histograms for face recognition. In: International conference on biometrics. Springer, Berlin, Heidelberg, pp 809–818 Chan C H, Kittler J, Messer K (2007) Multi-scale local binary pattern histograms for face recognition. In: International conference on biometrics. Springer, Berlin, Heidelberg, pp 809–818
32.
Zurück zum Zitat Arashloo SR, Kittler J (2014) Class-specific Kernel fusion of multiple descriptors for face verification using multiscale binarised statistical image features. IEEE Trans Inf Forens Secur 9(12):2100–2109CrossRef Arashloo SR, Kittler J (2014) Class-specific Kernel fusion of multiple descriptors for face verification using multiscale binarised statistical image features. IEEE Trans Inf Forens Secur 9(12):2100–2109CrossRef
33.
Zurück zum Zitat Davis J V, Kulis B, Jain P, Sra s, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of the 24th international conference on Machine learning. ACM, pp 209–216 Davis J V, Kulis B, Jain P, Sra s, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of the 24th international conference on Machine learning. ACM, pp 209–216
34.
Zurück zum Zitat Cao Q, Ying Y, Li P (2013) Similarity metric learning for face recognition. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2408–2415 Cao Q, Ying Y, Li P (2013) Similarity metric learning for face recognition. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2408–2415
Metadaten
Titel
Multiscale overlapping blocks binarized statistical image features descriptor with flip-free distance for face verification in the wild
verfasst von
Tianyu Geng
Menglong Yang
Zhisheng You
Ying Cai
Feihu Huang
Publikationsdatum
02.03.2017
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 10/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-2918-7

Weitere Artikel der Ausgabe 10/2018

Neural Computing and Applications 10/2018 Zur Ausgabe