Skip to main content
Top

2017 | OriginalPaper | Chapter

2. Real-Time Face Identification via Multi-convolutional Neural Network and Boosted Hashing Forest

Authors : Yury Vizilter, Vladimir Gorbatsevich, Andrey Vorotnikov, Nikita Kostromov

Published in: Deep Learning for Biometrics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The family of real-time face representations is obtained via Convolutional Network with Hashing Forest (CNHF). We learn the CNN, then transform CNN to the multiple convolution architecture and finally learn the output hashing transform via new Boosted Hashing Forest (BHF) technique. This BHF generalizes the Boosted Similarity Sensitive Coding (SSC) approach for hashing learning with joint optimization of face verification and identification. CNHF is trained on CASIA-WebFace dataset and evaluated on LFW dataset. We code the output of single CNN with 97% on LFW. For Hamming embedding we get CBHF-200 bit (25 byte) code with 96.3% and 2,000-bit code with 98.14% on LFW. CNHF with 2,000\(\times \)7-bit hashing trees achieves 93% rank-1 on LFW relative to basic CNN 89.9% rank-1. CNHF generates templates at the rate of 40\(+\) fps with CPU Core i7 and 120\(+\) fps with GPU GeForce GTX 650.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference M. Belkin, P. Niyogi, Laplacian eigenmaps and spectral techniques for embedding and clustering, in Proceedings of the NIPS, vol. 14 (2001), pp. 585–591 M. Belkin, P. Niyogi, Laplacian eigenmaps and spectral techniques for embedding and clustering, in Proceedings of the NIPS, vol. 14 (2001), pp. 585–591
2.
go back to reference L. Best-Rowden, H. Han, C. Otto, B. Klare, A.K. Jain, Unconstrained face recognition: identifying a person of interest from a media collection. IEEE Trans. Inf. Forensic Secur. 9(12), 2144–2157 (2014)CrossRef L. Best-Rowden, H. Han, C. Otto, B. Klare, A.K. Jain, Unconstrained face recognition: identifying a person of interest from a media collection. IEEE Trans. Inf. Forensic Secur. 9(12), 2144–2157 (2014)CrossRef
3.
go back to reference Z. Cao, Q. Yin, X. Tang, J. Sun, Face recognition with learning-based descriptor, in Proceedings of the CVPR (2010), pp. 2707–2714 Z. Cao, Q. Yin, X. Tang, J. Sun, Face recognition with learning-based descriptor, in Proceedings of the CVPR (2010), pp. 2707–2714
4.
go back to reference D. Chen, X. Cao, F. Wen, J. Sun, Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification, in Proceedings of the CVPR (2013), pp. 3025–3032 D. Chen, X. Cao, F. Wen, J. Sun, Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification, in Proceedings of the CVPR (2013), pp. 3025–3032
6.
go back to reference H. Fan, M. Yang, Z. Cao, Y. Jiang, Q. Yin, Learning compact face representation: packing a face into an int32, in Proceedings of the ACM International Conference on Multimedia (2014), pp. 933–936 H. Fan, M. Yang, Z. Cao, Y. Jiang, Q. Yin, Learning compact face representation: packing a face into an int32, in Proceedings of the ACM International Conference on Multimedia (2014), pp. 933–936
7.
go back to reference A. Gionis, P. Indyk, R. Motwani, Similarity search in high dimensions via hashing, in Proceedings of the VLDB (1999), pp. 518–529 A. Gionis, P. Indyk, R. Motwani, Similarity search in high dimensions via hashing, in Proceedings of the VLDB (1999), pp. 518–529
8.
go back to reference Y. Gong, S. Lazebnik, A. Gordo, F. Perronnin, Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2916–2929 (2012)CrossRef Y. Gong, S. Lazebnik, A. Gordo, F. Perronnin, Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2916–2929 (2012)CrossRef
9.
go back to reference K. Grauman, R. Fergus, Learning binary hash codes for large-scale image search, Machine Learning for Computer Vision (Springer, Berlin, 2013), pp. 49–87CrossRef K. Grauman, R. Fergus, Learning binary hash codes for large-scale image search, Machine Learning for Computer Vision (Springer, Berlin, 2013), pp. 49–87CrossRef
10.
go back to reference K. He, F. Wen, J. Sun, K-means hashing: an affinity-preserving quantization method for learning binary compact codes, in Proceedings of the CVPR (2013), pp. 2938–2945 K. He, F. Wen, J. Sun, K-means hashing: an affinity-preserving quantization method for learning binary compact codes, in Proceedings of the CVPR (2013), pp. 2938–2945
11.
go back to reference G.-B. Huang, M. Mattar, H. Lee, E. Learned-Miller, Learning to align from scratch, in Proceedings of the NIPS, vol. 25 (2012) G.-B. Huang, M. Mattar, H. Lee, E. Learned-Miller, Learning to align from scratch, in Proceedings of the NIPS, vol. 25 (2012)
12.
go back to reference G. Irie, L. Zhenguo, W. Xiao-Ming, C. Shih-Fu, Locally linear hashing for extracting non-linear manifolds, in Proceedings of the CVPR (2014), pp. 2115–2122 G. Irie, L. Zhenguo, W. Xiao-Ming, C. Shih-Fu, Locally linear hashing for extracting non-linear manifolds, in Proceedings of the CVPR (2014), pp. 2115–2122
13.
14.
go back to reference W. Liu, J. Wang, R. Ji, Y.-G. Jiang, S.-F. Chang, Supervised hashing with kernels, in Proceedings of the CVPR (2012), pp. 2074–2081 W. Liu, J. Wang, R. Ji, Y.-G. Jiang, S.-F. Chang, Supervised hashing with kernels, in Proceedings of the CVPR (2012), pp. 2074–2081
15.
go back to reference Y. Mishina, M. Tsuchiya, H. Fujiyoshi, Boosted random forest. IEICE Trans. E98D(9), 1630–1636 (2015)CrossRef Y. Mishina, M. Tsuchiya, H. Fujiyoshi, Boosted random forest. IEICE Trans. E98D(9), 1630–1636 (2015)CrossRef
16.
go back to reference H.-V. Nguyen, L. Bai, Cosine similarity metric learning for face verification, in Proceedings of the ACCV (2010), pp. 709–720CrossRef H.-V. Nguyen, L. Bai, Cosine similarity metric learning for face verification, in Proceedings of the ACCV (2010), pp. 709–720CrossRef
18.
go back to reference R. Salakhutdinov, G. Hinton, Semantic hashing. Int. J. Approx. Reason. 50(7), 969–978 (2009)CrossRef R. Salakhutdinov, G. Hinton, Semantic hashing. Int. J. Approx. Reason. 50(7), 969–978 (2009)CrossRef
19.
go back to reference F. Schroff, D. Kalenichenko, J. Philbin, FaceNet: a unified embedding for face recognition and clustering, in Proceedings of the CVPR (2015), pp. 815–823 F. Schroff, D. Kalenichenko, J. Philbin, FaceNet: a unified embedding for face recognition and clustering, in Proceedings of the CVPR (2015), pp. 815–823
20.
go back to reference G. Shakhnarovich, Learning task-specific similarity, Ph.D. thesis, Department of Electrical Engineering and Computer Science, MIT, Cambridge (2005) G. Shakhnarovich, Learning task-specific similarity, Ph.D. thesis, Department of Electrical Engineering and Computer Science, MIT, Cambridge (2005)
21.
go back to reference G. Shakhnarovich, P. Viola, T. Darrell, Fast pose estimation with parameter sensitive hashing. Proc. Comput. Vis. 2, 750–757 (2003) G. Shakhnarovich, P. Viola, T. Darrell, Fast pose estimation with parameter sensitive hashing. Proc. Comput. Vis. 2, 750–757 (2003)
22.
go back to reference J. Springer, X. Xin, Z. Li, J. Watt, A. Katsaggelos, Forest hashing: expediting large scale image retrieval, in Proceedings of the ICASSP (2013), pp. 1681–1684 J. Springer, X. Xin, Z. Li, J. Watt, A. Katsaggelos, Forest hashing: expediting large scale image retrieval, in Proceedings of the ICASSP (2013), pp. 1681–1684
23.
go back to reference Y. Sun, X. Wang, X. Tang, Deep learning face representation by joint identification-verification, in Proceedings of the NIPS, vol. 27 (2014) Y. Sun, X. Wang, X. Tang, Deep learning face representation by joint identification-verification, in Proceedings of the NIPS, vol. 27 (2014)
24.
go back to reference Y. Sun, X. Wang, X. Tang, Deep learning face representation from predicting 10,000 classes, in Proceedings of the CVPR (2014), pp. 1891–1898 Y. Sun, X. Wang, X. Tang, Deep learning face representation from predicting 10,000 classes, in Proceedings of the CVPR (2014), pp. 1891–1898
26.
go back to reference Y. Taigman, L. Wolf, T. Hassner, Multiple one-shots for utilizing class label information, in Proceedings of the BMVC (2009) Y. Taigman, L. Wolf, T. Hassner, Multiple one-shots for utilizing class label information, in Proceedings of the BMVC (2009)
27.
go back to reference Y. Taigman, M. Yang, M. Ranzato, L. Wolf, DeepFace: closing the gap to human-level performance in face verification, in Proceedings of the CVPR (2014), pp. 1701–1708 Y. Taigman, M. Yang, M. Ranzato, L. Wolf, DeepFace: closing the gap to human-level performance in face verification, in Proceedings of the CVPR (2014), pp. 1701–1708
28.
go back to reference C. Vens, F. Costa, Random forest based feature induction, in Proceedings of the ICDM (2011), pp. 744–753 C. Vens, F. Costa, Random forest based feature induction, in Proceedings of the ICDM (2011), pp. 744–753
29.
go back to reference W. Wang, J. Yang, J. Xiao, S. Li, D. Zhou, Face recognition based on deep learning, in Proceedings of the HCC, vol. 8944 (2015), pp. 812–820 W. Wang, J. Yang, J. Xiao, S. Li, D. Zhou, Face recognition based on deep learning, in Proceedings of the HCC, vol. 8944 (2015), pp. 812–820
30.
go back to reference Y. Weiss, A. Torralba, R. Fergus, Spectral hashing, in Proceedings of the NIPS, vol. 21 (2008) Y. Weiss, A. Torralba, R. Fergus, Spectral hashing, in Proceedings of the NIPS, vol. 21 (2008)
33.
go back to reference G. Yu, J. Yuan, Scalable forest hashing for fast similarity search, in Proceedings of the ICME (2014), pp. 1–6 G. Yu, J. Yuan, Scalable forest hashing for fast similarity search, in Proceedings of the ICME (2014), pp. 1–6
34.
go back to reference L. Zhang, Y. Zhang, X. Gu, J. Tang, Q. Tian, Topology preserving hashing for similarity search, in Proceedings of the ACM International Conference on Multimedia (2013), pp. 123–132 L. Zhang, Y. Zhang, X. Gu, J. Tang, Q. Tian, Topology preserving hashing for similarity search, in Proceedings of the ACM International Conference on Multimedia (2013), pp. 123–132
Metadata
Title
Real-Time Face Identification via Multi-convolutional Neural Network and Boosted Hashing Forest
Authors
Yury Vizilter
Vladimir Gorbatsevich
Andrey Vorotnikov
Nikita Kostromov
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-61657-5_2

Premium Partner