Skip to main content
Erschienen in: Wireless Personal Communications 2/2018

09.02.2018

Improving Deep Learning Feature with Facial Texture Feature for Face Recognition

verfasst von: Yunfei Li, Zhaoyang Lu, Jing Li, Yanzi Deng

Erschienen in: Wireless Personal Communications | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face recognition in the reality, is a challenging problem, due to varieties in illumination, background, pose etc. Recently, the deep learning based face recognition algorithm is able to learn effective face features to obtain a very impressive performance. However, this kind of face recognition algorithm completely relies on the machine learning based face features, while ignores the useful experience in hand-craft features which have been studied in a long period. Therefore, a face recognition based on facial texture feature aided deep learning feature (FTFA-DLF) is proposed in this paper. The proposed FTFA-DLF is able to combine the benefits of deep learning and hand-craft features. In the proposed FTFA-DLF method, the hand-craft features are texture features extracted from the eyes, nose, and mouth regions. Then, the hand-craft features are used to aid deep learning features by adding both deep learning and hand-craft features into the objective function layer, which adaptively adjusts the deep learning features so that it can better cooperate with the hand-craft features and obtain a better face recognition performance. Experimental results show that the proposed face recognition algorithm on the LFW face database to achieve the accuracy rate of 97.02%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dix, A. (2009). Human-computer interaction. In Encyclopedia of database systems (pp. 1327–1331). New York: Springer. Dix, A. (2009). Human-computer interaction. In Encyclopedia of database systems (pp. 1327–1331). New York: Springer.
2.
Zurück zum Zitat Arigbabu, O. A., et al. (2015). Integration of multiple soft biometrics for human identification. Pattern Recognition Letters, 68, 278–287.CrossRef Arigbabu, O. A., et al. (2015). Integration of multiple soft biometrics for human identification. Pattern Recognition Letters, 68, 278–287.CrossRef
3.
Zurück zum Zitat Husain, I., et al. (2016). Attendance system based on face recognition by using raspberry Pi. International Journal of Research, 3(3), 22–26. Husain, I., et al. (2016). Attendance system based on face recognition by using raspberry Pi. International Journal of Research, 3(3), 22–26.
4.
Zurück zum Zitat Feng, D., Siu, W.-C., & Zhang, H. J. (2013). Multimedia information retrieval and management: Technological fundamentals and applications. Dordrecht: Springer.MATH Feng, D., Siu, W.-C., & Zhang, H. J. (2013). Multimedia information retrieval and management: Technological fundamentals and applications. Dordrecht: Springer.MATH
5.
Zurück zum Zitat Ahonen, T., Hadid, A., & Pietikainen, M. (2006). Face description with local binary patterns: Application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(12), 2037–2041.CrossRef Ahonen, T., Hadid, A., & Pietikainen, M. (2006). Face description with local binary patterns: Application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(12), 2037–2041.CrossRef
6.
Zurück zum Zitat Zhang, L., et al. (2007). Face detection based on multi-block LBP representation. In Advances in biometrics (pp. 11–18). London: Springer. Zhang, L., et al. (2007). Face detection based on multi-block LBP representation. In Advances in biometrics (pp. 11–18). London: Springer.
7.
Zurück zum Zitat Albiol, A., et al. (2008). Face recognition using HOGCEBGM. Pattern Recognition Letters, 29(10), 1537–1543.CrossRef Albiol, A., et al. (2008). Face recognition using HOGCEBGM. Pattern Recognition Letters, 29(10), 1537–1543.CrossRef
8.
Zurück zum Zitat Dniz, O., et al. (2011). Face recognition using histograms of oriented gradients. Pattern Recognition Letters, 32(12), 1598–1603.CrossRef Dniz, O., et al. (2011). Face recognition using histograms of oriented gradients. Pattern Recognition Letters, 32(12), 1598–1603.CrossRef
9.
Zurück zum Zitat Lei, Z., et al. (2008). Gabor volume based local binary pattern for face representation and recognition. In 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG’08, 2008. Lei, Z., et al. (2008). Gabor volume based local binary pattern for face representation and recognition. In 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG’08, 2008.
10.
Zurück zum Zitat Luo, J., et al. (2007). Person-specific SIFT features for face recognition. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2007. Luo, J., et al. (2007). Person-specific SIFT features for face recognition. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2007.
11.
Zurück zum Zitat Liao, S., Jain, A. K., & Li, S. Z. (2013). Partial face recognition: Alignment-free approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(5), 1193–1205.CrossRef Liao, S., Jain, A. K., & Li, S. Z. (2013). Partial face recognition: Alignment-free approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(5), 1193–1205.CrossRef
12.
Zurück zum Zitat Huang, G. B., Lee, H., Learned-Miller, E. (2012). Learning hierarchical representations for face verification with convolutional deep belief networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012. Huang, G. B., Lee, H., Learned-Miller, E. (2012). Learning hierarchical representations for face verification with convolutional deep belief networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
13.
Zurück zum Zitat Sun, Y., Wang, X., Tang, X. (2013). Hybrid deep learning for face verification. In Proceedings of the IEEE International Conference on Computer Vision. Sun, Y., Wang, X., Tang, X. (2013). Hybrid deep learning for face verification. In Proceedings of the IEEE International Conference on Computer Vision.
14.
Zurück zum Zitat Deepface, Wolf, L. (2014). Closing the gap to human-level performance in face verification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. Deepface, Wolf, L. (2014). Closing the gap to human-level performance in face verification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
15.
Zurück zum Zitat Sun, Y., Wang, X., Tang, X. (2014). Deep learning face representation from predicting 10,000 classes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Sun, Y., Wang, X., Tang, X. (2014). Deep learning face representation from predicting 10,000 classes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
16.
Zurück zum Zitat Sun, Y., et al. (2014). Deep learning face representation by joint identification-verification. In Advances in Neural Information Processing Systems. Sun, Y., et al. (2014). Deep learning face representation by joint identification-verification. In Advances in Neural Information Processing Systems.
17.
Zurück zum Zitat Silapachote, P., Karuppiah, D. R., & Hanson, A. R. (2005). Feature selection using AdaBoost for face expression recognition. Massachusetts Univ Amherst Dept Of Computer Science. Silapachote, P., Karuppiah, D. R., & Hanson, A. R. (2005). Feature selection using AdaBoost for face expression recognition. Massachusetts Univ Amherst Dept Of Computer Science.
18.
Zurück zum Zitat Qin, J., He, Z.-S. (2005). A SVM face recognition method based on Gabor-featured key points. In Proceedings of 2005 International Conference on Machine Learning and Cybernetics, 2005. IEEE. Qin, J., He, Z.-S. (2005). A SVM face recognition method based on Gabor-featured key points. In Proceedings of 2005 International Conference on Machine Learning and Cybernetics, 2005. IEEE.
19.
Zurück zum Zitat Sharma, A., Jacobs, D.W. (2011). Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011. IEEE. Sharma, A., Jacobs, D.W. (2011). Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011. IEEE.
20.
Zurück zum Zitat Chen, D., Cao, X., Wang, L., Wen, F., & Sun, J. (2012). Bayesian face revisited: A joint formulation. In European Conference on Computer Vision, 2012, Florence, Italy (pp. 566–579). Springer. Chen, D., Cao, X., Wang, L., Wen, F., & Sun, J. (2012). Bayesian face revisited: A joint formulation. In European Conference on Computer Vision, 2012, Florence, Italy (pp. 566–579). Springer.
21.
Zurück zum Zitat Davis, J. V., et al. (2007). Information-theoretic metric learning. In Proceedings of the 24th international conference on Machine learning ACM. Davis, J. V., et al. (2007). Information-theoretic metric learning. In Proceedings of the 24th international conference on Machine learning ACM.
22.
Zurück zum Zitat Huang, G. B. et al. (2007). Labeled faces in the wild: A database for studying face recognition in unconstrained environments., Technical Report 07–49. Amherst: University of Massachusetts. Huang, G. B. et al. (2007). Labeled faces in the wild: A database for studying face recognition in unconstrained environments., Technical Report 07–49. Amherst: University of Massachusetts.
23.
Zurück zum Zitat Wolf, L., Hassner, T., Maoz, I. (2011). Face recognition in unconstrained videos with matched background similarity. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011. IEEE. Wolf, L., Hassner, T., Maoz, I. (2011). Face recognition in unconstrained videos with matched background similarity. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011. IEEE.
24.
Zurück zum Zitat Zhu, X., Ramanan, D. (2012). Face detection, pose estimation, and landmark localization in the wild. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012. IEEE. Zhu, X., Ramanan, D. (2012). Face detection, pose estimation, and landmark localization in the wild. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012. IEEE.
25.
26.
Zurück zum Zitat Ioffe, S., Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167. Accessed 2 Mar 2015. Ioffe, S., Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:​1502.​03167. Accessed 2 Mar 2015.
27.
Zurück zum Zitat Chen, D., Xudong, C., Fang, W., & Jian, S. (2013). Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In IEEE Conference on Computer vision and pattern recognition (CVPR), 2013 (pp. 3025–3032). IEEE. Chen, D., Xudong, C., Fang, W., & Jian, S. (2013). Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In IEEE Conference on Computer vision and pattern recognition (CVPR), 2013 (pp. 3025–3032). IEEE.
28.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 22782324.CrossRef LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 22782324.CrossRef
29.
Zurück zum Zitat A. Vedaldi, Lenc, K. (2015). Matconvnet: Convolutional neural networks for matlab, In Proceedings of the 23rd ACM international conference on Multimedia, ACM, pp. 689C692. A. Vedaldi, Lenc, K. (2015). Matconvnet: Convolutional neural networks for matlab, In Proceedings of the 23rd ACM international conference on Multimedia, ACM, pp. 689C692.
30.
Zurück zum Zitat Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T. Caffe: Convolutional architecture for fast feature embedding, arXiv preprint arXiv:1408.5093. Accessed 20 Jun 2014. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T. Caffe: Convolutional architecture for fast feature embedding, arXiv preprint arXiv:​1408.​5093. Accessed 20 Jun 2014.
31.
Zurück zum Zitat Chen, D., Cao, X., Wen, F., Sun, J. (2013). Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 30253032. Chen, D., Cao, X., Wen, F., Sun, J. (2013). Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 30253032.
32.
Zurück zum Zitat K. He, Zhang, X., Ren, S., et al. Deep Residual Learning for Image Recognition, arXiv preprint arXiv:1512.03385. Accessed 10 Dec 2015. K. He, Zhang, X., Ren, S., et al. Deep Residual Learning for Image Recognition, arXiv preprint arXiv:​1512.​03385. Accessed 10 Dec 2015.
33.
Zurück zum Zitat Wen, Y., Zhang, K., Li, Z., Yu, Q. (2016). A discriminative feature learning approach for deep face recognition, In European Conference on Computer Vision, pp. 499–515. Wen, Y., Zhang, K., Li, Z., Yu, Q. (2016). A discriminative feature learning approach for deep face recognition, In European Conference on Computer Vision, pp. 499–515.
34.
Zurück zum Zitat Ding, C., Choi, J., Tan, D., & Davis, L. (2016). Multi-directional multi-level dual-cross patterns for robust face recognition. IEEE Transactions on Pattern Analysis & Machine Intelligence, 38(3), 518.CrossRef Ding, C., Choi, J., Tan, D., & Davis, L. (2016). Multi-directional multi-level dual-cross patterns for robust face recognition. IEEE Transactions on Pattern Analysis & Machine Intelligence, 38(3), 518.CrossRef
35.
Zurück zum Zitat Ding, H., Zhou, S., Chellappa, R. (2017). FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition, In IEEE International Conference on Automatic Face & Gesture Recognition IEEE, pp. 118–126. Ding, H., Zhou, S., Chellappa, R. (2017). FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition, In IEEE International Conference on Automatic Face & Gesture Recognition IEEE, pp. 118–126.
36.
Zurück zum Zitat Wu, Y., Liu, H., Li, J., & Fu, Y. (2017). Deep Face Recognition with Center Invariant Loss. In ACM Multimedia-The matic Workshops. CA, USA ACM: Mountain View. Wu, Y., Liu, H., Li, J., & Fu, Y. (2017). Deep Face Recognition with Center Invariant Loss. In ACM Multimedia-The matic Workshops. CA, USA ACM: Mountain View.
37.
Zurück zum Zitat Waisy, A., Qahwaji, R., Ipson, S., Fahdawi, S. (2017). A multimodal deep learning framework using local feature representations for face recognition, In Machine Vision & Applications pp. 1–20. Waisy, A., Qahwaji, R., Ipson, S., Fahdawi, S. (2017). A multimodal deep learning framework using local feature representations for face recognition, In Machine Vision & Applications pp. 1–20.
Metadaten
Titel
Improving Deep Learning Feature with Facial Texture Feature for Face Recognition
verfasst von
Yunfei Li
Zhaoyang Lu
Jing Li
Yanzi Deng
Publikationsdatum
09.02.2018
Verlag
Springer US
Erschienen in
Wireless Personal Communications / Ausgabe 2/2018
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-018-5377-2

Weitere Artikel der Ausgabe 2/2018

Wireless Personal Communications 2/2018 Zur Ausgabe

Neuer Inhalt