Skip to main content
Top
Published in: Optical Memory and Neural Networks 1/2023

01-03-2023

Masked Face Recognition Using Generative Adversarial Networks by Restoring the Face Closed Part

Authors: Chaoxiang Chen, I. Kurnosov, Guangdi Ma, Yang Weichen, S. Ablameyko

Published in: Optical Memory and Neural Networks | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, many authors intensively develop systems allowing one to identify a person when something (a mask) covers a large part of his face. Most of the existing approaches use different forms of analysis of the visible facial features and apply the obtained results to solve the problem. In this article, we propose a fundamentally new approach based on the image segmentation to erase the mask from the face. After erasing the mask, we restore the image of the face under the mask and take an advantage of the existing face recognition methods. To reconstruct the covered part of the face we use the generative adversarial networks. We show that with the aid of the proposed approach it is possible to improve the quality of recognition of masked faces. We compare the effectiveness of our approach and the algorithm based on the MobileNetV2 and show that our method improves the recognition accuracy. We give some examples and appropriate recommendations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahmad Alzu’bi, Firas Albalas, Tawfik AL-Hadhrami, Lojin Bani Younis and Amjad Bashayreh. Masked Face Recognition Using Deep Learning: A Review. Electronics, 2021, 10 (21), 2666. Ahmad Alzu’bi, Firas Albalas, Tawfik AL-Hadhrami, Lojin Bani Younis and Amjad Bashayreh. Masked Face Recognition Using Deep Learning: A Review. Electronics, 2021, 10 (21), 2666.
2.
go back to reference Singh, S., Ahuja, U., Kumar, M. et al. Face mask detection using YOLOv3 and faster R-CNN models: COVID-19 environment. Multimed Tools Appl 80, 19753–19768 (2021). CrossRef Singh, S., Ahuja, U., Kumar, M. et al. Face mask detection using YOLOv3 and faster R-CNN models: COVID-19 environment. Multimed Tools Appl 80, 19753–19768 (2021). CrossRef
3.
go back to reference MFR 2021: Masked Face Recognition Competition—https://arxiv.org/pdf/2106.15288.pdf. MFR 2021: Masked Face Recognition Competition—https://​arxiv.​org/​pdf/​2106.​15288.​pdf.​
4.
go back to reference Yaaseen Muhammad Saib, Sameerchand Pudaruth—Is Face Recognition with Masks Possible? (IJACSA) International Journal of Advanced Computer Science and Applica-tions, Vol. 12, No. 7, 2021, pp. 43–50. Yaaseen Muhammad Saib, Sameerchand Pudaruth—Is Face Recognition with Masks Possible? (IJACSA) International Journal of Advanced Computer Science and Applica-tions, Vol. 12, No. 7, 2021, pp. 43–50.
5.
go back to reference Burak. Pins Face Recognition. October 30, 2020, from Kaggle: https://www.kaggle.com/hereisburak/pins-face-recognition. Burak. Pins Face Recognition. October 30, 2020, from Kaggle: https://​www.​kaggle.​com/​hereisburak/​pins-face-recognition.​
6.
go back to reference Pedro C. Neto, Fadi Boutros, Joao Ribeiro Pinto, Mohsen Saffari, Naser Damer, Ana F. Sequeira, Jaime S. Cardoso—My Eyes Are Up Here: Promoting Focus on Uncovered Re-gions in Masked Face Recognition. arXiv:2108.00996v3 [cs.CV] 18 Aug 2021. Pedro C. Neto, Fadi Boutros, Joao Ribeiro Pinto, Mohsen Saffari, Naser Damer, Ana F. Sequeira, Jaime S. Cardoso—My Eyes Are Up Here: Promoting Focus on Uncovered Re-gions in Masked Face Recognition. arXiv:2108.00996v3 [cs.CV] 18 Aug 2021.
7.
go back to reference Pedro C. Neto, Fadi Boutros, Joao Ribeiro Pinto, Naser Damer, Ana F. Sequeira and Jaime S. Cardoso—FocusFace: Multi-task Contrastive Learning for Masked Face Recog-nition. arXiv:2110.14940v2 [cs.CV] 1 Nov 2021. Pedro C. Neto, Fadi Boutros, Joao Ribeiro Pinto, Naser Damer, Ana F. Sequeira and Jaime S. Cardoso—FocusFace: Multi-task Contrastive Learning for Masked Face Recog-nition. arXiv:2110.14940v2 [cs.CV] 1 Nov 2021.
8.
go back to reference Baojin Huang, Zhongyuan Wang, Guangcheng Wang, Kui Jiang, Zheng He, Hua Zou, Qin Zou: Masked Face Recognition Datasets and Validation. In Proceedings of the Inter-national Conference on Computer Vision Workshops, 2021, p. 1487–1491. Baojin Huang, Zhongyuan Wang, Guangcheng Wang, Kui Jiang, Zheng He, Hua Zou, Qin Zou: Masked Face Recognition Datasets and Validation. In Proceedings of the Inter-national Conference on Computer Vision Workshops, 2021, p. 1487–1491.
9.
go back to reference Hariri, W. Efficient masked face recognition method during the COVID-19 pandem-ic. Signal, Image and Video Processing, volume 16, p. 605–612 (2022). CrossRef Hariri, W. Efficient masked face recognition method during the COVID-19 pandem-ic. Signal, Image and Video Processing, volume 16, p. 605–612 (2022). CrossRef
10.
go back to reference Vu, H.N., Nguyen, M.H. & Pham, C. Masked face recognition with convolutional neural networks and local binary patterns. Appl Intell 52, 5497–5512 (2022). CrossRef Vu, H.N., Nguyen, M.H. & Pham, C. Masked face recognition with convolutional neural networks and local binary patterns. Appl Intell 52, 5497–5512 (2022). CrossRef
11.
go back to reference Prasad, S.; Li, Y.; Lin, D.; Sheng, D. MaskedFaceNet: A Progressive Semi-Supervised Masked Face Detector. In Proceedings of the IEEE/CVF Winter Conference on Applica-tions of Computer Vision, Waikoloa, HI, USA, 3–8 January 2021; pp. 3389–3398. Prasad, S.; Li, Y.; Lin, D.; Sheng, D. MaskedFaceNet: A Progressive Semi-Supervised Masked Face Detector. In Proceedings of the IEEE/CVF Winter Conference on Applica-tions of Computer Vision, Waikoloa, HI, USA, 3–8 January 2021; pp. 3389–3398.
13.
go back to reference Olaf Ronneberger, Philipp Fischer, and Thomas Brox-U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv:1505.04597v1 [cs.CV] 18 May 2015. Olaf Ronneberger, Philipp Fischer, and Thomas Brox-U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv:1505.04597v1 [cs.CV] 18 May 2015.
14.
go back to reference Dong Yi, Zhen Lei, Shengcai Liao and Stan Z. Li—Learning Face Representation from Scratch. arXiv:1411.7923v1 [cs.CV] 28 November 2014. Dong Yi, Zhen Lei, Shengcai Liao and Stan Z. Li—Learning Face Representation from Scratch. arXiv:1411.7923v1 [cs.CV] 28 November 2014.
15.
go back to reference Ke Gong, Xiaodan Liang, Yicheng Li, Yimin Chen, Ming Yang, and Liang Lin—Instance-level Human Parsing via Part Grouping Network. arXiv:1808.00157v1 [cs.CV] 1 Aug 2018. Ke Gong, Xiaodan Liang, Yicheng Li, Yimin Chen, Ming Yang, and Liang Lin—Instance-level Human Parsing via Part Grouping Network. arXiv:1808.00157v1 [cs.CV] 1 Aug 2018.
16.
go back to reference AIM 2020 Challenge on Image Extreme Inpainting. arXiv:2010.01110v1 [cs.CV] 2 Oct 2020. AIM 2020 Challenge on Image Extreme Inpainting. arXiv:2010.01110v1 [cs.CV] 2 Oct 2020.
17.
go back to reference Hui, Z., Li, J., Wang, X., Gao, X.: Image fine-grained inpainting. arXiv:2002.02609v1 [cs.CV] 7 Feb 2020. Hui, Z., Li, J., Wang, X., Gao, X.: Image fine-grained inpainting. arXiv:2002.02609v1 [cs.CV] 7 Feb 2020.
Metadata
Title
Masked Face Recognition Using Generative Adversarial Networks by Restoring the Face Closed Part
Authors
Chaoxiang Chen
I. Kurnosov
Guangdi Ma
Yang Weichen
S. Ablameyko
Publication date
01-03-2023
Publisher
Pleiades Publishing
Published in
Optical Memory and Neural Networks / Issue 1/2023
Print ISSN: 1060-992X
Electronic ISSN: 1934-7898
DOI
https://doi.org/10.3103/S1060992X23010022

Other articles of this Issue 1/2023

Optical Memory and Neural Networks 1/2023 Go to the issue

Premium Partner