Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Machine Vision and Applications
Erschienen in: Machine Vision and Applications 5/2018

28.04.2018 | Original Paper

Occlusion detection and restoration techniques for 3D face recognition: a literature review

verfasst von: Nicole Dagnes, Enrico Vezzetti, Federica Marcolin, Stefano Tornincasa

Erschienen in: Machine Vision and Applications | Ausgabe 5/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Methodologies for 3D face recognition which work in the presence of occlusions are core for the current needs in the field of identification of suspects, as criminals try to take advantage of the weaknesses among the implemented security systems by camouflaging themselves and occluding their face with eyeglasses, hair, hands, or covering their face with scarves and hats. Recent occlusion detection and restoration strategies for recognition purposes of 3D partially occluded faces with unforeseen objects are here presented in a literature review. The research community has worked on face recognition systems under controlled environments, but uncontrolled conditions have been investigated in a lesser extent. The paper details the experiments and databases used to handle the problem of occlusion and the results obtained by different authors. Lastly, a comparison of various techniques is presented and some conclusions are drawn referring to the best outcomes.
Vorheriger Artikel Action detection fusing multiple Kinects and a WIMU: an application to in-home assistive technology for the elderly
Nächster Artikel Directional gradients integration image for illumination insensitive face representation

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren
Literatur
1.
Saini, R., Rana, N.: Comparison of various biometric methods. Int. J. Adv. Sci. Technol. (IJAST) 2(1), 24–30 (2014)
2.
Pato, J., Millett, L.: Biometric Recognition: Challenges and Opportunities. National Academies Press, Washington, D.C. (2010)
3.
Jain, A., Ross, A., Prabhakar, S.: An introduction to biometric recognition. IEEE Trans. Circuits Syst. Video Technol. 14(1), 4–20 (2004)CrossRef
4.
Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 35, 399–458 (2003)CrossRef
5.
Zhao, W., Chellappa, R.: 3D Model Enhanced Face Recognition. In: Proceedings 2000 International Conference on Image Processing 3, 50–53 (2000)
6.
Bowyer, K.W., Chang, K.I., Flynn, P.J.: A survey of approaches to three-dimensional face recognition. Int. Conf. Pattern Recognit. 1, 358–361 (2004)
7.
Kakadiaris, I.A., Toderici, G., Evangelopoulos, G., Passalis, G., Chu, D., Zhao, K., Shah, S.K., Theoharis, T.: 3D–2D face recognition with pose and illumination normalization. Comput. Vis. Image Underst. 154, 137–151 (2017)CrossRef
8.
Ayyavoo, T., Suseela, J.J.: Illumination pre-processing method for face recognition using 2D DWT and CLAHE. IET Biom. (2017)
9.
Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Comput. Vis. Image Underst. 101(1), 1–15 (2006)CrossRef
10.
Pal, R.: Innovative Research in Attention Modelling and Computer Vision Applications. IGI Global, Hershey, PA (2015)
11.
Ekenel, H., Stiefelhagen, R.: Why Is Facial Occlusion a Challenging Problem? Lecture Notes in Computer Science 5558 (2009)
12.
Li, H., Huang, D., Morvan, J.M., Chen, L., Wang, Y.: Expression-robust 3D face recognition via weighted sparse representation of multi-scale and multi-component local normal patterns. Neurocomputing 133, 179–193 (2014)CrossRef
13.
Chellappa, R., Wilson, C., Sirohey, S.: Human and machine recognition of faces: a survey. Proc. IEEE 83(5), 705–741 (1995)CrossRef
14.
Samal, A., Iyengar, P.A.: Automatic recognition and analysis of human faces and facial expressions: a survey. Pattern Recogn. 25, 65–7 (1992)CrossRef
15.
Azeem, A., Raza, M., Murtaza, M.: A survey: face recognition techniques under partial occlusion. Int. Arab J. Inf. Technol. 11, 1–10 (2014)
16.
Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus Database for 3D Face Analysis. Lecture Notes in Computer Science 5372 (2008)
17.
Alyuz, N., Gokberk, B., Akarun, L.: A 3D face recognition system for expression and occlusion invariance. Biometrics: Theory, Applications and Systems 29 (2008)
18.
Colombo, A., Cusano, C., Schettini, R.: UMB-DB: A database of partially occluded 3D faces. Computer Vision Workshops (ICCV Workshops) (2011)
19.
Moreno, A.B., Sanchez, A.: GavabDB: a 3D face database. Workshop on Biometrics on the Internet, 77–85 (2004)
20.
Zohra, F.T., Rahman, W., Gavrilova, M.: Occlusion Detection and Localization from Kinect Depth Images. In: International Conference on Cyberworlds (2016)
21.
Min, R., Kose, N., Dugelay, J.: KinectFaceDB: a kinect database for face recognition. IEEE Trans. Syst. Man Cybern. 44(11), 1534–1548 (2014)CrossRef
22.
Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 1, 947–954 (2005)
23.
Colombo, A., Cusano, C., Schettin, R.: Gappy PCA classification for occlusion tolerant 3D face detection. J. Math. Imaging Vision 35, 193 (2009)MathSciNetCrossRef
24.
Alyuz, N., Gokberk, B., Akarun, L.: 3-D face recognition under occlusion using masked projection. IEEE Trans. Inf. Forensics Secur. 8, 789–802 (2013)CrossRef
25.
Alyuz, N., Gokberk, B., Akarun, L.: Detection of realistic facial occlusions for robust 3D face recognition. In: 22nd International Conference on Pattern Recognition (2014)
26.
Bagchi, P., Bhattacharjee, D., Nasipuri, M.: Robust 3D face recognition in presence of pose and partial occlusions or missing parts. Int. J. Found. Comput. Sci. Technol. (IJFCST) 4(4), 21–35 (2014)CrossRef
27.
Bellil, W., Brahim, H., Ben Amar, C.: Gappy wavelet neural network for 3D occluded faces: detection and recognition. Moltimed. Tools Appl. 75, 36–380 (2016)
28.
Drira, H., Ben Amor, B., Srivastava, A., Daoudi, M., Slama, R.: 3D face recognition under expressions, occlusions and pose variations. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2270–2283 (2013)CrossRef
29.
Drira, H., Ben Amor, B., Srivastava, A., Daoudi, M., Slama, R.: 3D face recognition using geodesic facial curves to handle expression, occlusions and pose variations. Int. J. Comput. Sci. Inf. Technol. (IJCSIT) 53, 4284–4287 (2014)
30.
Ganguly, S., Bhattacharjee, D., Nasipuri, M.: Depth based occlusion detection and localization from 3D face image. Int. J. Image Graph. Signal Process. 5, 20–31 (2015)CrossRef
31.
Liu, P., Wang, Y., Huang, D., Zhaoxiang, Z.: Recognizing occluded 3D faces usign an efficient ICP variant. In: IEEE International Conference on Multimedia and Expo (2012)
32.
Liu, R., Hu, R., Yu, H.: Nose detection on 3D face images by depth-based template matching. In: The 2014 7th international congress on image and signal processing (2014)
33.
Yu, X., Gao, Y., Zhou, J.: Boosting Radial String for 3D Face Recognition with Expressions and Occlusions. In: International Conference on Digital Image Computing: Tecniques and Applications (DICTA) (2016)
34.
Zhao, X., Dellandrea, E., Chen, L.: Accurate Landmarking of Three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model. IEEE Trans. Syst. Man Cybern. 41(5), 1417–1428 (2011)CrossRef
35.
Alyuz, N., Gokberk, B., Akarun, L.: Adaptive registration for occlusion robust 3D face recognition. In: European Conference on Computer Vision 7585 (2012)
36.
Srinivasan, A., Balamurugan, V.: Occlusion detection and image restoration in 3D face image. In: IEEE Region Conference TENCON (2014)
37.
Li, X., Da, F.: Efficient 3D face recognition handling facial expression and hair occlusion. Image Vis. Comput. 30(9), 668–679 (2012)CrossRef
38.
Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial expression database for facial behavior research. In: FGR ’06: Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, pp. 211–216 (2006)
39.
Min, R., Hadid, A., Dugelay, J.L.: Efficient detection of occlusion prior to robust face recognition. Sci. World J. (2014)
40.
Li, H., Huang, D., Morvan, J.M., Wang, Y., Chen, L.: Towards 3D face recognition in the real: a registration-free approach using fine-grained matching of 3D keypoint descriptors. Int. J. Comput. Vision 113(2), 128–142 (2015)MathSciNetCrossRef
41.
Srivastava, A., Klassen, E., Joshi, S.H., Jermyn, I.H.: Shape analysis of elastic curves in euclidean spaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(7), 1415–1428 (2011)CrossRef
42.
Younes, L., Michor, P.W., Shah, J., Mumford, D.: A metric on shape space with explicit geodesics. Rendiconti Lincei—Matematica e Applicazioni 19(1), 25–57 (2008)MathSciNetCrossRefMATH
43.
Samir, C., Srivastava, A., Daoudi, M.: Three-dimensional face recognition using shapes of facial curves. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1858–1863 (2006)CrossRef
44.
Samir, C., Srivastava, A., Daoudi, M., Klassen, E.: An intrinsic framework for analysis of facial surfaces. Int. J. Comput. Vision 82(1), 80–95 (2009)CrossRef
45.
Samir, C., Srivastava, A., Daoudi, M.: Automatic 3D face recognition using shapes of facial curves. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2006)
46.
Raed, M., Zou, B., Hiyam, H.: Nose tip detection in 3D face image based on maximum intensity algorithm. Int. J. Multimed. Ubiquitous Eng. 10(5), 373–382 (2015)CrossRef
47.
Drira, H., Ben Amor, B., Daoudi, M., Srivastava, A.: Pose and expression invariant 3D face recognition using elastic radial curves. In: British Machine Vision Conference, pp. 1–11 (2010)
48.
Yu, X., Gao, Y., Zhou, J.: 3D face recognition under partial occlusions using radial strings. In: IEEE International Conference on Image Processing (ICIP) (2016)
49.
Gao, Y., Leung, M.: Human face profile recognition using attributed string. Pattern Recogn. 35, 353–360 (2002)CrossRefMATH
50.
Bhave, D., Choudhary, R., Gavali, R., Gholap, P.: 3D face recognition under expressions, occlusions, and pose variations. Int. J. Adv. Res. Comput. Commun. Eng. 5(3), 2270–2283 (2016)
51.
Pan, G., Zheng, L., Wu, v.: Robust metric and alignment for profile-based face recognition: an experimental comparison. In: Proceedings of Workshop Applications of Computer Vision, pp. 1–6 (2005)
52.
Veltkamp, R.C., Haar, F.B.: A 3D face matching framework for facial curves. Graph. Models 71(2), 77–91 (2009)CrossRef
53.
Li, C., Barreto, A., Zhai, J., Chin, C.: Exploring face recognition by combining 3D profiles and contours. In: IEEE Proceedings SoutheastCon 576–579 (2005)
54.
Samir, C., Srivastava, A., Daoudi, M.: Three-dimensional face recognition using shapes of facial curves. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1858–1863 (2006)CrossRef
55.
Kakadiaris, I.A., Passalis, G., Toderici, G., Murtuza, M.N., Lu, Y., Karampatziakis, N., Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 640–649 (2007)CrossRef
56.
Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1695–1700 (2006)CrossRef
57.
Faltemier, T., Bowyer, K.W., Flynn, P. J.: 3D face recognition with region committee voting. In: Third International Symposium on 3D Data Processing, Visualization, and Transmission 318–325 (2006)
58.
Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D–3D hybrid approach to automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29(11), 1927–1943 (2007)CrossRef
59.
Alyuz, N., Gokberk, B., Spreeuwers, L., Veldhuis, R., Akarun, L.: Robust 3D face recognition in the presence of realistic occlusions. In: 5th IAPR international conference on biometrics (ICB) (2012)
60.
Gonzalez, R.C., Woods, R.E.: Digital Image Processing (2007)
61.
Srinivas, T., Mohan, P., Shankar, R., Reddy, C.S., Naganjaneyulu, P.V.: Face recognition using PCA and bit-plane slicing. Lect. Notes Electr. Eng. 150, 515–523 (2013)CrossRef
62.
Otsu, N.: In a threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)MathSciNetCrossRef
63.
Nirmala Priya, G., Wahida Banu, R.S.D.: Occlusion invariant face recognition using mean based weight matrix and support vector machine. Sadhana 39(2), 303–315 (2014)CrossRefMATH
64.
Saxena, A., Chung, S.H.: 3D depth reconsrtuction from a single still image. Int. J. Comput. Vision 76(1), 53–69 (2008)CrossRef
65.
Lu, X., Jain, A.: Automatic feature extraction for multiview 3D face recognition. In: Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, pp. 585–590 (2006)
66.
Passalis, G., Perakis, P., Theoharis, T.: Using facial symmetry to handle pose variations in real-world 3d face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1938–1951 (2011)CrossRef
67.
Passalis, G., Perakis, P., Kakadiaris, I.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1552–1564 (2013)CrossRef
68.
Peng, X., Bennamoun, M., Mian, A.: A training-free nose tip detection method from face range images. Pattern Recogn. 44, 544–558 (2011)CrossRefMATH
69.
Faltemier, T., Bowyer, K., Flynn, P.: Rotated profile signatures for robust 3d feature detection. In: Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2008)
70.
Spreeuwers, L.: Fast and accurate 3d face recognition. Int. J. Comput. Visi. IJCV11 93, 389–414 (2011)CrossRefMATH
71.
Gokberk, B., Irfanoglu, M., Akarun, L.: 3D shape-based face representation and feature extraction for face recognition. J. Image Vis. Comput. 24, 857–869 (2006)CrossRef
72.
Salah, A., Alyuz, N., Akarun, L.: Registration of three-dimensional face scans with average face model. J. Electron. Imaging 17, 1–14 (2008)
73.
Blanken, H., De Vries, A.P., Blok, H.E., Feng, L.: Multimedia Retrieval, pp. 163–165. Springer-Verlag, Berlin (2007)CrossRefMATH
74.
Briechle, K., Hanebeck, U.D.: Template matching using fast normalized cross correlation. Proc. SPIE Opt. Pattern Matching XII 4387, 95–102 (2001)
75.
Maurer, T., Guigonis, D., Malov, I., Presenti, B., Tsaregorodtsev, A., West, D., Medioni, G.: Preformance of Geometrix ActiveID 3D Face Recognition engine on the FRGC data. IEEE CVPR (2005)
76.
Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multiple nose egion matching for 3D face recogntion under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1695–1700 (2006)CrossRef
77.
Calvo, A.R., Ruiz, F.T., Rurainsky, J., Eisert, P.: 2D-3D Mixed Face Recognition Schemes. In: Recent Advances in Face Recognition, pp. 125–149 (2008)
78.
Tsapatsoulis, N., Doulamis, N., Doulamis, A., Kollias, S.: Face extraction from non-uniform background and recognition in compressed domain. Proc. IEEE Int. Conf. Acoust. Speech Signal 5, 2701–2704 (1998)
79.
Chang, K.I., Bowyer, K.W., Flynn, P.J.: An evaluation of multimodal 2D+3D face biometrics. IEEE Trans Pattern Anal. Mach. Intell. 27, 619–624 (2005)CrossRef
80.
Samani, A., Winkler, J., Niranjan, M.: Automatic face recognition using stereo images. In: IEEE International Conference on Acoustics, Speech and Signal Processing (2006)
81.
Colombo, A., Cusano, C., Schettini, R.: 3D face detection using curvature analysis. Pattern Recogn. 39(3), 444–455 (2006)CrossRefMATH
82.
Boykov, Y.Y., Jolly, M.P.: Interactive graph cuts for optimal boundary & region segmentation of objects in nd images. Int. Conf. Comput. Vis. 1, 105–112 (2001)
83.
Boykov, Y., Funka-Lea, G.: Graph cuts and efficient ND image segmentation. Int. J. Comput. Vision 70(2), 109–131 (2006)CrossRef
84.
Colombo, A., Cusano, C., Schettini, R.: Detection and restoration of occlusions for 3D face recognition. In: IEEE International Conference on Multimedia and Expo, pp. 1541–1544 (2006)
85.
Everson, R., Sirovich, L.: Karhunen–Loeve procedure for gappy data. J. Opt. Soc. Am. A 12(8), 1657–1664 (1995)CrossRef
86.
Xiaoli Li, F.D.: Efficient 3D face recognition handling facial expression and hair occlusion. Image Vis. Comput. 30, 668–679 (2012)CrossRef
87.
Drira, H., Ben Amor, B., Srivastava, A., Daoudi, M., Slama, R.: 3D Face recognition under expressions, occlusions and pose variations. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, pp. 2270–2283 (2013)
88.
Othmani, M., Bellil, W., Amar, C., Alimi, M.: A New structure and training procedure for multimother wavelet networks. IJWMIP 8(1), 149–175 (2010)MATH
89.
Gawali, S., Deshmukh, R.R.: 3D face recognition using geodesic facial curves to handle expression, occlusion and pose variations. Int. J. Comput. Sci. Inf. Technol. 5(3), 4284–4287 (2014)
90.
Colombo, A., Cusano, C., Schettini, R.: Three-dimensional occlusion detection and restoration of partially occluded faces. J. Math. Imaging Vis. 40(1), 105–119 (2010)MathSciNetCrossRefMATH
91.
92.
Kim, D., Hernandez, M., Choi, J., Medioni, G.: Deep 3D face identification. Computer Vision and Pattern Recognition (2017)
Metadaten
Titel
Occlusion detection and restoration techniques for 3D face recognition: a literature review
verfasst von
Nicole Dagnes
Enrico Vezzetti
Federica Marcolin
Stefano Tornincasa
Publikationsdatum
28.04.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 5/2018
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-018-0933-z

Weitere Artikel der Ausgabe 5/2018

Machine Vision and Applications 5/2018 Zur Ausgabe

Original Paper

Kinship verification from facial images and videos: human versus machine

Original Paper

Scene text recognition using residual convolutional recurrent neural network

Original Paper

Action detection fusing multiple Kinects and a WIMU: an application to in-home assistive technology for the elderly

Original Paper

Fast and robust ellipse detection algorithm for head-mounted eye tracking systems

Original Paper

Multi-model particle filter-based tracking with switching dynamical state to study bedload transport

Original Paper

Benchmark for the robustness of image features in rainy conditions