Skip to main content
Top
Published in: Artificial Intelligence Review 2/2019

14-09-2017

A survey on techniques to handle face recognition challenges: occlusion, single sample per subject and expression

Authors: Badr Lahasan, Syaheerah Lebai Lutfi, Rubén San-Segundo

Published in: Artificial Intelligence Review | Issue 2/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Face recognition is receiving a significant attention due to the need of facing important challenges when developing real applications under unconstrained environments. The three most important challenges are facial occlusion, the problem of dealing with a single sample per subject (SSPS) and facial expression. This paper describes and analyzes various strategies that have been developed recently for overcoming these three major challenges that seriously affect the performance of real face recognition systems. This survey is organized in three parts. In the first part, approaches to tackle the challenge of facial occlusion are classified, illustrated and compared. The second part briefly describes the SSPS problem and the associated solutions. In the third part, facial expression challenge is illustrated. In addition, pros and cons of each technique are stated. Finally, several improvements for future research are suggested, providing a useful perspective for addressing new research in face recognition.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2d and 3d face recognition: a survey. Pattern Recognit Lett 28(14):1885–1906CrossRef Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2d and 3d face recognition: a survey. Pattern Recognit Lett 28(14):1885–1906CrossRef
go back to reference Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041MATHCrossRef Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041MATHCrossRef
go back to reference Aisha A, Muhammad S, Hussain SJ, Mudassar R (2014) Face recognition invariant to partial occlusions. KSII Trans Internet Inf Syst (TIIS) 8(7):2496–2511 Aisha A, Muhammad S, Hussain SJ, Mudassar R (2014) Face recognition invariant to partial occlusions. KSII Trans Internet Inf Syst (TIIS) 8(7):2496–2511
go back to reference Amutha R (2012) A novel approach to face recognition under various facial expressions, occlusion and tilt angles. In: 2012 International conference on emerging trends in science, engineering and technology (INCOSET). IEEE, pp 143–149 Amutha R (2012) A novel approach to face recognition under various facial expressions, occlusion and tilt angles. In: 2012 International conference on emerging trends in science, engineering and technology (INCOSET). IEEE, pp 143–149
go back to reference Andrés AM, Padovani S, Tepper M, Jacobo-Berlles J (2014) Face recognition on partially occluded images using compressed sensing. Pattern Recognit Lett 36:235–242CrossRef Andrés AM, Padovani S, Tepper M, Jacobo-Berlles J (2014) Face recognition on partially occluded images using compressed sensing. Pattern Recognit Lett 36:235–242CrossRef
go back to reference Ayarpadi K, Kannan E, Nair RR, Anitha T, Srinivasan R, Scholar P (2012) Face recognition under expressions and lighting variations using masking and synthesizing. Int J Eng Res Appl (IJERA) 2(1):758–763 Ayarpadi K, Kannan E, Nair RR, Anitha T, Srinivasan R, Scholar P (2012) Face recognition under expressions and lighting variations using masking and synthesizing. Int J Eng Res Appl (IJERA) 2(1):758–763
go back to reference Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464CrossRef Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464CrossRef
go back to reference Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
go back to reference Bilge, HS, Kerimbekov Y, Ugurlu HH (2013) Dimensionality reduction based on Lorentzian manifold for face recognition. In: 2013 International conference on electronics, computer and computation (ICECCO). IEEE, pp 212–215 Bilge, HS, Kerimbekov Y, Ugurlu HH (2013) Dimensionality reduction based on Lorentzian manifold for face recognition. In: 2013 International conference on electronics, computer and computation (ICECCO). IEEE, pp 212–215
go back to reference Bledsoe W (1964) The model method in facial recognition, panoramic research inc., Palo Alto, CA. Technical Report, Technical Report PRI:15 Bledsoe W (1964) The model method in facial recognition, panoramic research inc., Palo Alto, CA. Technical Report, Technical Report PRI:15
go back to reference Cai J, Chen J, Liang X (2015) Single-sample face recognition based on intra-class differences in a variation model. Sensors 15(1):1071–1087CrossRef Cai J, Chen J, Liang X (2015) Single-sample face recognition based on intra-class differences in a variation model. Sensors 15(1):1071–1087CrossRef
go back to reference Cevikalp H, Neamtu M, Wilkes M, Barkana A (2005) Discriminative common vectors for face recognition. IEEE Trans Pattern Anal Mach Intell 27(1):4–13CrossRef Cevikalp H, Neamtu M, Wilkes M, Barkana A (2005) Discriminative common vectors for face recognition. IEEE Trans Pattern Anal Mach Intell 27(1):4–13CrossRef
go back to reference Chadha AR, Vaidya PP, Roja MM (2011) Face recognition using discrete cosine transform for global and local features. In: 2011 International conference on recent advancements in electrical, electronics and control engineering (ICONRAEeCE). IEEE, pp 502–505 Chadha AR, Vaidya PP, Roja MM (2011) Face recognition using discrete cosine transform for global and local features. In: 2011 International conference on recent advancements in electrical, electronics and control engineering (ICONRAEeCE). IEEE, pp 502–505
go back to reference Chen W, Gao Y (2010) Recognizing partially occluded faces from a single sample per class using string-based matching. In: Computer vision-ECCV. Springer, pp 496–509 Chen W, Gao Y (2010) Recognizing partially occluded faces from a single sample per class using string-based matching. In: Computer vision-ECCV. Springer, pp 496–509
go back to reference Chen X, Rynn P, Bowyer KW (2005) Fully automated facial symmetry axis detection in frontal color images. In: Fourth IEEE workshop on automatic identification advanced technologies, (2005). IEEE, pp 106–111 Chen X, Rynn P, Bowyer KW (2005) Fully automated facial symmetry axis detection in frontal color images. In: Fourth IEEE workshop on automatic identification advanced technologies, (2005). IEEE, pp 106–111
go back to reference Chen X, Wang S, Liu W (2015) Face recognition based on error detection under partial occlusion. In: 2015 12th International conference on service systems and service management (ICSSSM). IEEE, pp 1–4 Chen X, Wang S, Liu W (2015) Face recognition based on error detection under partial occlusion. In: 2015 12th International conference on service systems and service management (ICSSSM). IEEE, pp 1–4
go back to reference Chen Y, Yang J, Luo L, Zhang H, Qian J, Tai Y, Zhang J (2016) Adaptive noise dictionary construction via IRRPCA for face recognition. Pattern Recognit 59:26–41 Chen Y, Yang J, Luo L, Zhang H, Qian J, Tai Y, Zhang J (2016) Adaptive noise dictionary construction via IRRPCA for face recognition. Pattern Recognit 59:26–41
go back to reference Chintalapati S, Raghunadh M (2014) Illumination, expression and occlusion invariant pose-adaptive face recognition system for real-time applications. Int J Eng Trends Technol (IJETT) 8(6):292–298 Chintalapati S, Raghunadh M (2014) Illumination, expression and occlusion invariant pose-adaptive face recognition system for real-time applications. Int J Eng Trends Technol (IJETT) 8(6):292–298
go back to reference Chitra S, Balakrishnan G (2012) A survey of face recognition on feature extraction process of dimensionality reduction techniques. J Theor Appl Inf Technol 36(1):92–100 Chitra S, Balakrishnan G (2012) A survey of face recognition on feature extraction process of dimensionality reduction techniques. J Theor Appl Inf Technol 36(1):92–100
go back to reference Deng Y, Dai Q, Zhang Z (2011) Graph Laplace for occluded face completion and recognition. IEEE Trans Image Process 20(8):2329–2338MathSciNetMATHCrossRef Deng Y, Dai Q, Zhang Z (2011) Graph Laplace for occluded face completion and recognition. IEEE Trans Image Process 20(8):2329–2338MathSciNetMATHCrossRef
go back to reference Deng W, Hu J, Zhou X, Guo J (2014) Equidistant prototypes embedding for single sample based face recognition with generic learning and incremental learning. Pattern Recognit 47(12):3738–3749CrossRef Deng W, Hu J, Zhou X, Guo J (2014) Equidistant prototypes embedding for single sample based face recognition with generic learning and incremental learning. Pattern Recognit 47(12):3738–3749CrossRef
go back to reference Ding R-X, Du DK, Huang Z-H, Li Z-M, Shang K (2015) Variational feature representation-based classification for face recognition with single sample per person. J Vis Commun Image Represent 30:35–45CrossRef Ding R-X, Du DK, Huang Z-H, Li Z-M, Shang K (2015) Variational feature representation-based classification for face recognition with single sample per person. J Vis Commun Image Represent 30:35–45CrossRef
go back to reference Etemad K, Chellappa R (1997) Discriminant analysis for recognition of human face images. JOSA A 14(8):1724–1733CrossRef Etemad K, Chellappa R (1997) Discriminant analysis for recognition of human face images. JOSA A 14(8):1724–1733CrossRef
go back to reference Faaya TH, Toygar O, Demiralp M, Mikhael W, Caballero A, Abatzoglou N, Tabrizi M, Leandre R, Garcia-Planas M, Chroas R (2008) Recognizing faces under facial expression variations and partial occlusions. In: WSEAS international conference. Proceedings. Mathematics and computers in science and engineering, no. 7. World Scientific and Engineering Academy and Society Faaya TH, Toygar O, Demiralp M, Mikhael W, Caballero A, Abatzoglou N, Tabrizi M, Leandre R, Garcia-Planas M, Chroas R (2008) Recognizing faces under facial expression variations and partial occlusions. In: WSEAS international conference. Proceedings. Mathematics and computers in science and engineering, no. 7. World Scientific and Engineering Academy and Society
go back to reference Feng Z, Yang M, Zhang L, Liu Y, Zhang D (2013) Joint discriminative dimensionality reduction and dictionary learning for face recognition. Pattern Recognit 46(8):2134–2143CrossRef Feng Z, Yang M, Zhang L, Liu Y, Zhang D (2013) Joint discriminative dimensionality reduction and dictionary learning for face recognition. Pattern Recognit 46(8):2134–2143CrossRef
go back to reference Gao Y, Leung MK (2002) Face recognition using line edge map. IEEE Trans Pattern Anal Mach Intell 24(6):764–779CrossRef Gao Y, Leung MK (2002) Face recognition using line edge map. IEEE Trans Pattern Anal Mach Intell 24(6):764–779CrossRef
go back to reference Gao Y, Qi Y (2005) Robust visual similarity retrieval in single model face databases. Pattern Recognit 38(7):1009–1020CrossRef Gao Y, Qi Y (2005) Robust visual similarity retrieval in single model face databases. Pattern Recognit 38(7):1009–1020CrossRef
go back to reference Gao Q-X, Zhang L, Zhang D (2008) Face recognition using FLDA with single training image per person. Appl Math Comput 205(2):726–734MATH Gao Q-X, Zhang L, Zhang D (2008) Face recognition using FLDA with single training image per person. Appl Math Comput 205(2):726–734MATH
go back to reference Gao S, Jia K, Zhuang L, Ma Y (2015) Neither global nor local: regularized patch-based representation for single sample per person face recognition. Int J Comput Vis 111(3):365–383MathSciNetCrossRef Gao S, Jia K, Zhuang L, Ma Y (2015) Neither global nor local: regularized patch-based representation for single sample per person face recognition. Int J Comput Vis 111(3):365–383MathSciNetCrossRef
go back to reference Gu G, Hou Z, Chen C, Zhao Y (2016) A dimensionality reduction method based on structured sparse representation for face recognition. Artif Intell Rev 46(4):431–443CrossRef Gu G, Hou Z, Chen C, Zhao Y (2016) A dimensionality reduction method based on structured sparse representation for face recognition. Artif Intell Rev 46(4):431–443CrossRef
go back to reference Guo G, Li SZ, Chan K (2000) Face recognition by support vector machines. In: Fourth IEEE international conference on automatic face and gesture recognition, Proceedings. IEEE, pp 196–201 Guo G, Li SZ, Chan K (2000) Face recognition by support vector machines. In: Fourth IEEE international conference on automatic face and gesture recognition, Proceedings. IEEE, pp 196–201
go back to reference Hafiz F, Shafie AA, Mustafah YM (2012) Face recognition from single sample per person by learning of generic discriminant vectors. Procedia Eng 41:465–472CrossRef Hafiz F, Shafie AA, Mustafah YM (2012) Face recognition from single sample per person by learning of generic discriminant vectors. Procedia Eng 41:465–472CrossRef
go back to reference Haghighat M, Abdel-Mottaleb M, Alhalabi W (2016) Fully automatic face normalization and single sample face recognition in unconstrained environments. Expert Syst Appl 47:23–34CrossRef Haghighat M, Abdel-Mottaleb M, Alhalabi W (2016) Fully automatic face normalization and single sample face recognition in unconstrained environments. Expert Syst Appl 47:23–34CrossRef
go back to reference Han X, Yap MH, Palmer I (2012) Face recognition in the presence of expressions. J Softw Eng Appl 5(5):321CrossRef Han X, Yap MH, Palmer I (2012) Face recognition in the presence of expressions. J Softw Eng Appl 5(5):321CrossRef
go back to reference Harguess J, Aggarwal J (2011) Is there a connection between face symmetry and face recognition? In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW). IEEE, pp 66–73 Harguess J, Aggarwal J (2011) Is there a connection between face symmetry and face recognition? In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW). IEEE, pp 66–73
go back to reference He X, Niyogi P (2004) Locality preserving projections. In: Advances in neural information processing systems, vol 5. pp 153–160 He X, Niyogi P (2004) Locality preserving projections. In: Advances in neural information processing systems, vol 5. pp 153–160
go back to reference Hsieh C-K, Lai S-H, Chen Y-C (2010) An optical flow-based approach to robust face recognition under expression variations. IEEE Trans Image Process 19(1):233–240MathSciNetMATHCrossRef Hsieh C-K, Lai S-H, Chen Y-C (2010) An optical flow-based approach to robust face recognition under expression variations. IEEE Trans Image Process 19(1):233–240MathSciNetMATHCrossRef
go back to reference Hu Y-S, Li, J, Yang Z, Lu J-G, Su J-B (2016) Joint dimensionality reduction for face recognition based on d-ksvd. In: 2016 International conference on machine learning and cybernetics (ICMLC), vol 2. IEEE, pp 483–488 Hu Y-S, Li, J, Yang Z, Lu J-G, Su J-B (2016) Joint dimensionality reduction for face recognition based on d-ksvd. In: 2016 International conference on machine learning and cybernetics (ICMLC), vol 2. IEEE, pp 483–488
go back to reference Hu C, Ye M, Ji S, Zeng W, Lu X (2015) A new face recognition method based on image decomposition for single sample per person problem. Neurocomputing 160:287–299CrossRef Hu C, Ye M, Ji S, Zeng W, Lu X (2015) A new face recognition method based on image decomposition for single sample per person problem. Neurocomputing 160:287–299CrossRef
go back to reference Huang X, Zhao G, Zheng W, Pietikäinen M (2012) Towards a dynamic expression recognition system under facial occlusion. Pattern Recognit Lett 33(16):2181–2191CrossRef Huang X, Zhao G, Zheng W, Pietikäinen M (2012) Towards a dynamic expression recognition system under facial occlusion. Pattern Recognit Lett 33(16):2181–2191CrossRef
go back to reference Huang J, Su K, El-Den J, Hu T, Li J (2014) An MPCA/LDA based dimensionality reduction algorithm for face recognition. Math Probl Eng 2014:1–12 Huang J, Su K, El-Den J, Hu T, Li J (2014) An MPCA/LDA based dimensionality reduction algorithm for face recognition. Math Probl Eng 2014:1–12
go back to reference Huang J, Yuen PC, Chen W-S, Lai J-H (2003) Component-based lDA method for face recognition with one training sample. In: IEEE international workshop on analysis and modeling of faces and gestures, AMFG 2003. IEEE, pp 120–126 Huang J, Yuen PC, Chen W-S, Lai J-H (2003) Component-based lDA method for face recognition with one training sample. In: IEEE international workshop on analysis and modeling of faces and gestures, AMFG 2003. IEEE, pp 120–126
go back to reference Jadhav DV, Holambe RS (2008) Radon and discrete cosine transforms based feature extraction and dimensionality reduction approach for face recognition. Signal Process 88(10):2604–2609MATHCrossRef Jadhav DV, Holambe RS (2008) Radon and discrete cosine transforms based feature extraction and dimensionality reduction approach for face recognition. Signal Process 88(10):2604–2609MATHCrossRef
go back to reference JayaMohan C, Deepak MS, Manuel MAE, Wise DJW (2015) Face recognition under expressions and lighting variations using artificial intelligence and image synthesizing. Int J Comput Sci Netw Secur (IJCSNS) 15(9):59 JayaMohan C, Deepak MS, Manuel MAE, Wise DJW (2015) Face recognition under expressions and lighting variations using artificial intelligence and image synthesizing. Int J Comput Sci Netw Secur (IJCSNS) 15(9):59
go back to reference Kan M, Shan S, Su Y, Xu D, Chen X (2013) Adaptive discriminant learning for face recognition. Pattern Recognit 46(9):2497–2509CrossRef Kan M, Shan S, Su Y, Xu D, Chen X (2013) Adaptive discriminant learning for face recognition. Pattern Recognit 46(9):2497–2509CrossRef
go back to reference Kanan HR, Gao Y (2009 Recognition of expression variant faces from one sample image per enrolled subject. In: 2009 16th IEEE intenational conference on image processing (ICIP). IEEE, pp 3309–3312 Kanan HR, Gao Y (2009 Recognition of expression variant faces from one sample image per enrolled subject. In: 2009 16th IEEE intenational conference on image processing (ICIP). IEEE, pp 3309–3312
go back to reference Kanan HR, Faez K (2010) Recognizing faces using adaptively weighted sub-gabor array from a single sample image per enrolled subject. Image Vis Comput 28(3):438–448CrossRef Kanan HR, Faez K (2010) Recognizing faces using adaptively weighted sub-gabor array from a single sample image per enrolled subject. Image Vis Comput 28(3):438–448CrossRef
go back to reference Kanan HR, Faez K, Gao Y (2008) Face recognition using adaptively weighted patch PZM array from a single exemplar image per person. Pattern Recognit 41(12):3799–3812MATHCrossRef Kanan HR, Faez K, Gao Y (2008) Face recognition using adaptively weighted patch PZM array from a single exemplar image per person. Pattern Recognit 41(12):3799–3812MATHCrossRef
go back to reference Khamele SV, Mundada SG (2015) An approach for restoring occluded images for face-recognition. Int J Adv Res Comput Commun Eng 4(17):571–575 Khamele SV, Mundada SG (2015) An approach for restoring occluded images for face-recognition. Int J Adv Res Comput Commun Eng 4(17):571–575
go back to reference Kim KI, Jung K, Kim HJ (2002) Face recognition using kernel principal component analysis. IEEE Signal Process Lett 9(2):40–42CrossRef Kim KI, Jung K, Kim HJ (2002) Face recognition using kernel principal component analysis. IEEE Signal Process Lett 9(2):40–42CrossRef
go back to reference Kim J, Choi J, Yi J, Turk M (2005) Effective representation using ICA for face recognition robust to local distortion and partial occlusion. IEEE Trans Pattern Anal Mach Intell 27(12):1977–1981CrossRef Kim J, Choi J, Yi J, Turk M (2005) Effective representation using ICA for face recognition robust to local distortion and partial occlusion. IEEE Trans Pattern Anal Mach Intell 27(12):1977–1981CrossRef
go back to reference Kim TY, Lee KM, Lee SU, Yim C-H (2007) Occlusion invariant face recognition using two-dimensional PCA. Adv Comput Graph Comput Vis 4:305–315 Kim TY, Lee KM, Lee SU, Yim C-H (2007) Occlusion invariant face recognition using two-dimensional PCA. Adv Comput Graph Comput Vis 4:305–315
go back to reference Kumar DS, Kumaresan SJ (2013) Real-time face recognition based on optical flow and histogram equalization. ICTACT J Image Video Process 3(4):626–629 Kumar DS, Kumaresan SJ (2013) Real-time face recognition based on optical flow and histogram equalization. ICTACT J Image Video Process 3(4):626–629
go back to reference Lahasan BM, Venkat I, Lutfi SL (2014) Recognition of occluded faces using an enhanced EBGM algorithm. In: International conference on computer & information sciences 2014 (ICCOINS2014), Kuala Lumpur, Malaysia, June 2014 Lahasan BM, Venkat I, Lutfi SL (2014) Recognition of occluded faces using an enhanced EBGM algorithm. In: International conference on computer & information sciences 2014 (ICCOINS2014), Kuala Lumpur, Malaysia, June 2014
go back to reference Lahasan BM, Venkat I, Al-Betar MA, Lutfi SL, De Wilde P (2016) Recognizing faces prone to occlusions and common variations using optimal face subgraphs. Appl Math Comput 283:316–332MathSciNetMATH Lahasan BM, Venkat I, Al-Betar MA, Lutfi SL, De Wilde P (2016) Recognizing faces prone to occlusions and common variations using optimal face subgraphs. Appl Math Comput 283:316–332MathSciNetMATH
go back to reference Latha P, Ganesan L, Annadurai S (2009) Face recognition using neural networks. Signal Process Int J (SPIJ) 3(5):153–160 Latha P, Ganesan L, Annadurai S (2009) Face recognition using neural networks. Signal Process Int J (SPIJ) 3(5):153–160
go back to reference Levine MD, Yu Y (2006) Face recognition subject to variations in facial expression, illumination and pose using correlation filters. Comput Vis Image Underst 104(1):1–15CrossRef Levine MD, Yu Y (2006) Face recognition subject to variations in facial expression, illumination and pose using correlation filters. Comput Vis Image Underst 104(1):1–15CrossRef
go back to reference Li Y, Feng J (2013) Reconstruction based face occlusion elimination for recognition. Neurocomputing 101:68–72CrossRef Li Y, Feng J (2013) Reconstruction based face occlusion elimination for recognition. Neurocomputing 101:68–72CrossRef
go back to reference Li Y, Gong S, Liddell H (2000) Support vector regression and classification based multi-view face detection and recognition. In: Fourth IEEE international conference on automatic face and gesture recognition, proceedings. IEEE, pp 300–305 Li Y, Gong S, Liddell H (2000) Support vector regression and classification based multi-view face detection and recognition. In: Fourth IEEE international conference on automatic face and gesture recognition, proceedings. IEEE, pp 300–305
go back to reference Li X, Mori G, Zhang H (2006) Expression-invariant face recognition with expression classification. In: The 3rd Canadian conference on computer and robot vision, 2006. IEEE, pp 77–77 Li X, Mori G, Zhang H (2006) Expression-invariant face recognition with expression classification. In: The 3rd Canadian conference on computer and robot vision, 2006. IEEE, pp 77–77
go back to reference Li L, Peng Y, Qiu G, Sun Z, Liu S (2017) A survey of virtual sample generation technology for face recognition. Artif Intell Rev 48:1–20 Li L, Peng Y, Qiu G, Sun Z, Liu S (2017) A survey of virtual sample generation technology for face recognition. Artif Intell Rev 48:1–20
go back to reference Liu J, Chen S, Zhang D, Tan X (2006) An efficient pseudoinverse linear discriminant analysis method for face recognition. In: International conference on neural information processing, Hong Kong, China Liu J, Chen S, Zhang D, Tan X (2006) An efficient pseudoinverse linear discriminant analysis method for face recognition. In: International conference on neural information processing, Hong Kong, China
go back to reference Liu Z, Pu J, Wu Q, Zhao X (2016) Using the original and symmetrical face training samples to perform collaborative representation for face recognition. Opt Int J Light Electron Opt 127(4):1900–1904CrossRef Liu Z, Pu J, Wu Q, Zhao X (2016) Using the original and symmetrical face training samples to perform collaborative representation for face recognition. Opt Int J Light Electron Opt 127(4):1900–1904CrossRef
go back to reference Lu C-L, Tsai L-W, Wang Y-K, Fan K-C (2010) Robust face recognition under illumination and facial expression variations. In: 2010 International conference on machine learning and cybernetics (ICMLC), vol 6. IEEE, pp 3257–3263 Lu C-L, Tsai L-W, Wang Y-K, Fan K-C (2010) Robust face recognition under illumination and facial expression variations. In: 2010 International conference on machine learning and cybernetics (ICMLC), vol 6. IEEE, pp 3257–3263
go back to reference Lu J, Tan Y-P, Wang G (2013) Discriminative multimanifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal Mach Intell 35(1):39–51CrossRef Lu J, Tan Y-P, Wang G (2013) Discriminative multimanifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal Mach Intell 35(1):39–51CrossRef
go back to reference Luan X, Fang B, Liu L, Zhou L (2013) Face recognition with contiguous occlusion using linear regression and level set method. Neurocomputing 122:386–397CrossRef Luan X, Fang B, Liu L, Zhou L (2013) Face recognition with contiguous occlusion using linear regression and level set method. Neurocomputing 122:386–397CrossRef
go back to reference Luan X, Fang B, Liu L, Yang W, Qian J (2014) Extracting sparse error of robust PCA for face recognition in the presence of varying illumination and occlusion. Pattern Recognit 47(2):495–508CrossRef Luan X, Fang B, Liu L, Yang W, Qian J (2014) Extracting sparse error of robust PCA for face recognition in the presence of varying illumination and occlusion. Pattern Recognit 47(2):495–508CrossRef
go back to reference Martínez AM (2003) Recognizing expression variant faces from a single sample image per class. In: 2003 IEEE computer society conference on computer vision and pattern recognition, 2003. Proceedings, vol 1. IEEE, pp I–353 Martínez AM (2003) Recognizing expression variant faces from a single sample image per class. In: 2003 IEEE computer society conference on computer vision and pattern recognition, 2003. Proceedings, vol 1. IEEE, pp I–353
go back to reference Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763CrossRef Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763CrossRef
go back to reference McCloskey S, Langer M, Siddiqi K (2011) Removal of partial occlusion from single images. IEEE Trans Pattern Anal Mach Intell 33(3):647–654CrossRef McCloskey S, Langer M, Siddiqi K (2011) Removal of partial occlusion from single images. IEEE Trans Pattern Anal Mach Intell 33(3):647–654CrossRef
go back to reference McLaughlin N, Ming J, Crookes D (2013) Robust multimodal person identification with limited training data. IEEE Trans Hum Mach Syst 43(2):214–224CrossRef McLaughlin N, Ming J, Crookes D (2013) Robust multimodal person identification with limited training data. IEEE Trans Hum Mach Syst 43(2):214–224CrossRef
go back to reference Min R, Hadid A, Dugelay J (2011) Improving the recognition of faces occluded by facial accessories. 442–447 Min R, Hadid A, Dugelay J (2011) Improving the recognition of faces occluded by facial accessories. 442–447
go back to reference Mliki H, Fendri E, Hammami M (2015) Face recognition through different facial expressions. J Signal Process Syst 81(3):433–446CrossRef Mliki H, Fendri E, Hammami M (2015) Face recognition through different facial expressions. J Signal Process Syst 81(3):433–446CrossRef
go back to reference Nandini M, Bhargavi P, Sekhar GR (2013) Face recognition using neural networks. Int J Sci Res Publ 3(3):1 Nandini M, Bhargavi P, Sekhar GR (2013) Face recognition using neural networks. Int J Sci Res Publ 3(3):1
go back to reference Neves J, Narducci F, Barra S, Proença H (2016) Biometric recognition in surveillance scenarios: a survey. Artif Intell Rev 46(4):515–541CrossRef Neves J, Narducci F, Barra S, Proença H (2016) Biometric recognition in surveillance scenarios: a survey. Artif Intell Rev 46(4):515–541CrossRef
go back to reference Ou W, You X, Tao D, Zhang P, Tang Y, Zhu Z (2014) Robust face recognition via occlusion dictionary learning. Pattern Recognit 47(4):1559–1572CrossRef Ou W, You X, Tao D, Zhang P, Tang Y, Zhu Z (2014) Robust face recognition via occlusion dictionary learning. Pattern Recognit 47(4):1559–1572CrossRef
go back to reference Pang YH, Teoh ABJ, Wong EK, Abas FS (2008) Supervised locally linear embedding in face recognition. In: International symposium on biometrics and security technologies, (2008) ISBAST 2008. IEEE, pp 1–6 Pang YH, Teoh ABJ, Wong EK, Abas FS (2008) Supervised locally linear embedding in face recognition. In: International symposium on biometrics and security technologies, (2008) ISBAST 2008. IEEE, pp 1–6
go back to reference Priya GN, Banu RW (2014) Occlusion invariant face recognition using mean based weight matrix and support vector machine. Sadhana 39(2):303–315MATHCrossRef Priya GN, Banu RW (2014) Occlusion invariant face recognition using mean based weight matrix and support vector machine. Sadhana 39(2):303–315MATHCrossRef
go back to reference Ramachandran M, Zhou SK, Jhalani D, Chellappa R (2005) A method for converting a smiling face to a neutral face with applications to face recognition. In: IEEE international conference on acoustics, speech, and signal processing, 2005. Proceedings. (ICASSP’05), vol 2. IEEE, pp ii–977 Ramachandran M, Zhou SK, Jhalani D, Chellappa R (2005) A method for converting a smiling face to a neutral face with applications to face recognition. In: IEEE international conference on acoustics, speech, and signal processing, 2005. Proceedings. (ICASSP’05), vol 2. IEEE, pp ii–977
go back to reference Raytchev B, Yoda I, Sakaue K (2006) Multi-view face recognition by nonlinear dimensionality reduction and generalized linear models. In: 7th International conference on automatic face and gesture recognition, 2006. FGR 2006. IEEE, pp 625–630 Raytchev B, Yoda I, Sakaue K (2006) Multi-view face recognition by nonlinear dimensionality reduction and generalized linear models. In: 7th International conference on automatic face and gesture recognition, 2006. FGR 2006. IEEE, pp 625–630
go back to reference Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
go back to reference Satonkar Suhas S, Kurhe Ajay B, Prakash Khanale B (2012) Face recognition using principal component analysis and linear discriminant analysis on holistic approach in facial images database. Int Organ Sci Res 2(12):15–23 Satonkar Suhas S, Kurhe Ajay B, Prakash Khanale B (2012) Face recognition using principal component analysis and linear discriminant analysis on holistic approach in facial images database. Int Organ Sci Res 2(12):15–23
go back to reference Schölkopf B, Smola A, Müller K-R (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Schölkopf B, Smola A, Müller K-R (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
go back to reference Sharma A, Dubey A, Tripathi P, Kumar V (2010) Pose invariant virtual classifiers from single training image using novel hybrid-eigenfaces. Neurocomputing 73(10):1868–1880CrossRef Sharma A, Dubey A, Tripathi P, Kumar V (2010) Pose invariant virtual classifiers from single training image using novel hybrid-eigenfaces. Neurocomputing 73(10):1868–1880CrossRef
go back to reference Sharma M, Prakash S, Gupta P (2013) An efficient partial occluded face recognition system. Neurocomputing 116:231–241CrossRef Sharma M, Prakash S, Gupta P (2013) An efficient partial occluded face recognition system. Neurocomputing 116:231–241CrossRef
go back to reference Singh AK, Nandi G (2012) Face recognition using facial symmetry. In: Proceedings of the second international conference on computational science, engineering and information technology. ACM, pp 550–554 Singh AK, Nandi G (2012) Face recognition using facial symmetry. In: Proceedings of the second international conference on computational science, engineering and information technology. ACM, pp 550–554
go back to reference Song F, Zhang D, Yang J (2006) A novel dimensionality-reduction approach for face recognition. Neurocomputing 69(13):1683–1687CrossRef Song F, Zhang D, Yang J (2006) A novel dimensionality-reduction approach for face recognition. Neurocomputing 69(13):1683–1687CrossRef
go back to reference Tan X, Chen S, Zhou Z-H, Zhang F (2005) Recognizing partially occluded, expression variant faces from single training image per person with som and soft k-nn ensemble. IEEE Trans Neural Netw 16(4):875–886CrossRef Tan X, Chen S, Zhou Z-H, Zhang F (2005) Recognizing partially occluded, expression variant faces from single training image per person with som and soft k-nn ensemble. IEEE Trans Neural Netw 16(4):875–886CrossRef
go back to reference Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recognit 39(9):1725–1745MATHCrossRef Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recognit 39(9):1725–1745MATHCrossRef
go back to reference Tan X, Chen S, Zhou Z-H, Liu J (2009) Face recognition under occlusions and variant expressions with partial similarity. IEEE Trans Inf Forensics Secur 4(2):217–230CrossRef Tan X, Chen S, Zhou Z-H, Liu J (2009) Face recognition under occlusions and variant expressions with partial similarity. IEEE Trans Inf Forensics Secur 4(2):217–230CrossRef
go back to reference Tenenbaum JB, De Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum JB, De Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
go back to reference Troje N, Bülthoff H (1996) Bilateral symmetry of human faces helps to generalize to novel views. In: 24th Göttingen neurobiology conference Troje N, Bülthoff H (1996) Bilateral symmetry of human faces helps to generalize to novel views. In: 24th Göttingen neurobiology conference
go back to reference Tsai P, Tran TP, Cao L (2009) Expression-invariant facial identification. In: IEEE international conference on systems, man and cybernetics (2009) SMC 2009. IEEE, pp 5151–5155 Tsai P, Tran TP, Cao L (2009) Expression-invariant facial identification. In: IEEE international conference on systems, man and cybernetics (2009) SMC 2009. IEEE, pp 5151–5155
go back to reference Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef
go back to reference Venkat I, Khader AT, Subramanian K, Wilde PD (2013) Recognizing occluded faces by exploiting psychophysically inspired similarity maps. Pattern Recognit Lett 34(8):903–911CrossRef Venkat I, Khader AT, Subramanian K, Wilde PD (2013) Recognizing occluded faces by exploiting psychophysically inspired similarity maps. Pattern Recognit Lett 34(8):903–911CrossRef
go back to reference Vijayalakshmi A, Raj P (2015a) An efficient method to recognize human faces from video sequences with occlusion? World Comput Sci Inf Technol J (WCSIT) 5(2):28–33 Vijayalakshmi A, Raj P (2015a) An efficient method to recognize human faces from video sequences with occlusion? World Comput Sci Inf Technol J (WCSIT) 5(2):28–33
go back to reference Vijayalakshmi A, Raj P (2015b) An approach to improvise recognition rate from occluded and pose variant faces. In: 2015 International conference on computation of power, energy information and commuincation (ICCPEIC). IEEE, pp 0547–0552 Vijayalakshmi A, Raj P (2015b) An approach to improvise recognition rate from occluded and pose variant faces. In: 2015 International conference on computation of power, energy information and commuincation (ICCPEIC). IEEE, pp 0547–0552
go back to reference Vimala K, Kalaivani V, Devi VA (2014) Optical flow based face recognition under expression variations. Int J Inf Sci Intell Syst 2(3):1–12 Vimala K, Kalaivani V, Devi VA (2014) Optical flow based face recognition under expression variations. Int J Inf Sci Intell Syst 2(3):1–12
go back to reference Vinay A, Vasuki V, Bhat S, Jayanth K, Murthy KB, Natarajan S (2016) Two dimensionality reduction techniques for surf based face recognition. Procedia Comput Sci 85:241–248CrossRef Vinay A, Vasuki V, Bhat S, Jayanth K, Murthy KB, Natarajan S (2016) Two dimensionality reduction techniques for surf based face recognition. Procedia Comput Sci 85:241–248CrossRef
go back to reference Wan M, Yang G, Huang W, Jin Z (2011) Class mean embedding for face recognition. Artif Intell Rev 36(4):285–297CrossRef Wan M, Yang G, Huang W, Jin Z (2011) Class mean embedding for face recognition. Artif Intell Rev 36(4):285–297CrossRef
go back to reference Wang B, Li W, Li Z, Liao Q (2013) Adaptive linear regression for single-sample face recognition. Neurocomputing 115:186–191CrossRef Wang B, Li W, Li Z, Liao Q (2013) Adaptive linear regression for single-sample face recognition. Neurocomputing 115:186–191CrossRef
go back to reference Wang Y, Wang M, Chen Y, Zhu Q (2014) A novel virtual samples-based sparse representation method for face recognition. Optik-Int J Light Electron Opt 125(15):3908–3912CrossRef Wang Y, Wang M, Chen Y, Zhu Q (2014) A novel virtual samples-based sparse representation method for face recognition. Optik-Int J Light Electron Opt 125(15):3908–3912CrossRef
go back to reference Wang C, Zhang J, Chang G, Ke Q (2015) Singular value decomposition projection for solving the small sample size problem in face recognition. J Vis Commun Image Represent 26:265–274CrossRef Wang C, Zhang J, Chang G, Ke Q (2015) Singular value decomposition projection for solving the small sample size problem in face recognition. J Vis Commun Image Represent 26:265–274CrossRef
go back to reference Wei, X, Li C-T (2013) Fixation and saccade based face recognition from single image per person with various occlusions and expressions. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 70–75 Wei, X, Li C-T (2013) Fixation and saccade based face recognition from single image per person with various occlusions and expressions. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 70–75
go back to reference Wei C-P, Wang Y-CF (2015) Undersampled face recognition via robust auxiliary dictionary learning. IEEE Trans Image Process 24(6):1722–1734MathSciNetMATHCrossRef Wei C-P, Wang Y-CF (2015) Undersampled face recognition via robust auxiliary dictionary learning. IEEE Trans Image Process 24(6):1722–1734MathSciNetMATHCrossRef
go back to reference Wei X, Li C-T, Hu Y (2013) Face recognition with occlusion using dynamic image-to-class warping (DICW). In: 10th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–6 Wei X, Li C-T, Hu Y (2013) Face recognition with occlusion using dynamic image-to-class warping (DICW). In: 10th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–6
go back to reference Wen Y, Liu W, Yang M, Fu Y, Xiang Y, Hu R (2016) Structured occlusion coding for robust face recognition. Neurocomputing 178:11–24CrossRef Wen Y, Liu W, Yang M, Fu Y, Xiang Y, Hu R (2016) Structured occlusion coding for robust face recognition. Neurocomputing 178:11–24CrossRef
go back to reference Weng R, Lu J, Tan Y (2016) Robust point set matching for partial face recognition. IEEE Trans Image Process 25(3):1163–1176 Weng R, Lu J, Tan Y (2016) Robust point set matching for partial face recognition. IEEE Trans Image Process 25(3):1163–1176
go back to reference Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef
go back to reference Xiang-Dong ZM-LL, Shi-Fu C (2003) Face recognition using kernel methods. Comput Sci 5:023 Xiang-Dong ZM-LL, Shi-Fu C (2003) Face recognition using kernel methods. Comput Sci 5:023
go back to reference Yang M, Zhang L, Shiu SC, Zhang D (2013) Gabor feature based robust representation and classification for face recognition with gabor occlusion dictionary. Pattern Recogn 46(7):1865–1878CrossRef Yang M, Zhang L, Shiu SC, Zhang D (2013) Gabor feature based robust representation and classification for face recognition with gabor occlusion dictionary. Pattern Recogn 46(7):1865–1878CrossRef
go back to reference Yang M, Zhang L, Shiu SC-K, Zhang D (2013) Robust kernel representation with statistical local features for face recognition. IEEE Trans Neural Netw Learn Syst 24(6):900–912CrossRef Yang M, Zhang L, Shiu SC-K, Zhang D (2013) Robust kernel representation with statistical local features for face recognition. IEEE Trans Neural Netw Learn Syst 24(6):900–912CrossRef
go back to reference Yang G, Feng Y, Lu H (2015) Sparse error via reweighted low rank representation for face recognition with various illumination and occlusion. Opt Int J Light Electron Opt 126(24):5376–5380CrossRef Yang G, Feng Y, Lu H (2015) Sparse error via reweighted low rank representation for face recognition with various illumination and occlusion. Opt Int J Light Electron Opt 126(24):5376–5380CrossRef
go back to reference Yang M, Zhang L, Yang J, Zhang D (2011) Robust sparse coding for face recognition. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 625–632 Yang M, Zhang L, Yang J, Zhang D (2011) Robust sparse coding for face recognition. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 625–632
go back to reference Ye J, Li Q (2005) A two-stage linear discriminant analysis via qr-decomposition. IEEE Trans Pattern Anal Mach Intell 27(6):929–941CrossRef Ye J, Li Q (2005) A two-stage linear discriminant analysis via qr-decomposition. IEEE Trans Pattern Anal Mach Intell 27(6):929–941CrossRef
go back to reference Zhang D, Chen S, Zhou Z-H (2005) A new face recognition method based on svd perturbation for single example image per person. Appl Math Comput 163(2):895–907MathSciNetMATHCrossRef Zhang D, Chen S, Zhou Z-H (2005) A new face recognition method based on svd perturbation for single example image per person. Appl Math Comput 163(2):895–907MathSciNetMATHCrossRef
go back to reference Zhang T, Li X, Guo R-Z (2014) Producing virtual face images for single sample face recognition. Opt Int J Light Electron Opt 125(17):5017–5024CrossRef Zhang T, Li X, Guo R-Z (2014) Producing virtual face images for single sample face recognition. Opt Int J Light Electron Opt 125(17):5017–5024CrossRef
go back to reference Zhao S, Hu Z-P (2015) A modular weighted sparse representation based on fisher discriminant and sparse residual for face recognition with occlusion. Inf Process Lett 115(9):677–683MathSciNetMATHCrossRef Zhao S, Hu Z-P (2015) A modular weighted sparse representation based on fisher discriminant and sparse residual for face recognition with occlusion. Inf Process Lett 115(9):677–683MathSciNetMATHCrossRef
go back to reference Zhao S, Hu Z-P (2015) Double layers sparse representation for occluded face recognition. Opt Int J Light Electron Opt 126(21):3016–3019CrossRef Zhao S, Hu Z-P (2015) Double layers sparse representation for occluded face recognition. Opt Int J Light Electron Opt 126(21):3016–3019CrossRef
go back to reference Zhao L-N, Hu W-B, Cui L-H (2012) Face recognition feature comparison based SVD and FFT. J Signal Inf Process 3(2):259–262 Zhao L-N, Hu W-B, Cui L-H (2012) Face recognition feature comparison based SVD and FFT. J Signal Inf Process 3(2):259–262
go back to reference Zhao Y, Liu Y, Liu Y, Zhong S, Hua KA (2015) Face recognition from a single registered image for conference socializing. Expert Syst Appl 42(3):973–979CrossRef Zhao Y, Liu Y, Liu Y, Zhong S, Hua KA (2015) Face recognition from a single registered image for conference socializing. Expert Syst Appl 42(3):973–979CrossRef
go back to reference Zhao Z-Q, Cheung Y-M, Hu H, Wu X (2016) Corrupted and occluded face recognition via cooperative sparse representation. Pattern Recognit 56:77–87CrossRef Zhao Z-Q, Cheung Y-M, Hu H, Wu X (2016) Corrupted and occluded face recognition via cooperative sparse representation. Pattern Recognit 56:77–87CrossRef
go back to reference Zheng C-H, Hou Y-F, Zhang J (2016) Improved sparse representation with low-rank representation for robust face recognition. Neurocomputing 198:114–124 Zheng C-H, Hou Y-F, Zhang J (2016) Improved sparse representation with low-rank representation for robust face recognition. Neurocomputing 198:114–124
Metadata
Title
A survey on techniques to handle face recognition challenges: occlusion, single sample per subject and expression
Authors
Badr Lahasan
Syaheerah Lebai Lutfi
Rubén San-Segundo
Publication date
14-09-2017
Publisher
Springer Netherlands
Published in
Artificial Intelligence Review / Issue 2/2019
Print ISSN: 0269-2821
Electronic ISSN: 1573-7462
DOI
https://doi.org/10.1007/s10462-017-9578-y

Other articles of this Issue 2/2019

Artificial Intelligence Review 2/2019 Go to the issue

Premium Partner