Skip to main content
Top
Published in: Neural Processing Letters 5/2022

31-07-2020

Joint Reflectance Field Estimation and Sparse Representation for Face Image Illumination Preprocessing and Recognition

Authors: Jian Zhang, Weihua Liu, Liling Bo, Heng Zhang, Hongran Li, Shuai Xu

Published in: Neural Processing Letters | Issue 5/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Illumination preprocessing is an important ingredient for handling lighting variation face recognition challenge. Nonetheless, existing methods are usually designed to be independent of the face recognition methods and the interaction between them is not yet well explored. In this paper, we formulate the face image illumination preprocessing and recognition into a unified sparse representation framework and propose a novel joint reflectance field estimation and sparse representation (JRSR) method for face recognition under extreme lighting conditions. The proposed method separates the identify factor and the interfered illumination of a query sample simultaneously by one nonconvex sparse optimizing model. We also present an efficient approximation algorithm to solve JRSR in this paper. Evaluation on several face databases and the experimental results of face recognition with illumination variation clearly demonstrate the advantages of our proposed JRSR algorithm in illumination preprocessing efficiency and recognition accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Adini Y, Moses Y, Ullman S (1997) Face recognition: the problem of compensating for changes in illumination direction. IEEE Trans Pattern Anal Mach Intell 19(7):721–732CrossRef Adini Y, Moses Y, Ullman S (1997) Face recognition: the problem of compensating for changes in illumination direction. IEEE Trans Pattern Anal Mach Intell 19(7):721–732CrossRef
2.
go back to reference Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, and Worek W (2005) Overview of the face recognition grand challenge. In: IEEE computer society conference on computer vision and pattern recognition, pp 947–954 Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, and Worek W (2005) Overview of the face recognition grand challenge. In: IEEE computer society conference on computer vision and pattern recognition, pp 947–954
3.
go back to reference Han H, Shan S, Chen X, Gao W (2013) A comparative study on illumination preprocessing in face recognition. Pattern Recognit 46(6):1691–1699CrossRef Han H, Shan S, Chen X, Gao W (2013) A comparative study on illumination preprocessing in face recognition. Pattern Recognit 46(6):1691–1699CrossRef
4.
go back to reference Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, Romeny BTH, Zimmerman JB, Zuiderveld K (1987) Adaptive histogram equalization and its variations. Comput Vis Graph Image Process 39(3):355–368CrossRef Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, Romeny BTH, Zimmerman JB, Zuiderveld K (1987) Adaptive histogram equalization and its variations. Comput Vis Graph Image Process 39(3):355–368CrossRef
5.
go back to reference Wang H, Li SZ, and Wang Y (2004) Face recognition under varying lighting conditions using self quotient image. In: IEEE international conference on automatic face and gesture recognition, pp 819–824 Wang H, Li SZ, and Wang Y (2004) Face recognition under varying lighting conditions using self quotient image. In: IEEE international conference on automatic face and gesture recognition, pp 819–824
6.
go back to reference Chen T, Yin W, Zhou XS, Comaniciu D, Huang TS (2006) Total variation models for variable lighting face recognition. IEEE Trans Pattern Anal Mach Intell 28(9):1519–1524CrossRef Chen T, Yin W, Zhou XS, Comaniciu D, Huang TS (2006) Total variation models for variable lighting face recognition. IEEE Trans Pattern Anal Mach Intell 28(9):1519–1524CrossRef
7.
go back to reference Chen W, Er MJ, Wu S (2006) Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans Syst Man Cybern Part B Cybern Publ IEEE Syste Man Cybern Soc 36(2):458CrossRef Chen W, Er MJ, Wu S (2006) Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans Syst Man Cybern Part B Cybern Publ IEEE Syste Man Cybern Soc 36(2):458CrossRef
8.
go back to reference Wei C, Wang W, Yang W, Liu J (2018) Deep retinex decomposition for low-light enhancement. In British machine vision conference Wei C, Wang W, Yang W, Liu J (2018) Deep retinex decomposition for low-light enhancement. In British machine vision conference
9.
go back to reference Chen J, Zeng Z, Zhang R, Wang W, Zheng Y, Tian K (2019) Adaptive illumination normalization via adaptive illumination preprocessing and modified weber-face. Appl Intell 49:872–882CrossRef Chen J, Zeng Z, Zhang R, Wang W, Zheng Y, Tian K (2019) Adaptive illumination normalization via adaptive illumination preprocessing and modified weber-face. Appl Intell 49:872–882CrossRef
10.
go back to reference Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef
11.
go back to reference Deng W, Hu J, Guo J (2012) Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864CrossRef Deng W, Hu J, Guo J (2012) Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864CrossRef
12.
go back to reference Wagner A, Wright J, Ganesh A, Zhou Z, Mobahi H, Ma Y (2012) Toward a practical face recognition system: robust alignment and illumination by sparse representation. IEEE Trans Pattern Anal Mach Intell 34(2):372CrossRef Wagner A, Wright J, Ganesh A, Zhou Z, Mobahi H, Ma Y (2012) Toward a practical face recognition system: robust alignment and illumination by sparse representation. IEEE Trans Pattern Anal Mach Intell 34(2):372CrossRef
13.
go back to reference Yang J, Zhang L, Xu Y, Yang J-Y (2012) Beyond sparsity: the role of l1-optimizer in pattern classification. Pattern Recognit 45(3):1104–1118CrossRef Yang J, Zhang L, Xu Y, Yang J-Y (2012) Beyond sparsity: the role of l1-optimizer in pattern classification. Pattern Recognit 45(3):1104–1118CrossRef
14.
go back to reference Yang J, Chu D, Zhang L, Xu Y, Yang J (2013) Sparse representation classifier steered discriminative projection with applications to face recognition. IEEE Trans Neural Netw Learn Syst 24(7):1023–1035CrossRef Yang J, Chu D, Zhang L, Xu Y, Yang J (2013) Sparse representation classifier steered discriminative projection with applications to face recognition. IEEE Trans Neural Netw Learn Syst 24(7):1023–1035CrossRef
15.
go back to reference Xu Y, Li X, Yang J, Lai Z, Zhang D (2014) Integrating conventional and inverse representation for face recognition. IEEE Trans Cybern 44(10):1738–1746CrossRef Xu Y, Li X, Yang J, Lai Z, Zhang D (2014) Integrating conventional and inverse representation for face recognition. IEEE Trans Cybern 44(10):1738–1746CrossRef
16.
go back to reference Cao F, Hu H, Lu J, Zhao J, Zhou Z, Wu J (2016) Pose and illumination variable face recognition via sparse representation and illumination dictionary. Knowl-Based Syst 107:117–128CrossRef Cao F, Hu H, Lu J, Zhao J, Zhou Z, Wu J (2016) Pose and illumination variable face recognition via sparse representation and illumination dictionary. Knowl-Based Syst 107:117–128CrossRef
17.
go back to reference Yang J, Luo L, Qian J, Tai Y, Zhang F, Xu Y (2016) Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans Pattern Anal Mach Intell 39(1):156–171CrossRef Yang J, Luo L, Qian J, Tai Y, Zhang F, Xu Y (2016) Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans Pattern Anal Mach Intell 39(1):156–171CrossRef
18.
go back to reference Qian J, Yang J, Zhang F, Lin Z (2015) Robust low-rank regularized regression for face recognition with occlusion. Pattern Recognit 48:3145–3159CrossRef Qian J, Yang J, Zhang F, Lin Z (2015) Robust low-rank regularized regression for face recognition with occlusion. Pattern Recognit 48:3145–3159CrossRef
19.
go back to reference Jiang J, Ma J, Chen C, Jiang X, Zheng W (2017) Noise robust face image super-resolution through smooth sparse representation. IEEE Transa Cybern 47(11):3991–4002CrossRef Jiang J, Ma J, Chen C, Jiang X, Zheng W (2017) Noise robust face image super-resolution through smooth sparse representation. IEEE Transa Cybern 47(11):3991–4002CrossRef
20.
go back to reference Lai Z, Mo D, Wong WK, Xu Y, Miao D, Zhang D (2017) Robust discriminant regression for feature extraction. IEEE Transa Cybern 48(8):2472–84CrossRef Lai Z, Mo D, Wong WK, Xu Y, Miao D, Zhang D (2017) Robust discriminant regression for feature extraction. IEEE Transa Cybern 48(8):2472–84CrossRef
21.
go back to reference Yang J, Luo L, Qian J, Tai Y, Zhang F, Xu Y (2017) Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans Pattern Anal Mach Intell 39(1):156–171CrossRef Yang J, Luo L, Qian J, Tai Y, Zhang F, Xu Y (2017) Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans Pattern Anal Mach Intell 39(1):156–171CrossRef
22.
go back to reference Luo L, Yang J, Zhang B, Jiang J, Huang H (2018) Nonparametric bayesian correlated group regression with applications to image classification. IEEE Trans Neural Netw Learn Syst 29(11):5330–5344MathSciNetCrossRef Luo L, Yang J, Zhang B, Jiang J, Huang H (2018) Nonparametric bayesian correlated group regression with applications to image classification. IEEE Trans Neural Netw Learn Syst 29(11):5330–5344MathSciNetCrossRef
23.
go back to reference Wen J, Lai Z, Zhan Y, Cui J (2016) The l2,1-norm-based unsupervised optimal feature selection with applications to action recognition. Pattern Recogn 60:515–530CrossRef Wen J, Lai Z, Zhan Y, Cui J (2016) The l2,1-norm-based unsupervised optimal feature selection with applications to action recognition. Pattern Recogn 60:515–530CrossRef
24.
go back to reference Zhuang L, Yang AY, Zhou Z, Sastry SS, Ma Y (2015) Single-sample face recognition with image corruption and misalignment via sparse illumination transfer. Int J Comput Vis 114(2–3):272–287MathSciNetCrossRef Zhuang L, Yang AY, Zhou Z, Sastry SS, Ma Y (2015) Single-sample face recognition with image corruption and misalignment via sparse illumination transfer. Int J Comput Vis 114(2–3):272–287MathSciNetCrossRef
25.
go back to reference Land EH, Mccann JJ (1971) Lightness and retinex theory. J Opt Soc Am 61(1):1–11CrossRef Land EH, Mccann JJ (1971) Lightness and retinex theory. J Opt Soc Am 61(1):1–11CrossRef
26.
go back to reference Jobson DJ, Rahman Z, Woodell GA (1997) Properties and performance of a center/surround retinex. IEEE Trans Image Process Publi IEEE Signal Process Soc 6(3):451–62CrossRef Jobson DJ, Rahman Z, Woodell GA (1997) Properties and performance of a center/surround retinex. IEEE Trans Image Process Publi IEEE Signal Process Soc 6(3):451–62CrossRef
27.
go back to reference Xie X, Lam KM (2006) An efficient illumination normalization method for face recognition. Pattern Recognit Lett 27(6):609–617CrossRef Xie X, Lam KM (2006) An efficient illumination normalization method for face recognition. Pattern Recognit Lett 27(6):609–617CrossRef
28.
go back to reference Gross R, and Brajovic V (2003) An image preprocessing algorithm for illumination invariant face recognition. In: International conference on audio-and video-based biometric person authentication, pp 10–18 Gross R, and Brajovic V (2003) An image preprocessing algorithm for illumination invariant face recognition. In: International conference on audio-and video-based biometric person authentication, pp 10–18
29.
go back to reference Malioutov DM, Cetin M, Willsky AS (2005) Homotopy continuation for sparse signal representation. In: Proceedings of EEE international conference on acoustics, speech, and signal processing, vol 5, pp v/733–v/736 Malioutov DM, Cetin M, Willsky AS (2005) Homotopy continuation for sparse signal representation. In: Proceedings of EEE international conference on acoustics, speech, and signal processing, vol 5, pp v/733–v/736
30.
go back to reference Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef
31.
go back to reference Lee KC, Ho J, Kriegman DJ (2005) Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans Pattern Anal Mach Intell 27(5):684–698CrossRef Lee KC, Ho J, Kriegman DJ (2005) Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans Pattern Anal Mach Intell 27(5):684–698CrossRef
32.
go back to reference Hespanha JP, Naghshtabrizi P, Xu Y (2003) The cmu pose, illumination, and expression (pie) database. IEEE Trans Pattern Anal Mach Intell 25(12):1615–1618CrossRef Hespanha JP, Naghshtabrizi P, Xu Y (2003) The cmu pose, illumination, and expression (pie) database. IEEE Trans Pattern Anal Mach Intell 25(12):1615–1618CrossRef
33.
go back to reference Tan X, Triggs B (2007) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 4778(6):1635–1650MathSciNetMATH Tan X, Triggs B (2007) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 4778(6):1635–1650MathSciNetMATH
34.
go back to reference Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRef Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRef
35.
go back to reference Wiskott L, Fellous JM, Krüger N, Malsburg CVD (1997) Face recognition by elastic bunch graph matching. IEEE Trans Pattern Anal Mach Intell 19(7):775–779CrossRef Wiskott L, Fellous JM, Krüger N, Malsburg CVD (1997) Face recognition by elastic bunch graph matching. IEEE Trans Pattern Anal Mach Intell 19(7):775–779CrossRef
Metadata
Title
Joint Reflectance Field Estimation and Sparse Representation for Face Image Illumination Preprocessing and Recognition
Authors
Jian Zhang
Weihua Liu
Liling Bo
Heng Zhang
Hongran Li
Shuai Xu
Publication date
31-07-2020
Publisher
Springer US
Published in
Neural Processing Letters / Issue 5/2022
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10316-6

Other articles of this Issue 5/2022

Neural Processing Letters 5/2022 Go to the issue