Skip to main content
Top
Published in: Machine Vision and Applications 6/2013

01-08-2013 | Original Paper

Shadow compensation and illumination normalization of face image

Authors: Haiyang Wang, Mao Ye, Shangming Yang

Published in: Machine Vision and Applications | Issue 6/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study proposes a novel shadow compensation and illumination normalization method under uncontrolled light conditions. First, we decompose the face image into two images based on the Lambertian theory, which corresponds to the large- and small-scale features, respectively. Then, the threshold minimum-and-maximum filter on the small-scale features to smooth the shadow edge is applied. After that, the robust Principal Component Analysis and some normalization methods are used to remove the shadow and normalize the face image on the large-scale features. In the end, the normalized face image is obtained by combining both results from the large- and small-scale features. Our main contribution is that a more reliable shadow compensation approach is found, which can get a better normalized face image. Experiments on the Extended Yale B, CMU-PIE and FRGC 2.0 (Face Recognition Grand Challenge) face datasets show that not only the recognition performance is significantly improved, but also much better visual quality is achieved.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: ECCV, pp. 469–481 (2004) Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: ECCV, pp. 469–481 (2004)
2.
go back to reference Al-Osaimi, F.R., Bennamoun, M., Mian, A.: Illumination normalization of facial images by reversing the process of image formation. Mach. Vis. Appl. 22(6), 899–911 (2011)CrossRef Al-Osaimi, F.R., Bennamoun, M., Mian, A.: Illumination normalization of facial images by reversing the process of image formation. Mach. Vis. Appl. 22(6), 899–911 (2011)CrossRef
3.
go back to reference Basri, R., Jacobs, D.W.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Analysis Mach. Intell. 25(2), 218–233 (2003)CrossRef Basri, R., Jacobs, D.W.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Analysis Mach. Intell. 25(2), 218–233 (2003)CrossRef
4.
go back to reference Belhumeur, P.N., Kriegman, D.J.: What is the set of images of an object under all possible illumination conditions? Int. J. Comput. Vis. 28(3), 245–260 (1998)CrossRef Belhumeur, P.N., Kriegman, D.J.: What is the set of images of an object under all possible illumination conditions? Int. J. Comput. Vis. 28(3), 245–260 (1998)CrossRef
5.
go back to reference Candès, E.J., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM 58(3), Article 11 (2011) Candès, E.J., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM 58(3), Article 11 (2011)
6.
go back to reference Chang, H., Koschan, A., Abidi, B., Abidi, M.: Fusing continuous spectral images for face recognition under indoor and outdoor illuminants. Mach. Vis. Appl. 21(2), 201–215 (2010)CrossRef Chang, H., Koschan, A., Abidi, B., Abidi, M.: Fusing continuous spectral images for face recognition under indoor and outdoor illuminants. Mach. Vis. Appl. 21(2), 201–215 (2010)CrossRef
7.
go back to reference Chen, T., Yin, W., Zhou, X.S., Comaniciu, D., Huang, T.S.: Total variation models for variable lighting face recognition. IEEE Trans. Pattern Analysis Mach. Intell. 28(9), 1519–1524 (2006)CrossRef Chen, T., Yin, W., Zhou, X.S., Comaniciu, D., Huang, T.S.: Total variation models for variable lighting face recognition. IEEE Trans. Pattern Analysis Mach. Intell. 28(9), 1519–1524 (2006)CrossRef
8.
go back to reference Chen, W., Er, M.J., Wu, S.: Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man Cybern. B Cybern. 36(2), 458–466 (2006)CrossRef Chen, W., Er, M.J., Wu, S.: Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man Cybern. B Cybern. 36(2), 458–466 (2006)CrossRef
9.
go back to reference Garcia, C., Zikos, G., Tziritas, G.: A wavelet-based framework for face recognition, In: International Workshop on Advances in Facial Image Analysis and Recognition Technology, 5th European Conference on Computer Vision (1998) Garcia, C., Zikos, G., Tziritas, G.: A wavelet-based framework for face recognition, In: International Workshop on Advances in Facial Image Analysis and Recognition Technology, 5th European Conference on Computer Vision (1998)
10.
go back to reference Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Analysis Mach. Intell. 23(6), 643–660 (2001)CrossRef Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Analysis Mach. Intell. 23(6), 643–660 (2001)CrossRef
11.
go back to reference Hafed, Z.M., Levine, M.D.: Face recognition using the discrete cosine transform. Int. J. Comput. Vis. 43(3), 167–188 (2001)MATHCrossRef Hafed, Z.M., Levine, M.D.: Face recognition using the discrete cosine transform. Int. J. Comput. Vis. 43(3), 167–188 (2001)MATHCrossRef
12.
go back to reference Kumar, R., Jones, M., Marks, T.K.: Morphable reflectance fields for enhancing face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2606–2613 (2010) Kumar, R., Jones, M., Marks, T.K.: Morphable reflectance fields for enhancing face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2606–2613 (2010)
13.
go back to reference Lai, J.H., Yuen, P.C., Feng, G.C.: Face recognition using holistic Fourier invariant features. Pattern Recognit. 34(1), 95–109 (2001)MATHCrossRef Lai, J.H., Yuen, P.C., Feng, G.C.: Face recognition using holistic Fourier invariant features. Pattern Recognit. 34(1), 95–109 (2001)MATHCrossRef
14.
go back to reference Land, E.H., McCann, J.J.: Lightness and Retinex theory. J. Opt. Soc. Am. 61(1), 1–11 (1971) Land, E.H., McCann, J.J.: Lightness and Retinex theory. J. Opt. Soc. Am. 61(1), 1–11 (1971)
15.
go back to reference Li, D., Tang, X., Pedrycz, W.: Face recognition using decimated redundant discrete wavelet transforms. Mach. Vis. Appl. 23(2), 1–11 (2012) Li, D., Tang, X., Pedrycz, W.: Face recognition using decimated redundant discrete wavelet transforms. Mach. Vis. Appl. 23(2), 1–11 (2012)
16.
go back to reference Phillips, P.J., Flynn, P.J., Scruggs, T.: Overview of the face recognition grand challenge. In: IEEE conference on Computer Vision and Pattern Recognition, vol. 1, pp. 947–954 (2005) Phillips, P.J., Flynn, P.J., Scruggs, T.: Overview of the face recognition grand challenge. In: IEEE conference on Computer Vision and Pattern Recognition, vol. 1, pp. 947–954 (2005)
17.
go back to reference Shashua, A., Riklin-Raviv, T.: The quotient image: class-based re-rendering and recognition with varying illuminations. IEEE Trans. Pattern Analysis Mach. Intell. 23(2), 129–139 (2001)CrossRef Shashua, A., Riklin-Raviv, T.: The quotient image: class-based re-rendering and recognition with varying illuminations. IEEE Trans. Pattern Analysis Mach. Intell. 23(2), 129–139 (2001)CrossRef
18.
go back to reference Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression database. IEEE Trans. Pattern Analysis Mach. Intell. 25(12), 1615–1618 (2003)CrossRef Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression database. IEEE Trans. Pattern Analysis Mach. Intell. 25(12), 1615–1618 (2003)CrossRef
19.
go back to reference Vizireanu, N.D.: Generalizations of binary morphological shape decomposition. J. Electron. Imaging 16(1), 1–6 (2007)CrossRef Vizireanu, N.D.: Generalizations of binary morphological shape decomposition. J. Electron. Imaging 16(1), 1–6 (2007)CrossRef
20.
go back to reference Vizireanu, D.N.: Morphological shape decomposition interframe interpolation method. J. Electron. Imaging 17, 1–5 (2008)CrossRef Vizireanu, D.N.: Morphological shape decomposition interframe interpolation method. J. Electron. Imaging 17, 1–5 (2008)CrossRef
21.
go back to reference Vizireanu, N., Halunga, S., Marghescu, G.: Morphological skeleton decomposition interframe interpolation method. J. Electron. Imaging 19, 1–3 (2010)CrossRef Vizireanu, N., Halunga, S., Marghescu, G.: Morphological skeleton decomposition interframe interpolation method. J. Electron. Imaging 19, 1–3 (2010)CrossRef
22.
go back to reference Wang, H., Li, S.Z., Wang, Y.: Face recognition under varying lighting conditions using self quotient image. In: Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 819–824 (2004) Wang, H., Li, S.Z., Wang, Y.: Face recognition under varying lighting conditions using self quotient image. In: Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 819–824 (2004)
23.
go back to reference Wang, H., Li, S.Z., Wang, Y.: Generalized quotient image. In: IEEE Computer Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 498–505 (2004) Wang, H., Li, S.Z., Wang, Y.: Generalized quotient image. In: IEEE Computer Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 498–505 (2004)
24.
go back to reference Wright, J., Ganesh, A., Rao, S., Ma, Y.: Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. In: Conference on Neural Information Processing Systems (2009) Wright, J., Ganesh, A., Rao, S., Ma, Y.: Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. In: Conference on Neural Information Processing Systems (2009)
25.
go back to reference Xie, X., Zheng, W.S., Lai, J.: Face illumination normalization on large and small scale features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008) Xie, X., Zheng, W.S., Lai, J.: Face illumination normalization on large and small scale features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
26.
go back to reference Xie, X., Zheng, W.S., Lai, J., Yuen, P.C., Suen, C.Y.: Normalization of face illumination based on large- and small-scale features. IEEE Trans. Image Process. 20(7), 1807–1821 (2011)MathSciNetCrossRef Xie, X., Zheng, W.S., Lai, J., Yuen, P.C., Suen, C.Y.: Normalization of face illumination based on large- and small-scale features. IEEE Trans. Image Process. 20(7), 1807–1821 (2011)MathSciNetCrossRef
27.
go back to reference Zhang, T., Fang, B., Yuan, Y., Yan Tang, Y., Shang, Z., Li, D., Lang, F.: Multiscale facial structure representation for face recognition under varying illumination. Pattern Recognit. 42(2), 251–258 (2009)MATHCrossRef Zhang, T., Fang, B., Yuan, Y., Yan Tang, Y., Shang, Z., Li, D., Lang, F.: Multiscale facial structure representation for face recognition under varying illumination. Pattern Recognit. 42(2), 251–258 (2009)MATHCrossRef
Metadata
Title
Shadow compensation and illumination normalization of face image
Authors
Haiyang Wang
Mao Ye
Shangming Yang
Publication date
01-08-2013
Publisher
Springer Berlin Heidelberg
Published in
Machine Vision and Applications / Issue 6/2013
Print ISSN: 0932-8092
Electronic ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-013-0488-y

Other articles of this Issue 6/2013

Machine Vision and Applications 6/2013 Go to the issue

Premium Partner