Skip to main content
Top
Published in: Soft Computing 1/2019

09-08-2018 | Methodologies and Application

Sign correlation subspace for face alignment

Authors: Dansong Cheng, Yongqiang Zhang, Feng Tian, Ce Liu, Xiaofang Liu

Published in: Soft Computing | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Face alignment is an essential task for facial performance capture and expression analysis. Current methods such as random subspace supervised descent method, stage-wise relational dictionary and coarse-to-fine shape searching can ease multi-pose face alignment problem, but no method can deal with the multiple local minima problem directly. In this paper, we propose a sign correlation subspace method for domain partition in only one reduced low-dimensional subspace. Unlike previous methods, we analyze the sign correlation between features and shapes and project both of them into a mutual sign correlation subspace. Each pair of projected shape and feature keeps their signs consistent in each dimension of the subspace, so that each hyper octant holds the condition that one general descent exists. Then a set of general descents are learned from the samples in different hyperoctants. Requiring only the feature projection for domain partition, our proposed method is effective for face alignment. We have validated our approach with the public face datasets which include a range of poses. The validation results show that our method can reveal their latent relationships to poses. The comparison with state-of-the-art methods demonstrates that our method outperforms them, especially in uncontrolled conditions with various poses, while enjoying the comparable speed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Belhumeur PN, Jacobs DW, Kriegman DJ, Kumar N (2013) Localizing parts of faces using a consensus of exemplars. IEEE Trans Pattern Anal Mach Intell 35(12):2930–40CrossRef Belhumeur PN, Jacobs DW, Kriegman DJ, Kumar N (2013) Localizing parts of faces using a consensus of exemplars. IEEE Trans Pattern Anal Mach Intell 35(12):2930–40CrossRef
go back to reference Burgosartizzu XP, Perona P, Dollar P (2013) Robust face landmark estimation under occlusion. In: IEEE international conference on computer vision, pp 1513–1520 Burgosartizzu XP, Perona P, Dollar P (2013) Robust face landmark estimation under occlusion. In: IEEE international conference on computer vision, pp 1513–1520
go back to reference Cao X, Wei Y, Wen F, Sun J (2012) Face alignment by explicit shape regression. US Patent App. 13/728,584 Cao X, Wei Y, Wen F, Sun J (2012) Face alignment by explicit shape regression. US Patent App. 13/728,584
go back to reference Cootes TF, Taylor CJ, Cooper DH, Graham J (1995) Active shape models-their training and application. Comput Vis Image Underst 61(1):38–59CrossRef Cootes TF, Taylor CJ, Cooper DH, Graham J (1995) Active shape models-their training and application. Comput Vis Image Underst 61(1):38–59CrossRef
go back to reference Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685CrossRef Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685CrossRef
go back to reference Cristinacce D, Cootes TF (2006) Feature detection and tracking with constrained local models. BMVC 41:929–938MATH Cristinacce D, Cootes TF (2006) Feature detection and tracking with constrained local models. BMVC 41:929–938MATH
go back to reference Dollar P, Welinder P, Perona P (2010) Cascaded pose regression. IEEE 238(6):1078–1085 Dollar P, Welinder P, Perona P (2010) Cascaded pose regression. IEEE 238(6):1078–1085
go back to reference Fan X, Wang H, Luo Z, Li Y, Hu W, Luo D (2015) Fiducial facial point extraction using a novel projective invariant. IEEE Trans Image Process 24(3):1164–77MathSciNetCrossRef Fan X, Wang H, Luo Z, Li Y, Hu W, Luo D (2015) Fiducial facial point extraction using a novel projective invariant. IEEE Trans Image Process 24(3):1164–77MathSciNetCrossRef
go back to reference Feng ZH, Huber P, Kittler J, Christmas W, Wu XJ (2015a) Random cascaded-regression copse for robust facial landmark detection. IEEE Signal Process Lett 22(1):76–80CrossRef Feng ZH, Huber P, Kittler J, Christmas W, Wu XJ (2015a) Random cascaded-regression copse for robust facial landmark detection. IEEE Signal Process Lett 22(1):76–80CrossRef
go back to reference Feng ZH, Hu G, Kittler J, Christmas W, Wu XJ (2015b) Cascaded collaborative regression for robust facial landmark detection trained using a mixture of synthetic and real images with dynamic weighting. IEEE Trans Image Process 24(11):3425–3440MathSciNetCrossRef Feng ZH, Hu G, Kittler J, Christmas W, Wu XJ (2015b) Cascaded collaborative regression for robust facial landmark detection trained using a mixture of synthetic and real images with dynamic weighting. IEEE Trans Image Process 24(11):3425–3440MathSciNetCrossRef
go back to reference Gonzalezmora J, Torre FDL, Murthi R, Guil N, Zapata EL (2007) Bilinear active appearance models. In: IEEE international conference on computer vision, pp 1–8 Gonzalezmora J, Torre FDL, Murthi R, Guil N, Zapata EL (2007) Bilinear active appearance models. In: IEEE international conference on computer vision, pp 1–8
go back to reference Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database for studying face recognition in unconstrained environments Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database for studying face recognition in unconstrained environments
go back to reference Kazemi V, Sullivan J (2014) One millisecond face alignment with an ensemble of regression trees. In: Computer vision and pattern recognition, pp 1867–1874 Kazemi V, Sullivan J (2014) One millisecond face alignment with an ensemble of regression trees. In: Computer vision and pattern recognition, pp 1867–1874
go back to reference Kostinger M, Wohlhart P, Roth PM, Bischof H (2011) Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In: IEEE international conference on computer vision workshops, ICCV 2011 workshops, Barcelona, Spain, Nov 6–13, 2011, pp 2144–2151 Kostinger M, Wohlhart P, Roth PM, Bischof H (2011) Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In: IEEE international conference on computer vision workshops, ICCV 2011 workshops, Barcelona, Spain, Nov 6–13, 2011, pp 2144–2151
go back to reference Le V, Brandt J, Lin Z, Bourdev L, Huang TS (2012) Interactive facial feature localization. In: European conference on computer vision, pp 679–692 Le V, Brandt J, Lin Z, Bourdev L, Huang TS (2012) Interactive facial feature localization. In: European conference on computer vision, pp 679–692
go back to reference Lee HS, Kim D (2009) Tensor-based AAM with continuous variation estimation: application to variation-robust face recognition. IEEE Trans Pattern Anal Mach Intell 31(6):1102–16CrossRef Lee HS, Kim D (2009) Tensor-based AAM with continuous variation estimation: application to variation-robust face recognition. IEEE Trans Pattern Anal Mach Intell 31(6):1102–16CrossRef
go back to reference Lee D, Park H, Yoo CD (2015) Face alignment using cascade gaussian process regression trees. In: IEEE conference on computer vision and pattern recognition, pp 4204–4212 Lee D, Park H, Yoo CD (2015) Face alignment using cascade gaussian process regression trees. In: IEEE conference on computer vision and pattern recognition, pp 4204–4212
go back to reference Lindner C, Bromiley PA, Ionita MC, Cootes TF (2015) Robust and accurate shape model matching using random forest regression-voting. IEEE Trans Pattern Anal Mach Intell 37(9):1862–74CrossRef Lindner C, Bromiley PA, Ionita MC, Cootes TF (2015) Robust and accurate shape model matching using random forest regression-voting. IEEE Trans Pattern Anal Mach Intell 37(9):1862–74CrossRef
go back to reference Liu L, Hu J, Zhang S, Deng W (2014) Extended supervised descent method for robust face alignment. Springer, Berlin Liu L, Hu J, Zhang S, Deng W (2014) Extended supervised descent method for robust face alignment. Springer, Berlin
go back to reference Martinez B, Pantic M (2015a) Facial landmarking for in-the-wild images with local inference based on global appearance. Image Vis Comput 36(C):40–50CrossRef Martinez B, Pantic M (2015a) Facial landmarking for in-the-wild images with local inference based on global appearance. Image Vis Comput 36(C):40–50CrossRef
go back to reference Martinez B, Valstar MF (2015b) L 2,1-based regression and prediction accumulation across views for robust facial landmark detection. Image Vis Comput 45(4):371–382 Martinez B, Valstar MF (2015b) L 2,1-based regression and prediction accumulation across views for robust facial landmark detection. Image Vis Comput 45(4):371–382
go back to reference Ramanan D (2015) Face detection, pose estimation, and landmark localization in the wild. In: IEEE conference on computer vision and pattern recognition, pp 31–37 Ramanan D (2015) Face detection, pose estimation, and landmark localization in the wild. In: IEEE conference on computer vision and pattern recognition, pp 31–37
go back to reference Ren S, Cao X, Wei Y, Sun J (2014) Face alignment at 3000 FPS via regressing local binary features. In: IEEE transactions on image processing, pp 1685–1692 Ren S, Cao X, Wei Y, Sun J (2014) Face alignment at 3000 FPS via regressing local binary features. In: IEEE transactions on image processing, pp 1685–1692
go back to reference Romdhani S (1999) A multi-view nonlinear active shape model using kernel PCA. In: British machine vision conference, pp 483–492 Romdhani S (1999) A multi-view nonlinear active shape model using kernel PCA. In: British machine vision conference, pp 483–492
go back to reference Sagonas C, Tzimiropoulos G, Zafeiriou S, Pantic M (2013) A semi-automatic methodology for facial landmark annotation. In: IEEE conference on computer vision and pattern recognition workshops, pp 896–903 Sagonas C, Tzimiropoulos G, Zafeiriou S, Pantic M (2013) A semi-automatic methodology for facial landmark annotation. In: IEEE conference on computer vision and pattern recognition workshops, pp 896–903
go back to reference Snchez-Lozano E, Martinez B, Valstar MF (2016) Cascaded regression with sparsified feature covariance matrix for facial landmark detection. Pattern Recognit Lett 73(C):19–25CrossRef Snchez-Lozano E, Martinez B, Valstar MF (2016) Cascaded regression with sparsified feature covariance matrix for facial landmark detection. Pattern Recognit Lett 73(C):19–25CrossRef
go back to reference Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: Conference on computer vision and pattern recognition, pp 3476–3483 Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: Conference on computer vision and pattern recognition, pp 3476–3483
go back to reference Tzimiropoulos G (2015) Project-out cascaded regression with an application to face alignment. In: IEEE conference on computer vision and pattern recognition Tzimiropoulos G (2015) Project-out cascaded regression with an application to face alignment. In: IEEE conference on computer vision and pattern recognition
go back to reference Valstar M, Martinez B, Binefa X, Pantic M (2010) Facial point detection using boosted regression and graph models, pp 2729–2736 Valstar M, Martinez B, Binefa X, Pantic M (2010) Facial point detection using boosted regression and graph models, pp 2729–2736
go back to reference Xing J, Niu Z, Huang J, Hu W, Yan S (2014) Towards multi-view and partially-occluded face alignment. In: Computer vision and pattern recognition, pp 1829–1836 Xing J, Niu Z, Huang J, Hu W, Yan S (2014) Towards multi-view and partially-occluded face alignment. In: Computer vision and pattern recognition, pp 1829–1836
go back to reference Xiong X, De la Torre F (2013) Supervised descent method and its applications to face alignment. In: IEEE conference on computer vision and pattern recognition, pp 532–539 Xiong X, De la Torre F (2013) Supervised descent method and its applications to face alignment. In: IEEE conference on computer vision and pattern recognition, pp 532–539
go back to reference Xiong X, la Torre FD (2015) Global supervised descent method. In: IEEE conference on computer vision and pattern recognition, pp 2664–2673 Xiong X, la Torre FD (2015) Global supervised descent method. In: IEEE conference on computer vision and pattern recognition, pp 2664–2673
go back to reference Yang H, Patras I (2014) Fine-tuning regression forests votes for object alignment in the wild. IEEE Trans Image Process A Publ IEEE Signal Process Soc 24(2):619–31MathSciNetCrossRef Yang H, Patras I (2014) Fine-tuning regression forests votes for object alignment in the wild. IEEE Trans Image Process A Publ IEEE Signal Process Soc 24(2):619–31MathSciNetCrossRef
go back to reference Yang H, He X, Jia X, Patras I (2015a) Robust face alignment under occlusion via regional predictive power estimation. IEEE Trans Image Process 24(8):2393–403MathSciNetCrossRef Yang H, He X, Jia X, Patras I (2015a) Robust face alignment under occlusion via regional predictive power estimation. IEEE Trans Image Process 24(8):2393–403MathSciNetCrossRef
go back to reference Yang H, Jia X, Patras I, Chan KP (2015b) Random subspace supervised descent method for regression problems in computer vision. IEEE Signal Process Lett 22(10):1816–1820CrossRef Yang H, Jia X, Patras I, Chan KP (2015b) Random subspace supervised descent method for regression problems in computer vision. IEEE Signal Process Lett 22(10):1816–1820CrossRef
go back to reference Yan J, Lei Z, Yi D, Li SZ (2013) Learn to combine multiple hypotheses for accurate face alignment. In: IEEE international conference on computer vision workshops, pp 392–396 Yan J, Lei Z, Yi D, Li SZ (2013) Learn to combine multiple hypotheses for accurate face alignment. In: IEEE international conference on computer vision workshops, pp 392–396
go back to reference Zhang Z, Zhang W, Ding H, Liu J, Tang X (2014a) Hierarchical facial landmark localization via cascaded random binary patterns. Pattern Recognit 48(4):1277–1288CrossRef Zhang Z, Zhang W, Ding H, Liu J, Tang X (2014a) Hierarchical facial landmark localization via cascaded random binary patterns. Pattern Recognit 48(4):1277–1288CrossRef
go back to reference Zhang Z, Luo P, Loy CC, Tang X (2014b) Facial landmark detection by deep multi-task learning. In: European conference on computer vision, pp 94–108 Zhang Z, Luo P, Loy CC, Tang X (2014b) Facial landmark detection by deep multi-task learning. In: European conference on computer vision, pp 94–108
go back to reference Zhang J, Shan S, Kan M, Chen X (2014c) Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment. In: Computer vision-ECCV. Springer, pp 1–16 Zhang J, Shan S, Kan M, Chen X (2014c) Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment. In: Computer vision-ECCV. Springer, pp 1–16
go back to reference Zhou E, Fan H, Cao Z, Jiang Y, Yin Q (2013) Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: IEEE international conference on computer vision workshops, pp 386–391 Zhou E, Fan H, Cao Z, Jiang Y, Yin Q (2013) Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: IEEE international conference on computer vision workshops, pp 386–391
go back to reference Zhu S, Li C, Loy CC, Tang X (2015) Face alignment by coarse-to-fine shape searching. In: CVPR, pp 4998–5006 Zhu S, Li C, Loy CC, Tang X (2015) Face alignment by coarse-to-fine shape searching. In: CVPR, pp 4998–5006
Metadata
Title
Sign correlation subspace for face alignment
Authors
Dansong Cheng
Yongqiang Zhang
Feng Tian
Ce Liu
Xiaofang Liu
Publication date
09-08-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 1/2019
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3389-1

Other articles of this Issue 1/2019

Soft Computing 1/2019 Go to the issue

Premium Partner