Skip to main content

2018 | OriginalPaper | Buchkapitel

A Novel Frontal Facial Synthesis Algorithm Based on Individual Residual Face

verfasst von : Xin Ding, Ruimin Hu, Zhen Han, Zhongyuan Wang

Erschienen in: MultiMedia Modeling

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The frontal facial synthesis results of current main methods tend to be smooth and lack personal characteristics, which greatly influence the subjective impression. Especially aiming at large-scale deflecting faces, the shielding side just provides few features for reconstructing and the deformation of facial elements enhance the difficulty to obtain exact features of target frontal face, making the synthesis result seem to be same and as mean face of database. In this paper, to solve these problems, we propose a novel two-step face synthesis method. In the first step, we utilize the basic symmetry of human face to predict the missing patches according to the other side and generate interim facial image. And in the following step, we introduce the individual residual facial image between interim result and mean face to compensate for the lost personal features of the synthesis result because the residual image carries more individual characteristic of the input face. We show that experimental results of proposed method outperform in the objective and subjective effects with other state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Vetter, T., Poggio, T.: Linear object classes and image synthesis from a single example image. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 733–742 (1995)CrossRef Vetter, T., Poggio, T.: Linear object classes and image synthesis from a single example image. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 733–742 (1995)CrossRef
2.
Zurück zum Zitat Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. ACM Trans. Intell. Syst. Technol. 7(3) (2015) Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. ACM Trans. Intell. Syst. Technol. 7(3) (2015)
3.
Zurück zum Zitat Lee, M.W., Ranganath, S.: Pose-invariant face recognition using a 3D deformable model. Pattern Recogn. 36(8), 1835–1846 (2003)CrossRef Lee, M.W., Ranganath, S.: Pose-invariant face recognition using a 3D deformable model. Pattern Recogn. 36(8), 1835–1846 (2003)CrossRef
4.
Zurück zum Zitat Zhang, X., Gao, Y., Zhang, B.-L.: Recognizing rotated faces from two orthogonal views in mugshot databases, vol. 1, pp. 195–198 (2006) Zhang, X., Gao, Y., Zhang, B.-L.: Recognizing rotated faces from two orthogonal views in mugshot databases, vol. 1, pp. 195–198 (2006)
5.
Zurück zum Zitat Aldrian, O., Smith, W.A.P.: Inverse rendering of faces with a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1080–1093 (2013)CrossRef Aldrian, O., Smith, W.A.P.: Inverse rendering of faces with a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1080–1093 (2013)CrossRef
6.
Zurück zum Zitat Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999) Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)
7.
Zurück zum Zitat Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1063–1074 (2003)CrossRef Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1063–1074 (2003)CrossRef
8.
Zurück zum Zitat Zhu, X., Lei, Z., Yan, J., Yi, D.: High-fidelity pose and expression normalization for face recognition in the wild, pp. 787–796 (2015) Zhu, X., Lei, Z., Yan, J., Yi, D.: High-fidelity pose and expression normalization for face recognition in the wild, pp. 787–796 (2015)
9.
Zurück zum Zitat Hassner, T.: Viewing real-world faces in 3D. In: International Conference on Computer Vision (ICCV), December 2013 Hassner, T.: Viewing real-world faces in 3D. In: International Conference on Computer Vision (ICCV), December 2013
10.
Zurück zum Zitat Zhu, X., Lei, Z., Liu, X., Shi, H., Li, S.Z.: Face alignment across large poses: a 3D solution. Computer Science (2015) Zhu, X., Lei, Z., Liu, X., Shi, H., Li, S.Z.: Face alignment across large poses: a 3D solution. Computer Science (2015)
11.
Zurück zum Zitat Vetter, T., Jones, M.J., Poggio, T.: A bootstrapping algorithm for learning linear models of object classes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 40–46 (1997) Vetter, T., Jones, M.J., Poggio, T.: A bootstrapping algorithm for learning linear models of object classes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 40–46 (1997)
12.
Zurück zum Zitat Chai, X., Shan, S., Chen, X., Gao, W.: Locally linear regression for pose-invariant face recognition. IEEE Trans. Image Process. 16(7), 1716–1725 (2007)MathSciNetCrossRef Chai, X., Shan, S., Chen, X., Gao, W.: Locally linear regression for pose-invariant face recognition. IEEE Trans. Image Process. 16(7), 1716–1725 (2007)MathSciNetCrossRef
13.
Zurück zum Zitat Han, Z., Jiang, J., Hu, R., Lu, T.: A novel frontal view synthesis method based on neighbor embedding. In: International Conference on Image Analysis and Signal Processing, pp. 128–132 (2011) Han, Z., Jiang, J., Hu, R., Lu, T.: A novel frontal view synthesis method based on neighbor embedding. In: International Conference on Image Analysis and Signal Processing, pp. 128–132 (2011)
14.
Zurück zum Zitat Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 275–282 (2004) Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 275–282 (2004)
15.
Zurück zum Zitat Hao, Y., Qi, C.: A unified regularization framework for virtual frontal face image synthesis. IEEE Sig. Process. Lett. 22(22), 559–563 (2015)CrossRef Hao, Y., Qi, C.: A unified regularization framework for virtual frontal face image synthesis. IEEE Sig. Process. Lett. 22(22), 559–563 (2015)CrossRef
17.
Zurück zum Zitat Jiang, J., Ruimin, H., Wang, Z., Han, Z.: Noise robust face hallucination via locality-constrained representation. IEEE Trans. Multimedia 16(5), 1268–1281 (2014)CrossRef Jiang, J., Ruimin, H., Wang, Z., Han, Z.: Noise robust face hallucination via locality-constrained representation. IEEE Trans. Multimedia 16(5), 1268–1281 (2014)CrossRef
Metadaten
Titel
A Novel Frontal Facial Synthesis Algorithm Based on Individual Residual Face
verfasst von
Xin Ding
Ruimin Hu
Zhen Han
Zhongyuan Wang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-73600-6_2

Neuer Inhalt