Skip to main content

2015 | OriginalPaper | Buchkapitel

Rapid 3D Face Modeling from Video

verfasst von : Hong Song, Jie Lv, Yanming Wang

Erschienen in: Advances in Multimedia Information Processing -- PCM 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, an efficient technique is developed to construct textured 3D face model from video containing a face rotating from frontal to profile. After two manual clicks on a profile to tell the system where the eye corner and bottom of the chin are, the system automatically generates a realistic looking 3D face model. The proposed method consists of three components. Firstly, based on the facial feature points extracted from frontal and profile images, an individual 3D geometric face model is generated by deforming the generic model with improved Radial basis function. Then the model is refined by using improved √3-Subdivision. Secondly, the multi-resolution technique and weighted smoothing algorithm are combined to synthesize individual facial texture image. Finally, a realistic 3D face model is built by mapping the individual texture to the individual 3D geometric model. The accuracy and robustness of the method are demonstrated with a set of experiments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Parke, F.I.: Computer generated animation of faces. In: Proceedings of the ACM Annual Conference, pp. 451–457 (1972) Parke, F.I.: Computer generated animation of faces. In: Proceedings of the ACM Annual Conference, pp. 451–457 (1972)
2.
Zurück zum Zitat Guenter, B., Grimm, C., Wood, D., et al.: Making faces. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 55–66. ACM (1998) Guenter, B., Grimm, C., Wood, D., et al.: Making faces. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 55–66. ACM (1998)
3.
Zurück zum Zitat Park, S.W., Heo, J., Savvides, M.: 3D face reconstruction from a single 2D face image. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2008, pp. 1–8 (2008) Park, S.W., Heo, J., Savvides, M.: 3D face reconstruction from a single 2D face image. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2008, pp. 1–8 (2008)
4.
Zurück zum Zitat Fan, X., Peng, Q., Zhong, M.: 3D face reconstruction from single 2D image based on robust facial feature points extraction and generic wire frame model. In: International Conference on Communications and Mobile Computing, pp. 396–400 (2010) Fan, X., Peng, Q., Zhong, M.: 3D face reconstruction from single 2D image based on robust facial feature points extraction and generic wire frame model. In: International Conference on Communications and Mobile Computing, pp. 396–400 (2010)
5.
Zurück zum Zitat Lin, Y., Lin, Q., Tang, F., et al.: Creating 3D realistic head: from two orthogonal photos to multiview face contents. In: International Society for Optics and Photonics (2011) Lin, Y., Lin, Q., Tang, F., et al.: Creating 3D realistic head: from two orthogonal photos to multiview face contents. In: International Society for Optics and Photonics (2011)
6.
Zurück zum Zitat Beeler, T., Bickel, B., Beardsley, P., et al.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. (TOG) 29, 40 (2010)CrossRef Beeler, T., Bickel, B., Beardsley, P., et al.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. (TOG) 29, 40 (2010)CrossRef
7.
Zurück zum Zitat Xin, L., Wang, Q., Tao, J., Tang, X., et al.: Automatic 3D face modeling from video. In: Tenth IEEE International Conference on Computer Vision, ICCV, vol. 2, pp. 1193–1199 (2005) Xin, L., Wang, Q., Tao, J., Tang, X., et al.: Automatic 3D face modeling from video. In: Tenth IEEE International Conference on Computer Vision, ICCV, vol. 2, pp. 1193–1199 (2005)
8.
Zurück zum Zitat Song, H., Huang, X., Wang, S.: Automatic generation of portraits with multiple expressions. Acta Electronica Sin. 41(8), 1494–1499 (2013). Chinese Song, H., Huang, X., Wang, S.: Automatic generation of portraits with multiple expressions. Acta Electronica Sin. 41(8), 1494–1499 (2013). Chinese
9.
Zurück zum Zitat Yin, L., Basu, A.: Integrating active face tracking with model based coding. Pattern Recogn. Lett. 20(6), 651–657 (1999)CrossRef Yin, L., Basu, A.: Integrating active face tracking with model based coding. Pattern Recogn. Lett. 20(6), 651–657 (1999)CrossRef
10.
Zurück zum Zitat Huang, J., Su, Z., Wang, R.: 3D Face Reconstruction based on Improved CANDIDE-3 model. In: 2012 Fourth International Conference on Digital Home (ICDH), pp. 438–442. IEEE (2012) Huang, J., Su, Z., Wang, R.: 3D Face Reconstruction based on Improved CANDIDE-3 model. In: 2012 Fourth International Conference on Digital Home (ICDH), pp. 438–442. IEEE (2012)
11.
Zurück zum Zitat Liu, S., Wang, C.C.L.: Quasi-interpolation for surface reconstruction from scattered data with radial basis function. Comput. Aided Geom. Des. 29(7), 435–447 (2012)MathSciNetCrossRefMATH Liu, S., Wang, C.C.L.: Quasi-interpolation for surface reconstruction from scattered data with radial basis function. Comput. Aided Geom. Des. 29(7), 435–447 (2012)MathSciNetCrossRefMATH
12.
Zurück zum Zitat Du, P., Xu, D., Liu, C.: Research of individual 3D face model and its application. J. Shanghai Jiaotong Univ. 37(3), 435–439 (2003) Du, P., Xu, D., Liu, C.: Research of individual 3D face model and its application. J. Shanghai Jiaotong Univ. 37(3), 435–439 (2003)
13.
Zurück zum Zitat Huang, J., Schröder, P.: √3-Based 1-form subdivision. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2011. LNCS, vol. 6920, pp. 351–368. Springer, Heidelberg (2012)CrossRef Huang, J., Schröder, P.: √3-Based 1-form subdivision. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2011. LNCS, vol. 6920, pp. 351–368. Springer, Heidelberg (2012)CrossRef
14.
Zurück zum Zitat Zhang, H., Wang, G.: Semi-stationary push-back subdivision schemes. J. Softw. 13(9), 1830–1839 (2002) Zhang, H., Wang, G.: Semi-stationary push-back subdivision schemes. J. Softw. 13(9), 1830–1839 (2002)
15.
Zurück zum Zitat Zhang, C., Burt, P.J., van der Wal, G.S.: Multi-scale multi-camera adaptive fusion with constrast normalization: U. S. Patent. 8,411, 938 (2013) Zhang, C., Burt, P.J., van der Wal, G.S.: Multi-scale multi-camera adaptive fusion with constrast normalization: U. S. Patent. 8,411, 938 (2013)
16.
Zurück zum Zitat Lee, W.-S., Thalmann, N.M.: Head modeling from pictures and morphing in 3d with image metamorphosis based on triangulation. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) CAPTECH 1998. LNCS (LNAI), vol. 1537, pp. 254–267. Springer, Heidelberg (1998)CrossRef Lee, W.-S., Thalmann, N.M.: Head modeling from pictures and morphing in 3d with image metamorphosis based on triangulation. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) CAPTECH 1998. LNCS (LNAI), vol. 1537, pp. 254–267. Springer, Heidelberg (1998)CrossRef
Metadaten
Titel
Rapid 3D Face Modeling from Video
verfasst von
Hong Song
Jie Lv
Yanming Wang
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24078-7_20

Neuer Inhalt