Skip to main content

2016 | OriginalPaper | Buchkapitel

Semantic 3D Reconstruction of Heads

verfasst von : Fabio Maninchedda, Christian Häne, Bastien Jacquet, Amaël Delaunoy, Marc Pollefeys

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a novel approach that jointly reconstructs the geometry of a human head and semantically segments it into labels such as skin, hair and eyebrows. In order to get faithful reconstructions from data captured in uncontrolled environments, we propose to adapt a recently introduced implicit volumetric surface normal based shape prior formulation. Shape prior based approaches critically rely on an accurate alignment between the data and the prior to succeed. To this end, we propose an automatic alignment procedure for the used shape prior formulation. We evaluate our alignment procedure thoroughly and show head reconstruction results on challenging datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
2.
Zurück zum Zitat Beeler, T., Bickel, B., Beardsley, P., Sumner, B., Gross, M.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. (ToG) 29(4), 40 (2010)CrossRef Beeler, T., Bickel, B., Beardsley, P., Sumner, B., Gross, M.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. (ToG) 29(4), 40 (2010)CrossRef
3.
Zurück zum Zitat Beeler, T., Bickel, B., Noris, G., Marschner, S., Beardsley, P., Sumner, R.W., Gross, M.: Coupled 3D reconstruction of sparse facial hair and skin. ACM Trans. Graph. (ToG) 31(4), 117 (2012)CrossRef Beeler, T., Bickel, B., Noris, G., Marschner, S., Beardsley, P., Sumner, R.W., Gross, M.: Coupled 3D reconstruction of sparse facial hair and skin. ACM Trans. Graph. (ToG) 31(4), 117 (2012)CrossRef
4.
Zurück zum Zitat Brunton, A., Salazar, A., Bolkart, T., Wuhrer, S.: Review of statistical shape spaces for 3D data with comparative analysis for human faces. Comput. Vis. Image Underst. (CVIU) 128, 1–17 (2014)CrossRef Brunton, A., Salazar, A., Bolkart, T., Wuhrer, S.: Review of statistical shape spaces for 3D data with comparative analysis for human faces. Comput. Vis. Image Underst. (CVIU) 128, 1–17 (2014)CrossRef
5.
6.
Zurück zum Zitat Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: International Conference on Computer graphics and interactive techniques (SIGGRAPH) (1996) Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: International Conference on Computer graphics and interactive techniques (SIGGRAPH) (1996)
7.
Zurück zum Zitat Dame, A., Prisacariu, V.A., Ren, C.Y., Reid, I.: Dense reconstruction using 3D object shape priors. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2013) Dame, A., Prisacariu, V.A., Ren, C.Y., Reid, I.: Dense reconstruction using 3D object shape priors. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2013)
8.
Zurück zum Zitat Echevarria, J.I., Bradley, D., Gutierrez, D., Beeler, T.: Capturing and stylizing hair for 3D fabrication. ACM Trans. Graphics (ToG) 33(4), 125 (2014)CrossRef Echevarria, J.I., Bradley, D., Gutierrez, D., Beeler, T.: Capturing and stylizing hair for 3D fabrication. ACM Trans. Graphics (ToG) 33(4), 125 (2014)CrossRef
9.
Zurück zum Zitat Esedoglu, S., Osher, S.J.: Decomposition of images by the anisotropic Rudin-Osher-Fatemi model. Commun. Pure Appl. Math. 57(12), 1609–1626 (2004)MathSciNetCrossRefMATH Esedoglu, S., Osher, S.J.: Decomposition of images by the anisotropic Rudin-Osher-Fatemi model. Commun. Pure Appl. Math. 57(12), 1609–1626 (2004)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Fanelli, G., Dantone, M., Gall, J., Fossati, A., Van Gool, L.: Random forests for real time 3D face analysis. Int. J. Comput. Vis. (IJCV) 101(3), 437–458 (2013)CrossRef Fanelli, G., Dantone, M., Gall, J., Fossati, A., Van Gool, L.: Random forests for real time 3D face analysis. Int. J. Comput. Vis. (IJCV) 101(3), 437–458 (2013)CrossRef
11.
Zurück zum Zitat Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 32(8), 1362–1376 (2010)CrossRef Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 32(8), 1362–1376 (2010)CrossRef
12.
Zurück zum Zitat Garrido, P., Valgaerts, L., Wu, C., Theobalt, C.: Reconstructing detailed dynamic face geometry from monocular video. ACM Trans. Graph. (ToG) 32(6), 158 (2013)CrossRef Garrido, P., Valgaerts, L., Wu, C., Theobalt, C.: Reconstructing detailed dynamic face geometry from monocular video. ACM Trans. Graph. (ToG) 32(6), 158 (2013)CrossRef
13.
Zurück zum Zitat Häne, C., Heng, L., Lee, G.H., Sizov, A., Pollefeys, M.: Real-time direct dense matching on fisheye images using plane-sweeping stereo. In: International Conference on 3D Vision (3DV) (2014) Häne, C., Heng, L., Lee, G.H., Sizov, A., Pollefeys, M.: Real-time direct dense matching on fisheye images using plane-sweeping stereo. In: International Conference on 3D Vision (3DV) (2014)
14.
Zurück zum Zitat Häne, C., Savinov, N., Pollefeys, M.: Class specific 3D object shape priors using surface normals. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014) Häne, C., Savinov, N., Pollefeys, M.: Class specific 3D object shape priors using surface normals. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)
15.
Zurück zum Zitat Häne, C., Zach, C., Cohen, A., Angst, R., Pollefeys, M.: Joint 3D scene reconstruction and class segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2013) Häne, C., Zach, C., Cohen, A., Angst, R., Pollefeys, M.: Joint 3D scene reconstruction and class segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2013)
16.
Zurück zum Zitat Ichim, A.E., Bouaziz, S., Pauly, M.: Dynamic 3D avatar creation from hand-held video input. ACM Trans. Graph. (ToG) 34(4), 45 (2015)CrossRef Ichim, A.E., Bouaziz, S., Pauly, M.: Dynamic 3D avatar creation from hand-held video input. ACM Trans. Graph. (ToG) 34(4), 45 (2015)CrossRef
17.
Zurück zum Zitat Jourabloo, A., Liu, X.: Pose-invariant 3D face alignment. In: International Conference on Computer Vision (ICCV) (2015) Jourabloo, A., Liu, X.: Pose-invariant 3D face alignment. In: International Conference on Computer Vision (ICCV) (2015)
18.
Zurück zum Zitat Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Eurographics Symposium on Geometry Processing (SGP) (2006) Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Eurographics Symposium on Geometry Processing (SGP) (2006)
19.
Zurück zum Zitat Ladicky, L., Russell, C., Kohli, P., Torr, P.H.: Associative hierarchical random fields. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(6), 1056–1077 (2014)CrossRef Ladicky, L., Russell, C., Kohli, P., Torr, P.H.: Associative hierarchical random fields. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(6), 1056–1077 (2014)CrossRef
20.
Zurück zum Zitat Lempitsky, V., Boykov, Y.: Global optimization for shape fitting (2007) Lempitsky, V., Boykov, Y.: Global optimization for shape fitting (2007)
21.
Zurück zum Zitat Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. In: Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) (1987) Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. In: Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) (1987)
22.
Zurück zum Zitat Luo, L., Li, H., Paris, S., Weise, T., Pauly, M., Rusinkiewicz, S.: Multi-view hair capture using orientation fields. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012) Luo, L., Li, H., Paris, S., Weise, T., Pauly, M., Rusinkiewicz, S.: Multi-view hair capture using orientation fields. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
23.
Zurück zum Zitat Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition (2009) Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition (2009)
24.
Zurück zum Zitat Pock, T., Chambolle, A.: Diagonal preconditioning for first order primal-dual algorithms in convex optimization. In: International Conference on Computer Vision (ICCV) (2011) Pock, T., Chambolle, A.: Diagonal preconditioning for first order primal-dual algorithms in convex optimization. In: International Conference on Computer Vision (ICCV) (2011)
25.
Zurück zum Zitat Preparata, F.P., Shamos, M.: Computational Geometry: An Introduction. Springer, New York (1985)CrossRefMATH Preparata, F.P., Shamos, M.: Computational Geometry: An Introduction. Springer, New York (1985)CrossRefMATH
26.
Zurück zum Zitat Prisacariu, V.A., Segal, A.V., Reid, I.: Simultaneous monocular 2D segmentation, 3D pose recovery and 3D reconstruction. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part I. LNCS, vol. 7724, pp. 593–606. Springer, Heidelberg (2013) Prisacariu, V.A., Segal, A.V., Reid, I.: Simultaneous monocular 2D segmentation, 3D pose recovery and 3D reconstruction. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part I. LNCS, vol. 7724, pp. 593–606. Springer, Heidelberg (2013)
27.
Zurück zum Zitat Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014) Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)
28.
Zurück zum Zitat Saragih, J.M., Lucey, S., Cohn, J.F.: Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vis. (IJCV) 91(2), 200–215 (2011)MathSciNetCrossRefMATH Saragih, J.M., Lucey, S., Cohn, J.F.: Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vis. (IJCV) 91(2), 200–215 (2011)MathSciNetCrossRefMATH
29.
Zurück zum Zitat Savinov, N., Häne, C., Ladicky, L., Pollefeys, M.: Semantic 3D reconstruction with continuous regularization and ray potentials using a visibility consistency constraint. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2016) Savinov, N., Häne, C., Ladicky, L., Pollefeys, M.: Semantic 3D reconstruction with continuous regularization and ray potentials using a visibility consistency constraint. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
30.
Zurück zum Zitat Savinov, N., Ladicky, L., Häne, C., Pollefeys, M.: Discrete optimization of ray potentials for semantic 3D reconstruction. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2015) Savinov, N., Ladicky, L., Häne, C., Pollefeys, M.: Discrete optimization of ray potentials for semantic 3D reconstruction. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
31.
Zurück zum Zitat Stühmer, J., Schröder, P., Cremers, D.: Tree shape priors with connectivity constraints using convex relaxation on general graphs. In: International Conference on Computer Vision Proceedings (ICCV) (2013) Stühmer, J., Schröder, P., Cremers, D.: Tree shape priors with connectivity constraints using convex relaxation on general graphs. In: International Conference on Computer Vision Proceedings (ICCV) (2013)
32.
Zurück zum Zitat Tanskanen, P., Kolev, K., Meier, L., Camposeco, F., Saurer, O., Pollefeys, M.: Live metric 3D reconstruction on mobile phones. In: International Conference on Computer Vision (ICCV) (2013) Tanskanen, P., Kolev, K., Meier, L., Camposeco, F., Saurer, O., Pollefeys, M.: Live metric 3D reconstruction on mobile phones. In: International Conference on Computer Vision (ICCV) (2013)
34.
Zurück zum Zitat Wei, Y., Ofek, E., Quan, L., Shum, H.Y.: Modeling hair from multiple views. ACM Trans. Graphics (TOG) 24(3), 816–820 (2005)CrossRef Wei, Y., Ofek, E., Quan, L., Shum, H.Y.: Modeling hair from multiple views. ACM Trans. Graphics (TOG) 24(3), 816–820 (2005)CrossRef
36.
Zurück zum Zitat Zach, C.: Fast and high quality fusion of depth maps. In: International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT) (2008) Zach, C.: Fast and high quality fusion of depth maps. In: International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT) (2008)
37.
Zurück zum Zitat Zach, C., Häne, C., Pollefeys, M.: What is optimized in tight convex relaxations for multi-label problems? In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2012) Zach, C., Häne, C., Pollefeys, M.: What is optimized in tight convex relaxations for multi-label problems? In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
38.
Zurück zum Zitat Zach, C., Häne, C., Pollefeys, M.: What is optimized in convex relaxations for multilabel problems: Connecting discrete and continuously inspired map inference. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(1), 157–170 (2014)CrossRef Zach, C., Häne, C., Pollefeys, M.: What is optimized in convex relaxations for multilabel problems: Connecting discrete and continuously inspired map inference. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(1), 157–170 (2014)CrossRef
Metadaten
Titel
Semantic 3D Reconstruction of Heads
verfasst von
Fabio Maninchedda
Christian Häne
Bastien Jacquet
Amaël Delaunoy
Marc Pollefeys
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46466-4_40

Premium Partner