Skip to main content

2018 | OriginalPaper | Buchkapitel

Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes

verfasst von : Eric Patterson, Jessica Baron, Devin Simpson

Erschienen in: Computer Vision and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Believable, detailed digital faces are desired for both film and game production as well as research applications. A high-resolution mesh of a face is acquired often with structured light and stereo computer-vision methods. In production for visual effects or games, the acquired mesh is “re-topologized” by an artist using software to draw a new edge layout in order to simplify and prepare a mesh for animation. For building models of facial population and expression for research, meshes often undergo a similar process to find correspondence among face models, although in the past the desired layout has not been designed for effective facial animation. We propose a process using images accompanying a 3D scan to locate dense 2D facial landmarks automatically to re-topologize meshes with the particular goal of creating models that deform well for facial animation. The technique also allows real-time editing of the re-topology relationship if modifications are desired.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Amberg, B., Knothe, R., Vetter, T.: Optimal step nonrigid ICP algorithms for surface registration. In: IEEE International Conference on Computer Vision and Pattern Recognition (2007) Amberg, B., Knothe, R., Vetter, T.: Optimal step nonrigid ICP algorithms for surface registration. In: IEEE International Conference on Computer Vision and Pattern Recognition (2007)
2.
Zurück zum Zitat Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., Zafeiriou, S.: Hog appearance models (2014) Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., Zafeiriou, S.: Hog appearance models (2014)
3.
Zurück zum Zitat Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: SIGGRAPH International Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999) Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: SIGGRAPH International Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)
4.
Zurück zum Zitat Bookstein, F.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 567–585 (1989)CrossRef Bookstein, F.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 567–585 (1989)CrossRef
5.
Zurück zum Zitat Booth, J., Roussos, A., Zafeiriou, S., Ponniahy, A., Dunaway, D.: A 3D morphable model learnt from 10,000 faces. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5543–5552 (2016) Booth, J., Roussos, A., Zafeiriou, S., Ponniahy, A., Dunaway, D.: A 3D morphable model learnt from 10,000 faces. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5543–5552 (2016)
7.
Zurück zum Zitat Cootes, T.F., Kittipanya-ngam, P.: Comparing variations on the active appearance model algorithm. In: British Machine Vision Conference, pp. 837–842 (2002) Cootes, T.F., Kittipanya-ngam, P.: Comparing variations on the active appearance model algorithm. In: British Machine Vision Conference, pp. 837–842 (2002)
8.
Zurück zum Zitat Cosker, D., Krumhuber, E., Hilton, A.: A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In: Proceedings of the IEEE International Conference on Computer Vision (2011) Cosker, D., Krumhuber, E., Hilton, A.: A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In: Proceedings of the IEEE International Conference on Computer Vision (2011)
9.
Zurück zum Zitat Debevec, P.: The light stages and their applications to photoreal digital actors. In: SIGGRAPH Asia, Singapore (2012) Debevec, P.: The light stages and their applications to photoreal digital actors. In: SIGGRAPH Asia, Singapore (2012)
10.
Zurück zum Zitat Ekman, P., Friesen, W., Hager, J.: Facial Action Coding System: Second Edition. Paul Ekman Group (2002) Ekman, P., Friesen, W., Hager, J.: Facial Action Coding System: Second Edition. Paul Ekman Group (2002)
11.
Zurück zum Zitat Enstice, T.: The curious case of Benjamin Button. In: ACM SIGGRAPH 2009 Computer Animation Festival, SIGGRAPH 2009, pp. 36–37. ACM, New York (2009) Enstice, T.: The curious case of Benjamin Button. In: ACM SIGGRAPH 2009 Computer Animation Festival, SIGGRAPH 2009, pp. 36–37. ACM, New York (2009)
12.
Zurück zum Zitat Ichikari, R., Alexander, O., Debevec, P.: Vuvuzela: a facial scan correspondence tool. In: ACM SIGGRAPH 2013 Posters, SIGGRAPH 2013, p. 89:1. ACM, New York (2013) Ichikari, R., Alexander, O., Debevec, P.: Vuvuzela: a facial scan correspondence tool. In: ACM SIGGRAPH 2013 Posters, SIGGRAPH 2013, p. 89:1. ACM, New York (2013)
13.
Zurück zum Zitat Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recognit. 48(1), 73–85 (2015)CrossRef Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recognit. 48(1), 73–85 (2015)CrossRef
14.
Zurück zum Zitat Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 1867–1874. IEEE Computer Society, Washington, DC (2014) Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 1867–1874. IEEE Computer Society, Washington, DC (2014)
16.
Zurück zum Zitat Lambert, T.: From 2D to 3D painting with mesh colors. In: ACM SIGGRAPH 2015 Talks, SIGGRAPH 2015, p. 72:1. ACM, New York (2015) Lambert, T.: From 2D to 3D painting with mesh colors. In: ACM SIGGRAPH 2015 Talks, SIGGRAPH 2015, p. 72:1. ACM, New York (2015)
18.
Zurück zum Zitat Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28(5) (2009). Proceedings SIGGRAPH Asia 2009 Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28(5) (2009). Proceedings SIGGRAPH Asia 2009
19.
Zurück zum Zitat Ma, M., Peng, S., Hu, X.: A lighting robust fitting approach of 3D morphable model for face reconstruction. Vis. Comput. 32(10), 1223–1238 (2016)CrossRef Ma, M., Peng, S., Hu, X.: A lighting robust fitting approach of 3D morphable model for face reconstruction. Vis. Comput. 32(10), 1223–1238 (2016)CrossRef
20.
Zurück zum Zitat Marcias, G., et al.: Data-driven interactive quadrangulation. ACM Trans. Graph. 34(4), 65:1–65:10 (2015)CrossRef Marcias, G., et al.: Data-driven interactive quadrangulation. ACM Trans. Graph. 34(4), 65:1–65:10 (2015)CrossRef
21.
Zurück zum Zitat Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Comput. Vis. 60(2), 135–164 (2004)CrossRef Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Comput. Vis. 60(2), 135–164 (2004)CrossRef
22.
Zurück zum Zitat Alabort-i-Medina, J., Antonakos, E., Booth, J., Snape, P., Zafeiriou, S.: Menpo: a comprehensive platform for parametric image alignment and visual deformable models. In: Proceedings of the ACM International Conference on Multimedia (2014) Alabort-i-Medina, J., Antonakos, E., Booth, J., Snape, P., Zafeiriou, S.: Menpo: a comprehensive platform for parametric image alignment and visual deformable models. In: Proceedings of the ACM International Conference on Multimedia (2014)
24.
Zurück zum Zitat Patel, A., Smith, W.: 3D morphable face models revisited. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1327–1334 (2009) Patel, A., Smith, W.: 3D morphable face models revisited. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1327–1334 (2009)
25.
Zurück zum Zitat Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: IEEE International Conference on Advanced Video and Signal-Based Surveilance (2009) Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: IEEE International Conference on Advanced Video and Signal-Based Surveilance (2009)
26.
Zurück zum Zitat Peng, C.H., Zhang, E., Kobayashi, Y., Wonka, P.: Connectivity editing for quadrilateral meshes. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 141:1–141:12. ACM, New York (2011) Peng, C.H., Zhang, E., Kobayashi, Y., Wonka, P.: Connectivity editing for quadrilateral meshes. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 141:1–141:12. ACM, New York (2011)
27.
Zurück zum Zitat Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4) (2011). Proceedings SIGGRAPH 2011CrossRef Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4) (2011). Proceedings SIGGRAPH 2011CrossRef
Metadaten
Titel
Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes
verfasst von
Eric Patterson
Jessica Baron
Devin Simpson
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-00692-1_37