Skip to main content
main-content

Tipp

Weitere Kapitel dieses Buchs durch Wischen aufrufen

2018 | OriginalPaper | Buchkapitel

Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes

verfasst von: Eric Patterson, Jessica Baron, Devin Simpson

Erschienen in: Computer Vision and Graphics

Verlag: Springer International Publishing

share
TEILEN

Abstract

Believable, detailed digital faces are desired for both film and game production as well as research applications. A high-resolution mesh of a face is acquired often with structured light and stereo computer-vision methods. In production for visual effects or games, the acquired mesh is “re-topologized” by an artist using software to draw a new edge layout in order to simplify and prepare a mesh for animation. For building models of facial population and expression for research, meshes often undergo a similar process to find correspondence among face models, although in the past the desired layout has not been designed for effective facial animation. We propose a process using images accompanying a 3D scan to locate dense 2D facial landmarks automatically to re-topologize meshes with the particular goal of creating models that deform well for facial animation. The technique also allows real-time editing of the re-topology relationship if modifications are desired.
Literatur
1.
Zurück zum Zitat Amberg, B., Knothe, R., Vetter, T.: Optimal step nonrigid ICP algorithms for surface registration. In: IEEE International Conference on Computer Vision and Pattern Recognition (2007) Amberg, B., Knothe, R., Vetter, T.: Optimal step nonrigid ICP algorithms for surface registration. In: IEEE International Conference on Computer Vision and Pattern Recognition (2007)
2.
Zurück zum Zitat Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., Zafeiriou, S.: Hog appearance models (2014) Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., Zafeiriou, S.: Hog appearance models (2014)
3.
Zurück zum Zitat Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: SIGGRAPH International Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999) Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: SIGGRAPH International Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)
4.
Zurück zum Zitat Bookstein, F.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 567–585 (1989) CrossRef Bookstein, F.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 567–585 (1989) CrossRef
5.
Zurück zum Zitat Booth, J., Roussos, A., Zafeiriou, S., Ponniahy, A., Dunaway, D.: A 3D morphable model learnt from 10,000 faces. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5543–5552 (2016) Booth, J., Roussos, A., Zafeiriou, S., Ponniahy, A., Dunaway, D.: A 3D morphable model learnt from 10,000 faces. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5543–5552 (2016)
7.
Zurück zum Zitat Cootes, T.F., Kittipanya-ngam, P.: Comparing variations on the active appearance model algorithm. In: British Machine Vision Conference, pp. 837–842 (2002) Cootes, T.F., Kittipanya-ngam, P.: Comparing variations on the active appearance model algorithm. In: British Machine Vision Conference, pp. 837–842 (2002)
8.
Zurück zum Zitat Cosker, D., Krumhuber, E., Hilton, A.: A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In: Proceedings of the IEEE International Conference on Computer Vision (2011) Cosker, D., Krumhuber, E., Hilton, A.: A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In: Proceedings of the IEEE International Conference on Computer Vision (2011)
9.
Zurück zum Zitat Debevec, P.: The light stages and their applications to photoreal digital actors. In: SIGGRAPH Asia, Singapore (2012) Debevec, P.: The light stages and their applications to photoreal digital actors. In: SIGGRAPH Asia, Singapore (2012)
10.
Zurück zum Zitat Ekman, P., Friesen, W., Hager, J.: Facial Action Coding System: Second Edition. Paul Ekman Group (2002) Ekman, P., Friesen, W., Hager, J.: Facial Action Coding System: Second Edition. Paul Ekman Group (2002)
11.
Zurück zum Zitat Enstice, T.: The curious case of Benjamin Button. In: ACM SIGGRAPH 2009 Computer Animation Festival, SIGGRAPH 2009, pp. 36–37. ACM, New York (2009) Enstice, T.: The curious case of Benjamin Button. In: ACM SIGGRAPH 2009 Computer Animation Festival, SIGGRAPH 2009, pp. 36–37. ACM, New York (2009)
12.
Zurück zum Zitat Ichikari, R., Alexander, O., Debevec, P.: Vuvuzela: a facial scan correspondence tool. In: ACM SIGGRAPH 2013 Posters, SIGGRAPH 2013, p. 89:1. ACM, New York (2013) Ichikari, R., Alexander, O., Debevec, P.: Vuvuzela: a facial scan correspondence tool. In: ACM SIGGRAPH 2013 Posters, SIGGRAPH 2013, p. 89:1. ACM, New York (2013)
13.
Zurück zum Zitat Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recognit. 48(1), 73–85 (2015) CrossRef Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recognit. 48(1), 73–85 (2015) CrossRef
14.
Zurück zum Zitat Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 1867–1874. IEEE Computer Society, Washington, DC (2014) Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 1867–1874. IEEE Computer Society, Washington, DC (2014)
16.
Zurück zum Zitat Lambert, T.: From 2D to 3D painting with mesh colors. In: ACM SIGGRAPH 2015 Talks, SIGGRAPH 2015, p. 72:1. ACM, New York (2015) Lambert, T.: From 2D to 3D painting with mesh colors. In: ACM SIGGRAPH 2015 Talks, SIGGRAPH 2015, p. 72:1. ACM, New York (2015)
18.
Zurück zum Zitat Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28(5) (2009). Proceedings SIGGRAPH Asia 2009 Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28(5) (2009). Proceedings SIGGRAPH Asia 2009
19.
Zurück zum Zitat Ma, M., Peng, S., Hu, X.: A lighting robust fitting approach of 3D morphable model for face reconstruction. Vis. Comput. 32(10), 1223–1238 (2016) CrossRef Ma, M., Peng, S., Hu, X.: A lighting robust fitting approach of 3D morphable model for face reconstruction. Vis. Comput. 32(10), 1223–1238 (2016) CrossRef
20.
Zurück zum Zitat Marcias, G., et al.: Data-driven interactive quadrangulation. ACM Trans. Graph. 34(4), 65:1–65:10 (2015) CrossRef Marcias, G., et al.: Data-driven interactive quadrangulation. ACM Trans. Graph. 34(4), 65:1–65:10 (2015) CrossRef
21.
Zurück zum Zitat Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Comput. Vis. 60(2), 135–164 (2004) CrossRef Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Comput. Vis. 60(2), 135–164 (2004) CrossRef
22.
Zurück zum Zitat Alabort-i-Medina, J., Antonakos, E., Booth, J., Snape, P., Zafeiriou, S.: Menpo: a comprehensive platform for parametric image alignment and visual deformable models. In: Proceedings of the ACM International Conference on Multimedia (2014) Alabort-i-Medina, J., Antonakos, E., Booth, J., Snape, P., Zafeiriou, S.: Menpo: a comprehensive platform for parametric image alignment and visual deformable models. In: Proceedings of the ACM International Conference on Multimedia (2014)
24.
Zurück zum Zitat Patel, A., Smith, W.: 3D morphable face models revisited. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1327–1334 (2009) Patel, A., Smith, W.: 3D morphable face models revisited. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1327–1334 (2009)
25.
Zurück zum Zitat Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: IEEE International Conference on Advanced Video and Signal-Based Surveilance (2009) Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: IEEE International Conference on Advanced Video and Signal-Based Surveilance (2009)
26.
Zurück zum Zitat Peng, C.H., Zhang, E., Kobayashi, Y., Wonka, P.: Connectivity editing for quadrilateral meshes. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 141:1–141:12. ACM, New York (2011) Peng, C.H., Zhang, E., Kobayashi, Y., Wonka, P.: Connectivity editing for quadrilateral meshes. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 141:1–141:12. ACM, New York (2011)
27.
Zurück zum Zitat Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4) (2011). Proceedings SIGGRAPH 2011 CrossRef Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4) (2011). Proceedings SIGGRAPH 2011 CrossRef
Metadaten
Titel
Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes
verfasst von
Eric Patterson
Jessica Baron
Devin Simpson
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-00692-1_37

Premium Partner