Skip to main content

2015 | OriginalPaper | Buchkapitel

A Method of Facial Animation Retargeting Based on Motion Capture

verfasst von : Dongsheng Zhou, Xiaoying Liang, Qiang Zhang, Jing Dong

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

By using facial motion data from passive optical motion capture system, this paper proposed an animation reconstruction approach, which is aimed to solve the common problem: model discontinuity and reconstructing a real-like facial animation. For this problem, a facial animation reconstruction approach with model divisions is proposed. We first divide facial model into different regions and request the deformed motion data by deploying RBF mapping. Then we adjust the deformed motion data to ensure their exactness. Besides, considering the nonlinear relationship of neighbors with the current point, we also proposed a facial animation reconstruction approach without model divisions, where we apply the motion of one-ring neighbors to adjust the deformed motion data. The experiments show that the proposed methods have an acceptable precision of reconstruction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alexanderson, S., Beskow, J.: Animated Lombard speech: motion capture, facial animation and visual intelligibility of speech produced in adverse conditions. Comput. Speech Lang. 28, 607–618 (2014)CrossRef Alexanderson, S., Beskow, J.: Animated Lombard speech: motion capture, facial animation and visual intelligibility of speech produced in adverse conditions. Comput. Speech Lang. 28, 607–618 (2014)CrossRef
2.
Zurück zum Zitat Yu, H., Garrod, O., Jack, R., Schyns, P.: Realistic facial animation generation based on facial expression mapping. In: Fifth International Conference on Graphic and Image Processing, Hongkong, China, pp. 906903–906903 (2014) Yu, H., Garrod, O., Jack, R., Schyns, P.: Realistic facial animation generation based on facial expression mapping. In: Fifth International Conference on Graphic and Image Processing, Hongkong, China, pp. 906903–906903 (2014)
3.
Zurück zum Zitat Duarte, R.L.P., El Rhalibi, A., Merabti, M.: Coarticulation and speech synchronization in MPEG-4 based facial animation. Kybernetes 43, 1165–1182 (2014)CrossRef Duarte, R.L.P., El Rhalibi, A., Merabti, M.: Coarticulation and speech synchronization in MPEG-4 based facial animation. Kybernetes 43, 1165–1182 (2014)CrossRef
4.
Zurück zum Zitat Parke, F.I., Waters, K.: Computer facial animation. Wellesley, AK Peters, Massachusetts (1996) Parke, F.I., Waters, K.: Computer facial animation. Wellesley, AK Peters, Massachusetts (1996)
5.
Zurück zum Zitat Waters, K.: A muscle model for animation three-dimensional facial expression. In: ACM SIGGRAPH Computer Graphics, New York, USA, pp. 17–24 (1987) Waters, K.: A muscle model for animation three-dimensional facial expression. In: ACM SIGGRAPH Computer Graphics, New York, USA, pp. 17–24 (1987)
6.
Zurück zum Zitat Williams, L.: Performance-driven facial animation. ACM SIGGRAPH Comput. Graphics 24, 235–242 (1990)CrossRef Williams, L.: Performance-driven facial animation. ACM SIGGRAPH Comput. Graphics 24, 235–242 (1990)CrossRef
7.
Zurück zum Zitat Guenter, B., Grimm, C., Wood, D., Malvar, H., Pighin, F.: Making faces. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, New York, USA, July, pp. 55–66 (1998) Guenter, B., Grimm, C., Wood, D., Malvar, H., Pighin, F.: Making faces. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, New York, USA, July, pp. 55–66 (1998)
8.
Zurück zum Zitat Platt, S.M.: A Structural Model of the Human Face. Doctoral dissertation, University of Pennsylvania (1985) Platt, S.M.: A Structural Model of the Human Face. Doctoral dissertation, University of Pennsylvania (1985)
9.
Zurück zum Zitat Li, Q., Deng, Z.G.: Facial Motion Capture Editing by Automated Orthogonal Blendshape Weight Propagation. Doctoral dissertation, University of Houston (2008) Li, Q., Deng, Z.G.: Facial Motion Capture Editing by Automated Orthogonal Blendshape Weight Propagation. Doctoral dissertation, University of Houston (2008)
10.
Zurück zum Zitat Tu, P.H., Lin, I.C., Yeh, J.S., Liang R.H., Ouhyoung, M.: Expression detail mapping for realistic facial animation. In: Proceedings of the Eighth International Conference CAD/Graphics, pp. 20–25 (2003) Tu, P.H., Lin, I.C., Yeh, J.S., Liang R.H., Ouhyoung, M.: Expression detail mapping for realistic facial animation. In: Proceedings of the Eighth International Conference CAD/Graphics, pp. 20–25 (2003)
11.
Zurück zum Zitat Edge, M.S.L.J.D., King, S.A., Maddock, S.: Use and re-use of facial motion capture data. In: Proceedings of Vision, Video, and Graphics, pp. 135–142 (2003) Edge, M.S.L.J.D., King, S.A., Maddock, S.: Use and re-use of facial motion capture data. In: Proceedings of Vision, Video, and Graphics, pp. 135–142 (2003)
12.
Zurück zum Zitat Noh, J.Y., Neumann, U.: Expression cloning. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, Los Angeles, CA, USA, pp. 277–288 (2001) Noh, J.Y., Neumann, U.: Expression cloning. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, Los Angeles, CA, USA, pp. 277–288 (2001)
13.
Zurück zum Zitat Deng, Z., Chiang, P.Y., Fox, P., Neumann, U.: Animating blendshape faces by cross-mapping motion capture data. In: Proceedings of the symposium on Interactive 3D graphics and games, March, New York, USA, pp. 43–48 (2006) Deng, Z., Chiang, P.Y., Fox, P., Neumann, U.: Animating blendshape faces by cross-mapping motion capture data. In: Proceedings of the symposium on Interactive 3D graphics and games, March, New York, USA, pp. 43–48 (2006)
14.
Zurück zum Zitat Xu, Z.: Research in motion capture and cloning of human facial expression. Master ‘s thesis, Beijing Jiaotong University (2009) (In Chinese) Xu, Z.: Research in motion capture and cloning of human facial expression. Master ‘s thesis, Beijing Jiaotong University (2009) (In Chinese)
15.
Zurück zum Zitat Shen, R.R.: Research on 3D Personalized Face Reconstruction Based on RBFs. Master’s thesis, JiangSu University (2007) (In Chinese) Shen, R.R.: Research on 3D Personalized Face Reconstruction Based on RBFs. Master’s thesis, JiangSu University (2007) (In Chinese)
16.
Zurück zum Zitat Lin, I.C., Yeh, J.S., Ouhyoung, M.: Realistic 3d facial animation parameters from mirror-reflected multi-view video. In: Proceedings of the Fourteenth Conference on Computer Animation, Seoul, Korea, pp. 2–250 (2001) Lin, I.C., Yeh, J.S., Ouhyoung, M.: Realistic 3d facial animation parameters from mirror-reflected multi-view video. In: Proceedings of the Fourteenth Conference on Computer Animation, Seoul, Korea, pp. 2–250 (2001)
17.
Zurück zum Zitat Fang, X.Y., Wei, X.P., Zhang, Q., Zhou, D.S.: Forward non-rigid motion tracking for facial MoCap. Visual Comput. 30, 139–157 (2014)CrossRef Fang, X.Y., Wei, X.P., Zhang, Q., Zhou, D.S.: Forward non-rigid motion tracking for facial MoCap. Visual Comput. 30, 139–157 (2014)CrossRef
19.
Zurück zum Zitat Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30, 77 (2011)CrossRef Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30, 77 (2011)CrossRef
20.
Zurück zum Zitat Tena, J.R., De la Torre, F., Matthews, I.: Interactive region-based linear 3d face models. ACM Trans. Graph. 30, 76 (2011)CrossRef Tena, J.R., De la Torre, F., Matthews, I.: Interactive region-based linear 3d face models. ACM Trans. Graph. 30, 76 (2011)CrossRef
21.
Zurück zum Zitat Wan, X., Liu, S., Chen, J.X., Jin, X.: Geodesic distance-based realistic facial animation using RBF interpolation. Comput. Sci. Eng. 14, 49–55 (2012)CrossRef Wan, X., Liu, S., Chen, J.X., Jin, X.: Geodesic distance-based realistic facial animation using RBF interpolation. Comput. Sci. Eng. 14, 49–55 (2012)CrossRef
22.
Zurück zum Zitat Sifakis, E., Neverov, I., Fedkiw, R.: Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24, 417–425 (2005)CrossRef Sifakis, E., Neverov, I., Fedkiw, R.: Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24, 417–425 (2005)CrossRef
23.
Zurück zum Zitat Yang, Y., Zheng, N., Liu, Y., Du, S., Nishio, Y.: Example-based performance driven facial shape animation. In: IEEE International Conference on Multimedia and Expo, New York, USA, pp. 1350–1353 (2009) Yang, Y., Zheng, N., Liu, Y., Du, S., Nishio, Y.: Example-based performance driven facial shape animation. In: IEEE International Conference on Multimedia and Expo, New York, USA, pp. 1350–1353 (2009)
24.
Zurück zum Zitat Carr, J.C., Beatson, R.K., Cherrie, J.B., Mitchell, T.J., Fright, W.R., McCallum, B.C., Evans T.R.: Reconstruction and representation of 3D objects with radial basis functions. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, New York, USA, pp. 67–76 (2001) Carr, J.C., Beatson, R.K., Cherrie, J.B., Mitchell, T.J., Fright, W.R., McCallum, B.C., Evans T.R.: Reconstruction and representation of 3D objects with radial basis functions. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, New York, USA, pp. 67–76 (2001)
25.
Zurück zum Zitat Ohtake, Y., Belyaev, A., Seidel, H.P.: A multi-scale approach to 3D scattered data interpolation with compactly supported basis functions, pp. 153–161. In Shape Modeling International, Saarbrucken (2003) Ohtake, Y., Belyaev, A., Seidel, H.P.: A multi-scale approach to 3D scattered data interpolation with compactly supported basis functions, pp. 153–161. In Shape Modeling International, Saarbrucken (2003)
Metadaten
Titel
A Method of Facial Animation Retargeting Based on Motion Capture
verfasst von
Dongsheng Zhou
Xiaoying Liang
Qiang Zhang
Jing Dong
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21978-3_14

Premium Partner