Skip to main content

2015 | OriginalPaper | Buchkapitel

One Simple Virtual Avatar System Based on Single Image

verfasst von : Lanfang Dong, Jianfu Wang, Kui Ni, Yatao Wang, Xian Wu, Mingxue Xu

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To establish virtual avatar systems at the computing environments with limited resources, we design such a system based on single image which can generate speech animation with different facial expressions. Firstly, facial feature points are extracted automatically or manually based on MPEG-4 facial animation to build the face model. Then, according to Facial Animation Parameters of visual phoneme and expression stream, the feature points after image warping are calculated. The next step is to generate the in-between frames by using the image warping algorithm based on scan lines and combining with the correlative time parameters. Finally, with adding the actions such as nodding, shaking heads and winking, the face animation is implemented. Experimental results show that the proposed system can generate smooth and realtime facial expressions under platforms with low computing capacity.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lee, Y., Terzopoulos, D., Waters, K.: Realistic modeling for facial animation. In: ACM Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 55–62. ACM Press, New York (1995) Lee, Y., Terzopoulos, D., Waters, K.: Realistic modeling for facial animation. In: ACM Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 55–62. ACM Press, New York (1995)
2.
Zurück zum Zitat Kahler, K., Haber, J., Seidel, H.P.: Geometry-based muscle modeling for facial animation. In: Graphics Interface, pp. 37–46. Morgan Kaufmann Press, Toronto (2001) Kahler, K., Haber, J., Seidel, H.P.: Geometry-based muscle modeling for facial animation. In: Graphics Interface, pp. 37–46. Morgan Kaufmann Press, Toronto (2001)
3.
Zurück zum Zitat Parke, F.I., Waters, K., Alley, T.R.: Computer Facial Animation. AK Peters Wellesley, Mass (1996) Parke, F.I., Waters, K., Alley, T.R.: Computer Facial Animation. AK Peters Wellesley, Mass (1996)
4.
Zurück zum Zitat Waters, K.: A muscle model for animation three-dimensional facial expression. ACM SIGGRAPH Comput. Graph. 21, 17–24 (1987)CrossRef Waters, K.: A muscle model for animation three-dimensional facial expression. ACM SIGGRAPH Comput. Graph. 21, 17–24 (1987)CrossRef
5.
Zurück zum Zitat Pandzic, I.S., Forchheimer, R.: MPEG-4 Facial Animation: The Standard, Implementation and Applications. Wiley, New York (2002)CrossRef Pandzic, I.S., Forchheimer, R.: MPEG-4 Facial Animation: The Standard, Implementation and Applications. Wiley, New York (2002)CrossRef
6.
Zurück zum Zitat Duarte, R.L.P., Rhalibi, A.E., Merabti, M.: Coarticulation and speech synchronization in MPEG-4 based facial animation. Kybernetes: Int. J. Syst. Cybern. 43, 1165–1182 (2014)CrossRef Duarte, R.L.P., Rhalibi, A.E., Merabti, M.: Coarticulation and speech synchronization in MPEG-4 based facial animation. Kybernetes: Int. J. Syst. Cybern. 43, 1165–1182 (2014)CrossRef
7.
Zurück zum Zitat Parreira, D.R., El, R.P., Carter, C., Merabti, M.: Survey and evaluation of Mpeg-4 based 3D character animation frameworks. In: 2013 5th International Conference on Games and Virtual Worlds for Serious Applications, pp. 1–8. IEEE Press, Dorset (2013) Parreira, D.R., El, R.P., Carter, C., Merabti, M.: Survey and evaluation of Mpeg-4 based 3D character animation frameworks. In: 2013 5th International Conference on Games and Virtual Worlds for Serious Applications, pp. 1–8. IEEE Press, Dorset (2013)
8.
Zurück zum Zitat Obaid, M., Mukundan, R., Billinghurst, M., Pelachaud, C.: Expressive MPEG-4 facial animation using quadratic deformation models. In: 2010 Seventh International Conference on Computer Graphics, Imaging and Visualization, pp. 9–14. IEEE Press, Sydney (2010) Obaid, M., Mukundan, R., Billinghurst, M., Pelachaud, C.: Expressive MPEG-4 facial animation using quadratic deformation models. In: 2010 Seventh International Conference on Computer Graphics, Imaging and Visualization, pp. 9–14. IEEE Press, Sydney (2010)
9.
Zurück zum Zitat El Rhalibi, A., Carter, C., Cooper, S., Merabti, M.: Highly realistic MPEG-4 compliant facial animation with charisma. In: 2011 Proceedings of 20th International Conference on Computer Communications and Networks, pp. 1–6. IEEE Press, Lahaina (2011) El Rhalibi, A., Carter, C., Cooper, S., Merabti, M.: Highly realistic MPEG-4 compliant facial animation with charisma. In: 2011 Proceedings of 20th International Conference on Computer Communications and Networks, pp. 1–6. IEEE Press, Lahaina (2011)
10.
Zurück zum Zitat Lee, Y., Terzopoulos, D., Waters, K.: Constructing Physics-based Facial Models of Individuals. Graphics Interface, Canadian Information Processing Society (1993) Lee, Y., Terzopoulos, D., Waters, K.: Constructing Physics-based Facial Models of Individuals. Graphics Interface, Canadian Information Processing Society (1993)
11.
Zurück zum Zitat Koch, R.M., Gross, M.H., Bosshard, A.A.: Emotion editing using finite elements. Comput. Graph. Forum 17, 295–302 (1998). Blackwell Publishers LtdCrossRef Koch, R.M., Gross, M.H., Bosshard, A.A.: Emotion editing using finite elements. Comput. Graph. Forum 17, 295–302 (1998). Blackwell Publishers LtdCrossRef
12.
Zurück zum Zitat Anderson, R., Stenger, B., Wan, V., Cipolla, R.: Expressive visual text-to-speech using active appearance models. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3382–3389, IEEE Press, Portland (2013) Anderson, R., Stenger, B., Wan, V., Cipolla, R.: Expressive visual text-to-speech using active appearance models. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3382–3389, IEEE Press, Portland (2013)
13.
Zurück zum Zitat Li, D., Sun, C., Hu, F., Zang, D., Wang, L., Zhang, M.: Real-time performance-driven facial animation with 3ds Max and Kinect. In: 2013 3rd International Conference on Consumer Electronics, Communications and Networks, pp. 473–476. IEEE Press, Xianning (2013) Li, D., Sun, C., Hu, F., Zang, D., Wang, L., Zhang, M.: Real-time performance-driven facial animation with 3ds Max and Kinect. In: 2013 3rd International Conference on Consumer Electronics, Communications and Networks, pp. 473–476. IEEE Press, Xianning (2013)
14.
Zurück zum Zitat Yu, H., Garrod, O., Jack, R., Schyns, P.: Realistic facial animation generation based on facial expression mapping. In: Fifth International Conference on Graphic and Image Processing, pp. 906903-1–906903-5. SPIE Press, Hong Kong (2014) Yu, H., Garrod, O., Jack, R., Schyns, P.: Realistic facial animation generation based on facial expression mapping. In: Fifth International Conference on Graphic and Image Processing, pp. 906903-1–906903-5. SPIE Press, Hong Kong (2014)
15.
Zurück zum Zitat Zhang, Y., Prakash, E.C., Sung, E.: A new physical model with multilayer architecture for facial expression animation using dynamic adaptive mesh. IEEE Trans. Vis. Comput. Graph. 10, 339–352 (2004)CrossRef Zhang, Y., Prakash, E.C., Sung, E.: A new physical model with multilayer architecture for facial expression animation using dynamic adaptive mesh. IEEE Trans. Vis. Comput. Graph. 10, 339–352 (2004)CrossRef
16.
Zurück zum Zitat Arad, N., Dyn, N., Reisfeld, D., Yeshurun, Y.: Image warping by radial basis functions: application to facial expressions. Graph. Models Image Process. 56, 161–172 (1994)CrossRef Arad, N., Dyn, N., Reisfeld, D., Yeshurun, Y.: Image warping by radial basis functions: application to facial expressions. Graph. Models Image Process. 56, 161–172 (1994)CrossRef
17.
Zurück zum Zitat Pan, H., Liu, Y., Xu, G.: Review on methods of facial synthesis. Appl. Res. Comput. 25, 327–331 (2008) Pan, H., Liu, Y., Xu, G.: Review on methods of facial synthesis. Appl. Res. Comput. 25, 327–331 (2008)
18.
Zurück zum Zitat Beier, T., Neely, S.: Feature-based image metamorphosis. ACM SIGGRAPH Comput. Graph. 26, 35–42 (1992)CrossRef Beier, T., Neely, S.: Feature-based image metamorphosis. ACM SIGGRAPH Comput. Graph. 26, 35–42 (1992)CrossRef
19.
Zurück zum Zitat Edge, J.D., Maddock, S.: Image-based talking heads using radial basis functions. In: IEEE Proceedings of Theory and Practice of Computer Graphics, pp. 74–80. IEEE Press, Birminghan (2003) Edge, J.D., Maddock, S.: Image-based talking heads using radial basis functions. In: IEEE Proceedings of Theory and Practice of Computer Graphics, pp. 74–80. IEEE Press, Birminghan (2003)
20.
Zurück zum Zitat Perng, W.L, Wu, Y., Ouhyoung, M.: Image talk: a real time synthetic talking head using one single image with chinese text-to-speech capability. In: Pacific Graphics’ Sixth Pacific Conference on Computer Graphics and Applications, pp. 140–148. IEEE Press, Singapore (1998) Perng, W.L, Wu, Y., Ouhyoung, M.: Image talk: a real time synthetic talking head using one single image with chinese text-to-speech capability. In: Pacific Graphics’ Sixth Pacific Conference on Computer Graphics and Applications, pp. 140–148. IEEE Press, Singapore (1998)
21.
Zurück zum Zitat Chuang, E., Bregler, C.: Mood swings: expressive speech animation. ACM Trans. Graph. 24, 331–347 (2005)CrossRef Chuang, E., Bregler, C.: Mood swings: expressive speech animation. ACM Trans. Graph. 24, 331–347 (2005)CrossRef
22.
Zurück zum Zitat Hong, P., Wen, Z., Huang, T.S.: Real-time speech-driven face animation with expressions using neural networks. IEEE Trans. Neural Netw. 13, 916–927 (2002)CrossRef Hong, P., Wen, Z., Huang, T.S.: Real-time speech-driven face animation with expressions using neural networks. IEEE Trans. Neural Netw. 13, 916–927 (2002)CrossRef
23.
Zurück zum Zitat Deng, Z., Neumann, U., Lewis, J.P., Kim, T.Y., Bulut, M., Narayanan, S.: Expressive facial animation synthesis by learning speech coarticulation and expression spaces. IEEE Trans. Vis. Comput. Graph. 12, 1523–1534 (2006)CrossRef Deng, Z., Neumann, U., Lewis, J.P., Kim, T.Y., Bulut, M., Narayanan, S.: Expressive facial animation synthesis by learning speech coarticulation and expression spaces. IEEE Trans. Vis. Comput. Graph. 12, 1523–1534 (2006)CrossRef
24.
Zurück zum Zitat Dong, L., Wang, Y., Ni, K., Lu, K.: Facial animation system based on image warping algorithm. In: 2011 IEEE International Conference on Electronics, Communications and Control, pp. 2648–2653. IEEE Press, Ningbo (2011) Dong, L., Wang, Y., Ni, K., Lu, K.: Facial animation system based on image warping algorithm. In: 2011 IEEE International Conference on Electronics, Communications and Control, pp. 2648–2653. IEEE Press, Ningbo (2011)
25.
Zurück zum Zitat Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30, 77–86 (2011)CrossRef Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30, 77–86 (2011)CrossRef
26.
Zurück zum Zitat Bouaziz, S., Wang, Y., Pauly, M.: Online modeling for realtime facial animation. ACM Trans. Graph. 32, 40–49 (2013)CrossRef Bouaziz, S., Wang, Y., Pauly, M.: Online modeling for realtime facial animation. ACM Trans. Graph. 32, 40–49 (2013)CrossRef
Metadaten
Titel
One Simple Virtual Avatar System Based on Single Image
verfasst von
Lanfang Dong
Jianfu Wang
Kui Ni
Yatao Wang
Xian Wu
Mingxue Xu
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21963-9_57