Skip to main content

2015 | OriginalPaper | Buchkapitel

Automatic Pose Tracking and Motion Transfer to Arbitrary 3D Characters

verfasst von : Ju Shen, Jianjun Yang

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

3D character with human motion offers a high end technology for creating compelling contents in graphics. In this paper, we present an automatic system to animate a 3D character with human motion streamed from a single video camera. The traditional mesh animation process is laborious and requires high skills from the users. To mitigate this limitation, a new way for bringing 3D objects to life is introduced that does not need explicit mesh positioning. In our framework, the animation is driven by the captured motion from an ordinary RGB camera. In order to reduce the ambiguity of the estimated 3D pose, a modified spatio-temporal constraint based algorithm is used for articulated gesture estimation across frames while maintaining temporal coherence. Our approach demonstrates promising performance on par with state-of-the-art techniques. We believe the presented animation system will allow a new audience of novice users to easily and efficiently create animation for arbitrary 3D characters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Igarashi, T., Matsuoka, T., Hughes, J.F.: Spatial keyframing for performance-driven animation. In: Symposium on Computer Animation (SCA) (2005) Igarashi, T., Matsuoka, T., Hughes, J.F.: Spatial keyframing for performance-driven animation. In: Symposium on Computer Animation (SCA) (2005)
2.
Zurück zum Zitat Thorne, M., Burke, D., Van, M.: Motion doodles: an interface for sketching character motion. ACM Trans. Graph. 23(3), 424–431 (2004)CrossRef Thorne, M., Burke, D., Van, M.: Motion doodles: an interface for sketching character motion. ACM Trans. Graph. 23(3), 424–431 (2004)CrossRef
3.
Zurück zum Zitat Shen, J., Cheung, S.: Layer depth denoising and completion for structured-light RGB-D cameras. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1187–1194 (2013) Shen, J., Cheung, S.: Layer depth denoising and completion for structured-light RGB-D cameras. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1187–1194 (2013)
4.
Zurück zum Zitat Shen, J., Su, P.-C., Cheung, S.-C., Zhao, J.: Virtual mirror rendering with stationary RGB-D cameras and stored 3-D background. IEEE Trans. Image Process. 22, 3433–3448 (2013)CrossRefMathSciNet Shen, J., Su, P.-C., Cheung, S.-C., Zhao, J.: Virtual mirror rendering with stationary RGB-D cameras and stored 3-D background. IEEE Trans. Image Process. 22, 3433–3448 (2013)CrossRefMathSciNet
5.
Zurück zum Zitat Bloomenthal, J., Lim, C.: Skeletal methods of shape manipulation. In: Shape Modeling International Conference (1999) Bloomenthal, J., Lim, C.: Skeletal methods of shape manipulation. In: Shape Modeling International Conference (1999)
6.
Zurück zum Zitat Katz, S., Tal, A.: Hierarchical mesh decomposition using fuzzy clustering and cuts. In: ACM SIGGRAPH (2003) Katz, S., Tal, A.: Hierarchical mesh decomposition using fuzzy clustering and cuts. In: ACM SIGGRAPH (2003)
7.
Zurück zum Zitat Gagvani, N., Silver, D.: Animating volumetric models. In: Graphical Models (2001) Gagvani, N., Silver, D.: Animating volumetric models. In: Graphical Models (2001)
8.
Zurück zum Zitat Lien, J., Keyser, J., Amato, N.: Simultaneous shape decomposition and skeletonization. In: ACM SPM/SMI (2006) Lien, J., Keyser, J., Amato, N.: Simultaneous shape decomposition and skeletonization. In: ACM SPM/SMI (2006)
9.
Zurück zum Zitat Shen, J., Yang, J., Taha-abusneineh, S., Payne, B., Hitz, M.: Structure preservinglarge imagery reconstruction. J. Cyber Secur. Mobil. 3(3) (2014) Shen, J., Yang, J., Taha-abusneineh, S., Payne, B., Hitz, M.: Structure preservinglarge imagery reconstruction. J. Cyber Secur. Mobil. 3(3) (2014)
10.
Zurück zum Zitat Yang, J., Wang, Y., Wang, H., Hua, K., Wang, W., Shen, J.: Automatic objects removal for scene completion. In: Workshop on Security and Privacy in Big Data, The 33rd Annual IEEE International Conference on Computer Communications (INFOCOM 2014), Toronto, Canada (2014) Yang, J., Wang, Y., Wang, H., Hua, K., Wang, W., Shen, J.: Automatic objects removal for scene completion. In: Workshop on Security and Privacy in Big Data, The 33rd Annual IEEE International Conference on Computer Communications (INFOCOM 2014), Toronto, Canada (2014)
11.
Zurück zum Zitat Zhou, Y., Li, L., Zhao, T., Zhang, H.: Region-based high-level semantics extraction with CEDD. In: IEEE International Conference on Network Infrastructure and Digital Content (2010) Zhou, Y., Li, L., Zhao, T., Zhang, H.: Region-based high-level semantics extraction with CEDD. In: IEEE International Conference on Network Infrastructure and Digital Content (2010)
12.
Zurück zum Zitat Wang, J., Halima, B., Gao, X.: Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification. Pattern Recogn. 46, 3249–3255 (2013)CrossRef Wang, J., Halima, B., Gao, X.: Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification. Pattern Recogn. 46, 3249–3255 (2013)CrossRef
13.
Zurück zum Zitat Shen, J., Tan, W.: Image-based indoor place-finder using image to plane matching. In: IEEE International Conference on Multimedia and Expo (ICME) (2014) Shen, J., Tan, W.: Image-based indoor place-finder using image to plane matching. In: IEEE International Conference on Multimedia and Expo (ICME) (2014)
14.
Zurück zum Zitat Zhou, Y., Li, Le, Zhao, T., Zhang, H.: Adaptive Learning of Region-based pLSA Model for Total Scene Annotation (2013). arXiv preprint arXiv:1311.5590 Zhou, Y., Li, Le, Zhao, T., Zhang, H.: Adaptive Learning of Region-based pLSA Model for Total Scene Annotation (2013). arXiv preprint arXiv:​1311.​5590
15.
Zurück zum Zitat Li, L., Yang, J., Zhao, K., Xu, Y., Zhang, H., Fan, Z.: Graph Regularized Non-negative Matrix Factorization By Maximizing Correntropy (2014). arXiv preprint arXiv:1405.2246 Li, L., Yang, J., Zhao, K., Xu, Y., Zhang, H., Fan, Z.: Graph Regularized Non-negative Matrix Factorization By Maximizing Correntropy (2014). arXiv preprint arXiv:​1405.​2246
16.
Zurück zum Zitat Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M.: Real-time human pose recognition in parts from a single depth image. In: IEEE CVPR (2011) Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M.: Real-time human pose recognition in parts from a single depth image. In: IEEE CVPR (2011)
17.
Zurück zum Zitat Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: CVPR (2000) Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: CVPR (2000)
18.
Zurück zum Zitat Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: IEEE CVPR (2011) Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: IEEE CVPR (2011)
19.
Zurück zum Zitat Wang, Y., Nandi, A., Agrawal, G.: SAGA: array storage as a DB with support for structural aggregations. In: Proceedings of SSDBM (2014) Wang, Y., Nandi, A., Agrawal, G.: SAGA: array storage as a DB with support for structural aggregations. In: Proceedings of SSDBM (2014)
20.
Zurück zum Zitat Ma, J., Choi, S.: Kinematic skeleton extraction from 3D articulated models. Comput. Aided Des. 46, 221–226 (2014)CrossRef Ma, J., Choi, S.: Kinematic skeleton extraction from 3D articulated models. Comput. Aided Des. 46, 221–226 (2014)CrossRef
21.
Zurück zum Zitat Leordeanu, M., Hebert, M.: A spectral technique for correspondence problems using pairwise constraints. In: IEEE International Conference on Computer Vision (2005) Leordeanu, M., Hebert, M.: A spectral technique for correspondence problems using pairwise constraints. In: IEEE International Conference on Computer Vision (2005)
22.
Zurück zum Zitat Garland, M., Heckbert, S.: Surface simplification using quadric error metrics. In: Proceedings of SIGGRAPH (1997) Garland, M., Heckbert, S.: Surface simplification using quadric error metrics. In: Proceedings of SIGGRAPH (1997)
23.
Zurück zum Zitat Sumner, R.W., Schmid, J., Pauly, M.: Embedded deformation for shape manipulation. In: ACM SIGGRAPH (2007) Sumner, R.W., Schmid, J., Pauly, M.: Embedded deformation for shape manipulation. In: ACM SIGGRAPH (2007)
24.
Zurück zum Zitat Luo, J., Alexander B.: A Heaviside-based regression of piecewise functions expressed as object-oriented programs. In: The International Conference on Machine Learning and Computing (2011) Luo, J., Alexander B.: A Heaviside-based regression of piecewise functions expressed as object-oriented programs. In: The International Conference on Machine Learning and Computing (2011)
25.
Zurück zum Zitat Alexander, B., Luo, J., Nash, H.: CoReJava: learning functions expressed as Object-Oriented programs. In: IEEE International Conference on In Machine Learning and Applications (2008) Alexander, B., Luo, J., Nash, H.: CoReJava: learning functions expressed as Object-Oriented programs. In: IEEE International Conference on In Machine Learning and Applications (2008)
26.
Zurück zum Zitat Wang, J., Bensmail, H., Yao, N., Gao, X.: Discriminative sparse coding on multimanifolds. Knowl. Based Syst. 54, 199–206 (2013)CrossRef Wang, J., Bensmail, H., Yao, N., Gao, X.: Discriminative sparse coding on multimanifolds. Knowl. Based Syst. 54, 199–206 (2013)CrossRef
27.
Zurück zum Zitat Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: IEEE CVPR 2011 (2011) Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: IEEE CVPR 2011 (2011)
28.
Zurück zum Zitat Wang, Y., Agrawal, G., Ozer, G., Huang, K.: Removing sequential bottlenecks in analysis of next-generation sequencing data. In: Workshop on High Performance Computational Biology (HiCOMB), IEEE International Parallel Distributed Processing Symposium (2014) Wang, Y., Agrawal, G., Ozer, G., Huang, K.: Removing sequential bottlenecks in analysis of next-generation sequencing data. In: Workshop on High Performance Computational Biology (HiCOMB), IEEE International Parallel Distributed Processing Symposium (2014)
29.
Zurück zum Zitat Ramanan, D.: Learning to parse images of articulated bodies. In: NIPS (2006) Ramanan, D.: Learning to parse images of articulated bodies. In: NIPS (2006)
30.
Zurück zum Zitat Ferrari, V., Marn-Jimnez, M., Zisserman, A.: 2D human pose estimation in TV shows. In: Proceedings of the Dagstuhl Seminar on Statistical and Geometrical Approaches to Visual Motion Analysis (2009) Ferrari, V., Marn-Jimnez, M., Zisserman, A.: 2D human pose estimation in TV shows. In: Proceedings of the Dagstuhl Seminar on Statistical and Geometrical Approaches to Visual Motion Analysis (2009)
31.
Zurück zum Zitat Sigal, L., Black, M.J.: Measure locally, reason globally: occlusion-sensitive articulated pose estimation. In: CVPR (2006) Sigal, L., Black, M.J.: Measure locally, reason globally: occlusion-sensitive articulated pose estimation. In: CVPR (2006)
32.
Zurück zum Zitat Quan, L., Lan, Z.: Linear N-point camera pose determination. IEEE Tras. PAMI 21, 774–780 (1999)CrossRef Quan, L., Lan, Z.: Linear N-point camera pose determination. IEEE Tras. PAMI 21, 774–780 (1999)CrossRef
33.
Zurück zum Zitat Baran, I., Popovic, J.: Automatic rigging and animation of 3D characters. In: SIGGRAPH (2007) Baran, I., Popovic, J.: Automatic rigging and animation of 3D characters. In: SIGGRAPH (2007)
34.
Zurück zum Zitat Wang, J., Bensmail, H., Gao, X.: Multiple graph regularized protein domain ranking. BMC Bioinf. 13, 307 (2012)CrossRef Wang, J., Bensmail, H., Gao, X.: Multiple graph regularized protein domain ranking. BMC Bioinf. 13, 307 (2012)CrossRef
Metadaten
Titel
Automatic Pose Tracking and Motion Transfer to Arbitrary 3D Characters
verfasst von
Ju Shen
Jianjun Yang
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21978-3_56

Premium Partner