Skip to main content
Top
Published in: Soft Computing 13/2020

04-11-2019 | Methodologies and Application

Stylized human motion warping method based on identity-independent coordinates

Authors: Lei Lyu, Jinling Zhang

Published in: Soft Computing | Issue 13/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Human motion style is a vital concept to virtual human that has a great impact on the expressiveness of the final animation. This paper presents a novel technique that transfers style between heterogeneous motions in real time. Unlike previous approaches, our stylized motion warping is capable of reusing style between heterogeneous motions. The key idea of our work is to represent human motions with identity-independent coordinates (IICs) and learn relative space–time transformations between stylistically different IICs, instead of separating style from content. Once the relative space–time transformations are estimated from a small set of stylized example motions whose contents are identical, our technique is capable of generating style-controllable human motions by applying these transformations to heterogeneous motions with simple linear operations. Experimental results demonstrate that our technique is efficient and powerful in stylized human motion generation. Besides, our technique can also be used in numerous interactive applications, such as real-time human motion style control, stylizing motion graphs and style-based human motion editing.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Amaya K, Bruderlin A, Calvert T (1996) Emotion from motion. In: Proceedings of the conference on Graphics interface, vol 96, pp 222–229 Amaya K, Bruderlin A, Calvert T (1996) Emotion from motion. In: Proceedings of the conference on Graphics interface, vol 96, pp 222–229
go back to reference Arikan O, Forsyth DA (2002) Interactive motion generation from examples. ACM Trans Graph 21(3):483–490MATHCrossRef Arikan O, Forsyth DA (2002) Interactive motion generation from examples. ACM Trans Graph 21(3):483–490MATHCrossRef
go back to reference Aristidou A, Stavrakis E, Papaefthimiou M, Papagiannakis G, Chrysanthou Y (2017) Style-based motion analysis for dance composition. Vis Comput 3:1–13 Aristidou A, Stavrakis E, Papaefthimiou M, Papagiannakis G, Chrysanthou Y (2017) Style-based motion analysis for dance composition. Vis Comput 3:1–13
go back to reference Beaudoin P, Coros S, Panne MVD, Poulin P (2008) Motion-motif graphs. In: Proceedings 2008 ACM SIGGRAPH/Eurographics symposium on computer animation, pp 117–126 Beaudoin P, Coros S, Panne MVD, Poulin P (2008) Motion-motif graphs. In: Proceedings 2008 ACM SIGGRAPH/Eurographics symposium on computer animation, pp 117–126
go back to reference Brand M (2000) Style machines. In: Siggraph computer graphics proceedings, pp 183–192 Brand M (2000) Style machines. In: Siggraph computer graphics proceedings, pp 183–192
go back to reference Bruderlin A, Calvert TW (1989) Goal-directed, dynamic animation of human walking. In: Conference on computer graphics and interactive techniques, pp 233–242CrossRef Bruderlin A, Calvert TW (1989) Goal-directed, dynamic animation of human walking. In: Conference on computer graphics and interactive techniques, pp 233–242CrossRef
go back to reference Foroud A, Whishaw IQ (2006) Changes in the kinematic structure and non-kinematic features of movements during skilled reaching after stroke: a Laban movement analysis in two case studies. J Neurosci Methods 158(1):137–149CrossRef Foroud A, Whishaw IQ (2006) Changes in the kinematic structure and non-kinematic features of movements during skilled reaching after stroke: a Laban movement analysis in two case studies. J Neurosci Methods 158(1):137–149CrossRef
go back to reference Grochow K, Martin SL, Hertzmann A (2004) Style-based inverse kinematics. ACM Trans Graph 23(3):522–531CrossRef Grochow K, Martin SL, Hertzmann A (2004) Style-based inverse kinematics. ACM Trans Graph 23(3):522–531CrossRef
go back to reference Gupta BB (2017) Computer and cyber security: principles, algorithm, applications and perspectives. CRC Press, Boca Raton Gupta BB (2017) Computer and cyber security: principles, algorithm, applications and perspectives. CRC Press, Boca Raton
go back to reference Gupta Brij DPA, Yamaguchi S (2016) Handbook of research on modern cryptographic solutions for computer and cyber security. IGI Global, PennsylvaniaCrossRef Gupta Brij DPA, Yamaguchi S (2016) Handbook of research on modern cryptographic solutions for computer and cyber security. IGI Global, PennsylvaniaCrossRef
go back to reference Hauser K, Bretl T, Harada K, Latombe JC (2006) Using motion primitives in probabilistic sample-based planning for humanoid robots. In: The workshop on algorithmic foundations of robotics, pp 507–522MATH Hauser K, Bretl T, Harada K, Latombe JC (2006) Using motion primitives in probabilistic sample-based planning for humanoid robots. In: The workshop on algorithmic foundations of robotics, pp 507–522MATH
go back to reference Heck R, Gleicher M (2007) Parametric motion graphs. In: Symposium on interactive 3d graphics and games, pp 129–136 Heck R, Gleicher M (2007) Parametric motion graphs. In: Symposium on interactive 3d graphics and games, pp 129–136
go back to reference Hong L, Liu B, Hao Z, Liang L, Xin Q, Zhang G (2018a) Crowd evacuation simulation approach based on navigation knowledge and two-layer control mechanism. Inf Sci 436–437:247–267MathSciNet Hong L, Liu B, Hao Z, Liang L, Xin Q, Zhang G (2018a) Crowd evacuation simulation approach based on navigation knowledge and two-layer control mechanism. Inf Sci 436–437:247–267MathSciNet
go back to reference Hong L, Xu B, Lu D, Zhang G (2018b) A path planning approach for crowd evacuation in buildings based on improved artificial bee colony algorithm. Appl Soft Comput 68:360–376CrossRef Hong L, Xu B, Lu D, Zhang G (2018b) A path planning approach for crowd evacuation in buildings based on improved artificial bee colony algorithm. Appl Soft Comput 68:360–376CrossRef
go back to reference Hsu E, Pulli K (2005) Style translation for human motion. ACM Trans Graph 24(3):1082–1089CrossRef Hsu E, Pulli K (2005) Style translation for human motion. ACM Trans Graph 24(3):1082–1089CrossRef
go back to reference Ikemoto L, Forsyth DA (2004) Enriching a motion collection by transplanting limbs. In: Symposium on computer animation, pp 99–108 Ikemoto L, Forsyth DA (2004) Enriching a motion collection by transplanting limbs. In: Symposium on computer animation, pp 99–108
go back to reference Jang WS, Lee WK, Lee IK, Lee J (2008) Enriching a motion database by analogous combination of partial human motions. Vis Comput Int J Comput Graph 24(4):271–280 Jang WS, Lee WK, Lee IK, Lee J (2008) Enriching a motion database by analogous combination of partial human motions. Vis Comput Int J Comput Graph 24(4):271–280
go back to reference Kang HL, Choi MG, Lee J (2006) Motion patches: building blocks for virtual environments annotated with motion data. In: ACM SIGGRAPH, pp 898–906 Kang HL, Choi MG, Lee J (2006) Motion patches: building blocks for virtual environments annotated with motion data. In: ACM SIGGRAPH, pp 898–906
go back to reference Korein JU, Badler NI (1982) Techniques for generating the goal-directed motion of articulated structures. IEEE Comput Graph Appl 2(9):71–81CrossRef Korein JU, Badler NI (1982) Techniques for generating the goal-directed motion of articulated structures. IEEE Comput Graph Appl 2(9):71–81CrossRef
go back to reference Kovar L, Gleicher M (2002) Motion graphs. In: Siggraph 02: conference on computer graphics and interactive techniques, pp 473–482 Kovar L, Gleicher M (2002) Motion graphs. In: Siggraph 02: conference on computer graphics and interactive techniques, pp 473–482
go back to reference Kovar L, Gleicher M (2003) Flexible automatic motion blending with registration curves. In: ACM Siggraph/Eurographics symposium on computer animation, pp 214–224 Kovar L, Gleicher M (2003) Flexible automatic motion blending with registration curves. In: ACM Siggraph/Eurographics symposium on computer animation, pp 214–224
go back to reference Kovar L, Gleicher M (2004) Automated extraction and parameterization of motions in large data sets. ACM Trans Graph 23(3):559–568CrossRef Kovar L, Gleicher M (2004) Automated extraction and parameterization of motions in large data sets. ACM Trans Graph 23(3):559–568CrossRef
go back to reference Lee J, Shin SY (1999) A hierarchical approach to interactive motion editing for human-like figures. Siggraph 99:39–48 Lee J, Shin SY (1999) A hierarchical approach to interactive motion editing for human-like figures. Siggraph 99:39–48
go back to reference Levine S, Wang JM, Haraux A, Koltun V (2012) Continuous character control with low-dimensional embeddings. ACM Trans Graph 31(4):1–10CrossRef Levine S, Wang JM, Haraux A, Koltun V (2012) Continuous character control with low-dimensional embeddings. ACM Trans Graph 31(4):1–10CrossRef
go back to reference Li Y, Wang T, Shum HY (2002) Motion texture: a two-level statistical model for character motion synthesis. In: Conference on computer graphics and interactive techniques, pp 465–472 Li Y, Wang T, Shum HY (2002) Motion texture: a two-level statistical model for character motion synthesis. In: Conference on computer graphics and interactive techniques, pp 465–472
go back to reference Mukai T, Kuriyama S (2005) Geostatistical motion interpolation. ACM Trans Graph 24(3):1062–1070CrossRef Mukai T, Kuriyama S (2005) Geostatistical motion interpolation. ACM Trans Graph 24(3):1062–1070CrossRef
go back to reference Neff M, Kim Y (2009) Interactive editing of motion style using drives and correlations. In: ACM Siggraph/Eurographics symposium on computer animation, SCA 2009. Louisiana, pp 103–112 Neff M, Kim Y (2009) Interactive editing of motion style using drives and correlations. In: ACM Siggraph/Eurographics symposium on computer animation, SCA 2009. Louisiana, pp 103–112
go back to reference Pan W, Torresani L (2009) Unsupervised hierarchical modeling of locomotion styles. In: International conference on machine learning, pp 785–792 Pan W, Torresani L (2009) Unsupervised hierarchical modeling of locomotion styles. In: International conference on machine learning, pp 785–792
go back to reference Panda SK, Naik S (2018) An efficient data replication algorithm for distributed systems. Int J Cloud Appl Comput 8(3):60–77 Panda SK, Naik S (2018) An efficient data replication algorithm for distributed systems. Int J Cloud Appl Comput 8(3):60–77
go back to reference Paul RP (1981) Robot manipulator: mathematics, programming and control: the computer control of robot manipulators. MIT Press, Cambridge Paul RP (1981) Robot manipulator: mathematics, programming and control: the computer control of robot manipulators. MIT Press, Cambridge
go back to reference Rose C, Cohen MF, Bodenheimer B (2002) Verbs and adverbs: multidimensional motion interpolation. IEEE Comput Graph Appl 18(5):32–40CrossRef Rose C, Cohen MF, Bodenheimer B (2002) Verbs and adverbs: multidimensional motion interpolation. IEEE Comput Graph Appl 18(5):32–40CrossRef
go back to reference Sang IP, Shin HJ, Shin SY (2002) On-line locomotion generation based on motion blending. In: ACM Siggraph/Eurographics symposium on computer animation, pp 105–111 Sang IP, Shin HJ, Shin SY (2002) On-line locomotion generation based on motion blending. In: ACM Siggraph/Eurographics symposium on computer animation, pp 105–111
go back to reference Shapiro A, Cao Y, Faloutsos P (2006) Style components. In: Graphics interface, pp 33–39 Shapiro A, Cao Y, Faloutsos P (2006) Style components. In: Graphics interface, pp 33–39
go back to reference Shin HJ (2001) Computer puppetry: an importance-based approach. ACM Trans Graph TOG 20(2):67–94CrossRef Shin HJ (2001) Computer puppetry: an importance-based approach. ACM Trans Graph TOG 20(2):67–94CrossRef
go back to reference Shin HJ, Oh HS (2006) Fat graphs: constructing an interactive character with continuous controls. In: ACM Siggraph/Eurographics symposium on computer animation, SCA 2006. Austria, pp 291–298 Shin HJ, Oh HS (2006) Fat graphs: constructing an interactive character with continuous controls. In: ACM Siggraph/Eurographics symposium on computer animation, SCA 2006. Austria, pp 291–298
go back to reference Sung Y, Guo H, Lee SG (2018) Motion quaternion-based motion estimation method of myo using k-means algorithm and bayesian probability. Soft Comput 4:1–11 Sung Y, Guo H, Lee SG (2018) Motion quaternion-based motion estimation method of myo using k-means algorithm and bayesian probability. Soft Comput 4:1–11
go back to reference Tolani D, Goswami A, Badler NI (2000) Real-time inverse kinematics techniques for anthropomorphic limbs. Graph Models 62(5):353–388MATHCrossRef Tolani D, Goswami A, Badler NI (2000) Real-time inverse kinematics techniques for anthropomorphic limbs. Graph Models 62(5):353–388MATHCrossRef
go back to reference Torre FEDL, Black MJ (2001) Dynamic coupled component analysis. Proc Comput Vision Pattern Recognit 2:643–651 Torre FEDL, Black MJ (2001) Dynamic coupled component analysis. Proc Comput Vision Pattern Recognit 2:643–651
go back to reference Treuille A, Lee Y (2007) Near-optimal character animation with continuous control. ACM Trans Graph 26(3):1–7CrossRef Treuille A, Lee Y (2007) Near-optimal character animation with continuous control. ACM Trans Graph 26(3):1–7CrossRef
go back to reference Unuma M, Anjyo K, Takeuchi R (1995) Fourier principles for emotion-based human figure animation. In: Conference on computer graphics and interactive techniques, pp 91–96 Unuma M, Anjyo K, Takeuchi R (1995) Fourier principles for emotion-based human figure animation. In: Conference on computer graphics and interactive techniques, pp 91–96
go back to reference Urtasun R, Glardon P, Boulic R, Thalmann D, Fua P (2010) Style-based motion synthesis. Comput Graph Forum 23(4):799–812CrossRef Urtasun R, Glardon P, Boulic R, Thalmann D, Fua P (2010) Style-based motion synthesis. Comput Graph Forum 23(4):799–812CrossRef
go back to reference Vasilescu MAO (2002) Human motion signatures: analysis, synthesis, recognition. In: International conference on pattern recognition, 2002 proceedings, vol 3, pp 456–460 Vasilescu MAO (2002) Human motion signatures: analysis, synthesis, recognition. In: International conference on pattern recognition, 2002 proceedings, vol 3, pp 456–460
go back to reference Wang JM, Fleet DJ, Hertzmann A (2007) Multifactor Gaussian process models for style-content separation. In: International conference on machine learning, pp 975–982 Wang JM, Fleet DJ, Hertzmann A (2007) Multifactor Gaussian process models for style-content separation. In: International conference on machine learning, pp 975–982
go back to reference Witkin A, Popovic Z (1995) Motion warping. In: Conference on computer graphics and interactive techniques, pp 105–108 Witkin A, Popovic Z (1995) Motion warping. In: Conference on computer graphics and interactive techniques, pp 105–108
go back to reference Wu X, Ma L, Zheng C, Chen Y, Huang KS (2006) On-line motion style transfer. In: International conference on entertainment computing, pp 268–279 Wu X, Ma L, Zheng C, Chen Y, Huang KS (2006) On-line motion style transfer. In: International conference on entertainment computing, pp 268–279
go back to reference Xiao Q, Liu S (2015) Motion retrieval based on dynamic Bayesian network and Canonical time warping. Soft Comput 2:1–14CrossRef Xiao Q, Liu S (2015) Motion retrieval based on dynamic Bayesian network and Canonical time warping. Soft Comput 2:1–14CrossRef
go back to reference Xiao Q, Song R (2016) Motion retrieval based on motion semantic dictionary and HMM inference. Soft Comput 21(1):1–11 Xiao Q, Song R (2016) Motion retrieval based on motion semantic dictionary and HMM inference. Soft Comput 21(1):1–11
Metadata
Title
Stylized human motion warping method based on identity-independent coordinates
Authors
Lei Lyu
Jinling Zhang
Publication date
04-11-2019
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 13/2020
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-019-04489-z

Other articles of this Issue 13/2020

Soft Computing 13/2020 Go to the issue

Premium Partner