skip to main content
research-article

Data-driven inverse dynamics for human motion

Published:05 December 2016Publication History
Skip Abstract Section

Abstract

Inverse dynamics is an important and challenging problem in human motion modeling, synthesis and simulation, as well as in robotics and biomechanics. Previous solutions to inverse dynamics are often noisy and ambiguous particularly when double stances occur. In this paper, we present a novel inverse dynamics method that accurately reconstructs biomechanically valid contact information, including center of pressure, contact forces, torsional torques and internal joint torques from input kinematic human motion data. Our key idea is to apply statistical modeling techniques to a set of preprocessed human kinematic and dynamic motion data captured by a combination of an optical motion capture system, pressure insoles and force plates. We formulate the data-driven inverse dynamics problem in a maximum a posteriori (MAP) framework by estimating the most likely contact information and internal joint torques that are consistent with input kinematic motion data. We construct a low-dimensional data-driven prior model for contact information and internal joint torques to reduce ambiguity of inverse dynamics for human motion. We demonstrate the accuracy of our method on a wide variety of human movements including walking, jumping, running, turning and hopping and achieve state-of-the-art accuracy in our comparison against alternative methods. In addition, we discuss how to extend the data-driven inverse dynamics framework to motion editing, filtering and motion control.

Skip Supplemental Material Section

Supplemental Material

References

  1. Adelsberger, R., and Troster, G. 2013. Pimu: A wireless pressure-sensing imu. In Intelligent Sensors, Sensor Networks and Information Processing, 2013 IEEE Eighth International Conference on, IEEE, 271--276.Google ScholarGoogle Scholar
  2. Aladdin, R., and Kry, P. 2012. Static pose reconstruction with an instrumented bouldering wall. In Proceedings of the 18th ACM symposium on Virtual reality software and technology, ACM, 177--184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Anybodytech, 2016. http://www.anybodytech.com/.Google ScholarGoogle Scholar
  4. Artec3D, 2016. https://www.artec3d.com/.Google ScholarGoogle Scholar
  5. Bazaraa, M. S., Sherali, H., and Shetty, C. 1993. Nonlinear programming: theory and algorithms. John Wiley&Sons, New York.Google ScholarGoogle Scholar
  6. Bergmann, G., Deuretzbacher, G., Heller, M., Graichen, F., Rohlmann, A., Strauss, J., and Duda, G. 2001. Hip contact forces and gait patterns from routine activities. Journal of Biomechanics 34, 7, 859 -- 871.Google ScholarGoogle ScholarCross RefCross Ref
  7. Bishop, C. M., et al. 1995. Neural networks for pattern recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Brubaker, M. A., Sigal, L., and Fleet, D. J. 2009. Estimating contact dynamics. In Computer Vision, 2009 IEEE 12th International Conference on, IEEE, 2389--2396.Google ScholarGoogle Scholar
  9. Cohen, M. F. 1992. Interactive spacetime control for animation. In ACM SIGGRAPH Computer Graphics, vol. 26, ACM, 293--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Corazza, S., Gambaretto, E., Mundermann, L., and Andriacchi, T. P. 2010. Automatic generation of a subject-specific model for accurate markerless motion capture and biomechanical applications. Biomedical Engineering, IEEE Transactions on 57, 4, 806--812.Google ScholarGoogle ScholarCross RefCross Ref
  11. De Leva, P. 1996. Adjustments to zatsiorsky-seluyanov's segment inertia parameters. Journal of biomechanics 29, 9, 1223--1230.Google ScholarGoogle ScholarCross RefCross Ref
  12. Delp, S. L., Anderson, F. C., Arnold, A. S., Loan, P., Habib, A., John, C. T., Guendelman, E., and Thelen, D. G. 2007. Opensim: open-source software to create and analyze dynamic simulations of movement. IEEE transactions on biomedical engineering 54, 11, 1940--1950.Google ScholarGoogle Scholar
  13. Forner-Cordero, A., Koopman, H., and Van der Helm, F. 2006. Inverse dynamics calculations during gait with restricted ground reaction force information from pressure insoles. Gait & posture 23, 2, 189--199.Google ScholarGoogle Scholar
  14. Ha, S., Bai, Y., and Liu, C. K. 2011. Human motion reconstruction from force sensors. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, 129--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ho, W.-H., Shiang, T.-Y., Lee, C.-C., and Cheng, S.-Y. 2013. Body segment parameters of young chinese men determined with magnetic resonance imaging. Medicine and science in sports and exercise 45, 9, 1759--1766.Google ScholarGoogle Scholar
  16. Hreljac, A., and Marshall, R. N. 2000. Algorithms to determine event timing during normal walking using kinematic data. Journal of biomechanics 33, 6, 783--786.Google ScholarGoogle ScholarCross RefCross Ref
  17. Jain, S., and Liu, C. K. 2011. Controlling physics-based characters using soft contacts. ACM Trans. Graph. (SIGGRAPH Asia) 30 (Dec.), 163:1--163:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kistler, 2016. http://www.kistler.com.Google ScholarGoogle Scholar
  19. Ko, H., and Badler, N. I. 1996. Animating human locomotion with inverse dynamics. Computer Graphics and Applications, IEEE 16, 2, 50--59. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kry, P. G., and Pai, D. K. 2006. Interaction capture and synthesis. In ACM Transactions on Graphics (TOG), vol. 25, ACM, 872--880. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Liu, L., Yin, K., van de Panne, M., Shao, T., and Xu, W. 2010. Sampling-based contact-rich motion control. ACM Transctions on Graphics 29, 4, Article 128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Liu, L., Yin, K., and Guo, B. 2015. Improving sampling-based motion control. Computer Graphics Forum 34, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Min, J., Chen, Y., and Chai, J. 2009. Interactive generation of human animation with deformable motion models. ACM Transactions on Graphics (TOG) 29, 1, 9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Muico, U., Lee, Y., Popović, J., and Popović, Z. 2009. Contact-aware nonlinear control of dynamic characters. In ACM Transactions on Graphics (TOG), vol. 28, ACM, 81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Myers, C. S., and Rabiner, L. R. 1981. A comparative study of several dynamic time-warping algorithms for connected-word recognition. Bell System Technical Journal 60, 7, 1389--1409.Google ScholarGoogle ScholarCross RefCross Ref
  26. Novel, 2016. http://www.novel.de.Google ScholarGoogle Scholar
  27. Oh, S. E., Choi, A., and Mun, J. H. 2013. Prediction of ground reaction forces during gait based on kinematics and a neural network model. Journal of biomechanics 46, 14, 2372--2380.Google ScholarGoogle ScholarCross RefCross Ref
  28. Rao, G., Amarantini, D., Berton, E., and Favier, D. 2006. Influence of body segments parameters estimation models on inverse dynamics solutions during gait. Journal of Biomechanics 39, 8, 1531--1536.Google ScholarGoogle ScholarCross RefCross Ref
  29. Ren, L., Jones, R. K., and Howard, D. 2008. Whole body inverse dynamics over a complete gait cycle based only on measured kinematics. Journal of Biomechanics 41, 12, 2750--2759.Google ScholarGoogle ScholarCross RefCross Ref
  30. Safonova, A., Hodgins, J. K., and Pollard, N. S. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. In ACM Transactions on Graphics (TOG), vol. 23, ACM, 514--521. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Sok, K. W., Kim, M., and Lee, J. 2007. Simulating biped behaviors from human motion data. In ACM Transactions on Graphics (TOG), vol. 26, ACM, 107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Sulejmanpašić, A., and Popović, J. 2005. Adaptation of performed ballistic motion. ACM Transactions on Graphics (TOG) 24, 1, 165--179. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Vicon, 2016. http://www.vicon.com.Google ScholarGoogle Scholar
  34. Vondrak, M., Sigal, L., and Jenkins, O. C. 2008. Physical simulation for probabilistic motion tracking. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, IEEE, 1--8.Google ScholarGoogle Scholar
  35. Vondrak, M., Sigal, L., Hodgins, J., and Jenkins, O. 2012. Video-based 3d motion capture through biped control. ACM Transactions On Graphics (TOG) 31, 4, 27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Wei, X., Min, J., and Chai, J. 2011. Physically valid statistical models for human motion generation. ACM Transactions on Graphics (TOG) 30, 3, 19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Witkin, A., and Kass, M. 1988. Spacetime constraints. In ACM Siggraph Computer Graphics, vol. 22, ACM, 159--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Xia, S., Wang, C., Chai, J., and Hodgins, J. 2015. Realtime style transfer for unlabeled heterogeneous human motion. ACM Transactions on Graphics (TOG) 34, 4, 119. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Xiang, Y., Arora, J. S., and Abdel-Malek, K. 2011. Optimization-based prediction of asymmetric human gait. Journal of Biomechanics 44, 4, 683--693.Google ScholarGoogle ScholarCross RefCross Ref
  40. Ye, Y., and Liu, C. K. 2008. Animating responsive characters with dynamic constraints in near-unactuated coordinates. In ACM Transactions on Graphics (TOG), vol. 27, ACM, 112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Yeadon, M. R., and Morlock, M. 1989. The appropriate use of regression equations for the estimation of segmental inertia parameters. Journal of biomechanics 22, 6, 683--689.Google ScholarGoogle ScholarCross RefCross Ref
  42. Yin, K., and Pai, D. K. 2003. Footsee: an interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, Eurographics Association, 329--338. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Zell, P., and Rosenhahn, B. 2015. A physics-based statistical model for human gait analysis. In Pattern Recognition. Springer, 169--180.Google ScholarGoogle Scholar
  44. Zhang, P., Siu, K., Zhang, J., Liu, C. K., and Chai, J. 2014. Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture. ACM Transactions on Graphics (TOG) 33, 6, 221. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Data-driven inverse dynamics for human motion

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Graphics
            ACM Transactions on Graphics  Volume 35, Issue 6
            November 2016
            1045 pages
            ISSN:0730-0301
            EISSN:1557-7368
            DOI:10.1145/2980179
            Issue’s Table of Contents

            Copyright © 2016 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 5 December 2016
            Published in tog Volume 35, Issue 6

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader