Skip to main content
Erschienen in: Neural Computing and Applications 15/2020

23.12.2019 | Original Article

Learning inverse dynamics for human locomotion analysis

verfasst von: Petrissa Zell, Bodo Rosenhahn

Erschienen in: Neural Computing and Applications | Ausgabe 15/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work, learning-based inverse dynamics algorithms are proposed for the analysis of human motion. Immeasurable joint torques and exterior contact forces are directly estimated from motions by machine learning techniques including deep neural networks, random forests and Ridge regression. A multistage subclass approach is introduced. The method recovers occluded motion data and generates meaningful features, as well as gait phase labels to restrict and facilitate the regression of forces and moments. In contrast to the state-of-the-art inverse dynamics optimization, the learning-based methods are independent of ground reaction force measurements and the global position and orientation of the human body. These properties make the application to reconstructed poses from videos or inertial measurements possible, creating fast and simple access to the underlying dynamics of recorded human motions. The performance of the proposed methods is evaluated on a self-recorded data set including walking and running motions and on a publicly available gait data set by Fukuchi et al. (PeerJ 6:e4640, 2018). Furthermore, the applicability to reconstructed gait sequences taken from the well-known CMU database (Human motion capture database, 2014. http://​mocap.​cs.​cmu.​edu/​) is investigated. Finally, the method is tested as a tool to detect abnormal torque distributions in gait, based on a reconstructed 3D motion of a limping subject.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: CVPR Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: CVPR
2.
Zurück zum Zitat Chang CC, Lin CJ (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef Chang CC, Lin CJ (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef
3.
Zurück zum Zitat Choi A, Lee JM, Mun JH (2013) Ground reaction forces predicted by using artificial neural network during asymmetric movements. Int J Precis Eng Manuf 14(3):475–483CrossRef Choi A, Lee JM, Mun JH (2013) Ground reaction forces predicted by using artificial neural network during asymmetric movements. Int J Precis Eng Manuf 14(3):475–483CrossRef
5.
Zurück zum Zitat Diba A, Fayyaz M, Sharma V, Karami AH, Arzani MM, Yousefzadeh R, Gool LV (2017) Temporal 3d convnets: New architecture and transfer learning for video classification. CoRR arXiv:abs/1711.08200 Diba A, Fayyaz M, Sharma V, Karami AH, Arzani MM, Yousefzadeh R, Gool LV (2017) Temporal 3d convnets: New architecture and transfer learning for video classification. CoRR arXiv:​abs/​1711.​08200
6.
Zurück zum Zitat Ding Y, Galiana I, Asbeck AT, Rossi SMMD, Bae J, Santos TRT, de Araujo VL, Lee S, Holt KG, Walsh C (2017) Biomechanical and physiological evaluation of multi-joint assistance with soft exosuits. IEEE Trans Neural Syst Rehabil Eng 25(2):119–130CrossRef Ding Y, Galiana I, Asbeck AT, Rossi SMMD, Bae J, Santos TRT, de Araujo VL, Lee S, Holt KG, Walsh C (2017) Biomechanical and physiological evaluation of multi-joint assistance with soft exosuits. IEEE Trans Neural Syst Rehabil Eng 25(2):119–130CrossRef
7.
Zurück zum Zitat Fluit R, Andersen M, Kolk S, Verdonschot N, Koopman H (2014) Prediction of ground reaction forces and moments during various activities of daily living. J Biomech 47(10):2321–2329CrossRef Fluit R, Andersen M, Kolk S, Verdonschot N, Koopman H (2014) Prediction of ground reaction forces and moments during various activities of daily living. J Biomech 47(10):2321–2329CrossRef
8.
Zurück zum Zitat Forner-Cordero A, Koopman H, van der Helm F (2006) Inverse dynamics calculations during gait with restricted ground reaction force information from pressure insoles. Gait Posture 23(2):189–199CrossRef Forner-Cordero A, Koopman H, van der Helm F (2006) Inverse dynamics calculations during gait with restricted ground reaction force information from pressure insoles. Gait Posture 23(2):189–199CrossRef
9.
Zurück zum Zitat Fukuchi CA, Fukuchi RK, Duarte M (2018) A public dataset of overground and treadmill walking kinematics and kinetics in healthy individuals. PeerJ 6:e4640CrossRef Fukuchi CA, Fukuchi RK, Duarte M (2018) A public dataset of overground and treadmill walking kinematics and kinetics in healthy individuals. PeerJ 6:e4640CrossRef
10.
Zurück zum Zitat Ghochani A, Ghomshe FT, Nejad SR, Rahimnejad M (2010) Analysis of torques and forces applied on limbs and joints of lower extremities in free kick in football. Procedia Eng 2(2):3269–3274CrossRef Ghochani A, Ghomshe FT, Nejad SR, Rahimnejad M (2010) Analysis of torques and forces applied on limbs and joints of lower extremities in free kick in football. Procedia Eng 2(2):3269–3274CrossRef
11.
Zurück zum Zitat Guo M, Chou E, Huang DA, Song S, Yeung S, Fei-Fei L (2018) Neural graph matching networks for fewshot 3d action recognition. In: The European Conference on Computer Vision (ECCV) Guo M, Chou E, Huang DA, Song S, Yeung S, Fei-Fei L (2018) Neural graph matching networks for fewshot 3d action recognition. In: The European Conference on Computer Vision (ECCV)
12.
Zurück zum Zitat Johnson L, Ballard DH (2014) Efficient codes for inverse dynamics during walking. In: Proceedings of the 28th AAAI conference on artificial intelligence. AAAI Press, pp 343–349 Johnson L, Ballard DH (2014) Efficient codes for inverse dynamics during walking. In: Proceedings of the 28th AAAI conference on artificial intelligence. AAAI Press, pp 343–349
13.
Zurück zum Zitat Johnson W, Alderson J, Lloyd D, Mian A (2018) Predicting athlete ground reaction forces and moments from spatio-temporal driven cnn models. IEEE Trans Biomed Eng 66:1 Johnson W, Alderson J, Lloyd D, Mian A (2018) Predicting athlete ground reaction forces and moments from spatio-temporal driven cnn models. IEEE Trans Biomed Eng 66:1
14.
Zurück zum Zitat Jung Y, Jung M, Lee K, Koo S (2014) Ground reaction force estimation using an insole-type pressure mat and joint kinematics during walking. J Biomech 47(11):2693–2699CrossRef Jung Y, Jung M, Lee K, Koo S (2014) Ground reaction force estimation using an insole-type pressure mat and joint kinematics during walking. J Biomech 47(11):2693–2699CrossRef
15.
Zurück zum Zitat Karatsidis A, Bellusci G, Schepers HM, de Zee M, Andersen MS, Veltink PH (2017) Estimation of ground reaction forces and moments during gait using only inertial motion capture. Sensors 17(1):75:1–75:22 Karatsidis A, Bellusci G, Schepers HM, de Zee M, Andersen MS, Veltink PH (2017) Estimation of ground reaction forces and moments during gait using only inertial motion capture. Sensors 17(1):75:1–75:22
16.
Zurück zum Zitat King MG, Lawrenson PR, Semciw AI, Middleton KJ, Crossley KM (2018) Lower limb biomechanics in femoroacetabular impingement syndrome: a systematic review and meta-analysis. Br J Sports Med 52(9):566–580CrossRef King MG, Lawrenson PR, Semciw AI, Middleton KJ, Crossley KM (2018) Lower limb biomechanics in femoroacetabular impingement syndrome: a systematic review and meta-analysis. Br J Sports Med 52(9):566–580CrossRef
18.
Zurück zum Zitat Li C, Tong R, Tang M (2018) Modelling human body pose for action recognition using deep neural networks. Arab J Sci Eng 43:7777–7788CrossRef Li C, Tong R, Tang M (2018) Modelling human body pose for action recognition using deep neural networks. Arab J Sci Eng 43:7777–7788CrossRef
19.
Zurück zum Zitat Li Y, Xie Y, Zhang Q (2018) 3d gesture recognition based on handheld smart terminals. Int J Ambient Comput Intell 9(4):96–111CrossRef Li Y, Xie Y, Zhang Q (2018) 3d gesture recognition based on handheld smart terminals. Int J Ambient Comput Intell 9(4):96–111CrossRef
20.
Zurück zum Zitat Lv X, Chai J, Xia S (2016) Data-driven inverse dynamics for human motion. ACM Trans Graph 35(6):163:1–163:12CrossRef Lv X, Chai J, Xia S (2016) Data-driven inverse dynamics for human motion. ACM Trans Graph 35(6):163:1–163:12CrossRef
21.
Zurück zum Zitat von Marcard T, Rosenhahn B, Black M, Pons-Moll G (2017) Sparse inertial poser: Automatic 3d human pose estimation from sparse imus. Computer Graphics Forum 36(2). In: Proceedings of the 38th annual conference of the European Association for computer graphics (Eurographics) von Marcard T, Rosenhahn B, Black M, Pons-Moll G (2017) Sparse inertial poser: Automatic 3d human pose estimation from sparse imus. Computer Graphics Forum 36(2). In: Proceedings of the 38th annual conference of the European Association for computer graphics (Eurographics)
22.
Zurück zum Zitat von Marcard T, Henschel R, Black MJ, Rosenhahn B, Pons-Moll G (2018) Recovering accurate 3D human pose in the wild using IMUs and a moving camera. In: European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11214. Springer, Cha, pp 614–631 von Marcard T, Henschel R, Black MJ, Rosenhahn B, Pons-Moll G (2018) Recovering accurate 3D human pose in the wild using IMUs and a moving camera. In: European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11214. Springer, Cha, pp 614–631
23.
Zurück zum Zitat Martinez J, Hossain R, Romero J, Little JJ (2017) A simple yet effective baseline for 3d human pose estimation. In: ICCV, IEEE Computer Society, pp 2659–2668 Martinez J, Hossain R, Romero J, Little JJ (2017) A simple yet effective baseline for 3d human pose estimation. In: ICCV, IEEE Computer Society, pp 2659–2668
24.
Zurück zum Zitat Mehta D, Sridhar S, Sotnychenko O, Rhodin H, Shafiei M, Seidel HP, Xu W, Casas D, Theobalt C (2017) Vnect: Real-time 3d human pose estimation with a single rgb camera. ACM Trans Gr 36:44CrossRef Mehta D, Sridhar S, Sotnychenko O, Rhodin H, Shafiei M, Seidel HP, Xu W, Casas D, Theobalt C (2017) Vnect: Real-time 3d human pose estimation with a single rgb camera. ACM Trans Gr 36:44CrossRef
25.
Zurück zum Zitat Muntoni F, Domingos J, Manzur A, Mayhew A, Guglieri M, Signorovitch J, Ward S (2017) Clustering trajectories of ambulatory function in the north star clinical network database. Neuromuscul Disord 27:S99CrossRef Muntoni F, Domingos J, Manzur A, Mayhew A, Guglieri M, Signorovitch J, Ward S (2017) Clustering trajectories of ambulatory function in the north star clinical network database. Neuromuscul Disord 27:S99CrossRef
26.
Zurück zum Zitat Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: ECCV (8) Lecture Notes in Computer Science, vol 9912. Springer, pp 483–499 Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: ECCV (8) Lecture Notes in Computer Science, vol 9912. Springer, pp 483–499
27.
Zurück zum Zitat Oh SE, Choi A, Mun JH (2013) Prediction of ground reaction forces during gait based on kinematics and a neural network model. J Biomech 46(14):2372–2380CrossRef Oh SE, Choi A, Mun JH (2013) Prediction of ground reaction forces during gait based on kinematics and a neural network model. J Biomech 46(14):2372–2380CrossRef
28.
Zurück zum Zitat Park S, Hwang J, Kwak N (2016) 3d human pose estimation using convolutional neural networks with 2d pose information. In: Hua G, Jégou H (eds) Computer Vision—ECCV 2016 Workshops. Springer, Cham, pp 156–169CrossRef Park S, Hwang J, Kwak N (2016) 3d human pose estimation using convolutional neural networks with 2d pose information. In: Hua G, Jégou H (eds) Computer Vision—ECCV 2016 Workshops. Springer, Cham, pp 156–169CrossRef
29.
Zurück zum Zitat Pavei G, Seminati E, Storniolo JL, Peyré-Tartaruga LA (2017) Estimates of running ground reaction force parameters from motion analysis. J Appl Biomech 33(1):69–75CrossRef Pavei G, Seminati E, Storniolo JL, Peyré-Tartaruga LA (2017) Estimates of running ground reaction force parameters from motion analysis. J Appl Biomech 33(1):69–75CrossRef
30.
Zurück zum Zitat Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830MathSciNetMATH Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830MathSciNetMATH
31.
Zurück zum Zitat Pizzolato C, Reggiani M, Modenese L, Lloyd DG (2016) Real-time inverse kinematics and inverse dynamics for lower limb applications using opensim. Comput Methods Biomech Biomed Eng 20(4):436–445CrossRef Pizzolato C, Reggiani M, Modenese L, Lloyd DG (2016) Real-time inverse kinematics and inverse dynamics for lower limb applications using opensim. Comput Methods Biomech Biomed Eng 20(4):436–445CrossRef
32.
Zurück zum Zitat Powers CM (2010) The influence of abnormal hip mechanics on knee injury: a biomechanical perspective. J Orthopaed Sports Phys Therapy 40(2):42–51CrossRef Powers CM (2010) The influence of abnormal hip mechanics on knee injury: a biomechanical perspective. J Orthopaed Sports Phys Therapy 40(2):42–51CrossRef
33.
Zurück zum Zitat Rifkin RM, Lippert RA (2003) Notes on regularized least-squares. Tech. Rep. MIT-CSAIL-TR-2007-025. Computer Science and Artificial Intelligence Laboratory, MIT Rifkin RM, Lippert RA (2003) Notes on regularized least-squares. Tech. Rep. MIT-CSAIL-TR-2007-025. Computer Science and Artificial Intelligence Laboratory, MIT
34.
Zurück zum Zitat Rouhani H, Favre J, Crevoisier X, Aminian K (2010) Ambulatory assessment of 3d ground reaction force using plantar pressure distribution. Gait Posture 32(3):311–316CrossRef Rouhani H, Favre J, Crevoisier X, Aminian K (2010) Ambulatory assessment of 3d ground reaction force using plantar pressure distribution. Gait Posture 32(3):311–316CrossRef
35.
Zurück zum Zitat Schwab AL, Delhaes GMJ (2009) Lecture Notes Multibody Dynamics B, wb1413 Schwab AL, Delhaes GMJ (2009) Lecture Notes Multibody Dynamics B, wb1413
36.
Zurück zum Zitat Steinparz F (1985) Co-ordinate transformation and robot control with Denavit-Hartenberg matrices. J Microcomput Appl 8(4):303–316CrossRef Steinparz F (1985) Co-ordinate transformation and robot control with Denavit-Hartenberg matrices. J Microcomput Appl 8(4):303–316CrossRef
37.
Zurück zum Zitat Waltz R, Morales J, Nocedal J, Orban D (2006) An interior algorithm for nonlinear optimization that combines line search and trust region steps. Math Program 107(3):391–408MathSciNetMATHCrossRef Waltz R, Morales J, Nocedal J, Orban D (2006) An interior algorithm for nonlinear optimization that combines line search and trust region steps. Math Program 107(3):391–408MathSciNetMATHCrossRef
38.
Zurück zum Zitat Wandt B, Ackermann H, Rosenhahn B (2016) 3d reconstruction of human motion from monocular image sequences. Trans Pattern Anal Machine Intell 38(8):1505–1516CrossRef Wandt B, Ackermann H, Rosenhahn B (2016) 3d reconstruction of human motion from monocular image sequences. Trans Pattern Anal Machine Intell 38(8):1505–1516CrossRef
39.
Zurück zum Zitat Wandt B, Ackermann H, Rosenhahn B (2018) A kinematic chain space for monocular motion capture. In: ECCV Workshops Wandt B, Ackermann H, Rosenhahn B (2018) A kinematic chain space for monocular motion capture. In: ECCV Workshops
40.
Zurück zum Zitat Wei X, Chai J (2010) Videomocap: modeling physically realistic human motion from monocular video sequences. ACM Trans Graph 29(4):42:1–42:10 Wei X, Chai J (2010) Videomocap: modeling physically realistic human motion from monocular video sequences. ACM Trans Graph 29(4):42:1–42:10
41.
Zurück zum Zitat Winter D (2009) Biomechanics and motor control of human movement. Wiley, HobokenCrossRef Winter D (2009) Biomechanics and motor control of human movement. Wiley, HobokenCrossRef
42.
Zurück zum Zitat Xiang Y, Arora JS, Rahmatalla S, Abdel-Malek K (2010) Physics-based modeling and simulation of human walking: a review of optimization-based and other approaches. Struct Multidiscip Optim 42(1):1–23MathSciNetMATHCrossRef Xiang Y, Arora JS, Rahmatalla S, Abdel-Malek K (2010) Physics-based modeling and simulation of human walking: a review of optimization-based and other approaches. Struct Multidiscip Optim 42(1):1–23MathSciNetMATHCrossRef
43.
Zurück zum Zitat Xiang Y, Chung HJ, Kim JH, Bhatt R, Rahmatalla S, Yang J, Marler T, Arora JS, Abdel-Malek K (2010) Predictive dynamics: an optimization-based novel approach for human motion simulation. Struct Multidiscip Optim 41(3):465–479MathSciNetMATHCrossRef Xiang Y, Chung HJ, Kim JH, Bhatt R, Rahmatalla S, Yang J, Marler T, Arora JS, Abdel-Malek K (2010) Predictive dynamics: an optimization-based novel approach for human motion simulation. Struct Multidiscip Optim 41(3):465–479MathSciNetMATHCrossRef
44.
Zurück zum Zitat Xu W, Chatterjee A, Zollhöfer M, Rhodin H, Mehta D, Seidel HP, Theobalt C (2018) Monoperfcap: human performance capture from monocular video. ACM Trans Graph 37(2):27:1–27:15CrossRef Xu W, Chatterjee A, Zollhöfer M, Rhodin H, Mehta D, Seidel HP, Theobalt C (2018) Monoperfcap: human performance capture from monocular video. ACM Trans Graph 37(2):27:1–27:15CrossRef
45.
Zurück zum Zitat Yang W, Ouyang W, Wang X, Ren JSJ, Li H, Wang X (2018) 3d human pose estimation in the wild by adversarial learning. In: CVPR. IEEE Computer Society, pp 5255–5264 Yang W, Ouyang W, Wang X, Ren JSJ, Li H, Wang X (2018) 3d human pose estimation in the wild by adversarial learning. In: CVPR. IEEE Computer Society, pp 5255–5264
46.
Zurück zum Zitat Zanfir A, Marinoiu E, Sminchisescu C (2018) Monocular 3d pose and shape estimation of multiple people in natural scenes - the importance of multiple scene constraints. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Zanfir A, Marinoiu E, Sminchisescu C (2018) Monocular 3d pose and shape estimation of multiple people in natural scenes - the importance of multiple scene constraints. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
47.
Zurück zum Zitat Zell P, Rosenhahn B (2017) Learning-based inverse dynamics of human motion. In: The IEEE International Conference on Computer Vision (ICCV) Workshops, pp 842–850 Zell P, Rosenhahn B (2017) Learning-based inverse dynamics of human motion. In: The IEEE International Conference on Computer Vision (ICCV) Workshops, pp 842–850
48.
Zurück zum Zitat Zell P, Wandt B, Rosenhahn B (2017) Joint 3d human motion capture and physical analysis from monocular videos. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops Zell P, Wandt B, Rosenhahn B (2017) Joint 3d human motion capture and physical analysis from monocular videos. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops
Metadaten
Titel
Learning inverse dynamics for human locomotion analysis
verfasst von
Petrissa Zell
Bodo Rosenhahn
Publikationsdatum
23.12.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 15/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04658-z

Weitere Artikel der Ausgabe 15/2020

Neural Computing and Applications 15/2020 Zur Ausgabe

Premium Partner