Skip to main content

2022 | OriginalPaper | Buchkapitel

Latest Trends in Gait Analysis Using Deep Learning Techniques: A Systematic Review

verfasst von : Dimple Sethi, Chandra Prakash, Sourabh Bharti

Erschienen in: Artificial Intelligence and Speech Technology

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Marker-less analysis of human gait has made considerable progress in recent years. However, developing a gait analysis system capable of extracting reliable and precise kinematic data in a standard and unobtrusive manner remains an open challenge. This narrative review considers the transformation of methods for extracting gait extremity information from videos or images, perceived how analysis methods have improved from arduous manual procedures to semi-objective and objective marker-based systems and then marker-less systems. The gait analysis systems widely used restrict the analysis process with the use of markers, inhibited environmental conditions, and long processing duration. Such limitations can impede the use of a gait analysis system in multiple applications. Advancement in marker-less pose estimation and Q-learning-based techniques are opening the possibility of adopting productive methods for estimating precise poses of humans and information of movement from video frames. Vision-Based gait analysis techniques are capable of providing a cost-effective, unobtrusive solution for estimation of stick images and thus the analysis of the gait. This work provides a comprehensive review of marker-less computer vision and deep neural network-based gait analysis, parameters, design specifications, and the latest trends. This survey provides a birds-eye view of the domain. This review aims to introduce the latest trends in gait analysis using computer vision methods thus provide a single platform to learn various marker-less methods for the analysis of the gait that is likely to have a future impact in bio-mechanics while considering the challenges with accuracy and robustness that are yet to be addressed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Alnowami, M., Khan, A., Morfeq, A.H., Alothmany, N., Hafez, E.A.: Feasibility study of markerless gait tracking using kinect. Life Sci. J. 11(7), 514–523 (2014) Alnowami, M., Khan, A., Morfeq, A.H., Alothmany, N., Hafez, E.A.: Feasibility study of markerless gait tracking using kinect. Life Sci. J. 11(7), 514–523 (2014)
3.
Zurück zum Zitat Alonge, F., Cucco, E., D’Ippolito, F., Pulizzotto, A.: The use of accelerometers and gyroscopes to estimate hip and knee angles on gait analysis. Sensors 14(5), 8430–8446 (2014)CrossRef Alonge, F., Cucco, E., D’Ippolito, F., Pulizzotto, A.: The use of accelerometers and gyroscopes to estimate hip and knee angles on gait analysis. Sensors 14(5), 8430–8446 (2014)CrossRef
5.
Zurück zum Zitat Carreira, J., Agrawal, P., Fragkiadaki, K., Malik, J.: Human pose estimation with iterative error feedback. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4733–4742 (2016) Carreira, J., Agrawal, P., Fragkiadaki, K., Malik, J.: Human pose estimation with iterative error feedback. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4733–4742 (2016)
6.
Zurück zum Zitat Castelli, A., Paolini, G., Cereatti, A., Della Croce, U.: A 2D markerless gait analysis methodology: validation on healthy subjects. Comput. Math. Methods Med. 2015 (2015) Castelli, A., Paolini, G., Cereatti, A., Della Croce, U.: A 2D markerless gait analysis methodology: validation on healthy subjects. Comput. Math. Methods Med. 2015 (2015)
7.
Zurück zum Zitat Colyer, S.L., Evans, M., Cosker, D.P., Salo, A.I.: A review of the evolution of vision-based motion analysis and the integration of advanced computer vision methods towards developing a markerless system. Sports Med.-Open 4(1), 1–15 (2018)CrossRef Colyer, S.L., Evans, M., Cosker, D.P., Salo, A.I.: A review of the evolution of vision-based motion analysis and the integration of advanced computer vision methods towards developing a markerless system. Sports Med.-Open 4(1), 1–15 (2018)CrossRef
8.
Zurück zum Zitat Goffredo, M., Carter, J.N., Nixon, M.S.: 2D markerless gait analysis. In: Vander Sloten, J., Verdonck, P., Nyssen, M., Haueisen, J. (eds.) 4th European Conference of the International Federation for Medical and Biological Engineering. IFMBE, vol. 22, pp. 67–71. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-540-89208-3_18 Goffredo, M., Carter, J.N., Nixon, M.S.: 2D markerless gait analysis. In: Vander Sloten, J., Verdonck, P., Nyssen, M., Haueisen, J. (eds.) 4th European Conference of the International Federation for Medical and Biological Engineering. IFMBE, vol. 22, pp. 67–71. Springer, Heidelberg (2009). https://​doi.​org/​10.​1007/​978-3-540-89208-3_​18
10.
11.
Zurück zum Zitat Gu, X., Deligianni, F., Lo, B., Chen, W., Yang, G.Z.: Markerless gait analysis based on a single RGB camera. In: 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 42–45. IEEE (2018) Gu, X., Deligianni, F., Lo, B., Chen, W., Yang, G.Z.: Markerless gait analysis based on a single RGB camera. In: 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 42–45. IEEE (2018)
12.
Zurück zum Zitat Guffanti, D., Brunete, A., Hernando, M.: Non-invasive multi-camera gait analysis system and its application to gender classification. IEEE Access 8, 95734–95746 (2020)CrossRef Guffanti, D., Brunete, A., Hernando, M.: Non-invasive multi-camera gait analysis system and its application to gender classification. IEEE Access 8, 95734–95746 (2020)CrossRef
13.
Zurück zum Zitat Guo, Y., Deligianni, F., Gu, X., Yang, G.Z.: 3-D canonical pose estimation and abnormal gait recognition with a single RGB-D camera. IEEE Robot. Autom. Lett. 4(4), 3617–3624 (2019)CrossRef Guo, Y., Deligianni, F., Gu, X., Yang, G.Z.: 3-D canonical pose estimation and abnormal gait recognition with a single RGB-D camera. IEEE Robot. Autom. Lett. 4(4), 3617–3624 (2019)CrossRef
14.
Zurück zum Zitat Huynh-The, T., Hua, C.H., Tu, N.A., Kim, D.S.: Learning 3D spatiotemporal gait feature by convolutional network for person identification. Neurocomputing 397, 192–202 (2020)CrossRef Huynh-The, T., Hua, C.H., Tu, N.A., Kim, D.S.: Learning 3D spatiotemporal gait feature by convolutional network for person identification. Neurocomputing 397, 192–202 (2020)CrossRef
15.
Zurück zum Zitat Jun, K., Lee, Y., Lee, S., Lee, D.W., Kim, M.S.: Pathological gait classification using Kinect v2 and gated recurrent neural networks. IEEE Access 8, 139881–139891 (2020)CrossRef Jun, K., Lee, Y., Lee, S., Lee, D.W., Kim, M.S.: Pathological gait classification using Kinect v2 and gated recurrent neural networks. IEEE Access 8, 139881–139891 (2020)CrossRef
16.
Zurück zum Zitat Kidziński, Ł, Yang, B., Hicks, J.L., Rajagopal, A., Delp, S.L., Schwartz, M.H.: Deep neural networks enable quantitative movement analysis using single-camera videos. Nat. Commun. 11(1), 1–10 (2020)CrossRef Kidziński, Ł, Yang, B., Hicks, J.L., Rajagopal, A., Delp, S.L., Schwartz, M.H.: Deep neural networks enable quantitative movement analysis using single-camera videos. Nat. Commun. 11(1), 1–10 (2020)CrossRef
17.
Zurück zum Zitat Luo, J., Tjahjadi, T.: Multi-set canonical correlation analysis for 3D abnormal gait behaviour recognition based on virtual sample generation. IEEE Access 8, 32485–32501 (2020)CrossRef Luo, J., Tjahjadi, T.: Multi-set canonical correlation analysis for 3D abnormal gait behaviour recognition based on virtual sample generation. IEEE Access 8, 32485–32501 (2020)CrossRef
18.
Zurück zum Zitat Papandreou, G., et al.: Towards accurate multi-person pose estimation in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4903–4911 (2017) Papandreou, G., et al.: Towards accurate multi-person pose estimation in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4903–4911 (2017)
20.
Zurück zum Zitat Rohan, A., Rabah, M., Hosny, T., Kim, S.H.: Human pose estimation-based real-time gait analysis using convolutional neural network. IEEE Access 8, 191542–191550 (2020)CrossRef Rohan, A., Rabah, M., Hosny, T., Kim, S.H.: Human pose estimation-based real-time gait analysis using convolutional neural network. IEEE Access 8, 191542–191550 (2020)CrossRef
24.
Zurück zum Zitat Swanson, C.W., Haigh, Z.J., Fling, B.W.: Two-minute walk tests demonstrate similar age-related gait differences as a six-minute walk test. Gait Posture 69, 36–39 (2019)CrossRef Swanson, C.W., Haigh, Z.J., Fling, B.W.: Two-minute walk tests demonstrate similar age-related gait differences as a six-minute walk test. Gait Posture 69, 36–39 (2019)CrossRef
25.
Zurück zum Zitat Tompson, J.J.R.: Localization of humans in images using convolutional networks. Ph.D. thesis, New York University (2015) Tompson, J.J.R.: Localization of humans in images using convolutional networks. Ph.D. thesis, New York University (2015)
26.
Zurück zum Zitat Tong, K., Granat, M.H.: A practical gait analysis system using gyroscopes. Med. Eng. Phys. 21(2), 87–94 (1999)CrossRef Tong, K., Granat, M.H.: A practical gait analysis system using gyroscopes. Med. Eng. Phys. 21(2), 87–94 (1999)CrossRef
27.
Zurück zum Zitat Vilas-Boas, M.d.C., et al.: Validation of a single RGB-D camera for gait assessment of polyneuropathy patients. Sensors 19(22), 4929 (2019) Vilas-Boas, M.d.C., et al.: Validation of a single RGB-D camera for gait assessment of polyneuropathy patients. Sensors 19(22), 4929 (2019)
28.
Zurück zum Zitat Vishnoi, N., Mitra, A., Duric, Z., Gerber, N.L.: Motion based markerless gait analysis using standard events of gait and ensemble Kalman filtering. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2512–2516 (2014). https://doi.org/10.1109/EMBC.2014.6944133 Vishnoi, N., Mitra, A., Duric, Z., Gerber, N.L.: Motion based markerless gait analysis using standard events of gait and ensemble Kalman filtering. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2512–2516 (2014). https://​doi.​org/​10.​1109/​EMBC.​2014.​6944133
29.
Zurück zum Zitat Yoo, J.H., Nixon, M.S.: Automated markerless analysis of human gait motion for recognition and classification. ETRI J. 33(2), 259–266 (2011)CrossRef Yoo, J.H., Nixon, M.S.: Automated markerless analysis of human gait motion for recognition and classification. ETRI J. 33(2), 259–266 (2011)CrossRef
Metadaten
Titel
Latest Trends in Gait Analysis Using Deep Learning Techniques: A Systematic Review
verfasst von
Dimple Sethi
Chandra Prakash
Sourabh Bharti
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-030-95711-7_31

Premium Partner