Skip to main content
Top
Published in:
Cover of the book

2020 | OriginalPaper | Chapter

Exploring Workout Repetition Counting and Validation Through Deep Learning

Authors : Bruno Ferreira, Pedro M. Ferreira, Gil Pinheiro, Nelson Figueiredo, Filipe Carvalho, Paulo Menezes, Jorge Batista

Published in: Image Analysis and Recognition

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Studying human motion from images and videos has turned into an interesting topic of research given the recent advances in computer vision and deep learning algorithms. When focusing on the automatic procedure of tracking physical exercises, cameras can be used for full human pose estimation in relation to worn sensors. In this work, we propose a method for workout repetition counting and validation based on a set of skeleton-based and deep semantic features that are obtained from a 2D human pose estimation network. Given that some of the individuals’ body parts might be occluded throughout physical exercises, we also perform a multi-view analysis on supporting cameras to improve our recognition rates. Nevertheless, the obtained results for a single-view approach show that we are able to count valid repetitions with over \(90\%\) precision scores for 4 out of 5 considered exercises, while recognizing more than \(50\%\) of the invalid ones.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
2
From [5] – Precision is the fraction of relevant instances among the retrieved instances: \(Precision = \frac{tp}{tp+fp}\). Recall measures the proportion of actual positives that are correctly identified: \(Recall = \frac{tp}{tp + fn}\).
 
Literature
1.
go back to reference Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175–185 (1992)MathSciNet Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175–185 (1992)MathSciNet
2.
go back to reference Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. arXiv preprint arXiv:1812.08008 (2018) Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. arXiv preprint arXiv:​1812.​08008 (2018)
4.
go back to reference Ho, T.K.: Random decision forests. In: Proceedings of 3rd International Conference on Document Analysis and Recognition, vol. 1, pp. 278–282. IEEE (1995) Ho, T.K.: Random decision forests. In: Proceedings of 3rd International Conference on Document Analysis and Recognition, vol. 1, pp. 278–282. IEEE (1995)
5.
go back to reference Kent, A., Berry, M.M., Luehrs Jr., F.U., Perry, J.W.: Machine literature searching viii. Operational criteria for designing information retrieval systems. Am. Doc. 6(2), 93–101 (1955)CrossRef Kent, A., Berry, M.M., Luehrs Jr., F.U., Perry, J.W.: Machine literature searching viii. Operational criteria for designing information retrieval systems. Am. Doc. 6(2), 93–101 (1955)CrossRef
6.
go back to reference Khurana, R., Ahuja, K., Yu, Z., Mankoff, J., Harrison, C., Goel, M.: Gymcam: detecting, recognizing and tracking simultaneous exercises in unconstrained scenes. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 2, no. 4, pp. 1–17 (2018) Khurana, R., Ahuja, K., Yu, Z., Mankoff, J., Harrison, C., Goel, M.: Gymcam: detecting, recognizing and tracking simultaneous exercises in unconstrained scenes. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 2, no. 4, pp. 1–17 (2018)
7.
go back to reference Rêgo, M.L., Cabral, D.A., Costa, E.C., Fontes, E.B.: Physical exercise for individuals with hypertension: it is time to emphasize its benefits on the brain and cognition. Clin. Med. Insights: Cardiol. 13, 1179546819839411 (2019) Rêgo, M.L., Cabral, D.A., Costa, E.C., Fontes, E.B.: Physical exercise for individuals with hypertension: it is time to emphasize its benefits on the brain and cognition. Clin. Med. Insights: Cardiol. 13, 1179546819839411 (2019)
9.
go back to reference Soro, A., Brunner, G., Tanner, S., Wattenhofer, R.: Recognition and repetition counting for complex physical exercises with deep learning. Sensors 19(3), 714 (2019)CrossRef Soro, A., Brunner, G., Tanner, S., Wattenhofer, R.: Recognition and repetition counting for complex physical exercises with deep learning. Sensors 19(3), 714 (2019)CrossRef
Metadata
Title
Exploring Workout Repetition Counting and Validation Through Deep Learning
Authors
Bruno Ferreira
Pedro M. Ferreira
Gil Pinheiro
Nelson Figueiredo
Filipe Carvalho
Paulo Menezes
Jorge Batista
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-50347-5_1

Premium Partner