Download PDF
Methods Inf Med 2015; 54(02): 145-155
DOI: 10.3414/ME13-01-0109
Original Articles
Schattauer GmbH

Exercise Recognition for Kinect-based Telerehabilitation[*]

D. Antón
1   Department of Computer Languages and Systems, University of the Basque Country UPV/EHU, Donostia-San Sebastián, Spain
,
A. Goñi
1   Department of Computer Languages and Systems, University of the Basque Country UPV/EHU, Donostia-San Sebastián, Spain
,
A. Illarramendi
1   Department of Computer Languages and Systems, University of the Basque Country UPV/EHU, Donostia-San Sebastián, Spain
› Author Affiliations
Further Information

Publication History

received: 03 October 2013

accepted: 05 July 2014

Publication Date:
22 January 2018 (online)

    Permissions and Reprints

Summary

Background: An aging population and people’s higher survival to diseases and traumas that leave physical consequences are challenging aspects in the context of an efficient health management. This is why telerehabilitation systems are being developed, to allow monitoring and support of physiotherapy sessions at home, which could reduce healthcare costs while also improving the quality of life of the users.

Objectives: Our goal is the development of a Kinect-based algorithm that provides a very accurate real-time monitoring of physical rehabilitation exercises and that also provides a friendly interface oriented both to users and physiotherapists.

Methods: The two main constituents of our algorithm are the posture classification method and the exercises recognition method. The exercises consist of series of movements. Each movement is composed of an initial posture, a final posture and the angular trajectories of the limbs involved in the movement. The algorithm was designed and tested with datasets of real movements performed by volunteers. We also explain in the paper how we obtained the optimal values for the trade-off values for posture and trajectory recognition.

Results: Two relevant aspects of the algorithm were evaluated in our tests, classification accuracy and real-time data processing. We achieved 91.9% accuracy in posture classification and 93.75% accuracy in trajectory recognition. We also checked whether the algorithm was able to process the data in real-time. We found that our algorithm could process more than 20,000 postures per second and all the required trajectory data-series in real-time, which in practice guarantees no perceptible delays. Later on, we carried out two clinical trials with real patients that suffered shoulder disorders. We obtained an exercise monitoring accuracy of 95.16%.

Conclusions: We present an exercise recognition algorithm that handles the data provided by Kinect efficiently. The algorithm has been validated in a real scenario where we have verified its suitability. Moreover, we have received a positive feedback from both users and the physiotherapists who took part in the tests.

Keywords

Telerehabilitation - telemedicine - exercise recognition - Kinect-based motion tracking

* Supplementary material published on our web-site www.methods-online.com


 

  • References

  • 1 Bidargaddi N, Sarela A. Activity and heart rate-based measures for outpatient cardiac rehabilitation. Methods Inf Med 2008; 47 (03) 208-216.
    Article in Thieme ConnectPubMedGoogle Scholar
  • 2 Digital Agenda for Europe [Internet] [cited 2014 Jun 25]. Available from. http://ec.europa.eu/ digital-agenda/en/ehealth-and-ageing.
    PubMedGoogle Scholar
  • 3 Cooper RA, Fitzgerald SG, Boninger ML, Brienza DM, Shapcott N, Cooper R, Flood K. Telerehabilitation: Expanding access to rehabilitation expertise. Proceedings of the IEEE 2001; 89 (08) 1174-1193.
    CrossrefPubMedGoogle Scholar
  • 4 Rizzo AS, Kim GJ. A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence: Teleoperators & Virtual Environments. 2005; 14 (02) 119-146.
    CrossrefPubMedGoogle Scholar
  • 5 Weiss PL, Rand D, Katz N, Kizony R. Video capture virtual reality as a flexible and effective rehabilitation tool. Journal of NeuroEngineering and Rehabilitation 2004; 1 (01) 12-24.
    CrossrefPubMedGoogle Scholar
  • 6 Burdea G. Virtual rehabilitation-benefits and challenges. Methods Inf Med 2003; 42 (05) 519-523.
    Article in Thieme ConnectPubMedGoogle Scholar
  • 7 Kinect for Windows [Internet] [cited 2014 Jun 25]. Available from. http://www.microsoft.com/en-us/kinectforwindows/discover/features.aspx.
    PubMedGoogle Scholar
  • 8 Clark RA, Pua Y, Bryant AL, Hunt MA. Validity of the microsoft kinect for providing lateral trunk lean feedback during gait retraining. Gait Posture. 2013
    Google Scholar
  • 9 Obdrzalek S, Kurillo G, Ofli F, Bajcsy R, Seto E, Jimison H, Pavel M. Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population. In: Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE; 2012IEEE. 2012: 1188-1193.
    Google Scholar
  • 10 Dutta T. Evaluation of the kinect™ sensor for 3-D kinematic measurement in the workplace. Appl Ergon 2012; 43 (04) 645-649.
    CrossrefPubMedGoogle Scholar
  • 11 Llorens R, Gil-Gomez J, Mesa-Gresa P, Alcaniz M, Colomer C, Noe E. BioTrak: a comprehensive overview. In: Virtual Rehabilitation (ICVR), 2011 International Conference on;2011. Zurich, Switzerland: 2011: 1-6.
    Google Scholar
  • 12 Spina G, Huang G, Vaes A, Spruit M, Amft O. COPDTrainer: A smartphone-based motion rehabilitation training system with real-time acoustic feedback. In: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing; 2013ACM. 2013: 597-606.
    Google Scholar
  • 13 Martin-Moreno J, Ruiz-Fernandez D, Soriano-Paya A, Jesus Berenguer-Miralles V. Monitoring 3D movements for the rehabilitation of joints in physiotherapy. In: Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE;2008. Vancouver, Canada: 2008: 4836-4839.
    Google Scholar
  • 14 Lange B, Chien-Yen ChangSuma E, Newman B, Rizzo AS, Bolas M. Development and evaluation of low cost game-based balance rehabilitation tool using the microsoft kinect sensor. In: Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE;2011. Boston, USA: 2011: 1831-1834.
    Google Scholar
  • 15 Chang Y, Chen S, Huang J. A kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res Dev Disabil [Internet] 2011; 32 (06) 2566-2570.
    CrossrefPubMedGoogle Scholar
  • 16 Gotsis M, Lympouridis V, Turpin D, Tasse A, Poulos IC, Tucker D, Swider M, Thin AG, Jordan-Marsh M. Mixed reality game prototypes for upper body exercise and rehabilitation. In: Virtual Reality Workshops (VR), 2012 IEEE;2012. Orange County, CA, USA: 2012: 181-182.
    Google Scholar
  • 17 VirtualRehab [Internet] [cited 2014 Jun 25]. Available from. http://virtualrehab.info/en/product/.
    PubMedGoogle Scholar
  • 18 Jintronix Rehabilitation System. [Internet] [cited 2014 Jun 25]. Available from. http://www. jintronix.com/.
    PubMedGoogle Scholar
  • 19 Venugopalan J, Cheng C, Stokes TH, Wang MD. Kinect-based rehabilitation system for patients with traumatic brain injury. In: Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE; 2013IEEE . 2013: 4625-4628.
    Google Scholar
  • 20 Pastor I, Hayes HA, Bamberg SJ. A feasibility study of an upper limb rehabilitation system using kinect and computer games. In: Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE; 2012IEEE. 2012: 1286-1289.
    Google Scholar
  • 21 Chang Y, Han W, Tsai Y. A kinect-based upper limb rehabilitation system to assist people with cerebral palsy. Res Dev Disabil 2013; 34 (11) 3654-3659.
    CrossrefPubMedGoogle Scholar
  • 22 Gabel M, Gilad-Bachrach R, Renshaw E, Schuster A. Full body gait analysis with Kinect. In: Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE [Internet]; 2012IEEE. 2012: 1964-1967.
    Google Scholar
  • 23 Padilha Lanari Bo A, Hayashibe M, Poignet P. Joint Angle Estimation in Rehabilitation with Inertial Sensors and its Integration with Kinect. In: Engineering in Medicine and Biology Society,EMBC, 2011 Annual International Conference of the IEEE [Internet];2011. Boston, USA: 2011: 3479-3483.
    Google Scholar
  • 24 Salvador S, Chan P. Toward accurate dynamic time warping in linear time and space. Intell Data Anal 2007; 11 (05) 561-580.
    CrossrefPubMedGoogle Scholar
  • 25 Carmona JM, Climent J. A Performance Evaluation of HMM and DTW for Gesture Recognition In: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. Springer; 2012: 236-243.
    Google Scholar
  • 26 Wang X, Mueen A, Ding H, Trajcevski G, Scheuermann P, Keogh E. Experimental comparison of representation methods and distance measures for time series data. Data Mining and Knowledge Discovery 2013; 26 (02) 275-309.
    CrossrefPubMedGoogle Scholar
  • 27 Esling P, Agon C. Time-series data mining. ACM Computing Surveys (CSUR) 2012; 45 (01) 12.
    PubMedGoogle Scholar
  • 28 Fundacion Matia [Internet] [cited 2014 Jun 25]. Available from. http://www.matiafundazioa.net/en/home.
    PubMedGoogle Scholar
  • 29 González-Ortega D, Díaz-Pernas F, Martínez-Zarzuela M, Antón-Rodríguez M. A kinect-based system for cognitive rehabilitation exercises monitoring. Comput Methods Programs Biomed 2013; 113: 620-631.
    PubMedGoogle Scholar