Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 2/2022

09-09-2021 | Research Article-Computer Engineering and Computer Science

An Upper Limb Rehabilitation Exercise Status Identification System Based on Machine Learning and IoT

Authors: Binoy B. Nair, N. R. Sakthivel

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Rapid increase in stroke incidence coupled with the high cost and limited availability of healthcare professionals has made stroke rehabilitation process inaccessible to many patients in developing countries. Stroke rehabilitation exercises are of critical importance in ensuring quick and lasting recovery. A machine learning-based system that can automatically identify the completion status of upper limb rehabilitation exercises is presented in this study. Proposed system can detect completion status of twelve hand and arm rehabilitation exercises: six hand, four forearm and two shoulder exercises. Accelerometers record the movement of the upper limb part being exercised in the form of data sequences. Six curve-fitting-based machine learning model types are trained and evaluated for their effectiveness in modelling these sequences. This resulted in a total of 216 models (i.e. 12 exercises × 3 axes of motion × 6 model types) being evaluated on three performance measures: SSE, RMSE and R2. Best-performing model for each exercise is plugged into the proposed exercise completion status identification algorithm. System effectiveness is validated using four performance measures: accuracy, precision, recall and F1-score. Proposed system is demonstrated to be capable of detecting the exercise completion status with up to 90% accuracy. The proposed system is connected to cloud via an IoT interface with a dashboard type visualization system that allows for the healthcare professionals to remotely monitor the progress for each patient as well as carry out offline analysis. A game interaction interface is also provided to enable interaction with video games, helping in higher patient engagement while performing exercises.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Pandian, J.D.; Sudhan, P.: Stroke epidemiology and stroke care services in India. J. Stroke 15, 128–134 (2013)CrossRef Pandian, J.D.; Sudhan, P.: Stroke epidemiology and stroke care services in India. J. Stroke 15, 128–134 (2013)CrossRef
5.
go back to reference Ferri, C.P.; Schoenborn, C.; Kalra, L.; Acosta, D.; Guerra, M.; Huang, Y.; Jacob, K.S.; Rodriguez, J.J.L.; Salas, A.; Sosa, A.L.; Williams, J.D.: Prevalence of stroke and related burden among older people living in Latin America, India and China. J. Neurol. Neurosurg. Psychiatry 82, 1074–1082 (2011)CrossRef Ferri, C.P.; Schoenborn, C.; Kalra, L.; Acosta, D.; Guerra, M.; Huang, Y.; Jacob, K.S.; Rodriguez, J.J.L.; Salas, A.; Sosa, A.L.; Williams, J.D.: Prevalence of stroke and related burden among older people living in Latin America, India and China. J. Neurol. Neurosurg. Psychiatry 82, 1074–1082 (2011)CrossRef
6.
go back to reference Kamalakannan, S.; Venkata, M.G.; Prost, A.; Pant, S.N.H.; Chitalurri, N.; Goenka, S.; Kuper, H.: Rehabilitation needs of stroke survivors after discharge from hospital in India. Arch. Phys. Med. Rehabil. 96, 1526–1532 (2016)CrossRef Kamalakannan, S.; Venkata, M.G.; Prost, A.; Pant, S.N.H.; Chitalurri, N.; Goenka, S.; Kuper, H.: Rehabilitation needs of stroke survivors after discharge from hospital in India. Arch. Phys. Med. Rehabil. 96, 1526–1532 (2016)CrossRef
7.
go back to reference Khan, F.R.; Vijesh, P.V.; Rahool, S.; Radha, A.A.; Kurupath, S.S.R.: Physiotherapy practice in stroke rehabilitation: a cross-sectional survey of physiotherapists in the state of Kerala, India. Top. Stroke Rehabil. 19, 405–410 (2012)CrossRef Khan, F.R.; Vijesh, P.V.; Rahool, S.; Radha, A.A.; Kurupath, S.S.R.: Physiotherapy practice in stroke rehabilitation: a cross-sectional survey of physiotherapists in the state of Kerala, India. Top. Stroke Rehabil. 19, 405–410 (2012)CrossRef
8.
go back to reference Huang, V.S.; Krakauer, J.W.: Robotic neurorehabilitation: a computational motor learning perspective. J. Neuroeng. Rehabil. 6, 5 (2009)CrossRef Huang, V.S.; Krakauer, J.W.: Robotic neurorehabilitation: a computational motor learning perspective. J. Neuroeng. Rehabil. 6, 5 (2009)CrossRef
9.
go back to reference Megalingam, R.K.; Apuroop, K.G.S.; Boddupalli, S.: Single DoF hand orthosis for rehabilitation of stroke and SCI patients. In: International Conference on Materials, Alloys and Experimental Mechanics (ICMAEM-2017). pp. 1–6 (2017) Megalingam, R.K.; Apuroop, K.G.S.; Boddupalli, S.: Single DoF hand orthosis for rehabilitation of stroke and SCI patients. In: International Conference on Materials, Alloys and Experimental Mechanics (ICMAEM-2017). pp. 1–6 (2017)
11.
go back to reference Teasell, R.W.: What’s new in stroke rehabilitation. Stroke 35, 383–385 (2004)CrossRef Teasell, R.W.: What’s new in stroke rehabilitation. Stroke 35, 383–385 (2004)CrossRef
12.
go back to reference Laver, K.; George, S.; Ratcliffe, J.; Crotty, M.: Virtual reality stroke rehabilitation - hype or hope? Aust. Occup. Ther. J. 58, 215–219 (2011)CrossRef Laver, K.; George, S.; Ratcliffe, J.; Crotty, M.: Virtual reality stroke rehabilitation - hype or hope? Aust. Occup. Ther. J. 58, 215–219 (2011)CrossRef
13.
go back to reference Sai Krishna, M.N.S.S.C.; Monesh Karthikkeyan, B.A.; Nair, B.B.; Rajagopalan, T.: Sensor-based grip strength monitoring system for stroke rehabilitation. In: Sengodan, T.; Murugappan, M.; Misra, S. (Eds.) Advances in Electrical and Computer Technologies, pp. 789–802. Springer Singapore, Singapore (2021)CrossRef Sai Krishna, M.N.S.S.C.; Monesh Karthikkeyan, B.A.; Nair, B.B.; Rajagopalan, T.: Sensor-based grip strength monitoring system for stroke rehabilitation. In: Sengodan, T.; Murugappan, M.; Misra, S. (Eds.) Advances in Electrical and Computer Technologies, pp. 789–802. Springer Singapore, Singapore (2021)CrossRef
14.
go back to reference Amritha, N.; Mahima, M.M.; Namitha, K.; Unnikrishnan, R.; Harish, M.T.; Ravi, M.D.S.; Bhavani, R.R.: Design and development of balance training platform and games for people with balance impairments. In: 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016. pp. 960–966. IEEE (2016). https://doi.org/10.1109/ICACCI.2016.7732169 Amritha, N.; Mahima, M.M.; Namitha, K.; Unnikrishnan, R.; Harish, M.T.; Ravi, M.D.S.; Bhavani, R.R.: Design and development of balance training platform and games for people with balance impairments. In: 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016. pp. 960–966. IEEE (2016). https://​doi.​org/​10.​1109/​ICACCI.​2016.​7732169
15.
go back to reference Lin, W.-Y.; Chen, C.-H.; Tseng, Y.-J.; Tsai, Y.-T.; Chang, C.-Y.; Wang, H.-Y.; Chen, C.-K.: Predicting post-stroke activities of daily living through a machine learning-based approach on initiating rehabilitation. Int. J. Med. Inform. 111, 159–164 (2018)CrossRef Lin, W.-Y.; Chen, C.-H.; Tseng, Y.-J.; Tsai, Y.-T.; Chang, C.-Y.; Wang, H.-Y.; Chen, C.-K.: Predicting post-stroke activities of daily living through a machine learning-based approach on initiating rehabilitation. Int. J. Med. Inform. 111, 159–164 (2018)CrossRef
16.
go back to reference Loya, A.; Deshpande, S.; Purwar, A.: Machine learning-driven individualized gait rehabilitation: classification, prediction, and mechanism design. J. Eng. Sci. Med. Diagn. Ther. 3, 021105 (2020) Loya, A.; Deshpande, S.; Purwar, A.: Machine learning-driven individualized gait rehabilitation: classification, prediction, and mechanism design. J. Eng. Sci. Med. Diagn. Ther. 3, 021105 (2020)
17.
go back to reference Ongvisatepaiboon, K.; Chan, J.H.; Vanijja, V.: Smartphone-based tele-rehabilitation system for frozen shoulder using a machine learning approach. In: 2015 IEEE Symposium Series on Computational Intelligence. pp. 811–815. IEEE (2015) Ongvisatepaiboon, K.; Chan, J.H.; Vanijja, V.: Smartphone-based tele-rehabilitation system for frozen shoulder using a machine learning approach. In: 2015 IEEE Symposium Series on Computational Intelligence. pp. 811–815. IEEE (2015)
18.
go back to reference Beckerle, P.; Salvietti, G.; Unal, R.; Rossi, D.P.S.; Castellini, C.; Hirche, S.: A human–robot interaction perspective on assistive and rehabilitation robotics. Front. Neurorobot. 11, 24 (2017)CrossRef Beckerle, P.; Salvietti, G.; Unal, R.; Rossi, D.P.S.; Castellini, C.; Hirche, S.: A human–robot interaction perspective on assistive and rehabilitation robotics. Front. Neurorobot. 11, 24 (2017)CrossRef
19.
go back to reference Yang, G.; Deng, J.; Pang, G.; Zhang, H.; Li, J.; Deng, B.; Pang, Z.; Xu, J.; Jiang, M.; Liljeberg, P.; Xie, H.: An IoT-enabled stroke rehabilitation system based on smart wearable armband and machine learning. EEE J. Transl. Eng. Heal. Med. 6, 1–10 (2018) Yang, G.; Deng, J.; Pang, G.; Zhang, H.; Li, J.; Deng, B.; Pang, Z.; Xu, J.; Jiang, M.; Liljeberg, P.; Xie, H.: An IoT-enabled stroke rehabilitation system based on smart wearable armband and machine learning. EEE J. Transl. Eng. Heal. Med. 6, 1–10 (2018)
21.
go back to reference Yu, C.-H.; Mathiowetz, V.: Efficacy of a forearm rotation orthosis for persons with a hemiparetic arm: study protocol, University of Minnesota-Minneapolis (2017) Yu, C.-H.; Mathiowetz, V.: Efficacy of a forearm rotation orthosis for persons with a hemiparetic arm: study protocol, University of Minnesota-Minneapolis (2017)
23.
go back to reference Margot, A.; Hoessly, M.; Hedges, K.: Your guide to exercise after a stroke: a guide for people with stroke and their families. Stroke Foundation - New Zealand (2017) Margot, A.; Hoessly, M.; Hedges, K.: Your guide to exercise after a stroke: a guide for people with stroke and their families. Stroke Foundation - New Zealand (2017)
24.
go back to reference Bonnyaud, C.; Jinwala, K.; Roche, N.: Self-Rehabilitation Booklet for Hemiplegic Patients. Fondation Garches-Allergan Inc., Garches (2015) Bonnyaud, C.; Jinwala, K.; Roche, N.: Self-Rehabilitation Booklet for Hemiplegic Patients. Fondation Garches-Allergan Inc., Garches (2015)
25.
go back to reference Dept.of.Rehabilitation: Arm Exercises for Stroke Patients. Singapore (2021) Dept.of.Rehabilitation: Arm Exercises for Stroke Patients. Singapore (2021)
29.
go back to reference STMicroelectronics: LSM6DS33 iNEMO inertial module. (2017) STMicroelectronics: LSM6DS33 iNEMO inertial module. (2017)
30.
go back to reference Hsiao, Y.Y.; Huang, C.C.: Characterization of hand tendon by using high frequency ultrasound imaging. In: Jarm, T.; Mahnič-Kalamiza, S.; Cvetkoska, A.; Miklavčič, D. (Eds.) 8th European Medical and Biological Engineering Conference (EMBEC 2020). p. 92. Springer, Cham, Portoroz, Slovenia (2020) Hsiao, Y.Y.; Huang, C.C.: Characterization of hand tendon by using high frequency ultrasound imaging. In: Jarm, T.; Mahnič-Kalamiza, S.; Cvetkoska, A.; Miklavčič, D. (Eds.) 8th European Medical and Biological Engineering Conference (EMBEC 2020). p. 92. Springer, Cham, Portoroz, Slovenia (2020)
31.
go back to reference Halloran, S.; Tang, L.; Guan, Y.; Shi, J.Q.; Eyre, J.: Remote monitoring of stroke patients’ rehabilitation using wearable accelerometers. In: Proceedings - International Symposium on Wearable Computers, ISWC. pp. 72–77. Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3341163.3347731 Halloran, S.; Tang, L.; Guan, Y.; Shi, J.Q.; Eyre, J.: Remote monitoring of stroke patients’ rehabilitation using wearable accelerometers. In: Proceedings - International Symposium on Wearable Computers, ISWC. pp. 72–77. Association for Computing Machinery, New York, NY, USA (2019). https://​doi.​org/​10.​1145/​3341163.​3347731
33.
go back to reference Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11, 431–441 (1963)MathSciNetCrossRef Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11, 431–441 (1963)MathSciNetCrossRef
34.
go back to reference Nair, B.B.; Patturajan, M.; Mohandas, V.P.; Sreenivasan, R.R.: Predicting the BSE sensex: performance comparison of adaptive linear element, feed forward and time delay neural networks. In: 2012 International Conference on Power, Signals, Controls and Computation, EPSCICON 2012. pp. 290–293 (2012). https://doi.org/10.1109/EPSCICON.2012.6175277 Nair, B.B.; Patturajan, M.; Mohandas, V.P.; Sreenivasan, R.R.: Predicting the BSE sensex: performance comparison of adaptive linear element, feed forward and time delay neural networks. In: 2012 International Conference on Power, Signals, Controls and Computation, EPSCICON 2012. pp. 290–293 (2012). https://​doi.​org/​10.​1109/​EPSCICON.​2012.​6175277
Metadata
Title
An Upper Limb Rehabilitation Exercise Status Identification System Based on Machine Learning and IoT
Authors
Binoy B. Nair
N. R. Sakthivel
Publication date
09-09-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-06152-y

Other articles of this Issue 2/2022

Arabian Journal for Science and Engineering 2/2022 Go to the issue

Research Article-Computer Engineering and Computer Science

Cuckoo Energy-Efficient Load-Balancing On-Demand Multipath Routing Protocol

Research Article-Computer Engineering and Computer Science

Credit Card Fraud Detection by Modelling Behaviour Pattern using Hybrid Ensemble Model

Research Article-Computer Engineering and Computer Science

Multi-focus Image Fusion Using Hybrid De-focused Region Segmentation Approach

Premium Partners