Skip to main content
Erschienen in: Neural Computing and Applications 4/2024

18.11.2023 | Original Article

1D-convolutional transformer for Parkinson disease diagnosis from gait

verfasst von: Safwen Naimi, Wassim Bouachir, Guillaume-Alexandre Bilodeau

Erschienen in: Neural Computing and Applications | Ausgabe 4/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents an efficient deep neural network model for diagnosing Parkinson’s disease from gait. More specifically, we introduce a hybrid ConvNet-Transformer architecture to accurately diagnose the disease by detecting the severity stage. The proposed architecture exploits the strengths of both convolutional neural networks and Transformers in a single end-to-end model, where the former is able to extract relevant local features from Vertical Ground Reaction Force (VGRF) signal, while the latter allows to capture long-term spatio-temporal dependencies in data. In this manner, our hybrid architecture achieves an improved performance compared to using either models individually. Our experimental results show that our approach is effective for detecting the different stages of Parkinson’s disease from gait data, with a final accuracy of 88%, outperforming other state-of-the-art AI methods on the Physionet gait dataset. Moreover, our method can be generalized and adapted for other classification problems to jointly address the feature relevance and spatio-temporal dependency problems in 1D signals. Our source code and pre-trained models are publicly available at https://​github.​com/​SafwenNaimi.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Parkinson J (1969) An essay on the shaking palsy. JAMA Neurol 20:441–445 Parkinson J (1969) An essay on the shaking palsy. JAMA Neurol 20:441–445
3.
Zurück zum Zitat Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martínez-Martín P, Poewe W, Sampaio C, Stern MB, Dodel R, Dubois B, Holloway RG, Jankovic J, Kulisevsky J, Lang AE, Lees AJ, Leurgans SE, LeWitt P, Nyenhuis D, Olanow CW, Rascol O, Schrag AE, Teresi JA, Hilten JJ, Lapelle N (2008) Movement disorder society-sponsored revision of the unified Parkinson’s disease rating scale (mds-updrs): scale presentation and clinimetric testing results. Mov Disord 23:2129–2170CrossRef Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martínez-Martín P, Poewe W, Sampaio C, Stern MB, Dodel R, Dubois B, Holloway RG, Jankovic J, Kulisevsky J, Lang AE, Lees AJ, Leurgans SE, LeWitt P, Nyenhuis D, Olanow CW, Rascol O, Schrag AE, Teresi JA, Hilten JJ, Lapelle N (2008) Movement disorder society-sponsored revision of the unified Parkinson’s disease rating scale (mds-updrs): scale presentation and clinimetric testing results. Mov Disord 23:2129–2170CrossRef
4.
Zurück zum Zitat Bhidayasiri R, Tarsy D (2012) Parkinson’s disease: Hoehn and yahr scale Bhidayasiri R, Tarsy D (2012) Parkinson’s disease: Hoehn and yahr scale
5.
Zurück zum Zitat Parkinson’s Disease MDSTF (2003) The unified Parkinson’s disease rating scale (updrs): status and recommendations. Mov Disors 18:738–750CrossRef Parkinson’s Disease MDSTF (2003) The unified Parkinson’s disease rating scale (updrs): status and recommendations. Mov Disors 18:738–750CrossRef
6.
Zurück zum Zitat Hoehn MM, Yahr MD (1998) Parkinsonism: onset, progression, and mortality. 1967. Neurology 57(10 Suppl 3):11–26 Hoehn MM, Yahr MD (1998) Parkinsonism: onset, progression, and mortality. 1967. Neurology 57(10 Suppl 3):11–26
7.
Zurück zum Zitat Heida T, Wentink EC, Marani E (2013) Power spectral density analysis of physiological, rest and action tremor in Parkinson’s disease patients treated with deep brain stimulation. J NeuroEng Rehabilit 10:70–70CrossRef Heida T, Wentink EC, Marani E (2013) Power spectral density analysis of physiological, rest and action tremor in Parkinson’s disease patients treated with deep brain stimulation. J NeuroEng Rehabilit 10:70–70CrossRef
8.
Zurück zum Zitat Patel M, Nilsson MH, Rehncrona S, Tjernström F, Magnusson M, Johansson R, Fransson P-A (2021) Spectral analysis of body movement during deep brain stimulation in Parkinson’s disease. Gait Post 86:217–225CrossRef Patel M, Nilsson MH, Rehncrona S, Tjernström F, Magnusson M, Johansson R, Fransson P-A (2021) Spectral analysis of body movement during deep brain stimulation in Parkinson’s disease. Gait Post 86:217–225CrossRef
9.
Zurück zum Zitat Chang K-H, French IT, Liang W-K, Lo Y-S, Wang Y-R, Cheng M-L, Huang NE, Wu H-C, Lim S-N, Chen CM, Juan C-H (2022) Evaluating the different stages of Parkinson’s disease using electroencephalography with Holo-Hilbert spectral analysis. Front Aging Neurosci 14:832637CrossRef Chang K-H, French IT, Liang W-K, Lo Y-S, Wang Y-R, Cheng M-L, Huang NE, Wu H-C, Lim S-N, Chen CM, Juan C-H (2022) Evaluating the different stages of Parkinson’s disease using electroencephalography with Holo-Hilbert spectral analysis. Front Aging Neurosci 14:832637CrossRef
10.
Zurück zum Zitat Rizvi SQA, Wang G, Xing X (2019) Early detection of Parkinson disease using wavelet transform along with fourier transform. In: iSCI Rizvi SQA, Wang G, Xing X (2019) Early detection of Parkinson disease using wavelet transform along with fourier transform. In: iSCI
11.
Zurück zum Zitat Ertugrul ÖF, Kaya Y, Tekin R, Almali MN (2016) Detection of Parkinson’s disease by shifted one dimensional local binary patterns from gait. Expert Syst Appl 56:156–163CrossRef Ertugrul ÖF, Kaya Y, Tekin R, Almali MN (2016) Detection of Parkinson’s disease by shifted one dimensional local binary patterns from gait. Expert Syst Appl 56:156–163CrossRef
12.
Zurück zum Zitat Xia Y, Gao Q, Ye Q (2015) Classification of gait rhythm signals between patients with neuro-degenerative diseases and normal subjects: experiments with statistical features and different classification models. Biomed Sign Process Control 18:254–262CrossRef Xia Y, Gao Q, Ye Q (2015) Classification of gait rhythm signals between patients with neuro-degenerative diseases and normal subjects: experiments with statistical features and different classification models. Biomed Sign Process Control 18:254–262CrossRef
13.
Zurück zum Zitat Mannini A, Trojaniello D, Cereatti A, Sabatini AM (2016) A machine learning framework for gait classification using inertial sensors: application to elderly, post-stroke and Huntington’s disease patients. Sensors (Basel, Switzerland) 16:134CrossRef Mannini A, Trojaniello D, Cereatti A, Sabatini AM (2016) A machine learning framework for gait classification using inertial sensors: application to elderly, post-stroke and Huntington’s disease patients. Sensors (Basel, Switzerland) 16:134CrossRef
14.
Zurück zum Zitat Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2:121–167CrossRef Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2:121–167CrossRef
15.
Zurück zum Zitat Nanni L, Ghidoni S, Brahnam S (2017) Handcrafted versus non-handcrafted features for computer vision classification. Patt Recognit 71:158–172CrossRef Nanni L, Ghidoni S, Brahnam S (2017) Handcrafted versus non-handcrafted features for computer vision classification. Patt Recognit 71:158–172CrossRef
16.
Zurück zum Zitat Caramia C, Torricelli D, Schmid M, Muñoz-Gonzalez A, González-Vargas J, Grandas F, Pons JL (2018) Imu-based classification of Parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J Biomed Health Inform 22:1765–1774CrossRef Caramia C, Torricelli D, Schmid M, Muñoz-Gonzalez A, González-Vargas J, Grandas F, Pons JL (2018) Imu-based classification of Parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J Biomed Health Inform 22:1765–1774CrossRef
17.
Zurück zum Zitat Veeraragavan S, Gopalai AA, Gouwanda D, Ahmad SA (2020) Parkinson’s disease diagnosis and severity assessment using ground reaction forces and neural networks. Front Physiol 11:587057CrossRef Veeraragavan S, Gopalai AA, Gouwanda D, Ahmad SA (2020) Parkinson’s disease diagnosis and severity assessment using ground reaction forces and neural networks. Front Physiol 11:587057CrossRef
18.
Zurück zum Zitat Maâchi IE, Bilodeau G-A, Bouachir W (2019) Deep 1d-convnet for accurate Parkinson disease detection and severity prediction from gait. Expert Syst Appl 143:113075CrossRef Maâchi IE, Bilodeau G-A, Bouachir W (2019) Deep 1d-convnet for accurate Parkinson disease detection and severity prediction from gait. Expert Syst Appl 143:113075CrossRef
19.
Zurück zum Zitat Keller TS, Weisberger AM, Ray JL, Hasan SS, Shiavi RG, Spengler DM (1996) Relationship between vertical ground reaction force and speed during walking, slow jogging, and running. Clin Biomech 11(5):253–259CrossRef Keller TS, Weisberger AM, Ray JL, Hasan SS, Shiavi RG, Spengler DM (1996) Relationship between vertical ground reaction force and speed during walking, slow jogging, and running. Clin Biomech 11(5):253–259CrossRef
20.
Zurück zum Zitat Takahashi T, Ishida K, Hirose D, Nagano Y, Okumiya K, Nishinaga M, Doi Y, Yamamoto H (2004) Vertical ground reaction force shape is associated with gait parameters, timed up and go, and functional reach in elderly females. J Rehabilit Med 36(1):42–5CrossRef Takahashi T, Ishida K, Hirose D, Nagano Y, Okumiya K, Nishinaga M, Doi Y, Yamamoto H (2004) Vertical ground reaction force shape is associated with gait parameters, timed up and go, and functional reach in elderly females. J Rehabilit Med 36(1):42–5CrossRef
21.
Zurück zum Zitat Muniz AM, Manfio EF, Andrade MC, Nadal J (2006) Principal component analysis of vertical ground reaction force: a powerful method to discriminate normal and abnormal gait and assess treatment. In: 2006 international conference of the ieee engineering in medicine and biology society, pp 2683–2686 Muniz AM, Manfio EF, Andrade MC, Nadal J (2006) Principal component analysis of vertical ground reaction force: a powerful method to discriminate normal and abnormal gait and assess treatment. In: 2006 international conference of the ieee engineering in medicine and biology society, pp 2683–2686
22.
Zurück zum Zitat Mirelman A, Frank MBO, Melamed M, Granovsky L, Nieuwboer A, Rochester L, Din SD, Avanzino L, Pelosin E, Bloem BR, Croce UD, Cereatti A, Bonato P, Camicioli R, Ellis T, Hamilton JL, Hass CJ, Almeida QJ, Inbal M, Thaler A, Shirvan JC, Cedarbaum JM, Giladi N, Hausdorff JM (2021) Detecting sensitive mobility features for Parkinson’s disease stages via machine learning. Mov Disord 36:2144–2155CrossRef Mirelman A, Frank MBO, Melamed M, Granovsky L, Nieuwboer A, Rochester L, Din SD, Avanzino L, Pelosin E, Bloem BR, Croce UD, Cereatti A, Bonato P, Camicioli R, Ellis T, Hamilton JL, Hass CJ, Almeida QJ, Inbal M, Thaler A, Shirvan JC, Cedarbaum JM, Giladi N, Hausdorff JM (2021) Detecting sensitive mobility features for Parkinson’s disease stages via machine learning. Mov Disord 36:2144–2155CrossRef
23.
Zurück zum Zitat Sabo A, Mehdizadeh S, Ng K-D, Iaboni A, Taati B (2020) Assessment of parkinsonian gait in older adults with dementia via human pose tracking in video data. JNeuroEng Rehabilit 17:1–10 Sabo A, Mehdizadeh S, Ng K-D, Iaboni A, Taati B (2020) Assessment of parkinsonian gait in older adults with dementia via human pose tracking in video data. JNeuroEng Rehabilit 17:1–10
24.
Zurück zum Zitat Park J, Lee J-S, Sim D (2020) Low-complexity CNN with 1d and 2d filters for super-resolution. J Real-Time Image Process 17:2065–2076CrossRef Park J, Lee J-S, Sim D (2020) Low-complexity CNN with 1d and 2d filters for super-resolution. J Real-Time Image Process 17:2065–2076CrossRef
25.
Zurück zum Zitat Lohit S, Wang Q, Turaga PK (2019) Temporal transformer networks: joint learning of invariant and discriminative time warping. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 12418–12427 Lohit S, Wang Q, Turaga PK (2019) Temporal transformer networks: joint learning of invariant and discriminative time warping. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 12418–12427
26.
Zurück zum Zitat Tyagi H, Gärtner B, Krause A (2014) Advances in neural information processing systems (nips) Tyagi H, Gärtner B, Krause A (2014) Advances in neural information processing systems (nips)
27.
Zurück zum Zitat LeCun Y, Haffner P, Bottou L, Bengio Y (1999) Object recognition with gradient-based learning. In: Shape, contour and grouping in computer vision LeCun Y, Haffner P, Bottou L, Bengio Y (1999) Object recognition with gradient-based learning. In: Shape, contour and grouping in computer vision
28.
Zurück zum Zitat Yogev G, Giladi N, Peretz C, Springer S, Simon ES, Hausdorff JM (2005) Dual tasking, gait rhythmicity, and Parkinson’s disease: Which aspects of gait are attention demanding? Eur J Neurosci 22:1248–1256CrossRef Yogev G, Giladi N, Peretz C, Springer S, Simon ES, Hausdorff JM (2005) Dual tasking, gait rhythmicity, and Parkinson’s disease: Which aspects of gait are attention demanding? Eur J Neurosci 22:1248–1256CrossRef
29.
Zurück zum Zitat Hausdorff JM, Lowenthal J, Herman T, Gruendlinger L, Peretz C, Giladi N (2007) Rhythmic auditory stimulation modulates gait variability in Parkinson’s disease. Eur J Neurosci 26:2369–2375CrossRef Hausdorff JM, Lowenthal J, Herman T, Gruendlinger L, Peretz C, Giladi N (2007) Rhythmic auditory stimulation modulates gait variability in Parkinson’s disease. Eur J Neurosci 26:2369–2375CrossRef
30.
Zurück zum Zitat Frenkel-Toledo S, Giladi N, Peretz C, Herman T, Gruendlinger L, Hausdorff JM (2005) Treadmill walking as an external pacemaker to improve gait rhythm and stability in Parkinson’s disease. Mov Disord 20:1109–1114CrossRef Frenkel-Toledo S, Giladi N, Peretz C, Herman T, Gruendlinger L, Hausdorff JM (2005) Treadmill walking as an external pacemaker to improve gait rhythm and stability in Parkinson’s disease. Mov Disord 20:1109–1114CrossRef
32.
Zurück zum Zitat Pratama K, Kang D-K (2020) Trainable activation function with differentiable negative side and adaptable rectified point. Appl Intell 51:1784–1801CrossRef Pratama K, Kang D-K (2020) Trainable activation function with differentiable negative side and adaptable rectified point. Appl Intell 51:1784–1801CrossRef
33.
Zurück zum Zitat Dozat T (2016) Incorporating nesterov momentum into adam. In: Proceedings of the 54th annual meeting of the association for computational linguistics (ACL 2016) Dozat T (2016) Incorporating nesterov momentum into adam. In: Proceedings of the 54th annual meeting of the association for computational linguistics (ACL 2016)
34.
Zurück zum Zitat Nguyen DM, Miah M, Bilodeau G-A, Bouachir W (2022) Transformers for 1d signals in Parkinson’s disease detection from gait. In: 2022 26th international conference on pattern recognition (ICPR), pp 5089–5095 Nguyen DM, Miah M, Bilodeau G-A, Bouachir W (2022) Transformers for 1d signals in Parkinson’s disease detection from gait. In: 2022 26th international conference on pattern recognition (ICPR), pp 5089–5095
Metadaten
Titel
1D-convolutional transformer for Parkinson disease diagnosis from gait
verfasst von
Safwen Naimi
Wassim Bouachir
Guillaume-Alexandre Bilodeau
Publikationsdatum
18.11.2023
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 4/2024
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-023-09193-6

Weitere Artikel der Ausgabe 4/2024

Neural Computing and Applications 4/2024 Zur Ausgabe

Premium Partner