Skip to main content

2024 | OriginalPaper | Buchkapitel

A DNN-Based Learning Framework for Continuous Movements Segmentation

verfasst von : Tian-yu Xiang, Xiao-Hu Zhou, Xiao-Liang Xie, Shi-Qi Liu, Zhen-Qiu Feng, Mei-Jiang Gui, Hao Li, Zeng-Guang Hou

Erschienen in: Neural Information Processing

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study presents a novel experimental paradigm for collecting Electromyography (EMG) data from continuous movement sequences and a Deep Neural Network (DNN) learning framework for segmenting movements from these signals. Unlike prior research focusing on individual movements, this approach characterizes human motion as continuous sequences. The DNN framework comprises a segmentation module for time point level labeling of EMG data and a transfer module predicting movement transition time points. These outputs are integrated based on defined rules. Experimental results reveal an impressive capacity to accurately segment movements, evidenced by segmentation metrics (accuracy: \(88.3\%\); Dice coefficient: \(82.9\%\); mIoU: \(72.7\%\)). This innovative approach to time point level analysis of continuous movement sequences via EMG signals offers promising implications for future studies of human motor functions and the advancement of human-machine interaction systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016), pp. 265–283 (2016) Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016), pp. 265–283 (2016)
2.
Zurück zum Zitat van Amsterdam, B., et al.: Gesture recognition in robotic surgery with multimodal attention. IEEE Trans. Med. Imaging 41(7), 1677–1687 (2022)CrossRef van Amsterdam, B., et al.: Gesture recognition in robotic surgery with multimodal attention. IEEE Trans. Med. Imaging 41(7), 1677–1687 (2022)CrossRef
3.
Zurück zum Zitat Blankertz, B., et al.: The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans. Biomed. Eng. 51(6), 1044–1051 (2004)CrossRef Blankertz, B., et al.: The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans. Biomed. Eng. 51(6), 1044–1051 (2004)CrossRef
4.
Zurück zum Zitat Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017) Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
5.
Zurück zum Zitat Cisnal, A., Pérez-Turiel, J., Fraile, J.C., Sierra, D., de la Fuente, E.: Robhand: a hand exoskeleton with real-time EMG-driven embedded control quantifying hand gesture recognition delays for bilateral rehabilitation. IEEE Access 9, 137809–137823 (2021)CrossRef Cisnal, A., Pérez-Turiel, J., Fraile, J.C., Sierra, D., de la Fuente, E.: Robhand: a hand exoskeleton with real-time EMG-driven embedded control quantifying hand gesture recognition delays for bilateral rehabilitation. IEEE Access 9, 137809–137823 (2021)CrossRef
6.
Zurück zum Zitat Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289 (2015) Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:​1511.​07289 (2015)
7.
Zurück zum Zitat Côté-Allard, U., et al.: Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE Trans. Neural Syst. Rehabil. Eng. 27(4), 760–771 (2019)CrossRef Côté-Allard, U., et al.: Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE Trans. Neural Syst. Rehabil. Eng. 27(4), 760–771 (2019)CrossRef
8.
Zurück zum Zitat De Luca, C.J., Gilmore, L.D., Kuznetsov, M., Roy, S.H.: Filtering the surface EMG signal: movement artifact and baseline noise contamination. J. Biomech. 43(8), 1573–1579 (2010)CrossRef De Luca, C.J., Gilmore, L.D., Kuznetsov, M., Roy, S.H.: Filtering the surface EMG signal: movement artifact and baseline noise contamination. J. Biomech. 43(8), 1573–1579 (2010)CrossRef
9.
Zurück zum Zitat Henin, S., et al.: Learning hierarchical sequence representations across human cortex and hippocampus. Sci. Adv. 7(8), eabc4530 (2021) Henin, S., et al.: Learning hierarchical sequence representations across human cortex and hippocampus. Sci. Adv. 7(8), eabc4530 (2021)
10.
Zurück zum Zitat Inam, S., et al.: A brief review of strategies used for EMG signal classification. In: Proceedings of 2021 International Conference on Artificial Intelligence (ICAI), pp. 140–145. IEEE (2021) Inam, S., et al.: A brief review of strategies used for EMG signal classification. In: Proceedings of 2021 International Conference on Artificial Intelligence (ICAI), pp. 140–145. IEEE (2021)
11.
Zurück zum Zitat Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the International Conference on Machine Learning, pp. 448–456 (2015) Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the International Conference on Machine Learning, pp. 448–456 (2015)
12.
Zurück zum Zitat Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)CrossRef Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)CrossRef
13.
Zurück zum Zitat Lee, M.H., et al.: EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy. GigaScience 8(5), giz002 (2019) Lee, M.H., et al.: EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy. GigaScience 8(5), giz002 (2019)
14.
Zurück zum Zitat Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017) Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)
17.
Zurück zum Zitat Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)CrossRef Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)CrossRef
18.
Zurück zum Zitat Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetMATH Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetMATH
19.
Zurück zum Zitat Tieleman, T., Hinton, G., et al.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4(2), 26–31 (2012) Tieleman, T., Hinton, G., et al.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4(2), 26–31 (2012)
20.
Zurück zum Zitat Voytek, B., et al.: Oscillatory dynamics coordinating human frontal networks in support of goal maintenance. Nat. Neurosci. 18(9), 1318–1324 (2015)CrossRef Voytek, B., et al.: Oscillatory dynamics coordinating human frontal networks in support of goal maintenance. Nat. Neurosci. 18(9), 1318–1324 (2015)CrossRef
22.
Zurück zum Zitat Xiong, D., Zhang, D., Zhao, X., Zhao, Y.: Deep learning for EMG-based human-machine interaction: a review. IEEE/CAA J. Automatica Sinica 8(3), 512–533 (2021)CrossRef Xiong, D., Zhang, D., Zhao, X., Zhao, Y.: Deep learning for EMG-based human-machine interaction: a review. IEEE/CAA J. Automatica Sinica 8(3), 512–533 (2021)CrossRef
23.
Zurück zum Zitat Zhou, X.H., et al.: Surgical skill assessment based on dynamic warping manipulations. IEEE Trans. Med. Rob. Bionics 4(1), 50–61 (2022)MathSciNetCrossRef Zhou, X.H., et al.: Surgical skill assessment based on dynamic warping manipulations. IEEE Trans. Med. Rob. Bionics 4(1), 50–61 (2022)MathSciNetCrossRef
Metadaten
Titel
A DNN-Based Learning Framework for Continuous Movements Segmentation
verfasst von
Tian-yu Xiang
Xiao-Hu Zhou
Xiao-Liang Xie
Shi-Qi Liu
Zhen-Qiu Feng
Mei-Jiang Gui
Hao Li
Zeng-Guang Hou
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-8067-3_30

Premium Partner