Skip to main content
Top

2024 | OriginalPaper | Chapter

A DNN-Based Learning Framework for Continuous Movements Segmentation

Authors : Tian-yu Xiang, Xiao-Hu Zhou, Xiao-Liang Xie, Shi-Qi Liu, Zhen-Qiu Feng, Mei-Jiang Gui, Hao Li, Zeng-Guang Hou

Published in: Neural Information Processing

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study presents a novel experimental paradigm for collecting Electromyography (EMG) data from continuous movement sequences and a Deep Neural Network (DNN) learning framework for segmenting movements from these signals. Unlike prior research focusing on individual movements, this approach characterizes human motion as continuous sequences. The DNN framework comprises a segmentation module for time point level labeling of EMG data and a transfer module predicting movement transition time points. These outputs are integrated based on defined rules. Experimental results reveal an impressive capacity to accurately segment movements, evidenced by segmentation metrics (accuracy: \(88.3\%\); Dice coefficient: \(82.9\%\); mIoU: \(72.7\%\)). This innovative approach to time point level analysis of continuous movement sequences via EMG signals offers promising implications for future studies of human motor functions and the advancement of human-machine interaction systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016), pp. 265–283 (2016) Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016), pp. 265–283 (2016)
2.
go back to reference van Amsterdam, B., et al.: Gesture recognition in robotic surgery with multimodal attention. IEEE Trans. Med. Imaging 41(7), 1677–1687 (2022)CrossRef van Amsterdam, B., et al.: Gesture recognition in robotic surgery with multimodal attention. IEEE Trans. Med. Imaging 41(7), 1677–1687 (2022)CrossRef
3.
go back to reference Blankertz, B., et al.: The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans. Biomed. Eng. 51(6), 1044–1051 (2004)CrossRef Blankertz, B., et al.: The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans. Biomed. Eng. 51(6), 1044–1051 (2004)CrossRef
4.
go back to reference Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017) Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
5.
go back to reference Cisnal, A., Pérez-Turiel, J., Fraile, J.C., Sierra, D., de la Fuente, E.: Robhand: a hand exoskeleton with real-time EMG-driven embedded control quantifying hand gesture recognition delays for bilateral rehabilitation. IEEE Access 9, 137809–137823 (2021)CrossRef Cisnal, A., Pérez-Turiel, J., Fraile, J.C., Sierra, D., de la Fuente, E.: Robhand: a hand exoskeleton with real-time EMG-driven embedded control quantifying hand gesture recognition delays for bilateral rehabilitation. IEEE Access 9, 137809–137823 (2021)CrossRef
6.
go back to reference Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289 (2015) Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:​1511.​07289 (2015)
7.
go back to reference Côté-Allard, U., et al.: Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE Trans. Neural Syst. Rehabil. Eng. 27(4), 760–771 (2019)CrossRef Côté-Allard, U., et al.: Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE Trans. Neural Syst. Rehabil. Eng. 27(4), 760–771 (2019)CrossRef
8.
go back to reference De Luca, C.J., Gilmore, L.D., Kuznetsov, M., Roy, S.H.: Filtering the surface EMG signal: movement artifact and baseline noise contamination. J. Biomech. 43(8), 1573–1579 (2010)CrossRef De Luca, C.J., Gilmore, L.D., Kuznetsov, M., Roy, S.H.: Filtering the surface EMG signal: movement artifact and baseline noise contamination. J. Biomech. 43(8), 1573–1579 (2010)CrossRef
9.
go back to reference Henin, S., et al.: Learning hierarchical sequence representations across human cortex and hippocampus. Sci. Adv. 7(8), eabc4530 (2021) Henin, S., et al.: Learning hierarchical sequence representations across human cortex and hippocampus. Sci. Adv. 7(8), eabc4530 (2021)
10.
go back to reference Inam, S., et al.: A brief review of strategies used for EMG signal classification. In: Proceedings of 2021 International Conference on Artificial Intelligence (ICAI), pp. 140–145. IEEE (2021) Inam, S., et al.: A brief review of strategies used for EMG signal classification. In: Proceedings of 2021 International Conference on Artificial Intelligence (ICAI), pp. 140–145. IEEE (2021)
11.
go back to reference Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the International Conference on Machine Learning, pp. 448–456 (2015) Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the International Conference on Machine Learning, pp. 448–456 (2015)
12.
go back to reference Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)CrossRef Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)CrossRef
13.
go back to reference Lee, M.H., et al.: EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy. GigaScience 8(5), giz002 (2019) Lee, M.H., et al.: EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy. GigaScience 8(5), giz002 (2019)
14.
go back to reference Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017) Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)
17.
go back to reference Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)CrossRef Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)CrossRef
18.
go back to reference Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetMATH Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetMATH
19.
go back to reference Tieleman, T., Hinton, G., et al.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4(2), 26–31 (2012) Tieleman, T., Hinton, G., et al.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4(2), 26–31 (2012)
20.
go back to reference Voytek, B., et al.: Oscillatory dynamics coordinating human frontal networks in support of goal maintenance. Nat. Neurosci. 18(9), 1318–1324 (2015)CrossRef Voytek, B., et al.: Oscillatory dynamics coordinating human frontal networks in support of goal maintenance. Nat. Neurosci. 18(9), 1318–1324 (2015)CrossRef
22.
go back to reference Xiong, D., Zhang, D., Zhao, X., Zhao, Y.: Deep learning for EMG-based human-machine interaction: a review. IEEE/CAA J. Automatica Sinica 8(3), 512–533 (2021)CrossRef Xiong, D., Zhang, D., Zhao, X., Zhao, Y.: Deep learning for EMG-based human-machine interaction: a review. IEEE/CAA J. Automatica Sinica 8(3), 512–533 (2021)CrossRef
23.
go back to reference Zhou, X.H., et al.: Surgical skill assessment based on dynamic warping manipulations. IEEE Trans. Med. Rob. Bionics 4(1), 50–61 (2022)MathSciNetCrossRef Zhou, X.H., et al.: Surgical skill assessment based on dynamic warping manipulations. IEEE Trans. Med. Rob. Bionics 4(1), 50–61 (2022)MathSciNetCrossRef
Metadata
Title
A DNN-Based Learning Framework for Continuous Movements Segmentation
Authors
Tian-yu Xiang
Xiao-Hu Zhou
Xiao-Liang Xie
Shi-Qi Liu
Zhen-Qiu Feng
Mei-Jiang Gui
Hao Li
Zeng-Guang Hou
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-8067-3_30

Premium Partner