Skip to main content
Erschienen in: Neural Computing and Applications 11/2021

19.09.2020 | Original Article

A universal closed-loop brain–machine interface framework design and its application to a joint prosthesis

verfasst von: Hongguang Pan, Wenyu Mi, Haoqian Song, Fei Liu

Erschienen in: Neural Computing and Applications | Ausgabe 11/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Brain–machine interface (BMI) system offers the possibility for the brain communicating with external devices (such as prostheses) according to the electroencephalograms, but there are few BMI frameworks available for flexible design systems. In this paper, first of all, inspired by the single-joint information transmission (SJIT) model, a Wiener-filter-based decoder and an auxiliary controller based on model predictive control strategy are designed to rebuild the information pathways between the brain and prosthesis. Specifically, the decoder is used to decode the neuron activities from cerebral cortex, and the auxiliary controller is used to calculate control inputs, which injected to the SJIT model as feedback information. Then, a universal closed-loop BMI framework available for designing flexible systems is proposed and formulated on the basis of the brain model, decoder, auxiliary controller and prosthesis, and it can well recovery the motor function of prosthesis. Finally, a simulation and another experiment are designed to show that the presented closed-loop BMI framework is feasible and can track the target trajectory accurately, and the presented framework with actual prosthesis can successfully achieve the target position along the target trajectory.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ajemian R, Green A, Bullock D, Sergio L, Kalaska J, Grossberg S (2008) Assessing the function of motor cortex: single-neuron models of how neural response is modulated by limb biomechanics. Neuron 58(3):414–428CrossRef Ajemian R, Green A, Bullock D, Sergio L, Kalaska J, Grossberg S (2008) Assessing the function of motor cortex: single-neuron models of how neural response is modulated by limb biomechanics. Neuron 58(3):414–428CrossRef
2.
Zurück zum Zitat Alcaide-Aguirre R, Warschausky S, Brown D, Aref A, Huggins J (2017) Asynchronous brain–computer interface for cognitive assessment in people with cerebral palsy. J Neural Eng 14(6):066001CrossRef Alcaide-Aguirre R, Warschausky S, Brown D, Aref A, Huggins J (2017) Asynchronous brain–computer interface for cognitive assessment in people with cerebral palsy. J Neural Eng 14(6):066001CrossRef
3.
Zurück zum Zitat Ang KK, Chua KSG, Phua KS, Wang C, Chin ZY, Kuah CWK, Low W, Guan C (2015) A randomized controlled trial of EEG-based motor imagery brain–computer interface robotic rehabilitation for stroke. Clin EEG Neurosci 46(4):310–320CrossRef Ang KK, Chua KSG, Phua KS, Wang C, Chin ZY, Kuah CWK, Low W, Guan C (2015) A randomized controlled trial of EEG-based motor imagery brain–computer interface robotic rehabilitation for stroke. Clin EEG Neurosci 46(4):310–320CrossRef
4.
Zurück zum Zitat Bullock D, Cisek P, Grossberg S (1998) Cortical networks for control of voluntary arm movements under variable force conditions. Cereb Cortex 8(1):48–62CrossRef Bullock D, Cisek P, Grossberg S (1998) Cortical networks for control of voluntary arm movements under variable force conditions. Cereb Cortex 8(1):48–62CrossRef
5.
Zurück zum Zitat Dadarlat MC, O’Doherty JE, Sabes PN (2015) A learning-based approach to artificial sensory feedback leads to optimal integration. Nat Neurosci 18(1):138–144CrossRef Dadarlat MC, O’Doherty JE, Sabes PN (2015) A learning-based approach to artificial sensory feedback leads to optimal integration. Nat Neurosci 18(1):138–144CrossRef
6.
Zurück zum Zitat Dai J, Zhang P, Sun H, Qiao X, Zhao Y, Ma J, Li S, Zhou J, Wang C (2019) Reliability of motor and sensory neural decoding by threshold crossings for intracortical brain–machine interface. J Neural Eng 16(3):036011CrossRef Dai J, Zhang P, Sun H, Qiao X, Zhao Y, Ma J, Li S, Zhou J, Wang C (2019) Reliability of motor and sensory neural decoding by threshold crossings for intracortical brain–machine interface. J Neural Eng 16(3):036011CrossRef
8.
Zurück zum Zitat He Y, Eguren D, Azorín JM, Grossman RG, Luu TP, Contreras-Vidal JL (2018) Brain–machine interfaces for controlling lower-limb powered robotic systems. J Neural Eng 15(2):021004CrossRef He Y, Eguren D, Azorín JM, Grossman RG, Luu TP, Contreras-Vidal JL (2018) Brain–machine interfaces for controlling lower-limb powered robotic systems. J Neural Eng 15(2):021004CrossRef
9.
Zurück zum Zitat Hu J, Ding B (2019) Dynamic output feedback predictive control with one free control move for the Takagi-sugeno model with bounded disturbance. IEEE Trans Fuzzy Syst 27(3):462–473CrossRef Hu J, Ding B (2019) Dynamic output feedback predictive control with one free control move for the Takagi-sugeno model with bounded disturbance. IEEE Trans Fuzzy Syst 27(3):462–473CrossRef
11.
Zurück zum Zitat Kim S, Sanchez JC, Rao YN, Erdogmus D, Carmena JM, Lebedev MA, Nicolelis M, Principe J (2006) A comparison of optimal MIMO linear and nonlinear models for brain–machine interfaces. J Neural Eng 3(2):145–161CrossRef Kim S, Sanchez JC, Rao YN, Erdogmus D, Carmena JM, Lebedev MA, Nicolelis M, Principe J (2006) A comparison of optimal MIMO linear and nonlinear models for brain–machine interfaces. J Neural Eng 3(2):145–161CrossRef
13.
Zurück zum Zitat Kuchenbecker KJ, Gurari N, Okamura AM (2007) Effects of visual and proprioceptive motion feedback on human control of targeted movement. In: 2007 IEEE 10th international conference on rehabilitation robotics. IEEE, pp 513–524 Kuchenbecker KJ, Gurari N, Okamura AM (2007) Effects of visual and proprioceptive motion feedback on human control of targeted movement. In: 2007 IEEE 10th international conference on rehabilitation robotics. IEEE, pp 513–524
14.
Zurück zum Zitat Lee T, Goh SJA, Quek SY, Guan C, Cheung YB, Krishnan KR (2013) Efficacy and usability of a brain–computer interface system in improving cognition in the elderly. Alzheimer’s & Dementia J Alzheimer’s Assoc 9(4):P296CrossRef Lee T, Goh SJA, Quek SY, Guan C, Cheung YB, Krishnan KR (2013) Efficacy and usability of a brain–computer interface system in improving cognition in the elderly. Alzheimer’s & Dementia J Alzheimer’s Assoc 9(4):P296CrossRef
15.
Zurück zum Zitat Mayne DQ, Rawlings JB, Rao CV, Scokaert POM (2000) Constrained model predictive control: stability and optimality. Automatica 36(6):789–814MathSciNetCrossRef Mayne DQ, Rawlings JB, Rao CV, Scokaert POM (2000) Constrained model predictive control: stability and optimality. Automatica 36(6):789–814MathSciNetCrossRef
16.
Zurück zum Zitat Morone G, Pisotta I, Pichiorri F, Kleih S, Paolucci S, Molinari M, Cincotti F, Kübler A, Mattia D (2015) Proof of principle of a brain–computer interface approach to support poststroke arm rehabilitation in hospitalized patients: design, acceptability, and usability. Arch Phys Med Rehab 96(3):S71–S78CrossRef Morone G, Pisotta I, Pichiorri F, Kleih S, Paolucci S, Molinari M, Cincotti F, Kübler A, Mattia D (2015) Proof of principle of a brain–computer interface approach to support poststroke arm rehabilitation in hospitalized patients: design, acceptability, and usability. Arch Phys Med Rehab 96(3):S71–S78CrossRef
17.
Zurück zum Zitat O’Doherty JE, Lebedev MA, Ifft PJ, Zhuang KZ, Solaiman S, Hannes B, Nicolelis MAL (2012) Active tactile exploration using a brain–machine–brain interface. Nature 479(7372):228–231CrossRef O’Doherty JE, Lebedev MA, Ifft PJ, Zhuang KZ, Solaiman S, Hannes B, Nicolelis MAL (2012) Active tactile exploration using a brain–machine–brain interface. Nature 479(7372):228–231CrossRef
18.
Zurück zum Zitat Orsborn A (2013) Closed-loop design of brain–machine interface systems. Ph.D. thesis, UC Berkeley Orsborn A (2013) Closed-loop design of brain–machine interface systems. Ph.D. thesis, UC Berkeley
23.
Zurück zum Zitat Pan H, Zhong W, Wang Z (2018) Economic optimization and control based on multi priority rank RTO and double layered MPC. Asian J Control 20(6):2271–2280MathSciNetCrossRef Pan H, Zhong W, Wang Z (2018) Economic optimization and control based on multi priority rank RTO and double layered MPC. Asian J Control 20(6):2271–2280MathSciNetCrossRef
24.
Zurück zum Zitat Sciavicco L (1989) Robotics: modeling, planning, and control. Springer, Berlin Sciavicco L (1989) Robotics: modeling, planning, and control. Springer, Berlin
25.
Zurück zum Zitat Shanechi MM (2016) Brain–machine interface control algorithms. IEEE Trans Neural Syst Rehab Eng 25(10):1725–1734CrossRef Shanechi MM (2016) Brain–machine interface control algorithms. IEEE Trans Neural Syst Rehab Eng 25(10):1725–1734CrossRef
26.
Zurück zum Zitat Shanechi MM, Orsborn AL, Carmena JM (2016) Robust brain–machine interface design using optimal feedback control modeling and adaptive point process filtering. PLoS Comput Biol 12(4):e1004730CrossRef Shanechi MM, Orsborn AL, Carmena JM (2016) Robust brain–machine interface design using optimal feedback control modeling and adaptive point process filtering. PLoS Comput Biol 12(4):e1004730CrossRef
28.
Zurück zum Zitat Suyama T (2016) A network-type brain machine interface to support activities of daily living. IEICE Trans Commun 99(9):1930–1937CrossRef Suyama T (2016) A network-type brain machine interface to support activities of daily living. IEICE Trans Commun 99(9):1930–1937CrossRef
29.
Zurück zum Zitat Wang P, Feng X, Li W, Ping X, Yu W (2019) Robust RHC for wheeled vehicles with bounded disturbances. Int J Robust Nonlinear Control 29(7):2063–2081MathSciNetCrossRef Wang P, Feng X, Li W, Ping X, Yu W (2019) Robust RHC for wheeled vehicles with bounded disturbances. Int J Robust Nonlinear Control 29(7):2063–2081MathSciNetCrossRef
30.
Zurück zum Zitat Wang P, Feng X, Li W, Yu W (2017) DRHC synthesis for simultaneous tracking and formation of nonhomogeneous multi-agents with time-varying communication topology. Int J Adv Robot Syst 14(3):1–15 Wang P, Feng X, Li W, Yu W (2017) DRHC synthesis for simultaneous tracking and formation of nonhomogeneous multi-agents with time-varying communication topology. Int J Adv Robot Syst 14(3):1–15
31.
Zurück zum Zitat Zheng M, Yang B, Xie Y (2020) EEG classification across sessions and across subjects through transfer learning in motor imagery-based brain–machine interface system. Med Biol Eng Comput 58:1515–1528CrossRef Zheng M, Yang B, Xie Y (2020) EEG classification across sessions and across subjects through transfer learning in motor imagery-based brain–machine interface system. Med Biol Eng Comput 58:1515–1528CrossRef
Metadaten
Titel
A universal closed-loop brain–machine interface framework design and its application to a joint prosthesis
verfasst von
Hongguang Pan
Wenyu Mi
Haoqian Song
Fei Liu
Publikationsdatum
19.09.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 11/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05323-6

Weitere Artikel der Ausgabe 11/2021

Neural Computing and Applications 11/2021 Zur Ausgabe