Skip to main content

2019 | OriginalPaper | Buchkapitel

2. Multimodal Assistance System

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter describes the use of a multimodal system designed with a view to controlling the movements of an assistive robotic system. The multimodal control is based on two biosignals, namely electrooculography and electroencephalography. The chapter includes a description of the electrooculogram-based system along with the brain-machine interface and how these two interfaces were integrated. Finally, the experimental procedure and its results are presented.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Frisoli A, Loconsole C, Leonardis D, Banno F, Barsotti M, Chisari C, Bergamasco M (2012) A new gaze-BCI-driven control of an upper limb exoskeleton for rehabilitation in real-world tasks. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):1169–1179CrossRef Frisoli A, Loconsole C, Leonardis D, Banno F, Barsotti M, Chisari C, Bergamasco M (2012) A new gaze-BCI-driven control of an upper limb exoskeleton for rehabilitation in real-world tasks. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):1169–1179CrossRef
2.
Zurück zum Zitat Lee EC, Woo JC, Kim JH, Whang M, Park KR (2010) A Brain–Computer Interface method combined with eye tracking for 3D interaction. J Neurosci Methods 190:289–298CrossRef Lee EC, Woo JC, Kim JH, Whang M, Park KR (2010) A Brain–Computer Interface method combined with eye tracking for 3D interaction. J Neurosci Methods 190:289–298CrossRef
3.
Zurück zum Zitat McMullen DP, Hotson G, Katyal KD, Wester BA, Fifer MS, McGee TG, Harris A, Johannes MS, Vogelstein RJ, Ravitz AD, Anderson WS, Thakor NV, Crone NE (2014) Demonstration of a semi-autonomous hybrid brain–machine interface using human intracranial EEG, eye tracking, and computer vision to control a robotic upper limb prosthetic. IEEE Trans Neural Syst Rehabil Eng 22(4):784–796CrossRef McMullen DP, Hotson G, Katyal KD, Wester BA, Fifer MS, McGee TG, Harris A, Johannes MS, Vogelstein RJ, Ravitz AD, Anderson WS, Thakor NV, Crone NE (2014) Demonstration of a semi-autonomous hybrid brain–machine interface using human intracranial EEG, eye tracking, and computer vision to control a robotic upper limb prosthetic. IEEE Trans Neural Syst Rehabil Eng 22(4):784–796CrossRef
4.
Zurück zum Zitat Lee MH, Fazli S, Mehnert J, Lee SW (2014) Hybrid brain–computer interface based on EEG and NIRS modalities. In: 2014 international winter workshop on Brain–Computer Interface, BCI, pp 1–2 Lee MH, Fazli S, Mehnert J, Lee SW (2014) Hybrid brain–computer interface based on EEG and NIRS modalities. In: 2014 international winter workshop on Brain–Computer Interface, BCI, pp 1–2
5.
Zurück zum Zitat Takahashi K, Kashiyama T (2009) Remarks on multimodal nonverbal interface and its application to controlling mobile robot. In: Mechatronics and automation, IEEE international conference, vol 2, pp 999–1004 Takahashi K, Kashiyama T (2009) Remarks on multimodal nonverbal interface and its application to controlling mobile robot. In: Mechatronics and automation, IEEE international conference, vol 2, pp 999–1004
6.
Zurück zum Zitat Postelnicu CC, Talaba D, Toma MI (2011) Controlling a robotic arm by brainwaves and eye movement. In: Camarinha-Matos L (ed) Technological innovation for sustainability. IFIP advances in information and communication technology, vol 349. Springer, Berlin, pp 157–164CrossRef Postelnicu CC, Talaba D, Toma MI (2011) Controlling a robotic arm by brainwaves and eye movement. In: Camarinha-Matos L (ed) Technological innovation for sustainability. IFIP advances in information and communication technology, vol 349. Springer, Berlin, pp 157–164CrossRef
7.
Zurück zum Zitat Babiloni F, Del Gratta C, Carducci F, Babiloni C, Roberti GM, Pizzella V, Rossini PM, Romani G, Urbano A (1998) Combined high resolution eeg and meg data for linear inverse estimate of human event-related cortical activity. In: 20th annual international conference of the IEEE, vol 4, pp 2151–2154 Babiloni F, Del Gratta C, Carducci F, Babiloni C, Roberti GM, Pizzella V, Rossini PM, Romani G, Urbano A (1998) Combined high resolution eeg and meg data for linear inverse estimate of human event-related cortical activity. In: 20th annual international conference of the IEEE, vol 4, pp 2151–2154
8.
Zurück zum Zitat Kim BH, Kim M, Jo S (2014) Quadcopter flight control using a low-cost hybrid interface with EEG-based classification and eye tracking. Comput Biol Med 51:82–92CrossRef Kim BH, Kim M, Jo S (2014) Quadcopter flight control using a low-cost hybrid interface with EEG-based classification and eye tracking. Comput Biol Med 51:82–92CrossRef
9.
Zurück zum Zitat Hortal E, Iáñez E, Úbeda A, Perez-Vidal C, Azorín JM (2015) Combining a brain–machine interface and an electrooculography Interface to perform pick and place tasks with a robotic arm. Robot Auton Syst 72:181–188CrossRef Hortal E, Iáñez E, Úbeda A, Perez-Vidal C, Azorín JM (2015) Combining a brain–machine interface and an electrooculography Interface to perform pick and place tasks with a robotic arm. Robot Auton Syst 72:181–188CrossRef
10.
Zurück zum Zitat Iánez E, Azorín JM, Perez-Vidal C (2013) Using eye movement to control a computer: a design for a lightweight electro-oculogram electrode array and computer interface. PLoS One 8(7):e67099CrossRef Iánez E, Azorín JM, Perez-Vidal C (2013) Using eye movement to control a computer: a design for a lightweight electro-oculogram electrode array and computer interface. PLoS One 8(7):e67099CrossRef
11.
Zurück zum Zitat Hortal E, Úbeda A, Iáñez E, Planelles D, Azorín JM (2013) Online classification of two mental tasks using a SVM-based BCI system. In: 6th annual international IEEE EMBS conference on neural engineering, San Diego, California, pp 1307–1310 Hortal E, Úbeda A, Iáñez E, Planelles D, Azorín JM (2013) Online classification of two mental tasks using a SVM-based BCI system. In: 6th annual international IEEE EMBS conference on neural engineering, San Diego, California, pp 1307–1310
12.
Zurück zum Zitat Hortal E, Úbeda A, Iáñez E, Azorín JM (2014) Control of a 2 DoF robot using a brain-machine interface. Comput Methods Programs Biomed 116(2):169–176CrossRef Hortal E, Úbeda A, Iáñez E, Azorín JM (2014) Control of a 2 DoF robot using a brain-machine interface. Comput Methods Programs Biomed 116(2):169–176CrossRef
13.
Zurück zum Zitat Hortal E, Planelles D, Úbeda A, Costa A, Azorín JA (2014) Brain-Machine Interface system to differentiate between five mental tasks. In: 8th annual IEEE international systems conference, Ottawa, Canada, pp 172–175 Hortal E, Planelles D, Úbeda A, Costa A, Azorín JA (2014) Brain-Machine Interface system to differentiate between five mental tasks. In: 8th annual IEEE international systems conference, Ottawa, Canada, pp 172–175
15.
Zurück zum Zitat Flórez F, Azorín JM, Iánez E, Úbeda A, Fernández E (2011) Development of a low-cost SVM-based spontaneous brain–computer interface. In: Madani K, Kacprzyk J, Filipe J (eds), IJCCI (NCTA), SciTePress, Setúbal. pp 415–421 Flórez F, Azorín JM, Iánez E, Úbeda A, Fernández E (2011) Development of a low-cost SVM-based spontaneous brain–computer interface. In: Madani K, Kacprzyk J, Filipe J (eds), IJCCI (NCTA), SciTePress, Setúbal. pp 415–421
16.
Zurück zum Zitat Guger C, Schlögl A, Neuper C, Walterspacher D, Strein T, Pfurtscheller G (2001) Rapid prototyping of an EEG-based brain–computer interface (BCI). IEEE Trans Rehabil Eng 9(1):49–58 Guger C, Schlögl A, Neuper C, Walterspacher D, Strein T, Pfurtscheller G (2001) Rapid prototyping of an EEG-based brain–computer interface (BCI). IEEE Trans Rehabil Eng 9(1):49–58
Metadaten
Titel
Multimodal Assistance System
verfasst von
Enrique Hortal
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-95705-0_2

Neuer Inhalt