Skip to main content
Top
Published in: Cognitive Neurodynamics 5/2014

01-10-2014 | Research Article

An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface

Authors: Hongtao Wang, Yuanqing Li, Jinyi Long, Tianyou Yu, Zhenghui Gu

Published in: Cognitive Neurodynamics | Issue 5/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Wheelchair control requires multiple degrees of freedom and fast intention detection, which makes electroencephalography (EEG)-based wheelchair control a big challenge. In our previous study, we have achieved direction (turning left and right) and speed (acceleration and deceleration) control of a wheelchair using a hybrid brain–computer interface (BCI) combining motor imagery and P300 potentials. In this paper, we proposed hybrid EEG-EOG BCI, which combines motor imagery, P300 potentials, and eye blinking to implement forward, backward, and stop control of a wheelchair. By performing relevant activities, users (e.g., those with amyotrophic lateral sclerosis and locked-in syndrome) can navigate the wheelchair with seven steering behaviors. Experimental results on four healthy subjects not only demonstrate the efficiency and robustness of our brain-controlled wheelchair system but also indicate that all the four subjects could control the wheelchair spontaneously and efficiently without any other assistance (e.g., an automatic navigation system).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Allison B, Brunner C, Kaiser V, Müller-Putz G, Neuper C, Pfurtscheller G (2010) Toward a hybrid brain-computer interface based on imagined movement and visual attention. J Neural Eng 7(2):1–9CrossRef Allison B, Brunner C, Kaiser V, Müller-Putz G, Neuper C, Pfurtscheller G (2010) Toward a hybrid brain-computer interface based on imagined movement and visual attention. J Neural Eng 7(2):1–9CrossRef
go back to reference Bin G, Gao X, Yan Z, Hong B, Gao S (2009) An online multi-channel ssvep-based brain-computer interface using a canonical correlation analysis method. J Neural Eng 6:1–6CrossRef Bin G, Gao X, Yan Z, Hong B, Gao S (2009) An online multi-channel ssvep-based brain-computer interface using a canonical correlation analysis method. J Neural Eng 6:1–6CrossRef
go back to reference Birbaumer N (1999) Slow cortical potentials: plasticity, operant control, and behavioral effects. Neuroscientist 5(2):74–78CrossRef Birbaumer N (1999) Slow cortical potentials: plasticity, operant control, and behavioral effects. Neuroscientist 5(2):74–78CrossRef
go back to reference Blanchard G, Blankertz B (2004) BCI competition 2003-data set IIa: spatial patterns of self-controlled brain rhythm modulations. IEEE Trans Biomed Eng 51(6):1062–1066PubMedCrossRef Blanchard G, Blankertz B (2004) BCI competition 2003-data set IIa: spatial patterns of self-controlled brain rhythm modulations. IEEE Trans Biomed Eng 51(6):1062–1066PubMedCrossRef
go back to reference Bromberg MB (2008) Quality of life in amyotrophic lateral sclerosis. Phys Med Rehabil Clin N Am 19(3):591–605PubMedCrossRef Bromberg MB (2008) Quality of life in amyotrophic lateral sclerosis. Phys Med Rehabil Clin N Am 19(3):591–605PubMedCrossRef
go back to reference Borghetti D, Bruni A, Fabbrini M, Murri L, Sartucci F (2007) A low-cost interface for control of computer functions by means of eye movements. Comput Biol Med 37(12):1765–1770PubMedCrossRef Borghetti D, Bruni A, Fabbrini M, Murri L, Sartucci F (2007) A low-cost interface for control of computer functions by means of eye movements. Comput Biol Med 37(12):1765–1770PubMedCrossRef
go back to reference Dornhege G, Blankertz B, Curio G, Müller KR (2004) Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms. IEEE Trans Biomed Eng 51(6):993–1002PubMedCrossRef Dornhege G, Blankertz B, Curio G, Müller KR (2004) Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms. IEEE Trans Biomed Eng 51(6):993–1002PubMedCrossRef
go back to reference Hardoon D, Szedmak S, Shawe-Taylor J (2004) Canonical correlation analysis: an overview with application to learning methods. Neural Comput 16(12):2639–2664PubMedCrossRef Hardoon D, Szedmak S, Shawe-Taylor J (2004) Canonical correlation analysis: an overview with application to learning methods. Neural Comput 16(12):2639–2664PubMedCrossRef
go back to reference Huang D, Qian K, Fei D-Y, Jia W, Chen X, Bai O (2012) Electroencephalography (eeg)-based brain-computer interface (bci): a 2-d virtual wheelchair control based on event-related desynchronization/synchronization and state control. IEEE Trans Neural Syst Rehabil Eng 20(3):379–388PubMedCrossRef Huang D, Qian K, Fei D-Y, Jia W, Chen X, Bai O (2012) Electroencephalography (eeg)-based brain-computer interface (bci): a 2-d virtual wheelchair control based on event-related desynchronization/synchronization and state control. IEEE Trans Neural Syst Rehabil Eng 20(3):379–388PubMedCrossRef
go back to reference Iturrate I, Antelis JM, Kubler A, Minguez J (2009) A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation. IEEE Trans Robot 25(3):614–627CrossRef Iturrate I, Antelis JM, Kubler A, Minguez J (2009) A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation. IEEE Trans Robot 25(3):614–627CrossRef
go back to reference Kim Y, Doh N, Youm Y, Chung WK (2001) Development of human-mobile communication system using electrooculogram signals. In: Intelligent robots and systems, 2001. Proceedings of 2001 IEEE/RSJ international conference on, vol 4. IEEE, pp. 2160–2165 Kim Y, Doh N, Youm Y, Chung WK (2001) Development of human-mobile communication system using electrooculogram signals. In: Intelligent robots and systems, 2001. Proceedings of 2001 IEEE/RSJ international conference on, vol 4. IEEE, pp. 2160–2165
go back to reference Li Y, Long J, Yu T, Yu Z, Wang C, Zhang H, Guan C (2010) An EEG-based BCI system for 2-D cursor control by combining Mu/Beta rhythm and P300 potential. IEEE Trans Biomed Eng 57(10):2495–2505PubMedCrossRef Li Y, Long J, Yu T, Yu Z, Wang C, Zhang H, Guan C (2010) An EEG-based BCI system for 2-D cursor control by combining Mu/Beta rhythm and P300 potential. IEEE Trans Biomed Eng 57(10):2495–2505PubMedCrossRef
go back to reference Li Y, Guan C (2008) Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm. Mach Learn 71(1):33–53CrossRef Li Y, Guan C (2008) Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm. Mach Learn 71(1):33–53CrossRef
go back to reference Li Y, Pan J, Wang F, Yu Z (2013) A hybrid bci system combining p300 and ssvep and its application to wheelchair control. IEEE Trans Biomed Eng 60(11):3156–3166PubMedCrossRef Li Y, Pan J, Wang F, Yu Z (2013) A hybrid bci system combining p300 and ssvep and its application to wheelchair control. IEEE Trans Biomed Eng 60(11):3156–3166PubMedCrossRef
go back to reference Long J, Li Y, Wang H, Yu T, Pan J, Li F (2012) A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans Neural Syst Rehabil Eng 20(4):720–729PubMedCrossRef Long J, Li Y, Wang H, Yu T, Pan J, Li F (2012) A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans Neural Syst Rehabil Eng 20(4):720–729PubMedCrossRef
go back to reference Lv Z, Wu X, Li M, Zhang C (2008) Implementation of the eog-based human computer interface system. In: Bioinformatics and biomedical engineering, 2008. ICBBE 2008. The 2nd international conference on. IEEE, pp. 2188–2191 Lv Z, Wu X, Li M, Zhang C (2008) Implementation of the eog-based human computer interface system. In: Bioinformatics and biomedical engineering, 2008. ICBBE 2008. The 2nd international conference on. IEEE, pp. 2188–2191
go back to reference Millán J, Galán F, Vanhooydonck D, Lew E, Philips J, Nuttin M (2009) Asynchronous non-invasive brain-actuated control of an intelligent wheelchair. In: Engineering in medicine and biology society, 2009. Annual international conference of the IEEE, pp. 3361–3364 Millán J, Galán F, Vanhooydonck D, Lew E, Philips J, Nuttin M (2009) Asynchronous non-invasive brain-actuated control of an intelligent wheelchair. In: Engineering in medicine and biology society, 2009. Annual international conference of the IEEE, pp. 3361–3364
go back to reference Nakanishi M, Mitsukura Y (2013) Wheelchair control system by using electrooculogram signal processing, In: Frontiers of Computer Vision, (FCV), IEEE joint workshop on 2013 19th Korea-Japan, pp. 137–142 Nakanishi M, Mitsukura Y (2013) Wheelchair control system by using electrooculogram signal processing, In: Frontiers of Computer Vision, (FCV), IEEE joint workshop on 2013 19th Korea-Japan, pp. 137–142
go back to reference Panicker R, Puthusserypady S, Sun Y (2011) An asynchronous p300 bci with ssvep-based control state detection. IEEE Trans Biomed Eng 99:1781–1788CrossRef Panicker R, Puthusserypady S, Sun Y (2011) An asynchronous p300 bci with ssvep-based control state detection. IEEE Trans Biomed Eng 99:1781–1788CrossRef
go back to reference Pfurtscheller G, Neuper C, Guger C, Harkam W, Ramoser H, Schlogl A, Obermaier B, Pregenzer M (2000) Current trends in Graz brain-computer interface (BCI) research. IEEE Trans Neural Syst Rehabil Eng 8(2):216–219CrossRef Pfurtscheller G, Neuper C, Guger C, Harkam W, Ramoser H, Schlogl A, Obermaier B, Pregenzer M (2000) Current trends in Graz brain-computer interface (BCI) research. IEEE Trans Neural Syst Rehabil Eng 8(2):216–219CrossRef
go back to reference Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P, Muller-Putz GR (2010) Self-paced operation of an ssvep-based orthosis with and without an imagery-based brain switch: a feasibility study towards a hybrid bci. IEEE Trans Neural Syst Rehabil Eng 18(4):409–414PubMedCrossRef Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P, Muller-Putz GR (2010) Self-paced operation of an ssvep-based orthosis with and without an imagery-based brain switch: a feasibility study towards a hybrid bci. IEEE Trans Neural Syst Rehabil Eng 18(4):409–414PubMedCrossRef
go back to reference Rebsamen B, Guan C, Zhang H, Wang C, Teo C, Ang MH, Burdet E (2010) A brain controlled wheelchair to navigate in familiar environments. IEEE Trans Neural Syst Rehabil Eng 18(6):590–598PubMedCrossRef Rebsamen B, Guan C, Zhang H, Wang C, Teo C, Ang MH, Burdet E (2010) A brain controlled wheelchair to navigate in familiar environments. IEEE Trans Neural Syst Rehabil Eng 18(6):590–598PubMedCrossRef
go back to reference Rebsamen B, Burdet E, Guan C, Zhang H, Teo C, Zeng Q, Ang M, Laugier C (2006) A brain-controlled wheelchair based on p300 and path guidance. In Biomedical robotics and biomechatronics, 2006. BioRob 2006. The first IEEE/RAS-EMBS international conference on. IEEE, pp. 1101–1106 Rebsamen B, Burdet E, Guan C, Zhang H, Teo C, Zeng Q, Ang M, Laugier C (2006) A brain-controlled wheelchair based on p300 and path guidance. In Biomedical robotics and biomechatronics, 2006. BioRob 2006. The first IEEE/RAS-EMBS international conference on. IEEE, pp. 1101–1106
go back to reference Sellers E, Kubler A, Donchin E (2006) Brain-computer interface research at the university of south florida cognitive psychophysiology laboratory: the p300 speller. IEEE Trans Neural Syst Rehabil Eng 14(2):221–224PubMedCrossRef Sellers E, Kubler A, Donchin E (2006) Brain-computer interface research at the university of south florida cognitive psychophysiology laboratory: the p300 speller. IEEE Trans Neural Syst Rehabil Eng 14(2):221–224PubMedCrossRef
go back to reference Usakli AB, Gurkan S, Aloise F, Vecchiato G, Babiloni F (2010) On the use of electrooculogram for efficient human computer interfaces. Computational intelligence and neuroscience Vol. 2010, p. 1 Usakli AB, Gurkan S, Aloise F, Vecchiato G, Babiloni F (2010) On the use of electrooculogram for efficient human computer interfaces. Computational intelligence and neuroscience Vol. 2010, p. 1
go back to reference Williams MT, Donnelly JP, Holmlund T, Battaglia M (2008) Als: Family caregiver needs and quality of life. Amyotroph Lateral Scler 9(5):279–286PubMedCrossRef Williams MT, Donnelly JP, Holmlund T, Battaglia M (2008) Als: Family caregiver needs and quality of life. Amyotroph Lateral Scler 9(5):279–286PubMedCrossRef
Metadata
Title
An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface
Authors
Hongtao Wang
Yuanqing Li
Jinyi Long
Tianyou Yu
Zhenghui Gu
Publication date
01-10-2014
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics / Issue 5/2014
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-014-9296-y

Other articles of this Issue 5/2014

Cognitive Neurodynamics 5/2014 Go to the issue