Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 3/2013

01.03.2013 | Original Article

Sensorimotor learning with stereo auditory feedback for a brain–computer interface

verfasst von: Karl A. McCreadie, Damien H. Coyle, Girijesh Prasad

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Motor imagery can be used to modulate sensorimotor rhythms (SMR) enabling detection of voltage fluctuations on the surface of the scalp using electroencephalographic electrodes. Feedback is essential in learning to modulate SMR for non-muscular communication using a brain–computer interface (BCI). A BCI not reliant upon the visual modality not only releases the visual channel for other uses but also offers an attractive means of communication for the physically impaired who are also blind or vision impaired. This study demonstrates the feasibility of replacing the traditional visual feedback modality with stereo auditory feedback. Results from a pilot study were used to select the most appropriate sounds for auditory feedback based on three options: broadband noise and two anechoic instrument samples. Subsequently, an SMR BCI was used to examine the effect on sensorimotor learning with broadband noise utilising a modified stereophonic presentation method. Twenty participants split into equal groups took part in ten sessions. The visual group performed best initially but did not improve over time whilst the auditory group improved as the study progressed. The results demonstrate the feasibility of using stereophonic auditory feedback with broadband noise as opposed to other auditory feedback presentation methods and sounds which are less intuitive.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Access Economics Pty Limited (2009) Future Sight Loss UK: Economic impact of partial sight and blindness in the UK adult population Access Economics Pty Limited (2009) Future Sight Loss UK: Economic impact of partial sight and blindness in the UK adult population
2.
Zurück zum Zitat Blankertz B, Dornhege G, Krauledat M, Müller KR, Curio G (2007) The non-invasive Berlin Brain-Computer Interface: fast acquisition of effective performance in untrained subjects. NeuroImage 37(2):539–550PubMedCrossRef Blankertz B, Dornhege G, Krauledat M, Müller KR, Curio G (2007) The non-invasive Berlin Brain-Computer Interface: fast acquisition of effective performance in untrained subjects. NeuroImage 37(2):539–550PubMedCrossRef
3.
Zurück zum Zitat Blankertz B, Tomioka R, Lemm S, Kawanabe M, Muller KR (2008) Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process Mag 25(1):41–56CrossRef Blankertz B, Tomioka R, Lemm S, Kawanabe M, Muller KR (2008) Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process Mag 25(1):41–56CrossRef
4.
Zurück zum Zitat Blauert J (1997) Spatial hearing: the psychophysics of human sound localization. MIT Press, Cambridge Blauert J (1997) Spatial hearing: the psychophysics of human sound localization. MIT Press, Cambridge
5.
Zurück zum Zitat Brungart DS, Kordik AJ, Simpson BD, McKinley RL (2003) Auditory localization in the horizontal plane with single and double hearing protection. Aviat Space Environ Med 74:937–946PubMed Brungart DS, Kordik AJ, Simpson BD, McKinley RL (2003) Auditory localization in the horizontal plane with single and double hearing protection. Aviat Space Environ Med 74:937–946PubMed
6.
Zurück zum Zitat Burns R (1929) Blumlein and the birth of stereo. IEE Review: 269–273 Burns R (1929) Blumlein and the birth of stereo. IEE Review: 269–273
7.
Zurück zum Zitat Coyle D, Garcia J, Satti AR, Mcginnity TM (2011) EEG-based continuous control of a game using a 3 channel motor imagery BCI. In: 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), pp 1–7 Coyle D, Garcia J, Satti AR, Mcginnity TM (2011) EEG-based continuous control of a game using a 3 channel motor imagery BCI. In: 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), pp 1–7
8.
Zurück zum Zitat Coyle DH, Satti AR, Stow J, McCreadie K, Carroll A, McEelligott, J (2011) Operating a brain computer interface: able bodied versus physically impaired performance. In: Recent Advances in Assistive Technology and Engineering Conference, Warwich Coyle DH, Satti AR, Stow J, McCreadie K, Carroll A, McEelligott, J (2011) Operating a brain computer interface: able bodied versus physically impaired performance. In: Recent Advances in Assistive Technology and Engineering Conference, Warwich
9.
Zurück zum Zitat Coyle D, Prasad G, McGinnity TM (2005) A time-series prediction approach for feature extraction in a brain-computer interface. IEEE Trans Neural Systems Rehabil Eng 13:461–467CrossRef Coyle D, Prasad G, McGinnity TM (2005) A time-series prediction approach for feature extraction in a brain-computer interface. IEEE Trans Neural Systems Rehabil Eng 13:461–467CrossRef
10.
Zurück zum Zitat Friedrich EVC, Scherer R, Sonnleitner K, Neuper C (2011) Impact of auditory distraction on user performance in a brain-computer interface driven by different mental tasks. Clin Neurophysiol 122:2003–2009PubMed Friedrich EVC, Scherer R, Sonnleitner K, Neuper C (2011) Impact of auditory distraction on user performance in a brain-computer interface driven by different mental tasks. Clin Neurophysiol 122:2003–2009PubMed
11.
Zurück zum Zitat Furdea A, Halder S, Krusienski DJ, Bross D, Nijboer F, Birbaumer N, Kübler A (2009) An auditory oddball (P300) spelling system for brain-computer interfaces. Psychophysiology 46:617–625PubMedCrossRef Furdea A, Halder S, Krusienski DJ, Bross D, Nijboer F, Birbaumer N, Kübler A (2009) An auditory oddball (P300) spelling system for brain-computer interfaces. Psychophysiology 46:617–625PubMedCrossRef
12.
Zurück zum Zitat Guger C, Schlögl A, Neuper C, Walterspacher D, Strein T, Pfurtscheller G (2001) Rapid Prototyping of an EEG-Based Brain-Computer Interface. IEEE Trans Neural Sys Rehabil Eng 9(1):49–58CrossRef Guger C, Schlögl A, Neuper C, Walterspacher D, Strein T, Pfurtscheller G (2001) Rapid Prototyping of an EEG-Based Brain-Computer Interface. IEEE Trans Neural Sys Rehabil Eng 9(1):49–58CrossRef
13.
Zurück zum Zitat Halder S, Rea M, Andreoni R, Nijboer F, Hammer EM, Kleih SC, Birbaumer N, Kübler A (2010) An auditory oddball brain–computer interface for binary choices. Clin Neurophysiols 121:516–523CrossRef Halder S, Rea M, Andreoni R, Nijboer F, Hammer EM, Kleih SC, Birbaumer N, Kübler A (2010) An auditory oddball brain–computer interface for binary choices. Clin Neurophysiols 121:516–523CrossRef
14.
15.
Zurück zum Zitat Hinterberger T, Baier G (2005) Poser: parametric orchestral sonification of EEG in real-time for the self-regulation of brain states. IEEE Multimed 12:70–79CrossRef Hinterberger T, Baier G (2005) Poser: parametric orchestral sonification of EEG in real-time for the self-regulation of brain states. IEEE Multimed 12:70–79CrossRef
16.
Zurück zum Zitat Hinterberger T, Neumann N, Pham M, Kübler A, Grether A, Hofmayer N, Wilhelm B, Flor H, Birbaumer N (2004) A multimodal brain-based feedback and communication system. Exp Brain Res 154:521–526PubMedCrossRef Hinterberger T, Neumann N, Pham M, Kübler A, Grether A, Hofmayer N, Wilhelm B, Flor H, Birbaumer N (2004) A multimodal brain-based feedback and communication system. Exp Brain Res 154:521–526PubMedCrossRef
17.
Zurück zum Zitat Hinterberger T (2007) Orchestral sonification of brain signals and its application to brain-computer interfaces and performing arts. Workshop Interact Sonification, In Hinterberger T (2007) Orchestral sonification of brain signals and its application to brain-computer interfaces and performing arts. Workshop Interact Sonification, In
18.
Zurück zum Zitat Horki P, Solis-Escalante T, Neuper C, Müller-Putz G (2011) Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb. Med Biol Eng Comput 49:567–577PubMedCrossRef Horki P, Solis-Escalante T, Neuper C, Müller-Putz G (2011) Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb. Med Biol Eng Comput 49:567–577PubMedCrossRef
19.
Zurück zum Zitat Höhne J, Schreuder M, Blankertz B, Tangermann M (2010) Two-dimensional auditory p300 speller with predictive text system. In: Annual International Conference IEEE Engineering Medicine and Biology Society, pp 4185–4188 Höhne J, Schreuder M, Blankertz B, Tangermann M (2010) Two-dimensional auditory p300 speller with predictive text system. In: Annual International Conference IEEE Engineering Medicine and Biology Society, pp 4185–4188
20.
Zurück zum Zitat Höhne J, Schreuder M, Blankertz B, Tangermann M (2011) A novel 9-class auditory ERP paradigm driving a predictive text entry system. Front Neurosci 5:1–10CrossRef Höhne J, Schreuder M, Blankertz B, Tangermann M (2011) A novel 9-class auditory ERP paradigm driving a predictive text entry system. Front Neurosci 5:1–10CrossRef
21.
Zurück zum Zitat Lv J, Liu M (2008) Common spatial pattern and particle swarm optimization for channel selection in BCI. In: 2008 3rd International Conference on Innovative Computing Information and Control, pp 457–457 Lv J, Liu M (2008) Common spatial pattern and particle swarm optimization for channel selection in BCI. In: 2008 3rd International Conference on Innovative Computing Information and Control, pp 457–457
22.
Zurück zum Zitat Müller-Putz GR, Scherer R, Brunner C, Leeb R, Pfurtscheller G (2008) Better than random? A closer look on BCI results. Int J Bioelectromagn 10:52–55 Müller-Putz GR, Scherer R, Brunner C, Leeb R, Pfurtscheller G (2008) Better than random? A closer look on BCI results. Int J Bioelectromagn 10:52–55
23.
Zurück zum Zitat Nijboer F, Birbaumer N, Kübler A (2010) The influence of psychological state and motivation on brain-computer interface performance in patients with amyotrophic lateral sclerosis—a longitudinal study. Front Neurosci 4(55):1–13 Nijboer F, Birbaumer N, Kübler A (2010) The influence of psychological state and motivation on brain-computer interface performance in patients with amyotrophic lateral sclerosis—a longitudinal study. Front Neurosci 4(55):1–13
24.
Zurück zum Zitat Nijboer F, Furdea A, Gunst I, Mellinger J, McFarland DJ, Birbaumer N, Kübler A (2008) An auditory brain-computer interface (BCI). J Neurosci Methods 167:43–50PubMedCrossRef Nijboer F, Furdea A, Gunst I, Mellinger J, McFarland DJ, Birbaumer N, Kübler A (2008) An auditory brain-computer interface (BCI). J Neurosci Methods 167:43–50PubMedCrossRef
25.
Zurück zum Zitat Nijboer F, Sellers EW, Mellinger J, Jordan MA, Matuz T, Furdea A, Halder S, Mochty U, Krusienski DJ, Vaughan TM, Wolpaw JR, Birbaumer N, Kübler A (2008) A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol 119:1909–1916PubMedCrossRef Nijboer F, Sellers EW, Mellinger J, Jordan MA, Matuz T, Furdea A, Halder S, Mochty U, Krusienski DJ, Vaughan TM, Wolpaw JR, Birbaumer N, Kübler A (2008) A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol 119:1909–1916PubMedCrossRef
26.
Zurück zum Zitat Ohki M, Kanayama R, Nakamura T, Okuyama T, Kimura Y, Koike Y (1994) Ocular abnormalities in amyotrophic lateral sclerosis. Acta Oto-laryngologica Suppl 511:138–142CrossRef Ohki M, Kanayama R, Nakamura T, Okuyama T, Kimura Y, Koike Y (1994) Ocular abnormalities in amyotrophic lateral sclerosis. Acta Oto-laryngologica Suppl 511:138–142CrossRef
27.
Zurück zum Zitat Pfurtscheller G, Neuper C, Schlögl A, Lugger K (1998) Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. IEEE Trans Rehabil Eng 6(3):316–325PubMedCrossRef Pfurtscheller G, Neuper C, Schlögl A, Lugger K (1998) Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. IEEE Trans Rehabil Eng 6(3):316–325PubMedCrossRef
28.
Zurück zum Zitat Pham M, Hinterberger T, Neumann N, Kübler A, Hofmayer N, Grether A, Wilhelm B, Vatine JJ, Birbaumer N (2005) An auditory brain-computer interface based on the self-regulation of slow cortical potentials. Neurorehabilitation Neural Repair 19:206–218PubMedCrossRef Pham M, Hinterberger T, Neumann N, Kübler A, Hofmayer N, Grether A, Wilhelm B, Vatine JJ, Birbaumer N (2005) An auditory brain-computer interface based on the self-regulation of slow cortical potentials. Neurorehabilitation Neural Repair 19:206–218PubMedCrossRef
29.
Zurück zum Zitat Pulkki V (2002) Compensating displacement of amplitude-panned virtual sources. In: AES 22nd International Conference, pp 186–195 Pulkki V (2002) Compensating displacement of amplitude-panned virtual sources. In: AES 22nd International Conference, pp 186–195
30.
Zurück zum Zitat Rutkowski TM, Tanaka T, Zhao Q, Cichocki A (2010) Spatial auditory BCI/BMI paradigm-multichannel EMD approach to brain responses estimation. In: APSIPA Annual Summit and Conference, pp 197–202 Rutkowski TM, Tanaka T, Zhao Q, Cichocki A (2010) Spatial auditory BCI/BMI paradigm-multichannel EMD approach to brain responses estimation. In: APSIPA Annual Summit and Conference, pp 197–202
31.
Zurück zum Zitat Sannelli C, Dickhaus T, Halder S, Hammer E-M, Müller K-R, Blankertz B (2010) On optimal channel configurations for SMR-based brain-computer interfaces. Brain Topogr 23:186–193PubMedCrossRef Sannelli C, Dickhaus T, Halder S, Hammer E-M, Müller K-R, Blankertz B (2010) On optimal channel configurations for SMR-based brain-computer interfaces. Brain Topogr 23:186–193PubMedCrossRef
32.
Zurück zum Zitat Satti A, Guan C, Coyle D, Prasad G (2010) A covariate shift minimisation method to alleviate non-stationarity effects for an adaptive brain-computer interface. In: 20th International Conference on Pattern Recognition, pp 105–108 Satti A, Guan C, Coyle D, Prasad G (2010) A covariate shift minimisation method to alleviate non-stationarity effects for an adaptive brain-computer interface. In: 20th International Conference on Pattern Recognition, pp 105–108
33.
Zurück zum Zitat Schreuder M, Blankertz B, Tangermann M (2010) A new auditory multi-class brain-computer interface paradigm: spatial hearing as an informative cue. PLoS ONE 5(4):e9813PubMedCrossRef Schreuder M, Blankertz B, Tangermann M (2010) A new auditory multi-class brain-computer interface paradigm: spatial hearing as an informative cue. PLoS ONE 5(4):e9813PubMedCrossRef
34.
Zurück zum Zitat Stow J, Coyle D, Carroll A, Satti A, McElligott J (2011) Achievable brain computer communication through short intensive motor imagery training despite long term spinal cord injury. In: Annual IICN Registrar’s Prize in Neuroscience Stow J, Coyle D, Carroll A, Satti A, McElligott J (2011) Achievable brain computer communication through short intensive motor imagery training despite long term spinal cord injury. In: Annual IICN Registrar’s Prize in Neuroscience
35.
Zurück zum Zitat Velasco-Álvarez F, Ron-Angevin R, da Silva-Sauer L, Sancha-Ros S, Blanca-Mena M, Cabestany J, Rojas I, Joya G (2011) Audio-cued SMR brain-computer interface to drive a virtual wheelchair. Adv Comput Intell 6691:337–344 Velasco-Álvarez F, Ron-Angevin R, da Silva-Sauer L, Sancha-Ros S, Blanca-Mena M, Cabestany J, Rojas I, Joya G (2011) Audio-cued SMR brain-computer interface to drive a virtual wheelchair. Adv Comput Intell 6691:337–344
36.
Zurück zum Zitat Vidaurre C, Blankertz B (2010) Towards a cure for BCI illiteracy. Brain Topogr 23(2):194–198PubMedCrossRef Vidaurre C, Blankertz B (2010) Towards a cure for BCI illiteracy. Brain Topogr 23(2):194–198PubMedCrossRef
Metadaten
Titel
Sensorimotor learning with stereo auditory feedback for a brain–computer interface
verfasst von
Karl A. McCreadie
Damien H. Coyle
Girijesh Prasad
Publikationsdatum
01.03.2013
Verlag
Springer-Verlag
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 3/2013
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-012-0992-7

Weitere Artikel der Ausgabe 3/2013

Medical & Biological Engineering & Computing 3/2013 Zur Ausgabe

Premium Partner