Skip to main content

2013 | OriginalPaper | Buchkapitel

An Auditory Output Brain–Computer Interface for Speech Communication

verfasst von : Jonathan S. Brumberg, Frank H. Guenther, Philip R. Kennedy

Erschienen in: Brain-Computer Interface Research

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Understanding the neural mechanisms underlying speech production can aid the design and implementation of brain–computer interfaces for speech communication. Specifically, the act of speech production is unequivocally a motor behavior; speech arises from the precise activation of all of the muscles of the respiratory and vocal mechanisms. Speech also preferentially relies on auditory output to communicate information between conversation partners. However, self-perception of one’s own speech is also important for maintaining error-free speech and proper production of intended utterances. This chapter discusses our efforts to use motor cortical neural output during attempted speech production for control of a communication BCI device by an individual with locked-in syndrome while taking advantage of neural circuits used for learning and maintaining speech. The end result is a BCI capable of producing instantaneously vocalized output within a framework of motor-based brain-computer interfacing that provides appropriate auditory feedback to the user.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat J. Bartels, D. Andreasen, P. Ehirim, H. Mao, S. Seibert, E.J. Wright, P. Kennedy, Neurotrophic electrode: method of assembly and implantation into human motor speech cortex. J. Neurosci. Methods 174(2), 168–176 (2008)CrossRef J. Bartels, D. Andreasen, P. Ehirim, H. Mao, S. Seibert, E.J. Wright, P. Kennedy, Neurotrophic electrode: method of assembly and implantation into human motor speech cortex. J. Neurosci. Methods 174(2), 168–176 (2008)CrossRef
Zurück zum Zitat J.S. Brumberg, A. Nieto-Castanon, P.R. Kennedy, F.H. Guenther, Brain–computer interfaces for speech communication. Speech Commun. 52(4), 367–379 (2010)CrossRef J.S. Brumberg, A. Nieto-Castanon, P.R. Kennedy, F.H. Guenther, Brain–computer interfaces for speech communication. Speech Commun. 52(4), 367–379 (2010)CrossRef
Zurück zum Zitat C.S. DaSalla, H. Kambara, M. Sato, Y. Koike, Single-trial classification of vowel speech imagery using common spatial patterns. Neural Netw. 22(9), 1334–1339 (2009)CrossRef C.S. DaSalla, H. Kambara, M. Sato, Y. Koike, Single-trial classification of vowel speech imagery using common spatial patterns. Neural Netw. 22(9), 1334–1339 (2009)CrossRef
Zurück zum Zitat F.H. Guenther, A neural network model of speech acquisition and motor equivalent speech production. Biol. Cybern. 72(1), 43–53 (1994)CrossRef F.H. Guenther, A neural network model of speech acquisition and motor equivalent speech production. Biol. Cybern. 72(1), 43–53 (1994)CrossRef
Zurück zum Zitat F.H. Guenther, S.S. Ghosh, J.A. Tourville, Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang. 96(3), 280–301 (2006)CrossRef F.H. Guenther, S.S. Ghosh, J.A. Tourville, Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang. 96(3), 280–301 (2006)CrossRef
Zurück zum Zitat F.H. Guenther, J.S. Brumberg, E.J. Wright, A. Nieto-Castanon, J.A. Tourville, M. Panko, R. Law, S.A. Siebert, J.L. Bartels, D.S. Andreasen, P. Ehirim, H. Mao, P.R. Kennedy, A wireless brain-machine interface for real-time speech synthesis. PLoS ONE 4(12), e8218 (2009)CrossRef F.H. Guenther, J.S. Brumberg, E.J. Wright, A. Nieto-Castanon, J.A. Tourville, M. Panko, R. Law, S.A. Siebert, J.L. Bartels, D.S. Andreasen, P. Ehirim, H. Mao, P.R. Kennedy, A wireless brain-machine interface for real-time speech synthesis. PLoS ONE 4(12), e8218 (2009)CrossRef
Zurück zum Zitat G. Hickok, Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13(2), 135–145 (2012)CrossRef G. Hickok, Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13(2), 135–145 (2012)CrossRef
Zurück zum Zitat L.R. Hochberg, M.D. Serruya, G.M. Friehs, J.A. Mukand, M. Saleh, A.H. Caplan, A. Branner, D. Chen, R.D. Penn, J.P. Donoghue, Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442(7099), 164–171 (2006)CrossRef L.R. Hochberg, M.D. Serruya, G.M. Friehs, J.A. Mukand, M. Saleh, A.H. Caplan, A. Branner, D. Chen, R.D. Penn, J.P. Donoghue, Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442(7099), 164–171 (2006)CrossRef
Zurück zum Zitat J.F. Houde, S.S. Nagarajan, Speech production as state feedback control. Frontiers Human Neurosci. 5, 82 (2011) J.F. Houde, S.S. Nagarajan, Speech production as state feedback control. Frontiers Human Neurosci. 5, 82 (2011)
Zurück zum Zitat J.S. Brumberg, E.J. Wright, D.S. Andreasen, F.H. Guenther, P.R. Kennedy, Classification of intended phoneme production from chronic intracortical microelectrode recordings in speech-motor cortex. Frontiers Neurosci. 5(65), 1–14 (2011) J.S. Brumberg, E.J. Wright, D.S. Andreasen, F.H. Guenther, P.R. Kennedy, Classification of intended phoneme production from chronic intracortical microelectrode recordings in speech-motor cortex. Frontiers Neurosci. 5(65), 1–14 (2011)
Zurück zum Zitat S. Kellis, K. Miller, K. Thomson, R. Brown, P. House, B. Greger, Decoding spoken words using local field potentials recorded from the cortical surface. J. Neural Eng. 7(5), 056007 (2010)CrossRef S. Kellis, K. Miller, K. Thomson, R. Brown, P. House, B. Greger, Decoding spoken words using local field potentials recorded from the cortical surface. J. Neural Eng. 7(5), 056007 (2010)CrossRef
Zurück zum Zitat P.R. Kennedy, The cone electrode: a long-term electrode that records from neurites grown onto its recording surface. J. Neurosci. Methods 29(3), 181–193 (1989)CrossRef P.R. Kennedy, The cone electrode: a long-term electrode that records from neurites grown onto its recording surface. J. Neurosci. Methods 29(3), 181–193 (1989)CrossRef
Zurück zum Zitat E.C. Leuthardt, C. Gaona, M. Sharma, N. Szrama, J. Roland, Z. Freudenberg, J. Solis, J. Breshears, G. Schalk, Using the electrocorticographic speech network to control a brain–computer interface in humans. J. Neural Eng. 8(3), 036004 (2011)CrossRef E.C. Leuthardt, C. Gaona, M. Sharma, N. Szrama, J. Roland, Z. Freudenberg, J. Solis, J. Breshears, G. Schalk, Using the electrocorticographic speech network to control a brain–computer interface in humans. J. Neural Eng. 8(3), 036004 (2011)CrossRef
Zurück zum Zitat F. Nijboer, A. Furdea, I. Gunst, J. Mellinger, D.J. McFarland, N. Birbaumer, A. Kübler, An auditory brain-computer interface (BCI). J. Neurosci. Methods 167(1), 43–50 (2008)CrossRef F. Nijboer, A. Furdea, I. Gunst, J. Mellinger, D.J. McFarland, N. Birbaumer, A. Kübler, An auditory brain-computer interface (BCI). J. Neurosci. Methods 167(1), 43–50 (2008)CrossRef
Zurück zum Zitat F. Plum, J.B. Posner, The diagnosis of stupor and coma. Contemp. Neurol. Series 10, 1–286 (1972) F. Plum, J.B. Posner, The diagnosis of stupor and coma. Contemp. Neurol. Series 10, 1–286 (1972)
Zurück zum Zitat T. Blakely, K.J. Miller, R.P.N. Rao, M.D. Holmes, J.G. Ojemann, Localization and classification of phonemes using high spatial resolution electrocorticography (ECoG) grids, in IEEE Engineering in Medicine and Biology Society, vol. 2008, pp. 4964–4967, 2008 T. Blakely, K.J. Miller, R.P.N. Rao, M.D. Holmes, J.G. Ojemann, Localization and classification of phonemes using high spatial resolution electrocorticography (ECoG) grids, in IEEE Engineering in Medicine and Biology Society, vol. 2008, pp. 4964–4967, 2008
Zurück zum Zitat J.R. Wolpaw, D.J. McFarland, Control of a two-dimensional movement signal by a noninvasive brain–computer interface in humans. Proc. Natl. Acad. Sci. U. S. A. 101(51), 17849 (2004)CrossRef J.R. Wolpaw, D.J. McFarland, Control of a two-dimensional movement signal by a noninvasive brain–computer interface in humans. Proc. Natl. Acad. Sci. U. S. A. 101(51), 17849 (2004)CrossRef
Metadaten
Titel
An Auditory Output Brain–Computer Interface for Speech Communication
verfasst von
Jonathan S. Brumberg
Frank H. Guenther
Philip R. Kennedy
Copyright-Jahr
2013
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-36083-1_2

Neuer Inhalt