Skip to main content
Top
Published in: Cognitive Neurodynamics 6/2017

06-09-2017 | Research Article

Analyzing text recognition from tactually evoked EEG

Authors: A. Khasnobish, S. Datta, R. Bose, D. N. Tibarewala, A. Konar

Published in: Cognitive Neurodynamics | Issue 6/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Tactual exploration of objects produce specific patterns in the human brain and hence objects can be recognized by analyzing brain signals during tactile exploration. The present work aims at analyzing EEG signals online for recognition of embossed texts by tactual exploration. EEG signals are acquired from the parietal region over the somatosensory cortex of blindfolded healthy subjects while they tactually explored embossed texts, including symbols, numbers, and alphabets. Classifiers based on the principle of supervised learning are trained on the extracted EEG feature space, comprising three features, namely, adaptive autoregressive parameters, Hurst exponents, and power spectral density, to recognize the respective texts. The pre-trained classifiers are used to classify the EEG data to identify the texts online and the recognized text is displayed on the computer screen for communication. Online classifications of two, four, and six classes of embossed texts are achieved with overall average recognition rates of 76.62, 72.31, and 67.62% respectively and the computational time is less than 2 s in each case. The maximum information transfer rate and utility of the system performance over all experiments are 0.7187 and 2.0529 bits/s respectively. This work presents a study that shows the possibility to classify 3D letters using tactually evoked EEG. In future, it will help the BCI community to design stimuli for better tactile augmentation n also opens new directions of research to facilitate 3D letters for visually impaired persons. Further, 3D maps can be generated for aiding tactual BCI in teleoperation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Acharya UR, Faust O, Kannathal N, Chua T, Laxminarayan S (2005) Non-linear analysis of EEG signals at various sleep stages. Comput Methods Programs Biomed 80(1):37–45CrossRef Acharya UR, Faust O, Kannathal N, Chua T, Laxminarayan S (2005) Non-linear analysis of EEG signals at various sleep stages. Comput Methods Programs Biomed 80(1):37–45CrossRef
go back to reference Alkan A, Yilmaz AS (2007) Frequency domain analysis of power system transients using Welch and Yule–Walker AR methods. Energy Convers Manag 48(7):2129–2135CrossRef Alkan A, Yilmaz AS (2007) Frequency domain analysis of power system transients using Welch and Yule–Walker AR methods. Energy Convers Manag 48(7):2129–2135CrossRef
go back to reference Aloise F, Schettini F, Aricò P, Bianchi L, Riccio A, Mecella M, Cincotti F (2010) Advanced brain computer interface for communication and control. In Proceedings of the International Conference on Advanced Visual Interfaces. ACM, pp 399–400 Aloise F, Schettini F, Aricò P, Bianchi L, Riccio A, Mecella M, Cincotti F (2010) Advanced brain computer interface for communication and control. In Proceedings of the International Conference on Advanced Visual Interfaces. ACM, pp 399–400
go back to reference Amedi A, Kriegstein KV, Atteveldt NMV, Beauchamp MS, Naumer MJ (2005) Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166(34):559–571CrossRefPubMed Amedi A, Kriegstein KV, Atteveldt NMV, Beauchamp MS, Naumer MJ (2005) Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166(34):559–571CrossRefPubMed
go back to reference Beisteiner R, Windischberger C, Geißler A, Gartus A, Uhl F, Moser E, Deecke L, Lanzenberger R (2015) FMRI correlates of different components of Braille reading by the blind. Neurol Psychiatry Brain Res 21(4):137–145CrossRef Beisteiner R, Windischberger C, Geißler A, Gartus A, Uhl F, Moser E, Deecke L, Lanzenberger R (2015) FMRI correlates of different components of Braille reading by the blind. Neurol Psychiatry Brain Res 21(4):137–145CrossRef
go back to reference Bhaduri S, Khasnobish A, Bose R, Tibarewala DN (2016, March) Classification of lower limb motor imagery using K nearest neighbor and Naïve-Bayesian classifier. In: 2016 3rd international conference on recent advances in information technology (RAIT). IEEE, pp 499–504 Bhaduri S, Khasnobish A, Bose R, Tibarewala DN (2016, March) Classification of lower limb motor imagery using K nearest neighbor and Naïve-Bayesian classifier. In: 2016 3rd international conference on recent advances in information technology (RAIT). IEEE, pp 499–504
go back to reference Chan A, Early CE, Subedi S, Li Y, Lin H (2015, November) Systematic analysis of machine learning algorithms on EEG data for brain state intelligence. In: 2015 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 793–799 Chan A, Early CE, Subedi S, Li Y, Lin H (2015, November) Systematic analysis of machine learning algorithms on EEG data for brain state intelligence. In: 2015 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 793–799
go back to reference Cona F, Zavaglia M, Astolfi L, Babiloni F, Ursino M (2009) Changes in EEG power spectral density and cortical connectivity in healthy and tetraplegic patients during a motor imagery task. Comput Intell Neurosci. doi:10.1155/2009/279515 Cona F, Zavaglia M, Astolfi L, Babiloni F, Ursino M (2009) Changes in EEG power spectral density and cortical connectivity in healthy and tetraplegic patients during a motor imagery task. Comput Intell Neurosci. doi:10.​1155/​2009/​279515
go back to reference Curran EA, Stokes MJ (2003) Learning to control brain activity: a review of the production and control of EEG components for driving brain–computer interface (BCI) systems. Brain Cogn 51(3):326–336CrossRefPubMed Curran EA, Stokes MJ (2003) Learning to control brain activity: a review of the production and control of EEG components for driving brain–computer interface (BCI) systems. Brain Cogn 51(3):326–336CrossRefPubMed
go back to reference Dal Seno B, Matteucci M, Mainardi LT (2010) The utility metric: a novel method to assess the overall performance of discrete brain–computer interfaces. IEEE Trans Neural Syst Rehabil Eng 18(1):20–28CrossRef Dal Seno B, Matteucci M, Mainardi LT (2010) The utility metric: a novel method to assess the overall performance of discrete brain–computer interfaces. IEEE Trans Neural Syst Rehabil Eng 18(1):20–28CrossRef
go back to reference Datta S, Saha A, Konar A (2013) Perceptual basis of texture classification from tactile stimulus by EEG analysis. Proc Nat Conf Brain Consci, pp 38–45 Datta S, Saha A, Konar A (2013) Perceptual basis of texture classification from tactile stimulus by EEG analysis. Proc Nat Conf Brain Consci, pp 38–45
go back to reference Datta S, Khasnobish A, Konar A, Tibarewala DN (2015) Cognitive activity classification from EEG signals with an interval type-2 fuzzy system. In Advancements of Medical Electronics. Springer, New Delhi, pp 235–247 Datta S, Khasnobish A, Konar A, Tibarewala DN (2015) Cognitive activity classification from EEG signals with an interval type-2 fuzzy system. In Advancements of Medical Electronics. Springer, New Delhi, pp 235–247
go back to reference Dornhege G (2007) Towards brain–computer interfacing. MIT Press, Cambridge Dornhege G (2007) Towards brain–computer interfacing. MIT Press, Cambridge
go back to reference Fabiani GE, McFarland DJ, Wolpaw JR, Pfurtscheller G (2004) Conversion of EEG activity into cursor movement by a brain–computer interface (BCI). IEEE Trans Neural Syst Rehabil Eng 12(3):331–338CrossRefPubMed Fabiani GE, McFarland DJ, Wolpaw JR, Pfurtscheller G (2004) Conversion of EEG activity into cursor movement by a brain–computer interface (BCI). IEEE Trans Neural Syst Rehabil Eng 12(3):331–338CrossRefPubMed
go back to reference Gohel B, Lee P, Jeong Y (2016) Modality-specific spectral dynamics in response to visual and tactile sequential shape information processing tasks: an MEG study using multivariate pattern classification analysis. Brain Res 1644:39–52CrossRefPubMed Gohel B, Lee P, Jeong Y (2016) Modality-specific spectral dynamics in response to visual and tactile sequential shape information processing tasks: an MEG study using multivariate pattern classification analysis. Brain Res 1644:39–52CrossRefPubMed
go back to reference Grunwald M et al (2001) Theta power in the EEG of humans during ongoing processing in a haptic object recognition task. J Cogn Brain Res 11:33–37CrossRef Grunwald M et al (2001) Theta power in the EEG of humans during ongoing processing in a haptic object recognition task. J Cogn Brain Res 11:33–37CrossRef
go back to reference Gschwind M, Van De Ville D, Hardmeier M, Fuhr P, Michel C, Seeck M (2016) ID 249—corrupted fractal organization of EEG topographical fluctuations predict disease state in minimally disabled multiple sclerosis patients. Clin Neurophysiol 127(3):e72CrossRef Gschwind M, Van De Ville D, Hardmeier M, Fuhr P, Michel C, Seeck M (2016) ID 249—corrupted fractal organization of EEG topographical fluctuations predict disease state in minimally disabled multiple sclerosis patients. Clin Neurophysiol 127(3):e72CrossRef
go back to reference Ho YC (1999) The no free lunch theorem and the human-machine interface. IEEE Control Syst 19(3):8–10CrossRef Ho YC (1999) The no free lunch theorem and the human-machine interface. IEEE Control Syst 19(3):8–10CrossRef
go back to reference Hori J, Okada N (2017) Classification of tactile event-related potential elicited by Braille display for brain–computer interface. Biocybern Biomed Eng 37(1):135–142CrossRef Hori J, Okada N (2017) Classification of tactile event-related potential elicited by Braille display for brain–computer interface. Biocybern Biomed Eng 37(1):135–142CrossRef
go back to reference James TW, Kim S, Fisher JS (2007) The neural basis of haptic object processing. Can J Exp Psychol Rev 61(3):219CrossRef James TW, Kim S, Fisher JS (2007) The neural basis of haptic object processing. Can J Exp Psychol Rev 61(3):219CrossRef
go back to reference Jiménez J, Olea J, Torres J, Alonso I, Harder D, Fischer K (2009) Biography of Louis Braille and invention of the braille alphabet. Surv Ophthal 54(1):142–149CrossRef Jiménez J, Olea J, Torres J, Alonso I, Harder D, Fischer K (2009) Biography of Louis Braille and invention of the braille alphabet. Surv Ophthal 54(1):142–149CrossRef
go back to reference Kanounikov IE, Antonova EV, Kiselev BV, Belov DR (1999) Dependence of one of the fractal characteristics (Hurst exponent) of the human electroencephalogram on the cortical area and type of activity. Proc IEEE Int Jt Conf Neural Netw IJCNN 1:243–246 Kanounikov IE, Antonova EV, Kiselev BV, Belov DR (1999) Dependence of one of the fractal characteristics (Hurst exponent) of the human electroencephalogram on the cortical area and type of activity. Proc IEEE Int Jt Conf Neural Netw IJCNN 1:243–246
go back to reference Khasnobish A, Konar A, Tibarewala DN, Bhattacharyya S, Janarthanan R (2013) Object shape recognition from EEG signals during tactile and visual exploration. In: Maji P et al (eds) Pat Recog Mach Intell. Springer, Berlin 8251: 459–464 Khasnobish A, Konar A, Tibarewala DN, Bhattacharyya S, Janarthanan R (2013) Object shape recognition from EEG signals during tactile and visual exploration. In: Maji P et al (eds) Pat Recog Mach Intell. Springer, Berlin 8251: 459–464
go back to reference Kodama T, Makino S, Rutkowski TM (2016, December) Tactile brain-computer interface using classification of P300 responses evoked by full body spatial vibrotactile stimuli. In: Signal and information processing association annual summit and conference (APSIPA), 2016 Asia-Pacific. IEEE, pp 1–8 Kodama T, Makino S, Rutkowski TM (2016, December) Tactile brain-computer interface using classification of P300 responses evoked by full body spatial vibrotactile stimuli. In: Signal and information processing association annual summit and conference (APSIPA), 2016 Asia-Pacific. IEEE, pp 1–8
go back to reference Kono S, Aminaka D, Makino S, Rutkowski TM (2013, December) EEG signal processing and classification for the novel tactile-force brain-computer interface paradigm. In: 2013 international conference on signal-image technology & internet-based systems (SITIS). IEEE, pp 812–817 Kono S, Aminaka D, Makino S, Rutkowski TM (2013, December) EEG signal processing and classification for the novel tactile-force brain-computer interface paradigm. In: 2013 international conference on signal-image technology & internet-based systems (SITIS). IEEE, pp 812–817
go back to reference Leung KM (2007) Naive Bayesian classifier, technical report, Department of Computer Science/Finance and Risk Engineering, Polytechnic University, Brooklyn, New York, USA Leung KM (2007) Naive Bayesian classifier, technical report, Department of Computer Science/Finance and Risk Engineering, Polytechnic University, Brooklyn, New York, USA
go back to reference McCane LM, Heckman SM, McFarland DJ, Townsend G, Mak JN, Sellers EW et al (2015) P300-based brain-computer interface (BCI) event-related potentials (ERPs): people with amyotrophic lateral sclerosis (ALS) vs. age-matched controls. Clin Neurophysiol 126(11):2124–2131CrossRefPubMedPubMedCentral McCane LM, Heckman SM, McFarland DJ, Townsend G, Mak JN, Sellers EW et al (2015) P300-based brain-computer interface (BCI) event-related potentials (ERPs): people with amyotrophic lateral sclerosis (ALS) vs. age-matched controls. Clin Neurophysiol 126(11):2124–2131CrossRefPubMedPubMedCentral
go back to reference Mitchell TM (1997) Machine learning. McGraw Hill, New York City Mitchell TM (1997) Machine learning. McGraw Hill, New York City
go back to reference Mizraji E, Lin J (2017) The feeling of understanding: an exploration with neural models. Cogn Neurodyn 11(2):135–146CrossRefPubMed Mizraji E, Lin J (2017) The feeling of understanding: an exploration with neural models. Cogn Neurodyn 11(2):135–146CrossRefPubMed
go back to reference Nai-Jen H, Palaniappan R (2004) Classification of mental tasks using fixed and adaptive autoregressive models of EEG signals. In: Proceedings of 26th annual international conference of the IEEE engineering in medicine and biology society, vol 1, pp 507–510 Nai-Jen H, Palaniappan R (2004) Classification of mental tasks using fixed and adaptive autoregressive models of EEG signals. In: Proceedings of 26th annual international conference of the IEEE engineering in medicine and biology society, vol 1, pp 507–510
go back to reference Neuper C, Scherer R, Reiner M, Pfurtscheller G (2005) Imagery of motor actions: differential effects of kinesthetic and visual–motor mode of imagery in single-trial EEG. Cogn Brain Res 25(3):668–677CrossRef Neuper C, Scherer R, Reiner M, Pfurtscheller G (2005) Imagery of motor actions: differential effects of kinesthetic and visual–motor mode of imagery in single-trial EEG. Cogn Brain Res 25(3):668–677CrossRef
go back to reference Oyedotun OK, Khashman A (2017) Banknote recognition: investigating processing and cognition framework using competitive neural network. Cogn Neurodyn 11(1):67–79CrossRefPubMed Oyedotun OK, Khashman A (2017) Banknote recognition: investigating processing and cognition framework using competitive neural network. Cogn Neurodyn 11(1):67–79CrossRefPubMed
go back to reference Page A, Sagedy C, Smith E, Attaran N, Oates T, Mohsenin T (2015) A flexible multichannel EEG feature extractor and classifier for seizure detection. IEEE Trans Circuits Syst II Express Briefs 62(2):109–113CrossRef Page A, Sagedy C, Smith E, Attaran N, Oates T, Mohsenin T (2015) A flexible multichannel EEG feature extractor and classifier for seizure detection. IEEE Trans Circuits Syst II Express Briefs 62(2):109–113CrossRef
go back to reference Pal M, Khasnobish A, Konar A, Tibarewala DN, Janarthanan R (2014, January) Performance enhancement of object shape classification by coupling tactile sensing with EEG. In: 2014 international conference on electronics, communication and instrumentation (ICECI). IEEE, pp 1–4 Pal M, Khasnobish A, Konar A, Tibarewala DN, Janarthanan R (2014, January) Performance enhancement of object shape classification by coupling tactile sensing with EEG. In: 2014 international conference on electronics, communication and instrumentation (ICECI). IEEE, pp 1–4
go back to reference Paul TK, Hasegawa Y, Iba H (2006) Classification of gene expression data by majority voting genetic programming classifier. In: Proceedings of IEEE congress on evolutionary computation, pp 2521–2528 Paul TK, Hasegawa Y, Iba H (2006) Classification of gene expression data by majority voting genetic programming classifier. In: Proceedings of IEEE congress on evolutionary computation, pp 2521–2528
go back to reference Reed CL, Shoham S, Halgren E (2004) Neural substrates of tactile object recognition: an fMRI study. Hum Brain Mapp 21(4):236–246CrossRefPubMed Reed CL, Shoham S, Halgren E (2004) Neural substrates of tactile object recognition: an fMRI study. Hum Brain Mapp 21(4):236–246CrossRefPubMed
go back to reference Sanei S, Chambers JA (2008) EEG signal processing. Wiley, Hoboken Sanei S, Chambers JA (2008) EEG signal processing. Wiley, Hoboken
go back to reference Schlögl A (2000) The electroencephalogram and the adaptive autoregressive model: theory and applications. Shaker, Germany Schlögl A (2000) The electroencephalogram and the adaptive autoregressive model: theory and applications. Shaker, Germany
go back to reference Schlögl A, Lugger K, Pfurtscheller G (1997) Using adaptive autoregressive parameters for a brain–computer-interface experiment. In: Proceedings of IEEE 19th annual international conference engineering in medicine and biology society vol 4, pp 1533–535 Schlögl A, Lugger K, Pfurtscheller G (1997) Using adaptive autoregressive parameters for a brain–computer-interface experiment. In: Proceedings of IEEE 19th annual international conference engineering in medicine and biology society vol 4, pp 1533–535
go back to reference Taghizadeh-Sarabi M, Daliri MR, Niksirat KS (2015) Decoding objects of basic categories from electroencephalographic signals using wavelet transform and support vector machines. Brain Topogr 28(1):33–46CrossRefPubMed Taghizadeh-Sarabi M, Daliri MR, Niksirat KS (2015) Decoding objects of basic categories from electroencephalographic signals using wavelet transform and support vector machines. Brain Topogr 28(1):33–46CrossRefPubMed
go back to reference Teplan M (2002) Fundamentals of EEG measurement. Meas Sci Rev 2(2):1–11 Teplan M (2002) Fundamentals of EEG measurement. Meas Sci Rev 2(2):1–11
go back to reference Thompson DE, Blain-Moraes S, Huggins JE (2013) Performance assessment in brain–computer interface-based augmentative and alternative communication. Biomed Eng Online 12(1):43CrossRefPubMedPubMedCentral Thompson DE, Blain-Moraes S, Huggins JE (2013) Performance assessment in brain–computer interface-based augmentative and alternative communication. Biomed Eng Online 12(1):43CrossRefPubMedPubMedCentral
go back to reference Ursino M, Cuppini C, Magosso E (2011) An integrated neural model of semantic memory, lexical retrieval and category formation, based on a distributed feature representation. Cogn Neurodyn 5(2):183–207CrossRefPubMedPubMedCentral Ursino M, Cuppini C, Magosso E (2011) An integrated neural model of semantic memory, lexical retrieval and category formation, based on a distributed feature representation. Cogn Neurodyn 5(2):183–207CrossRefPubMedPubMedCentral
go back to reference Wang D, Liu Y, Hu D, Blohm G (2015) EEG-based perceived tactile location prediction. IEEE Trans Auton Ment Dev 7(4):342–348CrossRef Wang D, Liu Y, Hu D, Blohm G (2015) EEG-based perceived tactile location prediction. IEEE Trans Auton Ment Dev 7(4):342–348CrossRef
go back to reference Webb AR (2003) Statistical pattern recognition. Wiley, Hoboken Webb AR (2003) Statistical pattern recognition. Wiley, Hoboken
go back to reference Yamada Y, Kashimori Y (2013) Neural mechanism of dynamic responses of neurons in inferior temporal cortex in face perception. Cogn Neurodyn 7(1):23–38CrossRefPubMed Yamada Y, Kashimori Y (2013) Neural mechanism of dynamic responses of neurons in inferior temporal cortex in face perception. Cogn Neurodyn 7(1):23–38CrossRefPubMed
go back to reference Yuan P, Gao X, Allison B, Wang Y, Bin G, Gao S (2013) A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces. J Neural Eng 10(2):1–11CrossRef Yuan P, Gao X, Allison B, Wang Y, Bin G, Gao S (2013) A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces. J Neural Eng 10(2):1–11CrossRef
go back to reference Zhang D, Xu F, Xu H, Shull PB, Zhu X (2016a) Quantifying different tactile sensations evoked by cutaneous electrical stimulation using electroencephalography features. Int J Neural Syst 26(02):1650006CrossRefPubMed Zhang D, Xu F, Xu H, Shull PB, Zhu X (2016a) Quantifying different tactile sensations evoked by cutaneous electrical stimulation using electroencephalography features. Int J Neural Syst 26(02):1650006CrossRefPubMed
go back to reference Zhang Y, Liu B, Ji X, Huang D (2016b) Classification of EEG signals based on autoregressive model and wavelet packet decomposition. Neural Process Lett 2(45):365–378 Zhang Y, Liu B, Ji X, Huang D (2016b) Classification of EEG signals based on autoregressive model and wavelet packet decomposition. Neural Process Lett 2(45):365–378
Metadata
Title
Analyzing text recognition from tactually evoked EEG
Authors
A. Khasnobish
S. Datta
R. Bose
D. N. Tibarewala
A. Konar
Publication date
06-09-2017
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics / Issue 6/2017
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-017-9452-2

Other articles of this Issue 6/2017

Cognitive Neurodynamics 6/2017 Go to the issue