Skip to main content
Top
Published in: Cognitive Neurodynamics 5/2020

01-06-2020 | Research Article

A stacked sparse auto-encoder and back propagation network model for sensory event detection via a flexible ECoG

Authors: Oluwagbenga Paul Idowu, Jianping Huang, Yang Zhao, Oluwarotimi William Samuel, Mei Yu, Peng Fang, Guanglin Li

Published in: Cognitive Neurodynamics | Issue 5/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Current prostheses are limited in their ability to provide direct sensory feedback to users with missing limb. Several efforts have been made to restore tactile sensation to amputees but the somatotopic tactile feedback often results in unnatural sensations, and it is yet unclear how and what information the somatosensory system receives during voluntary movement. The present study proposes an efficient model of stacked sparse autoencoder and back propagation neural network for detecting sensory events from a highly flexible electrocorticography (ECoG) electrode. During the mechanical stimulation with Von Frey (VF) filament on the plantar surface of rats’ foot, simultaneous recordings of tactile afferent signals were obtained from primary somatosensory cortex (S1) in the brain. In order to achieve a model with optimal performance, Particle Swarm Optimization and Adaptive Moment Estimation (Adam) were adopted to select the appropriate number of neurons, hidden layers and learning rate of each sparse auto-encoder. We evaluated the stimulus-evoked sensation by using an automated up-down (UD) method otherwise called UDReader. The assessment of tactile thresholds with VF shows that the right side of the hind-paw was significantly more sensitive at the tibia-(p = 6.50 × 10−4), followed by the saphenous-(p = 7.84 × 10−4), and sural-(p = 8.24 × 10−4). We then validated our proposed model by comparing with the state-of-the-art methods, and recorded accuracy of 98.8%, sensitivity of 96.8%, and specificity of 99.1%. Hence, we demonstrated the effectiveness of our algorithms in detecting sensory events through flexible ECoG recordings which could be a viable option in restoring somatosensory feedback.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Antfolk C, D’Alonzo M, Rosén B, Lundborg G, Sebelius F, Cipriani C (2013) Sensory feedback in upper limb prosthetics. Expert Rev Med Devices 10(1):45–54CrossRef Antfolk C, D’Alonzo M, Rosén B, Lundborg G, Sebelius F, Cipriani C (2013) Sensory feedback in upper limb prosthetics. Expert Rev Med Devices 10(1):45–54CrossRef
go back to reference Azlan WAW, Low YF (2014) Feature extraction of electroencephalogram (EEG) signal—a review. In: 2014 IEEE conference on biomedical engineering and sciences (IECBES), Kuala Lumpur, pp 801–806 Azlan WAW, Low YF (2014) Feature extraction of electroencephalogram (EEG) signal—a review. In: 2014 IEEE conference on biomedical engineering and sciences (IECBES), Kuala Lumpur, pp 801–806
go back to reference Bernarding C, Strauss DJ, Hannemann R et al (2017) Neurodynamic evaluation of hearing aid features using EEG correlates of listening effort. Cogn Neurodyn 11:203–215CrossRef Bernarding C, Strauss DJ, Hannemann R et al (2017) Neurodynamic evaluation of hearing aid features using EEG correlates of listening effort. Cogn Neurodyn 11:203–215CrossRef
go back to reference Caldwell DJ, Ojemann JG, Rao RPN (2019) Direct electrical stimulation in electrocorticographic brain–computer interfaces: enabling technologies for input to cortex. Front Neurosci 13:804CrossRef Caldwell DJ, Ojemann JG, Rao RPN (2019) Direct electrical stimulation in electrocorticographic brain–computer interfaces: enabling technologies for input to cortex. Front Neurosci 13:804CrossRef
go back to reference Chaplan SR, Bach FW, Pogrel JW, Chung JM, Yaksh TL (1994) Quantitative assessment of tactile allodynia in the rat paw. J Neurosci Methods 53:55–63CrossRef Chaplan SR, Bach FW, Pogrel JW, Chung JM, Yaksh TL (1994) Quantitative assessment of tactile allodynia in the rat paw. J Neurosci Methods 53:55–63CrossRef
go back to reference Chen G (2014) Automatic EEG seizure detection using dual-tree complex wavelet-Fourier features. Expert Syst Appl 41(5):2391–2394CrossRef Chen G (2014) Automatic EEG seizure detection using dual-tree complex wavelet-Fourier features. Expert Syst Appl 41(5):2391–2394CrossRef
go back to reference Cordella F, Ciancio AL, Sacchetti R, Davalli A, Cutti AG, Guglielmelli E, Zollo L (2016) Literature review on needs of upper limb prosthesis users. Front Neurosci 10:209CrossRef Cordella F, Ciancio AL, Sacchetti R, Davalli A, Cutti AG, Guglielmelli E, Zollo L (2016) Literature review on needs of upper limb prosthesis users. Front Neurosci 10:209CrossRef
go back to reference Daoud H, Bayoumi MA (2019) Efficient epileptic seizure prediction based on deep learning. IEEE Trans Biomed Circuits Syst 13(5):804–813CrossRef Daoud H, Bayoumi MA (2019) Efficient epileptic seizure prediction based on deep learning. IEEE Trans Biomed Circuits Syst 13(5):804–813CrossRef
go back to reference Dixon WJ (1980) Efficient analysis of experimental observations. Annu Rev Pharmacol Toxicol 20:441–462CrossRef Dixon WJ (1980) Efficient analysis of experimental observations. Annu Rev Pharmacol Toxicol 20:441–462CrossRef
go back to reference Flesher N, Collinger L, Foldes T, Weiss M, Downey E, Tyler-Kabara C, Bensmaia J, Schwartz B, Boninger L, Gaunt A (2016) Intracortical microstimulation of human somatosensory cortex. Sci Transl Med 8(361):361ra141CrossRef Flesher N, Collinger L, Foldes T, Weiss M, Downey E, Tyler-Kabara C, Bensmaia J, Schwartz B, Boninger L, Gaunt A (2016) Intracortical microstimulation of human somatosensory cortex. Sci Transl Med 8(361):361ra141CrossRef
go back to reference González-Cano R, Boivin B, Bullock D, Cornelissen L, Andrews NA, Costigan ML (2018) Up–down reader: an open source program for efficiently processing 50% von Frey thresholds. Front Pharmacol 9:433CrossRef González-Cano R, Boivin B, Bullock D, Cornelissen L, Andrews NA, Costigan ML (2018) Up–down reader: an open source program for efficiently processing 50% von Frey thresholds. Front Pharmacol 9:433CrossRef
go back to reference Hatsopoulos NG, Donoghue JP (2009) The science of neural interface systems. Annu Rev Neurosci 32:249–266CrossRef Hatsopoulos NG, Donoghue JP (2009) The science of neural interface systems. Annu Rev Neurosci 32:249–266CrossRef
go back to reference Hill NJ, Gupta D, Brunner P, Gunduz A, Adamo MA, Ritaccio A, Schalk G (2012) Recording human electrocorticographic (ECoG) signals for neuroscientific research and real-time functional cortical mapping. J Vis Exp JoVE 64:3993. https://doi.org/10.3791/3993CrossRef Hill NJ, Gupta D, Brunner P, Gunduz A, Adamo MA, Ritaccio A, Schalk G (2012) Recording human electrocorticographic (ECoG) signals for neuroscientific research and real-time functional cortical mapping. J Vis Exp JoVE 64:3993. https://​doi.​org/​10.​3791/​3993CrossRef
go back to reference Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507CrossRef Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507CrossRef
go back to reference Idowu, O.P., Fang, P., Li, X., Xia, Z., Xiong, J., & Li, G. (2018). Towards control of EEG-based robotic arm using deep learning via stacked sparse autoencoder. In: IEEE international conference on robotics and biomimetics (ROBIO), pp 1053–1057 Idowu, O.P., Fang, P., Li, X., Xia, Z., Xiong, J., & Li, G. (2018). Towards control of EEG-based robotic arm using deep learning via stacked sparse autoencoder. In: IEEE international conference on robotics and biomimetics (ROBIO), pp 1053–1057
go back to reference Idowu OP, Huang J, Zhao Y, Li G, Fang P (2018b) Electrophysiological assessment of peripheral nerve stimulation through somatosensory evoked potential in rat hindlimb. IEEE Int Conf Cyborg Bionic Syst (CBS) 2018:21–24 Idowu OP, Huang J, Zhao Y, Li G, Fang P (2018b) Electrophysiological assessment of peripheral nerve stimulation through somatosensory evoked potential in rat hindlimb. IEEE Int Conf Cyborg Bionic Syst (CBS) 2018:21–24
go back to reference Kaiju T, Doi K, Yokota M, Watanabe K, Inoue M, Ando H, Takahashi K, Yoshida F, Hirata M, Suzuki T (2017) High spatiotemporal resolution ECoG recording of somatosensory evoked potentials with flexible micro-electrode arrays. Front Neural Circuits 11:20CrossRef Kaiju T, Doi K, Yokota M, Watanabe K, Inoue M, Ando H, Takahashi K, Yoshida F, Hirata M, Suzuki T (2017) High spatiotemporal resolution ECoG recording of somatosensory evoked potentials with flexible micro-electrode arrays. Front Neural Circuits 11:20CrossRef
go back to reference Kim GH, Kim K, Lee E, An T, Choi W, Lim G, Shin JH (2018) Recent progress on microelectrodes in neural interfaces. Materials (Basel, Switzerland) 11(10):1995CrossRef Kim GH, Kim K, Lee E, An T, Choi W, Lim G, Shin JH (2018) Recent progress on microelectrodes in neural interfaces. Materials (Basel, Switzerland) 11(10):1995CrossRef
go back to reference Kingma DP, Ba J (2014). Adam: a method for stochastic optimization. CoRR, abs/1412.6980 Kingma DP, Ba J (2014). Adam: a method for stochastic optimization. CoRR, abs/1412.6980
go back to reference Lambert GA, Mallos G, Zagami AS (2009) Von Frey’s hairs—a review of their technology and use—a novel automated von Frey device for improved testing for hyperalgesia. J Neurosci Methods 177:420–426CrossRef Lambert GA, Mallos G, Zagami AS (2009) Von Frey’s hairs—a review of their technology and use—a novel automated von Frey device for improved testing for hyperalgesia. J Neurosci Methods 177:420–426CrossRef
go back to reference Lefebvre B, Yger P, Marre O (2016) Recent progress in multi-electrode spike sorting methods. J Physiol Paris 110(4 Pt A):327–335CrossRef Lefebvre B, Yger P, Marre O (2016) Recent progress in multi-electrode spike sorting methods. J Physiol Paris 110(4 Pt A):327–335CrossRef
go back to reference Li G, Samuel OW, Lin C, Asogbon MG, Fang P, Idowu PO (2019) Realizing efficient EMG-based prosthetic control strategy. Adv Exp Med Biol 1101:149–166. ISSN: 0065-2598 Li G, Samuel OW, Lin C, Asogbon MG, Fang P, Idowu PO (2019) Realizing efficient EMG-based prosthetic control strategy. Adv Exp Med Biol 1101:149–166. ISSN: 0065-2598
go back to reference Nedic A, Moon JD, Kung TA, Langhals NB, Cederna PS, Urbanchek MG (2013) Von Frey monofilament testing successfully discriminates between sensory function of mixed nerve and sensory nerve regenerative peripheral nerve interfaces. In: 2013 6th International IEEE/EMBS conference on neural engineering (NER), pp 255–258 Nedic A, Moon JD, Kung TA, Langhals NB, Cederna PS, Urbanchek MG (2013) Von Frey monofilament testing successfully discriminates between sensory function of mixed nerve and sensory nerve regenerative peripheral nerve interfaces. In: 2013 6th International IEEE/EMBS conference on neural engineering (NER), pp 255–258
go back to reference Niknazar M, Mousavi SR, Motaghi S, Dehghani A, Vosoughi Vahdat B, Shamsollahi MB, Sayyah M, Noorbakhsh SM (2013) A unified approach for detection of induced epileptic seizures in rats using ECoG signals. Epilepsy Behav 27(2):355–364CrossRef Niknazar M, Mousavi SR, Motaghi S, Dehghani A, Vosoughi Vahdat B, Shamsollahi MB, Sayyah M, Noorbakhsh SM (2013) A unified approach for detection of induced epileptic seizures in rats using ECoG signals. Epilepsy Behav 27(2):355–364CrossRef
go back to reference Obien ME, Deligkaris K, Bullmann T, Bakkum DJ, Frey U (2015) Revealing neuronal function through microelectrode array recordings. Front Neurosci 8:423CrossRef Obien ME, Deligkaris K, Bullmann T, Bakkum DJ, Frey U (2015) Revealing neuronal function through microelectrode array recordings. Front Neurosci 8:423CrossRef
go back to reference Rahman MA, Ma W, Tran D, Campbell J (2012) A comprehensive survey of the feature extraction methods in the EEG research. ICA3PP Rahman MA, Ma W, Tran D, Campbell J (2012) A comprehensive survey of the feature extraction methods in the EEG research. ICA3PP
go back to reference Randall JN (1996) Interactions between motor commands and somatic perception in sensorimotor cortex. Curr Opin Neurobiol 6:801–810CrossRef Randall JN (1996) Interactions between motor commands and somatic perception in sensorimotor cortex. Curr Opin Neurobiol 6:801–810CrossRef
go back to reference Ravish DK, Shenbaga Devi S, Krishnamoorthy SG, Karthikeyan MR (2013) Detection of epileptic seizure in eeg recordings by spectral method and statistical analysis. J Appl Sci 13:207–219CrossRef Ravish DK, Shenbaga Devi S, Krishnamoorthy SG, Karthikeyan MR (2013) Detection of epileptic seizure in eeg recordings by spectral method and statistical analysis. J Appl Sci 13:207–219CrossRef
go back to reference Rey HG, Pedreira C, Quiroga RQ (2015) Past, present and future of spike sorting techniques. Brain Res Bull 119:106–117CrossRef Rey HG, Pedreira C, Quiroga RQ (2015) Past, present and future of spike sorting techniques. Brain Res Bull 119:106–117CrossRef
go back to reference Samuel OW, Geng Y, Li X, Li G (2017) Towards efficient decoding of multiple classes of motor imagery limb movements based on EEG spectral and time domain descriptors. J Med Syst 41(12):194CrossRef Samuel OW, Geng Y, Li X, Li G (2017) Towards efficient decoding of multiple classes of motor imagery limb movements based on EEG spectral and time domain descriptors. J Med Syst 41(12):194CrossRef
go back to reference Schiefer M, Tan D, Sidek SM et al (2016) Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis. J Neural Eng 13(1):016001CrossRef Schiefer M, Tan D, Sidek SM et al (2016) Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis. J Neural Eng 13(1):016001CrossRef
go back to reference Shi Y (2001) Particle swarm optimization: developments, applications and resources. In: Proceedings of the 2001 congress on evolutionary computation (IEEE Cat. No.01TH8546), vol 1, pp 81–86 Shi Y (2001) Particle swarm optimization: developments, applications and resources. In: Proceedings of the 2001 congress on evolutionary computation (IEEE Cat. No.01TH8546), vol 1, pp 81–86
go back to reference Stephens-Fripp B, Alici G, Mutlu R (2018) A review of non-invasive sensory feedback methods for transradial prosthetic hands. IEEE Access 6:6878–6899CrossRef Stephens-Fripp B, Alici G, Mutlu R (2018) A review of non-invasive sensory feedback methods for transradial prosthetic hands. IEEE Access 6:6878–6899CrossRef
go back to reference Svensson P, Wijk U, Björkman A, Antfolk C (2017) A review of invasive and non-invasive sensory feedback in upper limb prostheses. Expert Rev Med Devices 14(6):439–447CrossRef Svensson P, Wijk U, Björkman A, Antfolk C (2017) A review of invasive and non-invasive sensory feedback in upper limb prostheses. Expert Rev Med Devices 14(6):439–447CrossRef
go back to reference Thakor NV (2013) Translating the brain-machine interface. Sci Transl Med 5(210):210ps17CrossRef Thakor NV (2013) Translating the brain-machine interface. Sci Transl Med 5(210):210ps17CrossRef
go back to reference Volkova K, Lebedev MA, Kaplan A, Ossadtchi A (2019) Decoding movement from electrocorticographic activity: a review. Front Neuroinf 13:74CrossRef Volkova K, Lebedev MA, Kaplan A, Ossadtchi A (2019) Decoding movement from electrocorticographic activity: a review. Front Neuroinf 13:74CrossRef
go back to reference Wang D, Liu Y, Hu D, Blohm G (2015a) EEG-based perceived tactile location prediction. IEEE Trans Auton Ment Dev 7:342–348CrossRef Wang D, Liu Y, Hu D, Blohm G (2015a) EEG-based perceived tactile location prediction. IEEE Trans Auton Ment Dev 7:342–348CrossRef
go back to reference Zhao Y, Yu M, Li G, Fang P (2018) Highly stretchable electrodes based on gold films with cyclic stability for electrocorticogram recordings. IEEE Int Conf Cyborg Bionic Syst (CBS) 2018:17–20 Zhao Y, Yu M, Li G, Fang P (2018) Highly stretchable electrodes based on gold films with cyclic stability for electrocorticogram recordings. IEEE Int Conf Cyborg Bionic Syst (CBS) 2018:17–20
Metadata
Title
A stacked sparse auto-encoder and back propagation network model for sensory event detection via a flexible ECoG
Authors
Oluwagbenga Paul Idowu
Jianping Huang
Yang Zhao
Oluwarotimi William Samuel
Mei Yu
Peng Fang
Guanglin Li
Publication date
01-06-2020
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics / Issue 5/2020
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-020-09603-8

Other articles of this Issue 5/2020

Cognitive Neurodynamics 5/2020 Go to the issue