Skip to main content
Top

2018 | OriginalPaper | Chapter

Very Small Spiking Neural Networks Evolved for Temporal Pattern Recognition and Robust to Perturbed Neuronal Parameters

Authors : Muhammad Yaqoob, Borys Wróbel

Published in: Artificial Neural Networks and Machine Learning – ICANN 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We evolve both topology and synaptic weights of recurrent very small spiking neural networks in the presence of noise on the membrane potential. The noise is at a level similar to the level observed in biological neurons. The task of the networks is to recognise three signals in a particular order (a pattern ABC) in a continuous input stream in which each signal occurs with the same probability. The networks consist of adaptive exponential integrate and fire neurons and are limited to either three or four interneurons and one output neuron, with recurrent and self-connections allowed only for interneurons. Our results show that spiking neural networks evolved in the presence of noise are robust to the change of neuronal parameters. We propose a procedure to approximate the range, specific for every neuronal parameter, from which the parameters can be sampled to preserve, at least for some networks, high true positive rate and low false discovery rate. After assigning the state of neurons to states of the network corresponding to states in a finite state transducer, we show that this simple but not trivial computational task of temporal pattern recognition can be accomplished in a variety of ways.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahissar, E., Arieli, A.: Figuring space by time. Neuron 32, 185–201 (2001)CrossRef Ahissar, E., Arieli, A.: Figuring space by time. Neuron 32, 185–201 (2001)CrossRef
2.
go back to reference Anderson, J.S., Lampl, I., Gillespie, D.C., Ferster, D.: The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. Science 290, 1968–1972 (2000)CrossRef Anderson, J.S., Lampl, I., Gillespie, D.C., Ferster, D.: The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. Science 290, 1968–1972 (2000)CrossRef
3.
go back to reference Bialek, W., Rieke, F., de Ruyter van Steveninck, R.R., Warland, D., et al.: Reading a neural code. In: Neural Information Processing Systems, pp. 36–43 (1989) Bialek, W., Rieke, F., de Ruyter van Steveninck, R.R., Warland, D., et al.: Reading a neural code. In: Neural Information Processing Systems, pp. 36–43 (1989)
4.
go back to reference Burnstock, G.: Autonomic neurotransmission: 60 years since sir henry dale. Ann. Rev. Pharmacol. Toxicol. 49, 1–30 (2009)CrossRef Burnstock, G.: Autonomic neurotransmission: 60 years since sir henry dale. Ann. Rev. Pharmacol. Toxicol. 49, 1–30 (2009)CrossRef
5.
go back to reference Buzsáki, G., Chrobak, J.J.: Temporal structure in spatially organized neuronal ensembles: a role for interneuronal networks. Curr. Opin. Neurobiol. 5, 504–510 (1995)CrossRef Buzsáki, G., Chrobak, J.J.: Temporal structure in spatially organized neuronal ensembles: a role for interneuronal networks. Curr. Opin. Neurobiol. 5, 504–510 (1995)CrossRef
6.
go back to reference Decharms, R.C., Zador, A.: Neural representation and the cortical code. Ann. Rev. Neurosci. 23, 613–647 (2000)CrossRef Decharms, R.C., Zador, A.: Neural representation and the cortical code. Ann. Rev. Neurosci. 23, 613–647 (2000)CrossRef
7.
go back to reference Destexhe, A., Rudolph, M., Fellous, J.M., Sejnowski, T.: Fluctuating synaptic conductances recreate in vivo-like activity in neocortical neurons. Neuroscience 107, 13–24 (2001)CrossRef Destexhe, A., Rudolph, M., Fellous, J.M., Sejnowski, T.: Fluctuating synaptic conductances recreate in vivo-like activity in neocortical neurons. Neuroscience 107, 13–24 (2001)CrossRef
8.
go back to reference Destexhe, A., Paré, D.: Impact of network activity on the integrative properties of neocortical pyramidal neurons in vivo. J. Neurophysiol. 81, 1531–1547 (1999)CrossRef Destexhe, A., Paré, D.: Impact of network activity on the integrative properties of neocortical pyramidal neurons in vivo. J. Neurophysiol. 81, 1531–1547 (1999)CrossRef
9.
go back to reference Faisal, A.A., Selen, L.P., Wolpert, D.M.: Noise in the nervous system. Nat. Rev. Neurosci. 9, 292–303 (2008)CrossRef Faisal, A.A., Selen, L.P., Wolpert, D.M.: Noise in the nervous system. Nat. Rev. Neurosci. 9, 292–303 (2008)CrossRef
10.
go back to reference Finn, I.M., Priebe, N.J., Ferster, D.: The emergence of contrast-invariant orientation tuning in simple cells of cat visual cortex. Neuron 54, 137–152 (2007)CrossRef Finn, I.M., Priebe, N.J., Ferster, D.: The emergence of contrast-invariant orientation tuning in simple cells of cat visual cortex. Neuron 54, 137–152 (2007)CrossRef
11.
go back to reference Florian, R.V.: Biologically inspired neural networks for the control of embodied agents. Center for Cognitive and Neural Studies (Cluj-Napoca, Romania), Technical report Coneural-03-03 (2003) Florian, R.V.: Biologically inspired neural networks for the control of embodied agents. Center for Cognitive and Neural Studies (Cluj-Napoca, Romania), Technical report Coneural-03-03 (2003)
12.
go back to reference Gerstner, W., Kempter, R., van Hemmen, J.L., Wagner, H.: A neuronal learning rule for sub-millisecond temporal coding. Nature 383, 76–78 (1996)CrossRef Gerstner, W., Kempter, R., van Hemmen, J.L., Wagner, H.: A neuronal learning rule for sub-millisecond temporal coding. Nature 383, 76–78 (1996)CrossRef
13.
go back to reference Huxter, J., Burgess, N., O’keefe, J.: Independent rate and temporal coding in hippocampal pyramidal cells. Nature 425, 828–832 (2003)CrossRef Huxter, J., Burgess, N., O’keefe, J.: Independent rate and temporal coding in hippocampal pyramidal cells. Nature 425, 828–832 (2003)CrossRef
14.
go back to reference Jacobson, G., et al.: Subthreshold voltage noise of rat neocortical pyramidal neurones. J. Physiol. 564, 145–160 (2005)CrossRef Jacobson, G., et al.: Subthreshold voltage noise of rat neocortical pyramidal neurones. J. Physiol. 564, 145–160 (2005)CrossRef
15.
go back to reference Laurent, G.: Dynamical representation of odors by oscillating and evolving neural assemblies. Trends Neurosci. 19, 489–496 (1996)CrossRef Laurent, G.: Dynamical representation of odors by oscillating and evolving neural assemblies. Trends Neurosci. 19, 489–496 (1996)CrossRef
16.
go back to reference Marder, E.: Variability, compensation, and modulation in neurons and circuits. Proc. Natl. Acad. Sci. USA 108(Suppl. 3), 15542–15548 (2011)CrossRef Marder, E.: Variability, compensation, and modulation in neurons and circuits. Proc. Natl. Acad. Sci. USA 108(Suppl. 3), 15542–15548 (2011)CrossRef
17.
go back to reference Naud, R., Marcille, N., Clopath, C., Gerstner, W.: Firing patterns in the adaptive exponential integrate-and-fire model. Biol. Cybern. 99, 335–347 (2008)MathSciNetCrossRef Naud, R., Marcille, N., Clopath, C., Gerstner, W.: Firing patterns in the adaptive exponential integrate-and-fire model. Biol. Cybern. 99, 335–347 (2008)MathSciNetCrossRef
18.
go back to reference Paré, D., Shink, E., Gaudreau, H., Destexhe, A., Lang, E.J.: Impact of spontaneous synaptic activity on the resting properties of cat neocortical pyramidal neurons in vivo. J. Neurophysiol. 79, 1450–1460 (1998)CrossRef Paré, D., Shink, E., Gaudreau, H., Destexhe, A., Lang, E.J.: Impact of spontaneous synaptic activity on the resting properties of cat neocortical pyramidal neurons in vivo. J. Neurophysiol. 79, 1450–1460 (1998)CrossRef
19.
go back to reference Prinz, A.A., Bucher, D., Marder, E.: Similar network activity from disparate circuit parameters. Nat. Neurosci. 7, 1345–1352 (2004)CrossRef Prinz, A.A., Bucher, D., Marder, E.: Similar network activity from disparate circuit parameters. Nat. Neurosci. 7, 1345–1352 (2004)CrossRef
20.
go back to reference Stacey, W., Durand, D.: Stochastic resonance improves signal detection in hippocampal neurons. J. Neurophysiol. 83, 1394–402 (2000)CrossRef Stacey, W., Durand, D.: Stochastic resonance improves signal detection in hippocampal neurons. J. Neurophysiol. 83, 1394–402 (2000)CrossRef
21.
go back to reference Wiesenfeld, K., Moss, F.: Stochastic resonance and the benefits of noise: from ice ages to crayfish and squids. Nature 373, 33–36 (1995)CrossRef Wiesenfeld, K., Moss, F.: Stochastic resonance and the benefits of noise: from ice ages to crayfish and squids. Nature 373, 33–36 (1995)CrossRef
22.
23.
go back to reference Yaqoob, M., Wróbel, B.: Robust very small spiking neural networks evolved with noise to recognize temporal patterns. In: ALIFE 2018: Proceedings of the 2018 Conference on Artificial Life, pp. 665–672. MIT Press (2018) Yaqoob, M., Wróbel, B.: Robust very small spiking neural networks evolved with noise to recognize temporal patterns. In: ALIFE 2018: Proceedings of the 2018 Conference on Artificial Life, pp. 665–672. MIT Press (2018)
24.
go back to reference Yaqoob, M., Wróbel, B.: Very small spiking neural networks evolved to recognize a pattern in a continuous input stream. In: 2017 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 3496–3503. IEEE (2017) Yaqoob, M., Wróbel, B.: Very small spiking neural networks evolved to recognize a pattern in a continuous input stream. In: 2017 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 3496–3503. IEEE (2017)
Metadata
Title
Very Small Spiking Neural Networks Evolved for Temporal Pattern Recognition and Robust to Perturbed Neuronal Parameters
Authors
Muhammad Yaqoob
Borys Wróbel
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-01418-6_32

Premium Partner