Skip to main content
Erschienen in: Soft Computing 12/2009

01.10.2009 | Focus

Second order spiking perceptrons

verfasst von: Xuyan Xiang, Yingchun Deng, Xiangqun Yang

Erschienen in: Soft Computing | Ausgabe 12/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

According to the diffusion approximation and usual approximation scheme, we present two more biologically plausible so called second order spiking perceptron (SOSP) and extended second order spiking perceptron (ESOSP) based on the integrate-and-fire model with renewal process inputs, which employ both first and second statistical representation, i.e., the means, variances and correlations of the synaptic input. We show through various examples that such perceptrons, even a single neuron, are able to perform various complex non-linear tasks like the XOR problem, which is impossible to be solved by traditional single-layer perceptrons. Here our perceptrons offer a significant advantage over classical models, in that they include the second order statistics in computations, specially in that the ESOSP considers the learning of variance in the training. Our ultimate purpose is to open up the possibility of carrying out a stochastic computation in neuronal networks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
The coefficient of variation, \(CV=\sqrt{{\frac{TT}{(T)^2}}}\) , quantifies the irregularity of a spike train. If CV = 0, the spike train is regular, otherwise it is stochastic. In simulations, the initial value of CV is used to initialize the variance of ISIs in the input layer.
 
Literatur
Zurück zum Zitat Abbott LF, Varela JA, Sen K et al (1997) Synaptic depression and cortical gain control. Science 275:220–223CrossRef Abbott LF, Varela JA, Sen K et al (1997) Synaptic depression and cortical gain control. Science 275:220–223CrossRef
Zurück zum Zitat Bohte SM, Kok Joost NJN, La Poutre Han H (2002) Errorbackpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48(1–4):17–37MATHCrossRef Bohte SM, Kok Joost NJN, La Poutre Han H (2002) Errorbackpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48(1–4):17–37MATHCrossRef
Zurück zum Zitat Brunel N (2000) Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci 8:183–208MATHCrossRef Brunel N (2000) Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci 8:183–208MATHCrossRef
Zurück zum Zitat Fairhall AL, Lewen GD, Bialek W et al (2002) Efficiency and ambiguity in an adaptive neural code. Nature 412:787–792CrossRef Fairhall AL, Lewen GD, Bialek W et al (2002) Efficiency and ambiguity in an adaptive neural code. Nature 412:787–792CrossRef
Zurück zum Zitat Feng JF (2003) Computational neuroscience—a comprehensive approach. CRC Press, Chapman-Hall Feng JF (2003) Computational neuroscience—a comprehensive approach. CRC Press, Chapman-Hall
Zurück zum Zitat Feng JF, Brown D (2000) Impact of correlated inputs on the output of the integrate-and-fire models. Neural Comput 12:671–692CrossRef Feng JF, Brown D (2000) Impact of correlated inputs on the output of the integrate-and-fire models. Neural Comput 12:671–692CrossRef
Zurück zum Zitat Feng JF, Tuckwell HC (2003) Optimal control of neuronal activity. Phys Rev Lett 91:018101CrossRef Feng JF, Tuckwell HC (2003) Optimal control of neuronal activity. Phys Rev Lett 91:018101CrossRef
Zurück zum Zitat Gerstner W, Kistler W (2003) Spiking neuron models. Cambridge University Press, Cambridge Gerstner W, Kistler W (2003) Spiking neuron models. Cambridge University Press, Cambridge
Zurück zum Zitat Leng G, Brown CH, Bull PM et al (2001) Responses of magnocellular neurons to osmotic stimulation involves coactivation of excitatory and inhibitory input: an experimental and theoretical analysis. J Neurosci 21:6967–6977 Leng G, Brown CH, Bull PM et al (2001) Responses of magnocellular neurons to osmotic stimulation involves coactivation of excitatory and inhibitory input: an experimental and theoretical analysis. J Neurosci 21:6967–6977
Zurück zum Zitat Liu F, Feng JF, Wang W (2003) Impact of Poisson synaptic inputs with a changing rate on weak signal processing. Europhys Lett 64:131–136CrossRefMathSciNet Liu F, Feng JF, Wang W (2003) Impact of Poisson synaptic inputs with a changing rate on weak signal processing. Europhys Lett 64:131–136CrossRefMathSciNet
Zurück zum Zitat Matthews PBC (1996) Relationship of firing intervals of human motor units to the trajectory of post-spike after-hyperpolarization and synaptic noise. J Physiol 492:596–628 Matthews PBC (1996) Relationship of firing intervals of human motor units to the trajectory of post-spike after-hyperpolarization and synaptic noise. J Physiol 492:596–628
Zurück zum Zitat Pavlidis NG, Tasoulis DK, Plagianakos VP et al (2005) Neural network training using evolutionary algorithms. In: Proceedings of international joint conference on neural networks (IJCNN’05) Pavlidis NG, Tasoulis DK, Plagianakos VP et al (2005) Neural network training using evolutionary algorithms. In: Proceedings of international joint conference on neural networks (IJCNN’05)
Zurück zum Zitat Salinas E, Sejnowski TJ (2001) Correlated neuronal activity and the flow of neural information. Nat Rev Neurosci 2:539–550CrossRef Salinas E, Sejnowski TJ (2001) Correlated neuronal activity and the flow of neural information. Nat Rev Neurosci 2:539–550CrossRef
Zurück zum Zitat Sompolinsky H, Yoon H, Kang KJ et al (2001) Population coding in neuronal systems with correlated noise. Phys Rev E 64(5): 051904CrossRef Sompolinsky H, Yoon H, Kang KJ et al (2001) Population coding in neuronal systems with correlated noise. Phys Rev E 64(5): 051904CrossRef
Zurück zum Zitat Tuckwell HC (1988) Introduction to theoretical neurobiology. Cambridge University Press, Cambridge Tuckwell HC (1988) Introduction to theoretical neurobiology. Cambridge University Press, Cambridge
Metadaten
Titel
Second order spiking perceptrons
verfasst von
Xuyan Xiang
Yingchun Deng
Xiangqun Yang
Publikationsdatum
01.10.2009
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 12/2009
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-009-0415-3

Weitere Artikel der Ausgabe 12/2009

Soft Computing 12/2009 Zur Ausgabe

Editorial

Editorial