Skip to main content

2016 | OriginalPaper | Buchkapitel

Supervised Learning Algorithm for Spiking Neurons Based on Nonlinear Inner Products of Spike Trains

verfasst von : Xiangwen Wang, Xianghong Lin, Jichang Zhao, Huifang Ma

Erschienen in: Intelligent Computing Theories and Application

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Spiking neural networks are shown to be suitable tools for the processing of spatio-temporal information. However, due to their intricately discontinuous and implicit nonlinear mechanisms, the formulation of efficient supervised learning algorithms for spiking neural networks is difficult, which has become an important problem in the research area. This paper presents a new supervised, multi-spike learning algorithm for spiking neurons, which can implement the complex spatio-temporal pattern learning of spike trains. The proposed algorithm firstly defines nonlinear inner products operators to mathematically describe and manipulate spike trains, and then derive the learning rule from the common Widrow-Hoff rule with the nonlinear inner products of spike trains. The algorithm is successfully applied to learn sequences of spikes. The experimental results show that the proposed algorithm is effective for solving complex spatio-temporal pattern learning problems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Quiroga, R.Q., Panzeri, S.: Principles of Neural Coding. CRC Press, Boca Raton (2013)CrossRef Quiroga, R.Q., Panzeri, S.: Principles of Neural Coding. CRC Press, Boca Raton (2013)CrossRef
2.
Zurück zum Zitat Ghosh-Dastidar, S., Adeli, H.: Spiking neural networks. Int. J. Neural Syst. 19(4), 295–308 (2009)CrossRef Ghosh-Dastidar, S., Adeli, H.: Spiking neural networks. Int. J. Neural Syst. 19(4), 295–308 (2009)CrossRef
3.
Zurück zum Zitat Kasiński, A., Ponulak, F.: Comparison of supervised learning methods for spike time coding in spiking neural networks. Int. J. Appl. Math. Comput. Sci. 16(1), 101–113 (2006)MathSciNetMATH Kasiński, A., Ponulak, F.: Comparison of supervised learning methods for spike time coding in spiking neural networks. Int. J. Appl. Math. Comput. Sci. 16(1), 101–113 (2006)MathSciNetMATH
4.
Zurück zum Zitat Lin, X., Wang, X., Zhang, N., et al.: Supervised learning algorithms for spiking neural networks: a review. Acta Electronica Sinica 43(3), 577–586 (2015) Lin, X., Wang, X., Zhang, N., et al.: Supervised learning algorithms for spiking neural networks: a review. Acta Electronica Sinica 43(3), 577–586 (2015)
5.
Zurück zum Zitat Bohte, S.M., Kok, J.N., La Poutré, J.A.: Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48(1), 17–37 (2002)CrossRefMATH Bohte, S.M., Kok, J.N., La Poutré, J.A.: Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48(1), 17–37 (2002)CrossRefMATH
6.
Zurück zum Zitat Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, Cambridge (2002)CrossRefMATH Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, Cambridge (2002)CrossRefMATH
7.
Zurück zum Zitat Shrestha, S.B., Song, Q.: Adaptive learning rate of SpikeProp based on weight convergence analysis. Neural Networks 63, 185–198 (2015)CrossRefMATH Shrestha, S.B., Song, Q.: Adaptive learning rate of SpikeProp based on weight convergence analysis. Neural Networks 63, 185–198 (2015)CrossRefMATH
8.
Zurück zum Zitat Ghosh-Dastidar, S., Adeli, H.: A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection. Neural Networks 22(10), 1419–1431 (2009)CrossRef Ghosh-Dastidar, S., Adeli, H.: A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection. Neural Networks 22(10), 1419–1431 (2009)CrossRef
9.
Zurück zum Zitat Xu, Y., Zeng, X., Han, L., et al.: A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks. Neural Networks 43, 99–113 (2013)CrossRefMATH Xu, Y., Zeng, X., Han, L., et al.: A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks. Neural Networks 43, 99–113 (2013)CrossRefMATH
10.
Zurück zum Zitat Ponulak, F., Kasinski, A.: Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification, and spike shifting. Neural Comput. 22(2), 467–510 (2010)MathSciNetCrossRefMATH Ponulak, F., Kasinski, A.: Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification, and spike shifting. Neural Comput. 22(2), 467–510 (2010)MathSciNetCrossRefMATH
11.
Zurück zum Zitat Ponulak, F.: Analysis of the ReSuMe learning process for spiking neural networks. Int. J. Appl. Math. Comput. Sci. 18(2), 117–127 (2008)MathSciNetCrossRef Ponulak, F.: Analysis of the ReSuMe learning process for spiking neural networks. Int. J. Appl. Math. Comput. Sci. 18(2), 117–127 (2008)MathSciNetCrossRef
12.
13.
Zurück zum Zitat Taherkhani, A., Belatreche, A., Li, Y., et al.: DL-ReSuMe: a delay learning-based remote supervised method for spiking neurons. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 3137–3149 (2015)MathSciNetCrossRef Taherkhani, A., Belatreche, A., Li, Y., et al.: DL-ReSuMe: a delay learning-based remote supervised method for spiking neurons. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 3137–3149 (2015)MathSciNetCrossRef
14.
Zurück zum Zitat Taherkhani, A., Belatreche, A., Li, Y., et al.: Multi-DL-ReSuMe: multiple neurons delay learning remote supervised method. In: 2015 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE (2015) Taherkhani, A., Belatreche, A., Li, Y., et al.: Multi-DL-ReSuMe: multiple neurons delay learning remote supervised method. In: 2015 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE (2015)
15.
Zurück zum Zitat Mohemmed, A., Schliebs, S., Matsuda, S., et al.: SPAN: spike pattern association neuron for learning spatio-temporal spike patterns. Int. J. Neural Syst. 22(4), 786–803 (2012)CrossRef Mohemmed, A., Schliebs, S., Matsuda, S., et al.: SPAN: spike pattern association neuron for learning spatio-temporal spike patterns. Int. J. Neural Syst. 22(4), 786–803 (2012)CrossRef
16.
Zurück zum Zitat Mohemmed, A., Schliebs, S., Matsuda, S., et al.: Training spiking neural networks to associate spatio-temporal input–output spike patterns. Neurocomputing 107, 3–10 (2013)CrossRef Mohemmed, A., Schliebs, S., Matsuda, S., et al.: Training spiking neural networks to associate spatio-temporal input–output spike patterns. Neurocomputing 107, 3–10 (2013)CrossRef
17.
Zurück zum Zitat Yu, Q., Tang, H., Tan, K.C., et al.: Precise-spike-driven synaptic plasticity: learning hetero-association of spatiotemporal spike patterns. PLoS One 8(11), e78318 (2013)CrossRef Yu, Q., Tang, H., Tan, K.C., et al.: Precise-spike-driven synaptic plasticity: learning hetero-association of spatiotemporal spike patterns. PLoS One 8(11), e78318 (2013)CrossRef
18.
Zurück zum Zitat Yu, Q., Tang, H., Tan, K.C., et al.: A brain-inspired spiking neural network model with temporal encoding and learning. Neurocomputing 138, 3–13 (2014)CrossRef Yu, Q., Tang, H., Tan, K.C., et al.: A brain-inspired spiking neural network model with temporal encoding and learning. Neurocomputing 138, 3–13 (2014)CrossRef
19.
Zurück zum Zitat Park, I.M., Seth, S., Rao, M., et al.: Strictly positive-definite spike train kernels for point-process divergences. Neural Comput. 24(8), 2223–2250 (2012)MathSciNetCrossRefMATH Park, I.M., Seth, S., Rao, M., et al.: Strictly positive-definite spike train kernels for point-process divergences. Neural Comput. 24(8), 2223–2250 (2012)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Paiva, A.R.C., Park, I., Principe, J.C.: Inner products for representation and learning in the spike train domain. In: Statistical Signal Processing for Neuroscience and Neurotechnology, vol. 8 (2010) Paiva, A.R.C., Park, I., Principe, J.C.: Inner products for representation and learning in the spike train domain. In: Statistical Signal Processing for Neuroscience and Neurotechnology, vol. 8 (2010)
21.
Zurück zum Zitat Gütig, R., Aharonov, R., Rotter, S., et al.: Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J. Neurosci. 23(9), 3697–3714 (2003) Gütig, R., Aharonov, R., Rotter, S., et al.: Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J. Neurosci. 23(9), 3697–3714 (2003)
22.
Zurück zum Zitat Schreiber, S., Fellous, J.M., Whitmer, D., et al.: A new correlation-based measure of spike timing reliability. Neurocomputing 52, 925–931 (2003)CrossRef Schreiber, S., Fellous, J.M., Whitmer, D., et al.: A new correlation-based measure of spike timing reliability. Neurocomputing 52, 925–931 (2003)CrossRef
Metadaten
Titel
Supervised Learning Algorithm for Spiking Neurons Based on Nonlinear Inner Products of Spike Trains
verfasst von
Xiangwen Wang
Xianghong Lin
Jichang Zhao
Huifang Ma
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-42294-7_8