Skip to main content

2014 | OriginalPaper | Buchkapitel

Comparing Metaheuristic Algorithms on the Training Process of Spiking Neural Networks

verfasst von : Andrés Espinal, Martín Carpio, Manuel Ornelas, Héctor Puga, Patricia Melin, Marco Sotelo-Figueroa

Erschienen in: Recent Advances on Hybrid Approaches for Designing Intelligent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Spiking Neural Networks are considered as the third generation of Artificial Neural Networks. In these networks, spiking neurons receive/send the information by timing of events (spikes) instead by the spike rate; as their predecessors do. Spikeprop algorithm, based on gradient descent, was developed as learning rule for training SNNs to solve pattern recognition problems; however this algorithm trends to be trapped in local minima and has several limitations. For dealing with the supervised learning on Spiking Neural Networks without the drawbacks of Spikeprop, several metaheuristics such as: Evolutionary Strategy, Particle Swarm Optimization, have been used to tune the neural parameters. This work compares the performance and the impact of some metaheuristics used for training spiking neural networks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Maass, W.: Networks of spiking neurons: the third generation of neural network models. Neural Networks 10(9), 1659–1671 (1997)CrossRef Maass, W.: Networks of spiking neurons: the third generation of neural network models. Neural Networks 10(9), 1659–1671 (1997)CrossRef
2.
Zurück zum Zitat Maass, W.: Noisy Spiking Neurons with Temporal Coding Have More Computational Power Than Sigmoidal Neurons, pp. 211–217. MIT Press, Cambridge (1996) Maass, W.: Noisy Spiking Neurons with Temporal Coding Have More Computational Power Than Sigmoidal Neurons, pp. 211–217. MIT Press, Cambridge (1996)
3.
Zurück zum Zitat Bohte, S.M., Kok, J.N., LaPoutre, H.: Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48, 17–37 (2002)CrossRefMATH Bohte, S.M., Kok, J.N., LaPoutre, H.: Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48, 17–37 (2002)CrossRefMATH
4.
Zurück zum Zitat Belatreche, A.: Biologically Inspired Neural Networks: Models, Learning, and Applications. VDM Verlag Dr. Müller, Saarbrücken (2010) Belatreche, A.: Biologically Inspired Neural Networks: Models, Learning, and Applications. VDM Verlag Dr. Müller, Saarbrücken (2010)
5.
Zurück zum Zitat Belatreche, A., Maguire, L.P., McGinnity, M., Wu, Q.X.: An evolutionary strategy for supervised training of biologically plausible neural networks. In: The Sixth International Conference on Computational Intelligence and Natural Computing (CINC), Proceedings of the 7th Joint Conference on Information Sciences. pp. 1524–1527 (2003) Belatreche, A., Maguire, L.P., McGinnity, M., Wu, Q.X.: An evolutionary strategy for supervised training of biologically plausible neural networks. In: The Sixth International Conference on Computational Intelligence and Natural Computing (CINC), Proceedings of the 7th Joint Conference on Information Sciences. pp. 1524–1527 (2003)
6.
Zurück zum Zitat Belatreche, A., Maguire, L.P., McGinnity, T.M.: Advances in design and application of spiking neural networks. Soft. Comput. 11(3), 239–248 (2007)CrossRef Belatreche, A., Maguire, L.P., McGinnity, T.M.: Advances in design and application of spiking neural networks. Soft. Comput. 11(3), 239–248 (2007)CrossRef
7.
Zurück zum Zitat Shen, H., Liu, N., Li, X., Wang, Q.: A cooperative method for supervised learning in spiking neural networks. In: CSCWD. pp. 22–26. IEEE (2010) Shen, H., Liu, N., Li, X., Wang, Q.: A cooperative method for supervised learning in spiking neural networks. In: CSCWD. pp. 22–26. IEEE (2010)
8.
Zurück zum Zitat Zurada, J.M.: Introduction to Artificial Neural Systems. West (1992) Zurada, J.M.: Introduction to Artificial Neural Systems. West (1992)
9.
Zurück zum Zitat Judd, J.S.: Neural Network Design and the Complexity of Learning. Neural Network Modeling and Connectionism Series, Massachusetts Institute Technol (1990) Judd, J.S.: Neural Network Design and the Complexity of Learning. Neural Network Modeling and Connectionism Series, Massachusetts Institute Technol (1990)
10.
11.
Zurück zum Zitat Elizondo, D., Fiesler, E.: A survey of partially connected neural networks. Int. J. Neural Syst. 8(5–6), 535–558 (1997)CrossRef Elizondo, D., Fiesler, E.: A survey of partially connected neural networks. Int. J. Neural Syst. 8(5–6), 535–558 (1997)CrossRef
12.
Zurück zum Zitat Bohte, S.M., La Poutre, H., Kok, J.N.: Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks. Neural Networks IEEE Trans. 13, 426–435 (2002)CrossRef Bohte, S.M., La Poutre, H., Kok, J.N.: Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks. Neural Networks IEEE Trans. 13, 426–435 (2002)CrossRef
13.
Zurück zum Zitat Johnson, C., Roychowdhury, S., Venayagamoorthy, G.K.: A reversibility analysis of encoding methods for spiking neural networks. In: IJCNN. pp. 1802–1809 (2011) Johnson, C., Roychowdhury, S., Venayagamoorthy, G.K.: A reversibility analysis of encoding methods for spiking neural networks. In: IJCNN. pp. 1802–1809 (2011)
14.
Zurück zum Zitat Gerstner, W., Kistler, W.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, Cambridge (2002)CrossRef Gerstner, W., Kistler, W.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, Cambridge (2002)CrossRef
15.
Zurück zum Zitat Haykin, S.: Neural Networks: Comprehensive Foundation. Prentice Hall (1999) Haykin, S.: Neural Networks: Comprehensive Foundation. Prentice Hall (1999)
16.
Zurück zum Zitat Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, New York (2012) Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, New York (2012)
17.
Zurück zum Zitat Rechenberg, I.: Evolutions Strategie: optimierung technischer systeme nach prinzipien der biologischen evolution. Frommann-Holzboog (1973) Rechenberg, I.: Evolutions Strategie: optimierung technischer systeme nach prinzipien der biologischen evolution. Frommann-Holzboog (1973)
18.
Zurück zum Zitat Kennedy, J., Eberhart, R.C.: Particle swarm optimization. IEEE Int. Conf. Neural Netw. 4, 1942–1948 (1995) Kennedy, J., Eberhart, R.C.: Particle swarm optimization. IEEE Int. Conf. Neural Netw. 4, 1942–1948 (1995)
Metadaten
Titel
Comparing Metaheuristic Algorithms on the Training Process of Spiking Neural Networks
verfasst von
Andrés Espinal
Martín Carpio
Manuel Ornelas
Héctor Puga
Patricia Melin
Marco Sotelo-Figueroa
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-05170-3_27