Skip to main content

2016 | OriginalPaper | Buchkapitel

Synaptogenesis: Constraining Synaptic Plasticity Based on a Distance Rule

verfasst von : Jordi-Ysard Puigbò, Joeri van Wijngaarden, Sock Ching Low, Paul F. M. J. Verschure

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Neural models, artificial or biologically grounded, have been used for understanding the nature of learning mechanisms as well as for applied tasks. The study of such learning systems has been typically centered on the identification or extraction of the most relevant features that will help to solve a task. Recently, convolutional networks, deep architectures and huge reservoirs have shown impressive results in tasks ranging from speech recognition to visual classification or emotion perception. With the accumulated momentum of such large-scale architectures, the importance of imposing sparsity on the networks to differentiate contexts has been rising. We present a biologically grounded system that imposes physical and local constraints to these architectures in the form of synaptogenesis, or synapse generation. This method guarantees sparsity and promotes the acquisition of experience-relevant, topologically-organized and more diverse features.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Schrauwen, B., Verstraeten, D., Van Campenhout, J.: An overview of reservoir computing: theory, applications and implementations. In: 15th European Symposium on Artificial Neural Networks, pp. 471–482 (2007) Schrauwen, B., Verstraeten, D., Van Campenhout, J.: An overview of reservoir computing: theory, applications and implementations. In: 15th European Symposium on Artificial Neural Networks, pp. 471–482 (2007)
2.
Zurück zum Zitat Markov, N., Misery, P., Falchier, A., Lamy, C., Vezoli, J., Quilodran, R., Gariel, M., Giroud, P., Ercsey-Ravasz, M., Pilaz, L., et al.: Weight consistency specifies regularities of macaque cortical networks. Cereb. Cortex 21(6), 1254–1272 (2011)CrossRef Markov, N., Misery, P., Falchier, A., Lamy, C., Vezoli, J., Quilodran, R., Gariel, M., Giroud, P., Ercsey-Ravasz, M., Pilaz, L., et al.: Weight consistency specifies regularities of macaque cortical networks. Cereb. Cortex 21(6), 1254–1272 (2011)CrossRef
3.
Zurück zum Zitat Ercsey-Ravasz, M., Markov, N.T., Lamy, C., Van Essen, D.C., Knoblauch, K., Toroczkai, Z., Kennedy, H.: A predictive network model of cerebral cortical connectivity based on a distance rule. Neuron 80(1), 184–197 (2013)CrossRef Ercsey-Ravasz, M., Markov, N.T., Lamy, C., Van Essen, D.C., Knoblauch, K., Toroczkai, Z., Kennedy, H.: A predictive network model of cerebral cortical connectivity based on a distance rule. Neuron 80(1), 184–197 (2013)CrossRef
4.
Zurück zum Zitat Luskin, M.B.: Restricted proliferation and migration of postnatally generated neurons derived from the forebrain subventricular zone. Neuron 11(1), 173–189 (1993)CrossRef Luskin, M.B.: Restricted proliferation and migration of postnatally generated neurons derived from the forebrain subventricular zone. Neuron 11(1), 173–189 (1993)CrossRef
5.
Zurück zum Zitat Kuhn, H.G., Dickinson-Anson, H., Gage, F.H.: Neurogenesis in the dentate gyrus of the adult rat: age-related decrease of neuronal progenitor proliferation. J. Neurosci. 16(6), 2027–2033 (1996) Kuhn, H.G., Dickinson-Anson, H., Gage, F.H.: Neurogenesis in the dentate gyrus of the adult rat: age-related decrease of neuronal progenitor proliferation. J. Neurosci. 16(6), 2027–2033 (1996)
6.
Zurück zum Zitat Kelsch, W., Sim, S., Lois, C.: Watching synaptogenesis in the adult brain. Ann. Rev. Neurosci. 33, 131–149 (2010)CrossRef Kelsch, W., Sim, S., Lois, C.: Watching synaptogenesis in the adult brain. Ann. Rev. Neurosci. 33, 131–149 (2010)CrossRef
7.
Zurück zum Zitat Wang, K., Shamma, S.A., Byrne, W.J.: Noise robustness in the auditory representation of speech signals. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1993, vol. 2, pp. 335–338. IEEE (1993) Wang, K., Shamma, S.A., Byrne, W.J.: Noise robustness in the auditory representation of speech signals. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1993, vol. 2, pp. 335–338. IEEE (1993)
8.
Zurück zum Zitat Izhikevich, E.M., et al.: Simple model of spiking neurons. IEEE Trans. Neural Netw. 14(6), 1569–1572 (2003)MathSciNetCrossRef Izhikevich, E.M., et al.: Simple model of spiking neurons. IEEE Trans. Neural Netw. 14(6), 1569–1572 (2003)MathSciNetCrossRef
9.
Zurück zum Zitat Song, S., Miller, K.D., Abbott, L.F.: Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3(9), 919–926 (2000)CrossRef Song, S., Miller, K.D., Abbott, L.F.: Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3(9), 919–926 (2000)CrossRef
10.
Zurück zum Zitat Abbott, L., Gerstner, W.: Homeostasis and learning through spike-timing dependent plasticity. In: Summer School in Neurophzsics, no. LCN-PRESENTATION-2007-001 (2003) Abbott, L., Gerstner, W.: Homeostasis and learning through spike-timing dependent plasticity. In: Summer School in Neurophzsics, no. LCN-PRESENTATION-2007-001 (2003)
11.
Zurück zum Zitat Wang, K., Shamma, S.: Self-normalization and noise-robustness in early auditory representations. IEEE Trans. Speech Audio Process. 2(3), 421–435 (1994)CrossRef Wang, K., Shamma, S.: Self-normalization and noise-robustness in early auditory representations. IEEE Trans. Speech Audio Process. 2(3), 421–435 (1994)CrossRef
Metadaten
Titel
Synaptogenesis: Constraining Synaptic Plasticity Based on a Distance Rule
verfasst von
Jordi-Ysard Puigbò
Joeri van Wijngaarden
Sock Ching Low
Paul F. M. J. Verschure
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-44778-0_4

Premium Partner