Skip to main content

2020 | OriginalPaper | Buchkapitel

The Hierarchical Memory Based on Compartmental Spiking Neuron Model

verfasst von : Aleksandr Bakhshiev, Anton Korsakov, Lev Stankevich

Erschienen in: Artificial General Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper proposes the architecture of dynamically changing hierarchical memory based on compartmental spiking neuron model. The aim of the study is to create biologically-inspired memory models suitable for implementing the processes of features memorizing and high-level concepts. The presented architecture allows us to describe the bidirectional hierarchical structure of associative concepts related both in terms of generality and in terms of part-whole, with the ability to restore information both in the direction of generalization and in the direction of decomposition of the general concept into its component parts. A feature of the implementation is the use of a compartmental neuron model, which allows the use of a neuron to memorize objects by adding new sections of the dendritic tree. This opens the possibility of creating neural structures that are adaptive to significant changes in the environment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Squire, L.R.: Memory systems of the brain: A brief history and current perspective. Neurobiol. Learn. Mem. 82,171–177 (2004) Squire, L.R.: Memory systems of the brain: A brief history and current perspective. Neurobiol. Learn. Mem. 82,171–177 (2004)
2.
Zurück zum Zitat Rani, S.S., Nagendra Rao, D., Vatsal, S.: Review on neural networks associative memory models. Int. J. Pure Appl. Math. 120(6), 3143–3154 (2018) Rani, S.S., Nagendra Rao, D., Vatsal, S.: Review on neural networks associative memory models. Int. J. Pure Appl. Math. 120(6), 3143–3154 (2018)
3.
Zurück zum Zitat Shrestha, A., Mahmood, A.: Review of deep learning algorithms and architectures. Inst. Elec. Electron. Eng. Inc. 7, 53040–53065 (2019) Shrestha, A., Mahmood, A.: Review of deep learning algorithms and architectures. Inst. Elec. Electron. Eng. Inc. 7, 53040–53065 (2019)
4.
Zurück zum Zitat Marcus, G.: Deep Learning: A Critical Appraisal, pp. 1–27 (2018) Marcus, G.: Deep Learning: A Critical Appraisal, pp. 1–27 (2018)
5.
Zurück zum Zitat Hopfield, J.J.:  Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982) Hopfield, J.J.:  Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982)
6.
Zurück zum Zitat Kosko, B.: Competitive adaptive bi-directional associative memories. In: Caudill M., Butler C. (eds.) Proceedings of the IEEE First International Conference on Neural Networks, San Diego, vol. 2, pp. 759–766 (1987c) Kosko, B.: Competitive adaptive bi-directional associative memories. In: Caudill M., Butler C. (eds.) Proceedings of the IEEE First International Conference on Neural Networks, San Diego, vol. 2, pp. 759–766 (1987c)
7.
Zurück zum Zitat Hochreiter, S.: Long short-term memory, 1780, 1735–1780 (1997) Hochreiter, S.: Long short-term memory, 1780, 1735–1780 (1997)
8.
Zurück zum Zitat Tavanaei, A., Ghodrati, M., Kheradpisheh, S.R., Masquelier, T., Maida, A.: Deep learning in spiking neural networks. Neural Netw. 111, 47–63 (2019)CrossRef Tavanaei, A., Ghodrati, M., Kheradpisheh, S.R., Masquelier, T., Maida, A.: Deep learning in spiking neural networks. Neural Netw. 111, 47–63 (2019)CrossRef
9.
Zurück zum Zitat Bellec, G., Salaj, D., Subramoney, A., Legenstein, R., Maass, W.: Long short-term memory and learning-to-learn in networks of spiking neurons. In: Advances in Neural Information Processing Systems, vol. 2018, pp. 787–797, December 2018 Bellec, G., Salaj, D., Subramoney, A., Legenstein, R., Maass, W.: Long short-term memory and learning-to-learn in networks of spiking neurons. In: Advances in Neural Information Processing Systems, vol. 2018, pp. 787–797, December 2018
10.
Zurück zum Zitat Poirazi, P., Mel, B.W.: Impact of active dendrites and structural plasticity on the memory capacity of neural tissue. Neuron 29(3), 779–796 (2001)CrossRef Poirazi, P., Mel, B.W.: Impact of active dendrites and structural plasticity on the memory capacity of neural tissue. Neuron 29(3), 779–796 (2001)CrossRef
11.
Zurück zum Zitat Bakhshiev, A.V., Gundelakh F.V.: Mathematical model of the impulses transformation processes in natural neurons for biologically inspired control systems development. In: Supplementary Proceedings of the 4th International Conference on Analysis of Images, Social Networks and Texts (AIST-SUP 2015), Yekaterinburg, Russia, 9–11 April 2015, vol. 1452, pp. 1–12. CEUR-WS, 15 October 2015. http://ceur-ws.org/Vol-1452/ Bakhshiev, A.V., Gundelakh F.V.: Mathematical model of the impulses transformation processes in natural neurons for biologically inspired control systems development. In: Supplementary Proceedings of the 4th International Conference on Analysis of Images, Social Networks and Texts (AIST-SUP 2015), Yekaterinburg, Russia, 9–11 April 2015, vol. 1452, pp. 1–12. CEUR-WS, 15 October 2015. http://​ceur-ws.​org/​Vol-1452/​
Metadaten
Titel
The Hierarchical Memory Based on Compartmental Spiking Neuron Model
verfasst von
Aleksandr Bakhshiev
Anton Korsakov
Lev Stankevich
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-52152-3_4

Premium Partner