Skip to main content
Top

2020 | OriginalPaper | Chapter

The Hierarchical Memory Based on Compartmental Spiking Neuron Model

Authors : Aleksandr Bakhshiev, Anton Korsakov, Lev Stankevich

Published in: Artificial General Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper proposes the architecture of dynamically changing hierarchical memory based on compartmental spiking neuron model. The aim of the study is to create biologically-inspired memory models suitable for implementing the processes of features memorizing and high-level concepts. The presented architecture allows us to describe the bidirectional hierarchical structure of associative concepts related both in terms of generality and in terms of part-whole, with the ability to restore information both in the direction of generalization and in the direction of decomposition of the general concept into its component parts. A feature of the implementation is the use of a compartmental neuron model, which allows the use of a neuron to memorize objects by adding new sections of the dendritic tree. This opens the possibility of creating neural structures that are adaptive to significant changes in the environment.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Squire, L.R.: Memory systems of the brain: A brief history and current perspective. Neurobiol. Learn. Mem. 82,171–177 (2004) Squire, L.R.: Memory systems of the brain: A brief history and current perspective. Neurobiol. Learn. Mem. 82,171–177 (2004)
2.
go back to reference Rani, S.S., Nagendra Rao, D., Vatsal, S.: Review on neural networks associative memory models. Int. J. Pure Appl. Math. 120(6), 3143–3154 (2018) Rani, S.S., Nagendra Rao, D., Vatsal, S.: Review on neural networks associative memory models. Int. J. Pure Appl. Math. 120(6), 3143–3154 (2018)
3.
go back to reference Shrestha, A., Mahmood, A.: Review of deep learning algorithms and architectures. Inst. Elec. Electron. Eng. Inc. 7, 53040–53065 (2019) Shrestha, A., Mahmood, A.: Review of deep learning algorithms and architectures. Inst. Elec. Electron. Eng. Inc. 7, 53040–53065 (2019)
4.
go back to reference Marcus, G.: Deep Learning: A Critical Appraisal, pp. 1–27 (2018) Marcus, G.: Deep Learning: A Critical Appraisal, pp. 1–27 (2018)
5.
go back to reference Hopfield, J.J.:  Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982) Hopfield, J.J.:  Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982)
6.
go back to reference Kosko, B.: Competitive adaptive bi-directional associative memories. In: Caudill M., Butler C. (eds.) Proceedings of the IEEE First International Conference on Neural Networks, San Diego, vol. 2, pp. 759–766 (1987c) Kosko, B.: Competitive adaptive bi-directional associative memories. In: Caudill M., Butler C. (eds.) Proceedings of the IEEE First International Conference on Neural Networks, San Diego, vol. 2, pp. 759–766 (1987c)
7.
go back to reference Hochreiter, S.: Long short-term memory, 1780, 1735–1780 (1997) Hochreiter, S.: Long short-term memory, 1780, 1735–1780 (1997)
8.
go back to reference Tavanaei, A., Ghodrati, M., Kheradpisheh, S.R., Masquelier, T., Maida, A.: Deep learning in spiking neural networks. Neural Netw. 111, 47–63 (2019)CrossRef Tavanaei, A., Ghodrati, M., Kheradpisheh, S.R., Masquelier, T., Maida, A.: Deep learning in spiking neural networks. Neural Netw. 111, 47–63 (2019)CrossRef
9.
go back to reference Bellec, G., Salaj, D., Subramoney, A., Legenstein, R., Maass, W.: Long short-term memory and learning-to-learn in networks of spiking neurons. In: Advances in Neural Information Processing Systems, vol. 2018, pp. 787–797, December 2018 Bellec, G., Salaj, D., Subramoney, A., Legenstein, R., Maass, W.: Long short-term memory and learning-to-learn in networks of spiking neurons. In: Advances in Neural Information Processing Systems, vol. 2018, pp. 787–797, December 2018
10.
go back to reference Poirazi, P., Mel, B.W.: Impact of active dendrites and structural plasticity on the memory capacity of neural tissue. Neuron 29(3), 779–796 (2001)CrossRef Poirazi, P., Mel, B.W.: Impact of active dendrites and structural plasticity on the memory capacity of neural tissue. Neuron 29(3), 779–796 (2001)CrossRef
11.
go back to reference Bakhshiev, A.V., Gundelakh F.V.: Mathematical model of the impulses transformation processes in natural neurons for biologically inspired control systems development. In: Supplementary Proceedings of the 4th International Conference on Analysis of Images, Social Networks and Texts (AIST-SUP 2015), Yekaterinburg, Russia, 9–11 April 2015, vol. 1452, pp. 1–12. CEUR-WS, 15 October 2015. http://ceur-ws.org/Vol-1452/ Bakhshiev, A.V., Gundelakh F.V.: Mathematical model of the impulses transformation processes in natural neurons for biologically inspired control systems development. In: Supplementary Proceedings of the 4th International Conference on Analysis of Images, Social Networks and Texts (AIST-SUP 2015), Yekaterinburg, Russia, 9–11 April 2015, vol. 1452, pp. 1–12. CEUR-WS, 15 October 2015. http://​ceur-ws.​org/​Vol-1452/​
Metadata
Title
The Hierarchical Memory Based on Compartmental Spiking Neuron Model
Authors
Aleksandr Bakhshiev
Anton Korsakov
Lev Stankevich
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-52152-3_4

Premium Partner