Skip to main content
Erschienen in: Cognitive Neurodynamics 4/2010

01.12.2010 | Research Article

Functional model of biological neural networks

verfasst von: James Ting-Ho Lo

Erschienen in: Cognitive Neurodynamics | Ausgabe 4/2010

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A functional model of biological neural networks, called temporal hierarchical probabilistic associative memory (THPAM), is proposed in this paper. THPAM comprises functional models of dendritic trees for encoding inputs to neurons, a first type of neuron for generating spike trains, a second type of neuron for generating graded signals to modulate neurons of the first type, supervised and unsupervised Hebbian learning mechanisms for easy learning and retrieving, an arrangement of dendritic trees for maximizing generalization, hardwiring for rotation-translation-scaling invariance, and feedback connections with different delay durations for neurons to make full use of present and past informations generated by neurons in the same and higher layers. These functional models and their processing operations have many functions of biological neural networks that have not been achieved by other models in the open literature and provide logically coherent answers to many long-standing neuroscientific questions. However, biological justifications of these functional models and their processing operations are required for THPAM to qualify as a macroscopic model (or low-order approximate) of biological neural networks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Arbib MA (2003) The handbook of brain theory and neural networks, 2nd edn. The MIT Press, Cambridge Arbib MA (2003) The handbook of brain theory and neural networks, 2nd edn. The MIT Press, Cambridge
Zurück zum Zitat Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Advances in neural information processing systems. The handbook of brain theory and neural networks, MIT Press, Cambridge Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Advances in neural information processing systems. The handbook of brain theory and neural networks, MIT Press, Cambridge
Zurück zum Zitat Bengio Y, LeCun Y (2007) Scaling learning algorithms towards AI. In: Bottou et al. (eds) Large-scale kernel machines. The MIT Press, Cambridge Bengio Y, LeCun Y (2007) Scaling learning algorithms towards AI. In: Bottou et al. (eds) Large-scale kernel machines. The MIT Press, Cambridge
Zurück zum Zitat Bishop CM (2006) Pattern recognition and machine learning. Springer Science, New York Bishop CM (2006) Pattern recognition and machine learning. Springer Science, New York
Zurück zum Zitat Dayan P, Abbott LF (2001) Theoretical neuroscience: computational and mathematical modeling of neural systems. The MIT Press, Cambridge Dayan P, Abbott LF (2001) Theoretical neuroscience: computational and mathematical modeling of neural systems. The MIT Press, Cambridge
Zurück zum Zitat Desjardins G, Bengio Y (2008) Empirical evaluation of convolutional rbms for vision. Technical Report 1327, Département d’Informatique et de Recherche Opérationnelle, Université de Montréal Desjardins G, Bengio Y (2008) Empirical evaluation of convolutional rbms for vision. Technical Report 1327, Département d’Informatique et de Recherche Opérationnelle, Université de Montréal
Zurück zum Zitat Erhan D, Bengio Y, Courville A, Manzagol P, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res Appear Erhan D, Bengio Y, Courville A, Manzagol P, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res Appear
Zurück zum Zitat Fromherz P, Gaede V (1993) Exclusive-or function of single arborized neuron. Biol Cybern 69:337–334CrossRefPubMed Fromherz P, Gaede V (1993) Exclusive-or function of single arborized neuron. Biol Cybern 69:337–334CrossRefPubMed
Zurück zum Zitat Geist J, Wilkinson R, Janet S, Grother P, Hammond B, Larsen N, Klear R, Matsko M, Burges C, Creecy R, Hull J, Vogl, Wilson C (1994) The second census optical charater recognition systems conference. Technical Report NIST 5452, National Institute of Standards and Technology, May 1994 Geist J, Wilkinson R, Janet S, Grother P, Hammond B, Larsen N, Klear R, Matsko M, Burges C, Creecy R, Hull J, Vogl, Wilson C (1994) The second census optical charater recognition systems conference. Technical Report NIST 5452, National Institute of Standards and Technology, May 1994
Zurück zum Zitat George D, Hawkins J (2009) Towards a mathematical theory of cortical micro-circuits. PLoS Comput Biol 5–10:1–26CrossRef George D, Hawkins J (2009) Towards a mathematical theory of cortical micro-circuits. PLoS Comput Biol 5–10:1–26CrossRef
Zurück zum Zitat Granger R (2006) Engines of the brain: the computational instruction set of human cognition. AI Mag 27:15–31 Granger R (2006) Engines of the brain: the computational instruction set of human cognition. AI Mag 27:15–31
Zurück zum Zitat Grossberg S (2007) Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. Prog Brain Res 165:79–104CrossRefPubMed Grossberg S (2007) Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. Prog Brain Res 165:79–104CrossRefPubMed
Zurück zum Zitat Hassoun MH (1993) Associative neural memories, theory and implementation. Oxford University Press, New York Hassoun MH (1993) Associative neural memories, theory and implementation. Oxford University Press, New York
Zurück zum Zitat Hawkins J (2004) On intelligence. Henry Holt and Company, New York Hawkins J (2004) On intelligence. Henry Holt and Company, New York
Zurück zum Zitat Haykin S (2009) Neural networks and learning machine, 3rd edn. Pretice Hall, Upper Saddle River Haykin S (2009) Neural networks and learning machine, 3rd edn. Pretice Hall, Upper Saddle River
Zurück zum Zitat Hecht-Nielsen R (2007) Confabulation theory. Springer, New York Hecht-Nielsen R (2007) Confabulation theory. Springer, New York
Zurück zum Zitat Hecht-Nielsen R, McKenna T (2003) Computational models for neuroscience. Springer, New York Hecht-Nielsen R, McKenna T (2003) Computational models for neuroscience. Springer, New York
Zurück zum Zitat Hinton GE, Anderson JA (1989) Parallel models of associative memory. Lawrence Erlbaum Associates, Hllsdale Hinton GE, Anderson JA (1989) Parallel models of associative memory. Lawrence Erlbaum Associates, Hllsdale
Zurück zum Zitat Hinton GE, Osindero S, Teh Y (2006) A fast learning algorithm for deep belief nets. Neural Comput 313:504–507 Hinton GE, Osindero S, Teh Y (2006) A fast learning algorithm for deep belief nets. Neural Comput 313:504–507
Zurück zum Zitat Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 18:1527–1554 Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 18:1527–1554
Zurück zum Zitat Kandel ER, Schwartz JH, Jessell TM (2000) Principles of neural science. McGraw-Hill, New York Kandel ER, Schwartz JH, Jessell TM (2000) Principles of neural science. McGraw-Hill, New York
Zurück zum Zitat Koch C (1999) Biophysics of computation. Oxford University Press, Oxford Koch C (1999) Biophysics of computation. Oxford University Press, Oxford
Zurück zum Zitat Kohonen T (1988) Self-organization and associative memory. Springer, New York Kohonen T (1988) Self-organization and associative memory. Springer, New York
Zurück zum Zitat LeCun Y, Bose B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1–4:541–551CrossRef LeCun Y, Bose B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1–4:541–551CrossRef
Zurück zum Zitat LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. In: Proceedings of The IEEE 86(11):2278–2324 LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. In: Proceedings of The IEEE 86(11):2278–2324
Zurück zum Zitat Levitan IB, Kaczmarek LK (1993) Simulated annealing and boltzmann machines. Wiley, London Levitan IB, Kaczmarek LK (1993) Simulated annealing and boltzmann machines. Wiley, London
Zurück zum Zitat Martin KAC (2002) Microcircuits in visual cortex. Curr Opinion Neurobiol 12–4:418–425CrossRef Martin KAC (2002) Microcircuits in visual cortex. Curr Opinion Neurobiol 12–4:418–425CrossRef
Zurück zum Zitat Mel BW (1994) Information processing in dendritic trees. Neural Comput 6:1031–1085CrossRef Mel BW (1994) Information processing in dendritic trees. Neural Comput 6:1031–1085CrossRef
Zurück zum Zitat Mel BW (2002) Have we been hebbing down the wrong path? Neuron 34:275–288CrossRef Mel BW (2002) Have we been hebbing down the wrong path? Neuron 34:275–288CrossRef
Zurück zum Zitat Mountcastle VB (1978) An organizing principle for cerebral function: the unit model and the distributed system. In: Edelman GM, Mountcastle VB (eds) The mindful brain. MIT Press, Cambridge Mountcastle VB (1978) An organizing principle for cerebral function: the unit model and the distributed system. In: Edelman GM, Mountcastle VB (eds) The mindful brain. MIT Press, Cambridge
Zurück zum Zitat Oja E (1982) A simplified neuron nodel as a principal component analyzer. J Math Biol 15:267–273CrossRefPubMed Oja E (1982) A simplified neuron nodel as a principal component analyzer. J Math Biol 15:267–273CrossRefPubMed
Zurück zum Zitat O’Reilly R, Munakata Y (2000) Computational explorations in cognitive neuroscience. The MIT Press, Cambridge O’Reilly R, Munakata Y (2000) Computational explorations in cognitive neuroscience. The MIT Press, Cambridge
Zurück zum Zitat Principe JC, Euliano NR, Lefebvre WC (2000) Neural and adaptive systems: fundamentals through simulations. Wiley, New York Principe JC, Euliano NR, Lefebvre WC (2000) Neural and adaptive systems: fundamentals through simulations. Wiley, New York
Zurück zum Zitat Ranzato M, Huang F, Boureau Y, LeCun Y (2007) Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: Proceedings of computer vision and pattern recognition conference (CVPR 2007). IEEE Press, New York Ranzato M, Huang F, Boureau Y, LeCun Y (2007) Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: Proceedings of computer vision and pattern recognition conference (CVPR 2007). IEEE Press, New York
Zurück zum Zitat Rieke F, Warland D, de Ruyter R, van Steveninck, Bialek W (1999) Spikes: exploring the neural code. The MIT Press, Cambridge Rieke F, Warland D, de Ruyter R, van Steveninck, Bialek W (1999) Spikes: exploring the neural code. The MIT Press, Cambridge
Zurück zum Zitat Salakhutdinov R, Hinton G (2009) Deep Boltzmann machines. In: Proceedings of the 12th international conference on artificial intelligence and statistics (AISTATS) volume 5. Clearwater Beach, Florida, pp 448–455 Salakhutdinov R, Hinton G (2009) Deep Boltzmann machines. In: Proceedings of the 12th international conference on artificial intelligence and statistics (AISTATS) volume 5. Clearwater Beach, Florida, pp 448–455
Zurück zum Zitat Simard P, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks. In: Proceedings of the seventh international conference on document analysis and recognition 2:958–962 Simard P, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks. In: Proceedings of the seventh international conference on document analysis and recognition 2:958–962
Zurück zum Zitat Slepian D (1956) A class of binary signaling alphabets. Bell Syst Tech J 35:203 Slepian D (1956) A class of binary signaling alphabets. Bell Syst Tech J 35:203
Zurück zum Zitat Stuart G, Nelson S, Hausser M (2008) Dendrites, 2nd edn. Oxford University Press, New York Stuart G, Nelson S, Hausser M (2008) Dendrites, 2nd edn. Oxford University Press, New York
Zurück zum Zitat von Neumann J (1958) The computer and the brain. Yale University Press, New Haven von Neumann J (1958) The computer and the brain. Yale University Press, New Haven
Zurück zum Zitat Wilkinson R, Geist J, Janet S, Grother P, Burges C, Creecy R, Hammond B, Hull J, Larsen N, Vogl, Wilson C (1992) The first census optical charater recognition systems conference. Technical Report NIST 4912, National Institute of Standards and Technology, August 1992 Wilkinson R, Geist J, Janet S, Grother P, Burges C, Creecy R, Hammond B, Hull J, Larsen N, Vogl, Wilson C (1992) The first census optical charater recognition systems conference. Technical Report NIST 4912, National Institute of Standards and Technology, August 1992
Zurück zum Zitat Zador AM, Clairborne BJ, Brown TH (1992) Nonlinear pattern separation in single hippocampal neurons with active dendritic membrane. In: Moody J, Lippmann R (eds) Advances in neural information processing systems, vol. 4. Morgan Kaufmann, San Mateo, pp 51–58 Zador AM, Clairborne BJ, Brown TH (1992) Nonlinear pattern separation in single hippocampal neurons with active dendritic membrane. In: Moody J, Lippmann R (eds) Advances in neural information processing systems, vol. 4. Morgan Kaufmann, San Mateo, pp 51–58
Metadaten
Titel
Functional model of biological neural networks
verfasst von
James Ting-Ho Lo
Publikationsdatum
01.12.2010
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 4/2010
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-010-9110-4

Weitere Artikel der Ausgabe 4/2010

Cognitive Neurodynamics 4/2010 Zur Ausgabe

Neuer Inhalt