Skip to main content
Top
Published in: Cognitive Neurodynamics 4/2010

01-12-2010 | Research Article

Functional model of biological neural networks

Author: James Ting-Ho Lo

Published in: Cognitive Neurodynamics | Issue 4/2010

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A functional model of biological neural networks, called temporal hierarchical probabilistic associative memory (THPAM), is proposed in this paper. THPAM comprises functional models of dendritic trees for encoding inputs to neurons, a first type of neuron for generating spike trains, a second type of neuron for generating graded signals to modulate neurons of the first type, supervised and unsupervised Hebbian learning mechanisms for easy learning and retrieving, an arrangement of dendritic trees for maximizing generalization, hardwiring for rotation-translation-scaling invariance, and feedback connections with different delay durations for neurons to make full use of present and past informations generated by neurons in the same and higher layers. These functional models and their processing operations have many functions of biological neural networks that have not been achieved by other models in the open literature and provide logically coherent answers to many long-standing neuroscientific questions. However, biological justifications of these functional models and their processing operations are required for THPAM to qualify as a macroscopic model (or low-order approximate) of biological neural networks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Arbib MA (2003) The handbook of brain theory and neural networks, 2nd edn. The MIT Press, Cambridge Arbib MA (2003) The handbook of brain theory and neural networks, 2nd edn. The MIT Press, Cambridge
go back to reference Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Advances in neural information processing systems. The handbook of brain theory and neural networks, MIT Press, Cambridge Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Advances in neural information processing systems. The handbook of brain theory and neural networks, MIT Press, Cambridge
go back to reference Bengio Y, LeCun Y (2007) Scaling learning algorithms towards AI. In: Bottou et al. (eds) Large-scale kernel machines. The MIT Press, Cambridge Bengio Y, LeCun Y (2007) Scaling learning algorithms towards AI. In: Bottou et al. (eds) Large-scale kernel machines. The MIT Press, Cambridge
go back to reference Bishop CM (2006) Pattern recognition and machine learning. Springer Science, New York Bishop CM (2006) Pattern recognition and machine learning. Springer Science, New York
go back to reference Dayan P, Abbott LF (2001) Theoretical neuroscience: computational and mathematical modeling of neural systems. The MIT Press, Cambridge Dayan P, Abbott LF (2001) Theoretical neuroscience: computational and mathematical modeling of neural systems. The MIT Press, Cambridge
go back to reference Desjardins G, Bengio Y (2008) Empirical evaluation of convolutional rbms for vision. Technical Report 1327, Département d’Informatique et de Recherche Opérationnelle, Université de Montréal Desjardins G, Bengio Y (2008) Empirical evaluation of convolutional rbms for vision. Technical Report 1327, Département d’Informatique et de Recherche Opérationnelle, Université de Montréal
go back to reference Erhan D, Bengio Y, Courville A, Manzagol P, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res Appear Erhan D, Bengio Y, Courville A, Manzagol P, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res Appear
go back to reference Fromherz P, Gaede V (1993) Exclusive-or function of single arborized neuron. Biol Cybern 69:337–334CrossRefPubMed Fromherz P, Gaede V (1993) Exclusive-or function of single arborized neuron. Biol Cybern 69:337–334CrossRefPubMed
go back to reference Geist J, Wilkinson R, Janet S, Grother P, Hammond B, Larsen N, Klear R, Matsko M, Burges C, Creecy R, Hull J, Vogl, Wilson C (1994) The second census optical charater recognition systems conference. Technical Report NIST 5452, National Institute of Standards and Technology, May 1994 Geist J, Wilkinson R, Janet S, Grother P, Hammond B, Larsen N, Klear R, Matsko M, Burges C, Creecy R, Hull J, Vogl, Wilson C (1994) The second census optical charater recognition systems conference. Technical Report NIST 5452, National Institute of Standards and Technology, May 1994
go back to reference George D, Hawkins J (2009) Towards a mathematical theory of cortical micro-circuits. PLoS Comput Biol 5–10:1–26CrossRef George D, Hawkins J (2009) Towards a mathematical theory of cortical micro-circuits. PLoS Comput Biol 5–10:1–26CrossRef
go back to reference Granger R (2006) Engines of the brain: the computational instruction set of human cognition. AI Mag 27:15–31 Granger R (2006) Engines of the brain: the computational instruction set of human cognition. AI Mag 27:15–31
go back to reference Grossberg S (2007) Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. Prog Brain Res 165:79–104CrossRefPubMed Grossberg S (2007) Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. Prog Brain Res 165:79–104CrossRefPubMed
go back to reference Hassoun MH (1993) Associative neural memories, theory and implementation. Oxford University Press, New York Hassoun MH (1993) Associative neural memories, theory and implementation. Oxford University Press, New York
go back to reference Hawkins J (2004) On intelligence. Henry Holt and Company, New York Hawkins J (2004) On intelligence. Henry Holt and Company, New York
go back to reference Haykin S (2009) Neural networks and learning machine, 3rd edn. Pretice Hall, Upper Saddle River Haykin S (2009) Neural networks and learning machine, 3rd edn. Pretice Hall, Upper Saddle River
go back to reference Hecht-Nielsen R (2007) Confabulation theory. Springer, New York Hecht-Nielsen R (2007) Confabulation theory. Springer, New York
go back to reference Hecht-Nielsen R, McKenna T (2003) Computational models for neuroscience. Springer, New York Hecht-Nielsen R, McKenna T (2003) Computational models for neuroscience. Springer, New York
go back to reference Hinton GE, Anderson JA (1989) Parallel models of associative memory. Lawrence Erlbaum Associates, Hllsdale Hinton GE, Anderson JA (1989) Parallel models of associative memory. Lawrence Erlbaum Associates, Hllsdale
go back to reference Hinton GE, Osindero S, Teh Y (2006) A fast learning algorithm for deep belief nets. Neural Comput 313:504–507 Hinton GE, Osindero S, Teh Y (2006) A fast learning algorithm for deep belief nets. Neural Comput 313:504–507
go back to reference Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 18:1527–1554 Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 18:1527–1554
go back to reference Kandel ER, Schwartz JH, Jessell TM (2000) Principles of neural science. McGraw-Hill, New York Kandel ER, Schwartz JH, Jessell TM (2000) Principles of neural science. McGraw-Hill, New York
go back to reference Koch C (1999) Biophysics of computation. Oxford University Press, Oxford Koch C (1999) Biophysics of computation. Oxford University Press, Oxford
go back to reference Kohonen T (1988) Self-organization and associative memory. Springer, New York Kohonen T (1988) Self-organization and associative memory. Springer, New York
go back to reference LeCun Y, Bose B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1–4:541–551CrossRef LeCun Y, Bose B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1–4:541–551CrossRef
go back to reference LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. In: Proceedings of The IEEE 86(11):2278–2324 LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. In: Proceedings of The IEEE 86(11):2278–2324
go back to reference Levitan IB, Kaczmarek LK (1993) Simulated annealing and boltzmann machines. Wiley, London Levitan IB, Kaczmarek LK (1993) Simulated annealing and boltzmann machines. Wiley, London
go back to reference Martin KAC (2002) Microcircuits in visual cortex. Curr Opinion Neurobiol 12–4:418–425CrossRef Martin KAC (2002) Microcircuits in visual cortex. Curr Opinion Neurobiol 12–4:418–425CrossRef
go back to reference Mel BW (1994) Information processing in dendritic trees. Neural Comput 6:1031–1085CrossRef Mel BW (1994) Information processing in dendritic trees. Neural Comput 6:1031–1085CrossRef
go back to reference Mel BW (2002) Have we been hebbing down the wrong path? Neuron 34:275–288CrossRef Mel BW (2002) Have we been hebbing down the wrong path? Neuron 34:275–288CrossRef
go back to reference Mountcastle VB (1978) An organizing principle for cerebral function: the unit model and the distributed system. In: Edelman GM, Mountcastle VB (eds) The mindful brain. MIT Press, Cambridge Mountcastle VB (1978) An organizing principle for cerebral function: the unit model and the distributed system. In: Edelman GM, Mountcastle VB (eds) The mindful brain. MIT Press, Cambridge
go back to reference O’Reilly R, Munakata Y (2000) Computational explorations in cognitive neuroscience. The MIT Press, Cambridge O’Reilly R, Munakata Y (2000) Computational explorations in cognitive neuroscience. The MIT Press, Cambridge
go back to reference Principe JC, Euliano NR, Lefebvre WC (2000) Neural and adaptive systems: fundamentals through simulations. Wiley, New York Principe JC, Euliano NR, Lefebvre WC (2000) Neural and adaptive systems: fundamentals through simulations. Wiley, New York
go back to reference Ranzato M, Huang F, Boureau Y, LeCun Y (2007) Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: Proceedings of computer vision and pattern recognition conference (CVPR 2007). IEEE Press, New York Ranzato M, Huang F, Boureau Y, LeCun Y (2007) Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: Proceedings of computer vision and pattern recognition conference (CVPR 2007). IEEE Press, New York
go back to reference Rieke F, Warland D, de Ruyter R, van Steveninck, Bialek W (1999) Spikes: exploring the neural code. The MIT Press, Cambridge Rieke F, Warland D, de Ruyter R, van Steveninck, Bialek W (1999) Spikes: exploring the neural code. The MIT Press, Cambridge
go back to reference Salakhutdinov R, Hinton G (2009) Deep Boltzmann machines. In: Proceedings of the 12th international conference on artificial intelligence and statistics (AISTATS) volume 5. Clearwater Beach, Florida, pp 448–455 Salakhutdinov R, Hinton G (2009) Deep Boltzmann machines. In: Proceedings of the 12th international conference on artificial intelligence and statistics (AISTATS) volume 5. Clearwater Beach, Florida, pp 448–455
go back to reference Simard P, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks. In: Proceedings of the seventh international conference on document analysis and recognition 2:958–962 Simard P, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks. In: Proceedings of the seventh international conference on document analysis and recognition 2:958–962
go back to reference Slepian D (1956) A class of binary signaling alphabets. Bell Syst Tech J 35:203 Slepian D (1956) A class of binary signaling alphabets. Bell Syst Tech J 35:203
go back to reference Stuart G, Nelson S, Hausser M (2008) Dendrites, 2nd edn. Oxford University Press, New York Stuart G, Nelson S, Hausser M (2008) Dendrites, 2nd edn. Oxford University Press, New York
go back to reference von Neumann J (1958) The computer and the brain. Yale University Press, New Haven von Neumann J (1958) The computer and the brain. Yale University Press, New Haven
go back to reference Wilkinson R, Geist J, Janet S, Grother P, Burges C, Creecy R, Hammond B, Hull J, Larsen N, Vogl, Wilson C (1992) The first census optical charater recognition systems conference. Technical Report NIST 4912, National Institute of Standards and Technology, August 1992 Wilkinson R, Geist J, Janet S, Grother P, Burges C, Creecy R, Hammond B, Hull J, Larsen N, Vogl, Wilson C (1992) The first census optical charater recognition systems conference. Technical Report NIST 4912, National Institute of Standards and Technology, August 1992
go back to reference Zador AM, Clairborne BJ, Brown TH (1992) Nonlinear pattern separation in single hippocampal neurons with active dendritic membrane. In: Moody J, Lippmann R (eds) Advances in neural information processing systems, vol. 4. Morgan Kaufmann, San Mateo, pp 51–58 Zador AM, Clairborne BJ, Brown TH (1992) Nonlinear pattern separation in single hippocampal neurons with active dendritic membrane. In: Moody J, Lippmann R (eds) Advances in neural information processing systems, vol. 4. Morgan Kaufmann, San Mateo, pp 51–58
Metadata
Title
Functional model of biological neural networks
Author
James Ting-Ho Lo
Publication date
01-12-2010
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics / Issue 4/2010
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-010-9110-4

Other articles of this Issue 4/2010

Cognitive Neurodynamics 4/2010 Go to the issue