Skip to main content
Erschienen in: Neural Computing and Applications 6/2018

16.08.2016 | Original Article

An approach to variable-order prediction via multiple distal dendrites of neurons

verfasst von: Xinyi Zhou, Nianqing Tang, Yin Kuang, Zhong Liu

Erschienen in: Neural Computing and Applications | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we proposed an extended version of binary code selection algorithm (BCSA) for the variable-order prediction by introducing multiple distal dendrites into BCSA. The proposed model of artificial neurons has a single proximal dendrite to receive the feed-forward inputs (sequences) from the world and multiple distal dendrites to receive the horizontal inputs from nearby neurons. During training, each distal dendrite is able to remember the states of neurons activated at different time and store the temporal correlations. After training, each distal dendrite independently recalls the temporal correlations contained in sequences and makes a local prediction. The variable-order prediction can be obtained by combining these local predictions made by multiple distal dendrites. Experiments show that the proposed method outperforms BCSA and other methods, such as back-propagation networks and radial basis function networks, especially while processing complex sequences.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hawkins J, Blakeslee S (2007) On intelligence. Macmillan, London Hawkins J, Blakeslee S (2007) On intelligence. Macmillan, London
2.
Zurück zum Zitat Mountcastle VB (1997) The columnar organization of the neocortex. Brain 120(4):701–722CrossRef Mountcastle VB (1997) The columnar organization of the neocortex. Brain 120(4):701–722CrossRef
3.
Zurück zum Zitat Stuart G, Spruston N, Häusse M (2008) Dendrites. Oxford University Press, Oxford Stuart G, Spruston N, Häusse M (2008) Dendrites. Oxford University Press, Oxford
4.
Zurück zum Zitat Rall W (1967) Distinguishing theoretical synaptic potentials computed for different soma-dendritic distributions of synaptic input. J Neurophysiol 30(5):1138–1168CrossRef Rall W (1967) Distinguishing theoretical synaptic potentials computed for different soma-dendritic distributions of synaptic input. J Neurophysiol 30(5):1138–1168CrossRef
5.
Zurück zum Zitat Rall W, Burke R, Smith T, Nelson PG, Frank K (1967) Dendritic location of synapses and possible mechanisms for the monosynaptic epsp in motoneurons. J Neurophysiol 30(5):884–915 Rall W, Burke R, Smith T, Nelson PG, Frank K (1967) Dendritic location of synapses and possible mechanisms for the monosynaptic epsp in motoneurons. J Neurophysiol 30(5):884–915
6.
Zurück zum Zitat Rall W, Shepherd GM (1968) Theoretical reconstruction of field potentials and dendrodendritic synaptic interactions in olfactory bulb. J Neurophysiol 31(6):884–915CrossRef Rall W, Shepherd GM (1968) Theoretical reconstruction of field potentials and dendrodendritic synaptic interactions in olfactory bulb. J Neurophysiol 31(6):884–915CrossRef
7.
Zurück zum Zitat Segev I (2006) What do dendrites and their synapses tell the neuron? J Neurophysiol 95(3):1295–1297CrossRef Segev I (2006) What do dendrites and their synapses tell the neuron? J Neurophysiol 95(3):1295–1297CrossRef
8.
Zurück zum Zitat Hoekstra J, Rouw E (2000) Modeling of dendritic computation: the single dendrite. In: Computing anticipatory systems: CASYS’99-third international conference, vol 517. AIP Publishing, pp 308–322 Hoekstra J, Rouw E (2000) Modeling of dendritic computation: the single dendrite. In: Computing anticipatory systems: CASYS’99-third international conference, vol 517. AIP Publishing, pp 308–322
9.
Zurück zum Zitat Tang Z, Tamura H, Kuratu M, Ishizuka O, Tanno K (2001) A model of the neuron based on dendrite mechanisms. Electron Commun Jpn (Part III: Fundam Electron Sci) 84(8):11-24CrossRef Tang Z, Tamura H, Kuratu M, Ishizuka O, Tanno K (2001) A model of the neuron based on dendrite mechanisms. Electron Commun Jpn (Part III: Fundam Electron Sci) 84(8):11-24CrossRef
10.
Zurück zum Zitat Liu G (2004) Local structural balance and functional interaction of excitatory and inhibitory synapses in hippocampal dendrites. Nat Neurosci 7(4):373–379CrossRef Liu G (2004) Local structural balance and functional interaction of excitatory and inhibitory synapses in hippocampal dendrites. Nat Neurosci 7(4):373–379CrossRef
11.
Zurück zum Zitat Gasparini S, Magee JC (2006) State-dependent dendritic computation in hippocampal ca1 pyramidal neurons. J Neurosci 26(7):2088–2100CrossRef Gasparini S, Magee JC (2006) State-dependent dendritic computation in hippocampal ca1 pyramidal neurons. J Neurosci 26(7):2088–2100CrossRef
12.
Zurück zum Zitat Spruston N (2008) Pyramidal neurons: dendritic structure and synaptic integration. Nat Rev Neurosci 9(3):206–221MathSciNetCrossRef Spruston N (2008) Pyramidal neurons: dendritic structure and synaptic integration. Nat Rev Neurosci 9(3):206–221MathSciNetCrossRef
13.
Zurück zum Zitat Knoblauch A (2009) Structural plasticity, cortical memory, and the spacing effect. BMC Neurosci 10(Suppl1):O16MathSciNetCrossRef Knoblauch A (2009) Structural plasticity, cortical memory, and the spacing effect. BMC Neurosci 10(Suppl1):O16MathSciNetCrossRef
14.
Zurück zum Zitat Blasio Gd, Moreno Díaz A, Moreno Díaz R (2011) Dendritic-like reliable computation in artificial neurons. In: Actas de la 13th international conference on computer aided systems theory, EUROCAST 2011. Instituto Universitario de Ciencias y Tecnologías Cibernéticas, pp 66–68 Blasio Gd, Moreno Díaz A, Moreno Díaz R (2011) Dendritic-like reliable computation in artificial neurons. In: Actas de la 13th international conference on computer aided systems theory, EUROCAST 2011. Instituto Universitario de Ciencias y Tecnologías Cibernéticas, pp 66–68
15.
Zurück zum Zitat Sha Z, Hu L (2012) The algorithm improvement of the neuron model based on dendrites mechanism. Int J Comput Sci Netw Secur 12(10):1–5 Sha Z, Hu L (2012) The algorithm improvement of the neuron model based on dendrites mechanism. Int J Comput Sci Netw Secur 12(10):1–5
16.
Zurück zum Zitat Gollo LL, Kinouchi O, Copelli M (2013) Single-neuron criticality optimizes analog dendritic computation. Sci Rep 3(11):3222–3222CrossRef Gollo LL, Kinouchi O, Copelli M (2013) Single-neuron criticality optimizes analog dendritic computation. Sci Rep 3(11):3222–3222CrossRef
17.
Zurück zum Zitat George S, Hasler J, Koziol S, Nease S, Ramakrishnan S (2013) Low power dendritic computation for wordspotting. J Low Power Electron Appl 3(2):73–98CrossRef George S, Hasler J, Koziol S, Nease S, Ramakrishnan S (2013) Low power dendritic computation for wordspotting. J Low Power Electron Appl 3(2):73–98CrossRef
18.
Zurück zum Zitat Butz M, van Ooyen A (2013) A simple rule for dendritic spine and axonal bouton formation can account for cortical reorganization after focal retinal lesions. PLoS Comput Biol 9(10):e1003259CrossRef Butz M, van Ooyen A (2013) A simple rule for dendritic spine and axonal bouton formation can account for cortical reorganization after focal retinal lesions. PLoS Comput Biol 9(10):e1003259CrossRef
19.
Zurück zum Zitat Chen X, Sneyd J (2014) A computational model of the dendron of the gnrh neuron. Bull Math Biol 77(6):1–23MathSciNetMATH Chen X, Sneyd J (2014) A computational model of the dendron of the gnrh neuron. Bull Math Biol 77(6):1–23MathSciNetMATH
20.
Zurück zum Zitat Montegranario H, Espinosa J (2014) Radial basis functions. In: Variational regularization of 3D data. Springer, New York, pp 69–81 Montegranario H, Espinosa J (2014) Radial basis functions. In: Variational regularization of 3D data. Springer, New York, pp 69–81
21.
Zurück zum Zitat Balabin RM, Lomakina EI (2011) Support vector machine regression (SVR/LS-SVM) an alternative to neural networks (ANN) for analytical chemistry? comparison of nonlinear methods on near infrared (NIR) spectroscopy data. Analyst 136(8):1703–1712CrossRef Balabin RM, Lomakina EI (2011) Support vector machine regression (SVR/LS-SVM) an alternative to neural networks (ANN) for analytical chemistry? comparison of nonlinear methods on near infrared (NIR) spectroscopy data. Analyst 136(8):1703–1712CrossRef
22.
Zurück zum Zitat Sato T, Uchida G, Tanifuji M (2009) Cortical columnar organization is reconsidered in inferior temporal cortex. Cerebral Cortex 19(8):1870–1888CrossRef Sato T, Uchida G, Tanifuji M (2009) Cortical columnar organization is reconsidered in inferior temporal cortex. Cerebral Cortex 19(8):1870–1888CrossRef
23.
Zurück zum Zitat Hoyer PO, Hyvärinen A (2002) A multi-layer sparse coding network learns contour coding from natural images. Vision Research 42(12):1593–1605CrossRef Hoyer PO, Hyvärinen A (2002) A multi-layer sparse coding network learns contour coding from natural images. Vision Research 42(12):1593–1605CrossRef
24.
Zurück zum Zitat Hawkins J, Ahmad S, Dubinsky D (2012) Hierarchical temporal memory including htm cortical learning algorithms. Techical Report Hawkins J, Ahmad S, Dubinsky D (2012) Hierarchical temporal memory including htm cortical learning algorithms. Techical Report
25.
Zurück zum Zitat Olshausen BA, Field DJ (2004) Sparse coding of sensory inputs. Curr Opin Neurobiol 14(4):481–487CrossRef Olshausen BA, Field DJ (2004) Sparse coding of sensory inputs. Curr Opin Neurobiol 14(4):481–487CrossRef
26.
Zurück zum Zitat Attwell D, Laughlin SB (2001) An energy budget for signaling in the grey matter of the brain. J Cereb Blood Flow Metab 21(10):1133–1145CrossRef Attwell D, Laughlin SB (2001) An energy budget for signaling in the grey matter of the brain. J Cereb Blood Flow Metab 21(10):1133–1145CrossRef
27.
Zurück zum Zitat Lennie P (2003) The cost of cortical computation. Curr Biol 13(6):493–497CrossRef Lennie P (2003) The cost of cortical computation. Curr Biol 13(6):493–497CrossRef
28.
Zurück zum Zitat Olshausen BA et al (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381(6583):607–609CrossRef Olshausen BA et al (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381(6583):607–609CrossRef
29.
Zurück zum Zitat Changizi MA (2001) Universal scaling laws for hierarchical complexity in languages, organisms, behaviors and other combinatorial systems. J Theor Biol 211(3):277–295CrossRef Changizi MA (2001) Universal scaling laws for hierarchical complexity in languages, organisms, behaviors and other combinatorial systems. J Theor Biol 211(3):277–295CrossRef
31.
Zurück zum Zitat Simon HA (1996) Sciences of the artificial, vol 136. MIT Press, Cambridge Simon HA (1996) Sciences of the artificial, vol 136. MIT Press, Cambridge
32.
Zurück zum Zitat George D, Hawkins J (2009) Towards a mathematical theory of cortical micro-circuits. PLoS Comput Biol 5(10):e1000532MathSciNetCrossRef George D, Hawkins J (2009) Towards a mathematical theory of cortical micro-circuits. PLoS Comput Biol 5(10):e1000532MathSciNetCrossRef
33.
Zurück zum Zitat Bobier BA, Wirth M (2008) Content-based image retrieval using hierarchical temporal memory. In: Proceedings of the 16th ACM international conference on multimedia. ACM, pp 925–928 Bobier BA, Wirth M (2008) Content-based image retrieval using hierarchical temporal memory. In: Proceedings of the 16th ACM international conference on multimedia. ACM, pp 925–928
34.
Zurück zum Zitat Starzyk JA, He H (2009) Spatio-temporal memories for machine learning: a long-term memory organization. Neural Netw IEEE Trans 20(5):768–780CrossRef Starzyk JA, He H (2009) Spatio-temporal memories for machine learning: a long-term memory organization. Neural Netw IEEE Trans 20(5):768–780CrossRef
35.
Zurück zum Zitat Starzyk JA, He H (2007) Anticipation-based temporal sequences learning in hierarchical structure. Neural Netw IEEE Trans 18(2):344–358CrossRef Starzyk JA, He H (2007) Anticipation-based temporal sequences learning in hierarchical structure. Neural Netw IEEE Trans 18(2):344–358CrossRef
36.
Zurück zum Zitat Mountcastle VB (1978) An organizing principle for cerebral function: the unit model and the distributed system. MIT Press, Cambridge Mountcastle VB (1978) An organizing principle for cerebral function: the unit model and the distributed system. MIT Press, Cambridge
37.
Zurück zum Zitat Horton JC, Adams DL (2005) The cortical column: a structure without a function. Philos Trans R Soc B: Biol Sci 360(1456):837–862CrossRef Horton JC, Adams DL (2005) The cortical column: a structure without a function. Philos Trans R Soc B: Biol Sci 360(1456):837–862CrossRef
38.
Zurück zum Zitat Rinkus GJ (2010) A cortical sparse distributed coding model linking mini-and macrocolumn-scale functionality. Front Neuroanat 4(2):1–13 Rinkus GJ (2010) A cortical sparse distributed coding model linking mini-and macrocolumn-scale functionality. Front Neuroanat 4(2):1–13
39.
Zurück zum Zitat Kuang Y, Zhang Y, Zhang L (2013) An improved code selection algorithm for fault prediction. Neural Comput Appl 22(7–8):1763–1772CrossRef Kuang Y, Zhang Y, Zhang L (2013) An improved code selection algorithm for fault prediction. Neural Comput Appl 22(7–8):1763–1772CrossRef
40.
Zurück zum Zitat Hawkins J, George D (2011) Hierarchical temporal memory: concepts, theory and terminology. Whitepaper, Numenta Inc, Hayes Hawkins J, George D (2011) Hierarchical temporal memory: concepts, theory and terminology. Whitepaper, Numenta Inc, Hayes
41.
Zurück zum Zitat Pradhan B, Lee S (2010) Landslide susceptibility assessment and factor e?ect analysis: backpropagation artificial neural networks and their comparison with frequency ratio and bivariate logistic regression modelling. Environ Model Softw 25(6):747–759CrossRef Pradhan B, Lee S (2010) Landslide susceptibility assessment and factor e?ect analysis: backpropagation artificial neural networks and their comparison with frequency ratio and bivariate logistic regression modelling. Environ Model Softw 25(6):747–759CrossRef
42.
Zurück zum Zitat Shifei D, Gang M, Zhongzhi S (2014) A rough RBF neural network based on weighted regularized extreme learning machine. Neural Process Lett 40(3):245–260CrossRef Shifei D, Gang M, Zhongzhi S (2014) A rough RBF neural network based on weighted regularized extreme learning machine. Neural Process Lett 40(3):245–260CrossRef
43.
Zurück zum Zitat Zhizheng L, Ning L (2014) Efficient feature scaling for support vector machines with a quadratic kernel. Neural Process Lett 39(3):235–246CrossRef Zhizheng L, Ning L (2014) Efficient feature scaling for support vector machines with a quadratic kernel. Neural Process Lett 39(3):235–246CrossRef
44.
Zurück zum Zitat Hebb DO (2002) The organization of behavior: a neuropsychological theory. Psychology Press, Routledge Hebb DO (2002) The organization of behavior: a neuropsychological theory. Psychology Press, Routledge
45.
Zurück zum Zitat Rinkus GJ (1986) A combinatorial neural network exhibiting episodic and semantic memory properties for spatio-temporal patterns. Dissertation, Boston University Rinkus GJ (1986) A combinatorial neural network exhibiting episodic and semantic memory properties for spatio-temporal patterns. Dissertation, Boston University
46.
Zurück zum Zitat Willerman L, Schultz R, Rutledge JN, Bigler ED (1991) In vivo brain size and intelligence. Intelligence 15(2):223–228CrossRef Willerman L, Schultz R, Rutledge JN, Bigler ED (1991) In vivo brain size and intelligence. Intelligence 15(2):223–228CrossRef
Metadaten
Titel
An approach to variable-order prediction via multiple distal dendrites of neurons
verfasst von
Xinyi Zhou
Nianqing Tang
Yin Kuang
Zhong Liu
Publikationsdatum
16.08.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 6/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2518-y

Weitere Artikel der Ausgabe 6/2018

Neural Computing and Applications 6/2018 Zur Ausgabe