Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Cognitive Neurodynamics
Published in: Cognitive Neurodynamics 4/2009

01-12-2009 | Research Article

Syntactic sequencing in Hebbian cell assemblies

Authors: Thomas Wennekers, Günther Palm

Published in: Cognitive Neurodynamics | Issue 4/2009

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Hebbian cell assemblies provide a theoretical framework for the modeling of cognitive processes that grounds them in the underlying physiological neural circuits. Recently we have presented an extension of cell assemblies by operational components which allows to model aspects of language, rules, and complex behaviour. In the present work we study the generation of syntactic sequences using operational cell assemblies timed by unspecific trigger signals. Syntactic patterns are implemented in terms of hetero-associative transition graphs in attractor networks which cause a directed flow of activity through the neural state space. We provide regimes for parameters that enable an unspecific excitatory control signal to switch reliably between attractors in accordance with the implemented syntactic rules. If several target attractors are possible in a given state, noise in the system in conjunction with a winner-takes-all mechanism can randomly choose a target. Disambiguation can also be guided by context signals or specific additional external signals. Given a permanently elevated level of external excitation the model can enter an autonomous mode, where it generates temporal grammatical patterns continuously.
previous article A dynamical systems perspective on the relationship between symbolic and non-symbolic computation

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Literature
Abeles M (1991) Corticonics: neural circuits of the cerebral cortex. Cambridge University Press, Cambridge
Abeles M, Bergman H, Margalit E, Vaadia E (1993) Spatio-temporal firing patterns in frontal cortex of behaving mokeys. J Neurophysiol 70:1629–1643PubMed
Amari SI (1972) Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Trans Comput 21:1197–1206CrossRef
Amit D (1988) Modeling brain function. Cambridge University Press, Cambridge
Amit D (1995) The Hebbian paradigm reintegrated: local reverberations as internal representations. Behav Brain Sci 18:617–657CrossRef
Arbib MA (2005) From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav Brain Sci 28:105–167PubMed
Arbib M, Billard A, Iacoboni M, Oztop E (2000) Synthetic brain imaging: grasping, mirror neurons and imitation. Neural Netw 13:975–997CrossRefPubMed
Braitenberg V (1978) Cell assemblies in the cerebral cortex. In: Heim R, Palm G (eds) Theoretical approaches to complex systems. Springer, Berlin, pp 171–188
Buonomano DV (2003) Timing of neural responses in cortical organotypical slices. Proc Natl Acad Sci (USA) 100:4897–4902CrossRef
Coolen A (2001a) Statistical mechanics of recurrent neural networks i-statics. In: Moss F, Gielen S (eds) Handbook of biological physics, chap 14. 4th edn, Elsevier, Amsterdam, pp 531–596
Coolen A (2001b) Statistical mechanics of recurrent neural networks ii—dynamics. In: Moss F, Gielen S (eds) Handbook of biological physics, chap 15. 4th edn, Elsevier, Amsterdam, pp 597–662
Cossart R, Anonov D, Yuste R (2003) Attractor dynamics of network UP states in the neocortex. Nature 423:283–288CrossRefPubMed
Diesmann M, Gewaltig MO, Aertsen A (1999) Stable propagation of synchronous spiking in cortical neural networks. Nature 402:529–533CrossRefPubMed
Dosenbach NU, Visscher KM, Palmer ED, Miezin FM, Wenger KK, Kang HC, Burgund ED, Grimes AL, Schlaggar VL, Petersen SE (2006) A core system for the implementation of task sets. Neuron 50:799–812CrossRefPubMed
Eggert J, van Hemmen J (2000) Unifying framework for neuronal assembly dynamics. Phys Rev E 61:1855–1874CrossRef
Fay R, Kaufmann U, Knoblauch A, Markert H, Palm G (2005) Combining visual attention, object recognition and associative information processing in a neurobotic system. In: Wermter S, Palm G, Elshaw M (eds) Biomimetic neural learning for intelligent robots, LNAI, vol 3575. Springer, Berlin, pp 118–143
Feldman J, Narayanan S (2004) Embodied meaning in a neural theory of language. Brain Lang 89:385–392CrossRefPubMed
Garagnani M, Wennekers T, Pulvermüller F (2008) A neuroanatomically grounded Hebbian leaning model of attention-language interactions in the brain. Eur J Neurosci 27:492–513PubMedCrossRef
Gentner TQ, Margoliash D (2003) Neuronal populations and single cells representing learned auditory objects. Nature 424:669–674CrossRefPubMed
Gentner TQ, Fenn KM, Margoliash D, Nusbaum HC (2006) Recursive syntactic pattern learning by songbirds. Nature 440:1204–1207CrossRefPubMed
Hahnloser R, Kozhevnikov AA, Fee MS (2002) An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature 419:65–70CrossRefPubMed
Haider B, Duque A, Hasenstaub AR, McCormick DA (2006) Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. J Neurosci 26:4535–4545CrossRefPubMed
Harris KD, Csicsvari J, Hirase H, Dragoi G, Buzsaki G (2003) Organization of cell assemblies in the hippocampus. Nature 424:552–555CrossRefPubMed
Hebb D (1949) The organization of behavior. Wiley, New York
Herrmann M, Hertz J, Prugel-Bennet A (1995) Analysis of synfire chains. Network 6:403–414CrossRef
Hertz J, Krogh A, Palmer R (1991) Introduction to the theory of neural computation. Addison-Wesley, Reading
Hopcroft J, Ullman J (1969) Formal languages and their relation to automata. Addison-Wesley, Reading
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. PNAS 79:2554–2558CrossRefPubMed
Ikegaya Y, Aaron G, Cossart R, Aronov D, Lampl I, Ferster D, Yuste R (2004) Synfire chains and cortical songs: temporal modules of cortical activity. Science 304:559–564CrossRefPubMed
Indiveri G (2007) Synaptic plasticity and spike-based computation in VLSI networks of integrate-and-fire neurons. Neural Inf Process Lett Rev 11:135–146
Knoblauch A, Markert H, G Palm G (2005a) An associative cortical model of language understanding and action planning. In: Mira J, Alvarez JR (eds) Proceedings of IWINAC 2005, 1st international work-conference on the interplay between natural and artificial computation, Las Palmas de Gran Canaria, Spain, Lecture Notes in Computer Science, vol 3562, Springer, Berlin, pp 405–414
Knoblauch A, Markert H, Palm G (2005b) An associative model of cortical language and action understanding. In: Cangelosi A, Bugmann G, Borisyuk R (eds) Modeling language, cognition and action. Proceedings of the 9th neural computation and psychology workshop, Plymouth 2004. World Scientific, pp 79–83
Koechlin E, Jubault T (2006) Broca’s area and the hierarchical organization of human behaviour. Neuron 50:963–974CrossRefPubMed
Lashley K (1951) The problem of serial order in behavior. In: Jeffress L (ed) Cerebral mechanisms in behavior. New York, Wiley, pp 112–136
Markert H, Palm G (2006) An approach to language understanding and contextual disambiguation in human-robot interaction. In: International workshop on neural-symbolic learning and reasoning (NeSy 2006), pp 23–35
Markert H, Knoblauch A, Palm G (2005) Detecting sequences and understanding language with neural associative memories and cell assemblies. In: Wermter S, Palm G, Elshaw M (eds) Biomimetic neural learning for intelligent robots, Lecture Notes in Artificial Intelligence, vol 3575. Springer, Berlin, pp 107–117
Markert H, Knoblauch A, Palm G (2007) Modelling of syntactical processing in the cortex. BioSystems 89:300–315CrossRefPubMed
Markert H, Kayikci Z, Palm G (2008) Sentence understanding and learning of new words with large-scale neural networks. In: Prevost L, Marinai S, Schwenker F (eds) Proceedings of artificial neural networks in pattern recognition (ANNPR 2008), LNAI, vol 5064. Springer, Berlin, pp 217–227
Mushiake H, Saito N, Sakamoto K, Itoyama Y, Tanji J (2006) Activity in lateral prefrontal cortex reflects multiple steps of future events in action plans. Neuron 50:631–641CrossRefPubMed
Palm G (1982) Neural assemblies: an alternative approach to artificial intelligence. Springer, Berlin
Palm G, Sommer FT (1992) Information capacity in recurrent mcculloch-pitts networks with sparsely coded memory states. Network 2:177–186CrossRef
Press W, Teukolsky S, Vetterling W, Flannery B (1993) Numerical recipes in C: the art of scientific computing. Cambridge University Press, Cambridge
Pulvermüller F (1992) Constituents of a neurological theory of language. Concepts Neurosci 3:157–200
Pulvermüller F (2003) The neuroscience of language: on brain circuits of words and serial order. Cambridge University Press, CambridgeCrossRef
Rehn M, Lansner A (2004) Sequence memory with dynamical synapses. Neurocomputing 58–60:271–278CrossRef
Rizzolatti G, Fogassi L, Gallese V (2002) Motor and cognitive functions of the ventral premotor cortex. Curr Opin Neurobiol 12:149–154CrossRefPubMed
Rushworth M, Walton M, Kennerley S, Bannerman D (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410–417CrossRefPubMed
Russo E, Namboodiri VM, Treves A, Kropff E (2008) Free association transitions in models of cortical latching dynamics. New J Phys 10:015,008CrossRef
Schemmel J, Meier K, Mueller E (2004) A new VLSI model of neural microcircuits including spike time dependent plasticity. In: Proceedings of IJCNN. IEEE Press, pp 1711–1716
Sommer F, Wennekers T (2001) Associative memory in networks of spiking neurons. Neural Netw 14:825–834CrossRefPubMed
Sommer FT, Wennekers T (2005) Synfire chains with conductance-based neurons: internal timing and coordination with timed input. Neurocomputing 65–66:449–454CrossRef
Stoet G, Snyder LH (2003) Executive control and task-switching in monkeys. Neuropsychologia 41:1357–1364CrossRefPubMed
Sun R, Giles L (2000) Sequence learning: paradigms, algorithms, and applications. Springer, Berlin
Tsien JZ (2001) Linking Hebb’s coincidence-detection to memory formation. Curr Opin Neurobiol 10:266–273CrossRef
van Vreeswijk C SH (1996) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274:1724–1726CrossRefPubMed
von Neumann J (1958) The computer and the brain. Yale University Press, New Haven
Wennekers T (2000) Dynamics of spatio-temporal patterns in associative networks of spiking neurons. Neurocomputing 32:597–602CrossRef
Wennekers T (2006) Operational cell assemblies as a paradigm for brain-inspired future computing architectures. Neural Inf Process Lett Rev 10:135–145
Wennekers T, Ay N (2005) Finite state automata resulting from temporal information maximization and a temporal learning rule. Neural Comput 17:2258–2290CrossRefPubMed
Wennekers T, Palm G (2007) Modelling generic cognitive functions with operational Hebbian cell assemblies. In: Weiss M (ed) Neural network research horizons. Nova Science Publishers, New York, pp 225–294
Wennekers T, Garagnani M, Pulvermüller F (2006) Language models based on Hebbian cell assemblies. J Neurosci (Paris) 100:16–30
Wickelgren WA (1979) I liked the postcard you sent Abe and i: context-sensitive coding of syntax and other procedural knowledge. Bull Psychon Soc 13:61–63
Wickelgren WA (1992) Webs, cell assemblies, and chunking in neural nets. Concepts Neurosci 3:1–53
Wijekoon J, Dudek P (2008) Compact silicon neuron circuit with spiking and bursting behaviour. Neural Netw 21:524–534PubMed
Willshaw D, Buneman O, Longuet-Higgins H (1969) Non-holographic associative memory. Nature 222:960–962CrossRefPubMed
Wörgötter F, Porr B (2005) Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Comput 17:245–319CrossRefPubMed
Yamashita Y, Tani J (2008) Emergence of functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment. PLoS Comput Biol 4:e1000,220CrossRef
Metadata
Title
Syntactic sequencing in Hebbian cell assemblies
Authors
Thomas Wennekers
Günther Palm
Publication date
01-12-2009
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics / Issue 4/2009
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-009-9095-z

Other articles of this Issue 4/2009

Cognitive Neurodynamics 4/2009 Go to the issue

Research Article

Swing it to the left, swing it to the right: enacting flexible spatial language using a neurodynamic framework

Research Article

The Unification Space implemented as a localist neural net: predictions and error-tolerance in a constraint-based parser

Research Article

Memory reconsolidation for natural language processing

Research Article

A dynamical systems perspective on the relationship between symbolic and non-symbolic computation

Research Article

Unifying syntactic theory and sentence processing difficulty through a connectionist minimalist parser

Research article

Grammar resources for modelling dialogue dynamically