Skip to main content
Erschienen in: Cognitive Neurodynamics 5/2017

03.04.2017 | Research Article

A decision-making model based on a spiking neural circuit and synaptic plasticity

verfasst von: Hui Wei, Yijie Bu, Dawei Dai

Erschienen in: Cognitive Neurodynamics | Ausgabe 5/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To adapt to the environment and survive, most animals can control their behaviors by making decisions. The process of decision-making and responding according to cues in the environment is stable, sustainable, and learnable. Understanding how behaviors are regulated by neural circuits and the encoding and decoding mechanisms from stimuli to responses are important goals in neuroscience. From results observed in Drosophila experiments, the underlying decision-making process is discussed, and a neural circuit that implements a two-choice decision-making model is proposed to explain and reproduce the observations. Compared with previous two-choice decision making models, our model uses synaptic plasticity to explain changes in decision output given the same environment. Moreover, biological meanings of parameters of our decision-making model are discussed. In this paper, we explain at the micro-level (i.e., neurons and synapses) how observable decision-making behavior at the macro-level is acquired and achieved.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ananthanarayanan R, Modha DS (2007) Anatomy of a cortical simulator. In: Proceedings of the 2007 ACM/IEEE conference on supercomputing. ACM, p 3 Ananthanarayanan R, Modha DS (2007) Anatomy of a cortical simulator. In: Proceedings of the 2007 ACM/IEEE conference on supercomputing. ACM, p 3
Zurück zum Zitat Bell CC, Han VZ, Sugawara Y, Grant K (1997) Synaptic plasticity in a cerebellum-like structure depends on temporal order. Nature 387(6630):278–281CrossRefPubMed Bell CC, Han VZ, Sugawara Y, Grant K (1997) Synaptic plasticity in a cerebellum-like structure depends on temporal order. Nature 387(6630):278–281CrossRefPubMed
Zurück zum Zitat Bi G-Q, Poo M-M (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18(24):10464–10472PubMed Bi G-Q, Poo M-M (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18(24):10464–10472PubMed
Zurück zum Zitat Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD (2006) The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 113(4):700CrossRefPubMed Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD (2006) The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 113(4):700CrossRefPubMed
Zurück zum Zitat Bohte SM, Poutré HL, Kok JN (2002) Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks. IEEE Trans Neural Netw 13(2):426–435CrossRefPubMed Bohte SM, Poutré HL, Kok JN (2002) Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks. IEEE Trans Neural Netw 13(2):426–435CrossRefPubMed
Zurück zum Zitat Busemeyer JR, Townsend JT (1993) Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev 100(3):432CrossRefPubMed Busemeyer JR, Townsend JT (1993) Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev 100(3):432CrossRefPubMed
Zurück zum Zitat Eliasmith C, Stewart TC, Choo X, Bekolay T, DeWolf T, Tang Y, Rasmussen D (2012) A large-scale model of the functioning brain. Science 338(6111):1202–1205CrossRefPubMed Eliasmith C, Stewart TC, Choo X, Bekolay T, DeWolf T, Tang Y, Rasmussen D (2012) A large-scale model of the functioning brain. Science 338(6111):1202–1205CrossRefPubMed
Zurück zum Zitat Foderaro G, Henriquez C, Ferrari S (2010) Indirect training of a spiking neural network for flight control via spike-timing-dependent synaptic plasticity. In: 49th IEEE conference on decision and control (CDC). IEEE, pp 911–917 Foderaro G, Henriquez C, Ferrari S (2010) Indirect training of a spiking neural network for flight control via spike-timing-dependent synaptic plasticity. In: 49th IEEE conference on decision and control (CDC). IEEE, pp 911–917
Zurück zum Zitat Gerstner W, Kempter R, van Hemmen JL (1996) A neuronal learning rule for sub-millisecond temporal coding. Nature 383:76–78 (LCN-ARTICLE-1996-002)CrossRefPubMed Gerstner W, Kempter R, van Hemmen JL (1996) A neuronal learning rule for sub-millisecond temporal coding. Nature 383:76–78 (LCN-ARTICLE-1996-002)CrossRefPubMed
Zurück zum Zitat Izhikevich EM et al (2003) Simple model of spiking neurons. IEEE Trans Neural Netw 14(6):1569–1572CrossRefPubMed Izhikevich EM et al (2003) Simple model of spiking neurons. IEEE Trans Neural Netw 14(6):1569–1572CrossRefPubMed
Zurück zum Zitat Li X, Chen Q, Xue F (2016) Bursting dynamics remarkably improve the performance of neural networks on liquid computing. Cognit Neurodyn 10(5):415–421CrossRef Li X, Chen Q, Xue F (2016) Bursting dynamics remarkably improve the performance of neural networks on liquid computing. Cognit Neurodyn 10(5):415–421CrossRef
Zurück zum Zitat Markram H, Lübke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275(5297):213–215CrossRefPubMed Markram H, Lübke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275(5297):213–215CrossRefPubMed
Zurück zum Zitat Natschläger T, Ruf B (1998) Spatial and temporal pattern analysis via spiking neurons. Netw Comput Neural Syst 9(3):319–332CrossRef Natschläger T, Ruf B (1998) Spatial and temporal pattern analysis via spiking neurons. Netw Comput Neural Syst 9(3):319–332CrossRef
Zurück zum Zitat Nishiyama M, Hong K, Mikoshiba K, Poo M-M, Kato K (2000) Calcium stores regulate the polarity and input specificity of synaptic modification. Nature 408(6812):584–588CrossRefPubMed Nishiyama M, Hong K, Mikoshiba K, Poo M-M, Kato K (2000) Calcium stores regulate the polarity and input specificity of synaptic modification. Nature 408(6812):584–588CrossRefPubMed
Zurück zum Zitat Qu J, Wang R, Yan C, Du Y (2014) Oscillations and synchrony in a cortical neural network. Cognit Neurodyn 8(2):157–166CrossRef Qu J, Wang R, Yan C, Du Y (2014) Oscillations and synchrony in a cortical neural network. Cognit Neurodyn 8(2):157–166CrossRef
Zurück zum Zitat Ratcliff R, Rouder JN (1998) Modeling response times for two-choice decisions. Psychol Sci 9(5):347–356CrossRef Ratcliff R, Rouder JN (1998) Modeling response times for two-choice decisions. Psychol Sci 9(5):347–356CrossRef
Zurück zum Zitat Samura T, Ikegaya Y, Sato YD (2015) A neural network model of reliably optimized spike transmission. Cognit Neurodyn 9(3):265–277CrossRef Samura T, Ikegaya Y, Sato YD (2015) A neural network model of reliably optimized spike transmission. Cognit Neurodyn 9(3):265–277CrossRef
Zurück zum Zitat Tang S, Guo A (2001) Choice behavior of drosophila facing contradictory visual cues. Science 294(5546):1543–1547CrossRefPubMed Tang S, Guo A (2001) Choice behavior of drosophila facing contradictory visual cues. Science 294(5546):1543–1547CrossRefPubMed
Zurück zum Zitat Usher M, McClelland JL (2001) The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev 108(3):550CrossRefPubMed Usher M, McClelland JL (2001) The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev 108(3):550CrossRefPubMed
Zurück zum Zitat Vickers D (1970) Evidence for an accumulator model of psychophysical discrimination. Ergonomics 13(1):37–58CrossRefPubMed Vickers D (1970) Evidence for an accumulator model of psychophysical discrimination. Ergonomics 13(1):37–58CrossRefPubMed
Zurück zum Zitat Wang X-J (2002) Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36(5):955–968CrossRefPubMed Wang X-J (2002) Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36(5):955–968CrossRefPubMed
Zurück zum Zitat Wittenberg GM, Wang SS-H (2006) Malleability of spike-timing-dependent plasticity at the CA3-CA1 synapse. J Neurosci 26(24):6610–6617CrossRefPubMed Wittenberg GM, Wang SS-H (2006) Malleability of spike-timing-dependent plasticity at the CA3-CA1 synapse. J Neurosci 26(24):6610–6617CrossRefPubMed
Zurück zum Zitat Zhang K, Guo JZ, Peng Y, Xi W, Guo A (2007) Dopamine-mushroom body circuit regulates saliency-based decision-making in drosophila. Science 316(5833):1901–1904CrossRefPubMed Zhang K, Guo JZ, Peng Y, Xi W, Guo A (2007) Dopamine-mushroom body circuit regulates saliency-based decision-making in drosophila. Science 316(5833):1901–1904CrossRefPubMed
Zurück zum Zitat Zhang X, Xu Z, Henriquez C, Ferrari S (2013) Spike-based indirect training of a spiking neural network-controlled virtual insect. In: IEEE 52nd annual conference on decision and control (CDC). IEEE, pp 6798–6805 Zhang X, Xu Z, Henriquez C, Ferrari S (2013) Spike-based indirect training of a spiking neural network-controlled virtual insect. In: IEEE 52nd annual conference on decision and control (CDC). IEEE, pp 6798–6805
Zurück zum Zitat Zhao J, Deng B, Qin Y, Men C, Wang J, Wei X, Sun J (2016) Weak electric fields detectability in a noisy neural network. Cognit Neurodyn 11:81–90CrossRef Zhao J, Deng B, Qin Y, Men C, Wang J, Wei X, Sun J (2016) Weak electric fields detectability in a noisy neural network. Cognit Neurodyn 11:81–90CrossRef
Metadaten
Titel
A decision-making model based on a spiking neural circuit and synaptic plasticity
verfasst von
Hui Wei
Yijie Bu
Dawei Dai
Publikationsdatum
03.04.2017
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 5/2017
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-017-9436-2

Weitere Artikel der Ausgabe 5/2017

Cognitive Neurodynamics 5/2017 Zur Ausgabe

Neuer Inhalt