Top

Cognitive Neurodynamics

Published in:

13-03-2020 | Research Article

Effects of network topologies on stochastic resonance in feedforward neural network

Authors: Jia Zhao, Yingmei Qin, Yanqiu Che, Huangyanqiu Ran, Jingwen Li

Published in: Cognitive Neurodynamics | Issue 3/2020

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The effects of network topologies on signal propagation are studied in noisy feedforward neural network in detail, where the network topologies are modulated by changing both the in-degree and out-degree distributions of FFNs as identical, uniform and exponential respectively. Stochastic resonance appeared in three FFNs when the same external stimuli and noise are applied to the three different network topologies. It is found that optimal noise intensity decreases with the increase of network’s layer index. Meanwhile, the Q index of FFN with identical distribution is higher than that of the other two FFNs, indicating that the synchronization between the neuronal firing activities and the external stimuli is more obvious in FFN with identical distribution. The optimal parameter regions for the time cycle of external stimuli and the noise intensity are found for three FFNs, in which the resonance is more easily induced when the parameters of stimuli are set in this region. Furthermore, the relationship between the in-degree, the average membrane potential and the resonance performance is studied at the neuronal level, where it is found that both the average membrane potentials and the Q indexes of neurons in FFN with identical degree distribution is more consistent with each other than that of the other two FFNs due to their network topologies. In summary, the simulations here indicate that the network topologies play essential roles in affecting the signal propagation of FFNs.

previous article Various firing activities and finite-time synchronization of an improved Hindmarsh–Rose neuron model under electric field effect

next article Prediction of numbers of the accumulative confirmed patients (NACP) and the plateau phase of 2019-nCoV in China

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Aertsen A, Diesmann M, Gewaltig MO (1996) Propagation of synchronous spiking activity in feedforward neural networks. J Physiol Paris 90(3):243–247. https://doi.org/10.1016/S0928-4257(97)81432-5 CrossRefPubMed

Bikson M, Inoue M, Akiyama H, Deans JK, Fox JE, Miyakawa H, Jefferys JG (2004) Effects of uniform extracellular DC electric fields on excitability in rat hippocampal slices in vitro. J Physiol 557(Pt 1):175–190. https://doi.org/10.1113/jphysiol.2003.055772 CrossRefPubMedPubMedCentral

Dai Z, Yan C, Li K, Wang Z, Wang J, Cao M, Lin Q, Shu N, Xia M, Bi Y, He Y (2015) Identifying and mapping connectivity patterns of brain network hubs in Alzheimer’s disease. Cereb Cortex 25(10):3723–3742. https://doi.org/10.1093/cercor/bhu246 CrossRefPubMed

Deans JK, Powell AD, Jefferys JGR (2007) Sensitivity of coherent oscillations in rat hippocampus to AC electric fields. J Physiol 583(2):555–565. https://doi.org/10.1113/jphysiol.2007.137711 CrossRefPubMedPubMedCentral

Deng B, Wang J, Wei X, Tsang KM, Chan WL (2010) Vibrational resonance in neuron populations. Chaos 20(1):013113. https://doi.org/10.1063/1.3324700 CrossRefPubMed

Diesmann M, Gewaltig MO, Aertsen A (1999) Stable propagation of synchronous spiking in cortical neural networks. Nature 402(6761):529–533. https://doi.org/10.1038/990101 CrossRefPubMed

Fregni F, Liebetanz D, Monte-Silva KK, Oliveira MB, Santos AA, Nitsche MA, Pascual-Leone A, Guedes RCA (2007) Effects of transcranial direct current stimulation coupled with repetitive electrical stimulation on cortical spreading depression. Exp Neurol 204(1):462–466. https://doi.org/10.1016/j.expneurol.2006.09.019 CrossRefPubMed

Gammaitoni L, Hanggi P, Jung P, Marchesoni F (1998) Stochastic resonance. Rev Mod Phys 70(1):223–287. https://doi.org/10.1103/RevModPhys.70.223 CrossRef

Gluckman BJ, Netoff TI, Neel EJ, Ditto WL, Spano ML, Schiff SJ (1996) Stochastic resonance in a neuronal network from mammalian brain. Phys Rev Lett 77(19):4098–4101. https://doi.org/10.1103/PhysRevLett.77.4098 CrossRefPubMed

Guo D (2011) Inhibition of rhythmic spiking by colored noise in neural systems. Cogn Neurodyn 5(3):293–300. https://doi.org/10.1007/s11571-011-9160-2 CrossRefPubMedPubMedCentral

Guo D, Li C (2009) Stochastic and coherence resonance in feed-forward-loop neuronal network motifs. Phys Rev E 79(5):051921CrossRef

Iaccarino HF, Singer AC, Martorell AJ, Rudenko A, Gao F, Gillingham TZ, Mathys H, Seo J, Kritskiy O, Abdurrob F, Adaikkan C, Canter RG, Rueda R, Brown EN, Boyden ES, Tsai LH (2016) Gamma frequency entrainment attenuates amyloid load and modifies microglia. Nature 540:230. https://doi.org/10.1038/nature20587 CrossRefPubMedPubMedCentral

Kim SY, Lim W (2017) Dynamical responses to external stimuli for both cases of excitatory and inhibitory synchronization in a complex neuronal network. Cogn Neurodyn 11(5):395–413. https://doi.org/10.1007/s11571-017-9441-5 CrossRefPubMedPubMedCentral

Kim SY, Lim W (2018) Effect of spike-timing-dependent plasticity on stochastic burst synchronization in a scale-free neuronal network. Cogn Neurodyn 12(3):315–342CrossRef

Kim SY, Lim W (2019a) Burst synchronization in a scale-free neuronal network with inhibitory spike-timing-dependent plasticity. Cogn Neurodyn 13(1):53–73. https://doi.org/10.1007/s11571-018-9505-1 CrossRefPubMed

Kim SY, Lim W (2019b) Cluster burst synchronization in a scale-free network of inhibitory bursting neurons. Cogn Neurodyn. https://doi.org/10.1007/s11571-019-09546-9 CrossRefPubMed

Kumar A, Rotter S, Aertsen A (2008) Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model. J Neurosci 28(20):5268–5280. https://doi.org/10.1523/jneurosci.2542-07.2008 CrossRefPubMedPubMedCentral

Kumar A, Rotter S, Aertsen A (2010) Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding. Nat Rev Neurosci 11(9):615–627. https://doi.org/10.1038/nrn2886 CrossRefPubMed

Li M, Greenside H (2006) Stable propagation of a burst through a one-dimensional homogeneous excitatory chain model of songbird nucleus HVC. Phys Rev E 74(1):011918. https://doi.org/10.1103/PhysRevE.74.011918 CrossRef

Li X, Small M (2010) Enhancement of signal sensitivity in a heterogeneous neural network refined from synaptic plasticity. New J Phys 12(8):083045. https://doi.org/10.1088/1367-2630/12/8/083045 CrossRef

Li X, Wang J, Hu W (2007) Effects of chemical synapses on the enhancement of signal propagation in coupled neurons near the canard regime. Phys Rev E 76(4):041902CrossRef

Li X, Zhang J, Small M (2009) Self-organization of a neural network with heterogeneous neurons enhances coherence and stochastic resonance. Chaos 19(1):013126. https://doi.org/10.1063/1.3076394 CrossRefPubMed

Luz Y, Shamir M (2016) Oscillations via spike-timing dependent plasticity in a feed-forward model. PLoS Comput Biol 12(4):e1004878. https://doi.org/10.1371/journal.pcbi.1004878 CrossRefPubMedPubMedCentral

Malagarriga D, Pons AJ, Villa AEP (2019) Complex temporal patterns processing by a neural mass model of a cortical column. Cogn Neurodyn 13(4):379–392. https://doi.org/10.1007/s11571-019-09531-2 CrossRefPubMed

Masuda N, Kori H (2007) Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity. J Comput Neurosci 22(3):327–345. https://doi.org/10.1007/s10827-007-0022-1 CrossRefPubMed

Mizraji E, Lin J (2017) The feeling of understanding: an exploration with neural models. Cogn Neurodyn 11(2):135–146. https://doi.org/10.1007/s11571-016-9414-0 CrossRefPubMed

Mofakham S, Fink CG, Booth V, Zochowski MR (2016) Interplay between excitability type and distributions of neuronal connectivity determines neuronal network synchronization. Phys Rev E 94(4–1):042427. https://doi.org/10.1103/PhysRevE.94.042427 CrossRefPubMedPubMedCentral

Ozer M, Perc M, Uzuntarla M, Koklukaya E (2010) Weak signal propagation through noisy feedforward neuronal networks. NeuroReport 21(5):338–343. https://doi.org/10.1097/WNR.0b013e328336ee62 CrossRefPubMed

Perc M (2008) Stochastic resonance on weakly paced scale-free networks. Phys Rev E 78(3 Pt 2):036105. https://doi.org/10.1103/PhysRevE.78.036105 CrossRef

Qin YM, Wang J, Men C, Deng B, Wei XL (2011) Vibrational resonance in feedforward network. Chaos. https://doi.org/10.1063/1.3603818 CrossRefPubMed

Qin YM, Wang J, Men C, Zhao J, Wei XL, Deng B (2012) Self-sustained firing activities of the cortical network with plastic rules in weak AC electrical fields. Chin Phys B 21(7):078702. https://doi.org/10.1088/1674-1056/21/7/078702 CrossRef

Qin YM, Wang J, Men C, Deng B, Wei XL, Yu HT, Chan WL (2014) Stochastic resonance in feedforward acupuncture networks. Commun Nonlinear Sci 19(10):3660–3670. https://doi.org/10.1016/j.cnsns.2014.03.010 CrossRef

Qin YM, Che YQ, Zhao J (2018a) Effects of degree distributions on signal propagation in noisy feedforward neural networks. Phys A 512:763–774. https://doi.org/10.1016/j.physa.2018.08.061 CrossRef

Qin YM, Men C, Zhao J, Han CX, Che YQ (2018b) Toward heterogeneity in feedforward network with synaptic delays based on FitzHugh–Nagumo model. Int J Mod Phys B 32(01):1750274. https://doi.org/10.1142/s0217979217502745 CrossRef

Reato D, Rahman A, Bikson M, Parra LC (2010) Low-intensity electrical stimulation affects network dynamics by modulating population rate and spike timing. J Neurosci 30(45):15067–15079. https://doi.org/10.1523/jneurosci.2059-10.2010 CrossRefPubMedPubMedCentral

Reyes AD (2003) Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro. Nat Neurosci 6(6):593–599. https://doi.org/10.1038/nn1056 CrossRefPubMed

Thomson JM, Doruk D, Mascio B, Fregni F, Cerruti C (2015) Transcranial direct current stimulation modulates efficiency of reading processes. Front Hum Neurosci 9:114. https://doi.org/10.3389/fnhum.2015.00114 CrossRefPubMedPubMedCentral

Torres JJ, Uzuntarla M, Marro J (2020) A theoretical description of inverse stochastic resonance in nature. Commun Nonlinear Sci 80:104975. https://doi.org/10.1016/j.cnsns.2019.104975 CrossRef

Uzuntarla M, Cressman JR, Ozer M, Barreto E (2013) Dynamical structure underlying inverse stochastic resonance and its implications. Phys Rev E 88(4):042712. https://doi.org/10.1103/PhysRevE.88.042712 CrossRef

Uzuntarla M, Barreto E, Torres JJ (2017a) Inverse stochastic resonance in networks of spiking neurons. PLoS Comput Biol 13(7):e1005646. https://doi.org/10.1371/journal.pcbi.1005646 CrossRefPubMedPubMedCentral

Uzuntarla M, Torres JJ, So P, Ozer M, Barreto E (2017b) Double inverse stochastic resonance with dynamic synapses. Phys Rev E 95(1–1):012404. https://doi.org/10.1103/PhysRevE.95.012404 CrossRefPubMed

van den Heuvel MP, Sporns O (2011) Rich-club organization of the human connectome. J Neurosci 31(44):15775–15786. https://doi.org/10.1523/jneurosci.3539-11.2011 CrossRefPubMedPubMedCentral

Wang Q, Zhang H, Chen G (2012) Effect of the heterogeneous neuron and information transmission delay on stochastic resonance of neuronal networks. Chaos 22(4):043123. https://doi.org/10.1063/1.4767719 CrossRefPubMed

Yao Y, Ma J (2018) Weak periodic signal detection by sine-Wiener-noise-induced resonance in the FitzHugh-Nagumo neuron. Cogn Neurodyn 12(3):343–349. https://doi.org/10.1007/s11571-018-9475-3 CrossRefPubMedPubMedCentral

Yao Y, Deng H, Yi M, Ma J (2017) Impact of bounded noise on the formation and instability of spiral wave in a 2D Lattice of neurons. Sci Rep 7:43151. https://doi.org/10.1038/srep43151 CrossRefPubMedPubMedCentral

Yao Y, Ma C, Wang C, Yi M, Gui R (2018) Detection of sub-threshold periodic signal by multiplicative and additive cross-correlated sine-Wiener noises in the FitzHugh–Nagumo neuron. Phys A 492:1247–1256. https://doi.org/10.1016/j.physa.2017.11.052 CrossRef

Yu Y, Wang W, Wang J, Liu F (2001) Resonance-enhanced signal detection and transduction in the Hodgkin-Huxley neuronal systems. Phys Rev E 63(2):021907. https://doi.org/10.1103/PhysRevE.63.021907 CrossRef

Yuan K, Qin W, Yu D, Bi Y, Xing L, Jin C, Tian J (2016) Core brain networks interactions and cognitive control in internet gaming disorder individuals in late adolescence/early adulthood. Brain Struct Funct 221(3):1427–1442. https://doi.org/10.1007/s00429-014-0982-7 CrossRefPubMed

Zhao J, Guo X, Xia X, Peng W, Wang W, Li S, Zhang Y, Hu L (2016) Functional reorganization of the primary somatosensory cortex of a phantom limb pain patient. Pain Phys 19(5):E781–E786

Zhao J, Deng B, Qin Y, Men C, Wang J, Wei Xand Sun J (2017) Weak electric fields detectability in a noisy neural network. Cogn Neurodyn 11(1):81–90. https://doi.org/10.1007/s11571-016-9409-x CrossRefPubMed

Zhao J, Qin Y, Mand Che YQ (2018) Effects of topologies on signal propagation in feedforward networks. Chaos 28(1):013117. https://doi.org/10.1063/1.4999996 CrossRefPubMed

Zhao J, Qin YM, Che YQ (2019) Effects of sine-Wiener noise on signal propagation in a randomly connected neural network. Phys A 533:122030. https://doi.org/10.1016/j.physa.2019.122030 CrossRef

Zhou S, Yu Y (2018) Synaptic E-I balance underlies efficient neural coding. Front Neurosci 12:46. https://doi.org/10.3389/fnins.2018.00046 CrossRefPubMedPubMedCentral

Title: Effects of network topologies on stochastic resonance in feedforward neural network
Authors: Jia Zhao
Yingmei Qin
Yanqiu Che
Huangyanqiu Ran
Jingwen Li
Publication date: 13-03-2020
Publisher: Springer Netherlands
Published in: Cognitive Neurodynamics / Issue 3/2020
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI: https://doi.org/10.1007/s11571-020-09576-8

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 3/2020

An adaptive decoder design based on the receding horizon optimization in BMI system

Removing uncertainty in neural networks

Machine classification of spatiotemporal patterns: automated parameter search in a rebounding spiking network

A brain–computer interface for the continuous, real-time monitoring of working memory load in real-world environments

Effects of synaptic integration on the dynamics and computational performance of spiking neural network

Design exploration predicts designer creativity: a deep learning approach