Skip to main content
Top

2018 | OriginalPaper | Chapter

Spiking Neural Networks Evolved to Perform Multiplicative Operations

Authors : Muhammad Aamir Khan, Volker Steuber, Neil Davey, Borys Wróbel

Published in: Artificial Neural Networks and Machine Learning – ICANN 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multiplicative or divisive changes in tuning curves of individual neurons to one stimulus (“input”) as another stimulus (“modulation”) is applied, called gain modulation, play an important role in perception and decision making. Since the presence of modulatory synaptic stimulation results in a multiplicative operation by proportionally changing the neuronal input-output relationship, such a change affects the sensitivity of the neuron but not its selectivity. Multiplicative gain modulation has commonly been studied at the level of single neurons. Much less is known about arithmetic operations at the network level. In this work we have evolved small networks of spiking neurons in which the output neurons respond to input with non-linear tuning curves that exhibit gain modulation—the best network showed an over 3-fold multiplicative response to modulation. Interestingly, we have also obtained a network with only 2 interneurons showing an over 2-fold response.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ayaz, A., Chance, F.S.: Gain modulation of neuronal responses by subtractive and divisive mechanisms of inhibition. J. Neurophysiol. 101, 958–968 (2009)CrossRef Ayaz, A., Chance, F.S.: Gain modulation of neuronal responses by subtractive and divisive mechanisms of inhibition. J. Neurophysiol. 101, 958–968 (2009)CrossRef
2.
go back to reference Brette, R., Gerstner, W.: Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. J. Neurophysiol. 94, 3637–3642 (2005)CrossRef Brette, R., Gerstner, W.: Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. J. Neurophysiol. 94, 3637–3642 (2005)CrossRef
3.
go back to reference Chance, F.S., Abbott, L.F., Reyes, A.D.: Gain modulation from background synaptic input. Neuron 35, 773–782 (2002)CrossRef Chance, F.S., Abbott, L.F., Reyes, A.D.: Gain modulation from background synaptic input. Neuron 35, 773–782 (2002)CrossRef
4.
go back to reference Götz, K.G.: The optomotor equilibrium of the Drosophila navigation system. J. Comp. Physiol. 99, 187–210 (1975)CrossRef Götz, K.G.: The optomotor equilibrium of the Drosophila navigation system. J. Comp. Physiol. 99, 187–210 (1975)CrossRef
5.
go back to reference Hildebrandt, K.J., Benda, J., Hennig, R.M.: Multiple arithmetic operations in a single neuron: the recruitment of adaptation processes in the cricket auditory pathway depends on sensory context. J. Neurosci. 31, 14142–14150 (2011)CrossRef Hildebrandt, K.J., Benda, J., Hennig, R.M.: Multiple arithmetic operations in a single neuron: the recruitment of adaptation processes in the cricket auditory pathway depends on sensory context. J. Neurosci. 31, 14142–14150 (2011)CrossRef
6.
go back to reference Koch, C., Poggio, T.: Multiplying with synapses and neurons. In: Single Neuron Computation, pp. 315–345. Elsevier (1992) Koch, C., Poggio, T.: Multiplying with synapses and neurons. In: Single Neuron Computation, pp. 315–345. Elsevier (1992)
7.
go back to reference Murphy, B.K., Miller, K.D.: Multiplicative gain changes are induced by excitation or inhibition alone. J. Neurosci. 23, 10040–10051 (2003)CrossRef Murphy, B.K., Miller, K.D.: Multiplicative gain changes are induced by excitation or inhibition alone. J. Neurosci. 23, 10040–10051 (2003)CrossRef
8.
go back to reference Naud, R., Marcille, N., Clopath, C., Gerstner, W.: Firing patterns in the adaptive exponential integrate-and-fire model. Biol. Cybern. 99, 335–347 (2008)MathSciNetCrossRef Naud, R., Marcille, N., Clopath, C., Gerstner, W.: Firing patterns in the adaptive exponential integrate-and-fire model. Biol. Cybern. 99, 335–347 (2008)MathSciNetCrossRef
9.
go back to reference Peña, J.L., Konishi, M.: Robustness of multiplicative processes in auditory spatial tuning. J. Neurosci. 24, 8907–8910 (2004)CrossRef Peña, J.L., Konishi, M.: Robustness of multiplicative processes in auditory spatial tuning. J. Neurosci. 24, 8907–8910 (2004)CrossRef
10.
go back to reference Salinas, E., Abbott, L.: Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. Progress Brain Res. 130, 175–190 (2001)CrossRef Salinas, E., Abbott, L.: Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. Progress Brain Res. 130, 175–190 (2001)CrossRef
11.
go back to reference Salinas, E., Sejnowski, T.J.: Gain modulation in the central nervous system: where behavior, neurophysiology, and computation meet. Neuroscientist 7, 430–440 (2001)CrossRef Salinas, E., Sejnowski, T.J.: Gain modulation in the central nervous system: where behavior, neurophysiology, and computation meet. Neuroscientist 7, 430–440 (2001)CrossRef
12.
go back to reference Schnupp, J.W., King, A.J.: Neural processing: the logic of multiplication in single neurons. Curr. Biol. 11, 640–642 (2001)CrossRef Schnupp, J.W., King, A.J.: Neural processing: the logic of multiplication in single neurons. Curr. Biol. 11, 640–642 (2001)CrossRef
13.
14.
go back to reference Wróbel, B., Joachimczak, M.: Using the genetic regulatory evolving artificial networks (GReaNs) platform for signal processing, animat control, and artificial multicellular development. In: Kowaliw, T., Bredeche, N., Doursat, R. (eds.) Growing Adaptive Machines. SCI, vol. 557, pp. 187–200. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-55337-0_6CrossRef Wróbel, B., Joachimczak, M.: Using the genetic regulatory evolving artificial networks (GReaNs) platform for signal processing, animat control, and artificial multicellular development. In: Kowaliw, T., Bredeche, N., Doursat, R. (eds.) Growing Adaptive Machines. SCI, vol. 557, pp. 187–200. Springer, Heidelberg (2014). https://​doi.​org/​10.​1007/​978-3-642-55337-0_​6CrossRef
15.
go back to reference Yaqoob, M., Wróbel, B.: Robust very small spiking neural networks evolved with noise to recognize temporal patterns. In: Proceedings of the 2018 Conference on Artificial Life, ALIFE 2018, pp. 665–672. MIT Press (2018) Yaqoob, M., Wróbel, B.: Robust very small spiking neural networks evolved with noise to recognize temporal patterns. In: Proceedings of the 2018 Conference on Artificial Life, ALIFE 2018, pp. 665–672. MIT Press (2018)
Metadata
Title
Spiking Neural Networks Evolved to Perform Multiplicative Operations
Authors
Muhammad Aamir Khan
Volker Steuber
Neil Davey
Borys Wróbel
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-01418-6_31

Premium Partner