Skip to main content

2017 | OriginalPaper | Buchkapitel

Computing with Biophysical and Hardware-Efficient Neural Models

verfasst von : Konstantin Selyunin, Ramin M. Hasani, Denise Ratasich, Ezio Bartocci, Radu Grosu

Erschienen in: Advances in Computational Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we evaluate how seminal biophysical Hodgkin Huxley model and hardware-efficient TrueNorth model of spiking neurons can be used to perform computations on spike rates in frequency domain. This side-by-side evaluation allows us to draw connections how fundamental arithmetic operations can be realized by means of spiking neurons and what assumptions should be made on input to guarantee the correctness of the computed result. We validated our approach in simulation and consider this work as a first step towards FPGA hardware implementation of neuromorphic accelerators based on spiking models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophy. 5(4), 115–133 (1943)MathSciNetCrossRefMATH McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophy. 5(4), 115–133 (1943)MathSciNetCrossRefMATH
2.
Zurück zum Zitat da Silva, R.M., de Macedo Mourelle, L., Nedjah, N.: Compact yet efficient hardware architecture for multilayer-perceptron neural networks. SBA: Controle Automacao Soc. Bras. de Automatica 22, 647–663 (2011) da Silva, R.M., de Macedo Mourelle, L., Nedjah, N.: Compact yet efficient hardware architecture for multilayer-perceptron neural networks. SBA: Controle Automacao Soc. Bras. de Automatica 22, 647–663 (2011)
3.
Zurück zum Zitat Wang, R., Hamilton, T.J., Tapson, J., van Schaik, A.: An FPGA design framework for large-scale spiking neural networks. In: 2014 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 457–460, June 2014 Wang, R., Hamilton, T.J., Tapson, J., van Schaik, A.: An FPGA design framework for large-scale spiking neural networks. In: 2014 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 457–460, June 2014
4.
Zurück zum Zitat Cassidy, A.S., Merolla, P., Arthur, J.V., Esser, S.K., Jackson, B., Alvarez-icaza, R., Datta, P., Sawada, J., Wong, T.M., Feldman, V., Amir, A., Rubin, D.B.-D., Mcquinn, E., Risk, W.P., Modha, D.S.: Cognitive computing building block: a versatile and efficient digital neuron model for neurosynaptic cores. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2013) Cassidy, A.S., Merolla, P., Arthur, J.V., Esser, S.K., Jackson, B., Alvarez-icaza, R., Datta, P., Sawada, J., Wong, T.M., Feldman, V., Amir, A., Rubin, D.B.-D., Mcquinn, E., Risk, W.P., Modha, D.S.: Cognitive computing building block: a versatile and efficient digital neuron model for neurosynaptic cores. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2013)
5.
Zurück zum Zitat Du, Z., Ben-Dayan Rubin, D.D., Chen, Y., He, L., Chen, T., Zhang, L., Wu, C., Temam, O.: Neuromorphic accelerators: a comparison between neuroscience and machine-learning approaches. In: Proceedings of the 48th International Symposium on Microarchitecture, MICRO-48, pp. 494–507. ACM, New York (2015) Du, Z., Ben-Dayan Rubin, D.D., Chen, Y., He, L., Chen, T., Zhang, L., Wu, C., Temam, O.: Neuromorphic accelerators: a comparison between neuroscience and machine-learning approaches. In: Proceedings of the 48th International Symposium on Microarchitecture, MICRO-48, pp. 494–507. ACM, New York (2015)
6.
Zurück zum Zitat Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500–544 (1952)CrossRef Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500–544 (1952)CrossRef
7.
Zurück zum Zitat Roth, A., van Rossum, M.C.W.: Modeling synapses. Comput. Model. Methods Neurosci. 6, 139–160 (2009)CrossRef Roth, A., van Rossum, M.C.W.: Modeling synapses. Comput. Model. Methods Neurosci. 6, 139–160 (2009)CrossRef
8.
Zurück zum Zitat Schüz, A., Palm, G.: Density of neurons and synapses in the cerebral cortex of the mouse. J. Comp. Neurol. 286(4), 442–455 (1989)CrossRef Schüz, A., Palm, G.: Density of neurons and synapses in the cerebral cortex of the mouse. J. Comp. Neurol. 286(4), 442–455 (1989)CrossRef
9.
Zurück zum Zitat Drion, G., Massotte, L., Sepulchre, R., Seutin, V.: How modeling can reconcile apparently discrepant experimental results: the case of pacemaking in dopaminergic neurons. PLoS Comput. Biol. 7(5), e1002050 (2011)CrossRef Drion, G., Massotte, L., Sepulchre, R., Seutin, V.: How modeling can reconcile apparently discrepant experimental results: the case of pacemaking in dopaminergic neurons. PLoS Comput. Biol. 7(5), e1002050 (2011)CrossRef
10.
Zurück zum Zitat Trachtenberg, J.T., Chen, B.E., Knott, G.W., Feng, G., Sanes, J.R., Welker, E., Svoboda, K.: Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex. Nature 420(6917), 788–794 (2002)CrossRef Trachtenberg, J.T., Chen, B.E., Knott, G.W., Feng, G., Sanes, J.R., Welker, E., Svoboda, K.: Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex. Nature 420(6917), 788–794 (2002)CrossRef
11.
Zurück zum Zitat Dan, Y., Poo, M.-M.: Spike timing-dependent plasticity: from synapse to perception. Physiol. Rev. 86(3), 1033–1048 (2006)CrossRef Dan, Y., Poo, M.-M.: Spike timing-dependent plasticity: from synapse to perception. Physiol. Rev. 86(3), 1033–1048 (2006)CrossRef
12.
Zurück zum Zitat Jia, H., Rochefort, N.L., Chen, X., Konnerth, A.: Dendritic organization of sensory input to cortical neurons in vivo. Nature 464(7293), 1307–1312 (2010)CrossRef Jia, H., Rochefort, N.L., Chen, X., Konnerth, A.: Dendritic organization of sensory input to cortical neurons in vivo. Nature 464(7293), 1307–1312 (2010)CrossRef
13.
Zurück zum Zitat Brette, R.: What is the most realistic single-compartment model of spike initiation? PLOS Comput. Biol. 11(4), 1–13 (2015)MathSciNetCrossRef Brette, R.: What is the most realistic single-compartment model of spike initiation? PLOS Comput. Biol. 11(4), 1–13 (2015)MathSciNetCrossRef
14.
Zurück zum Zitat Izhikevich, E.M.: Which model to use for cortical spiking neurons. IEEE Trans. Neural Netw. 15, 1063–1070 (2004)CrossRef Izhikevich, E.M.: Which model to use for cortical spiking neurons. IEEE Trans. Neural Netw. 15, 1063–1070 (2004)CrossRef
15.
Zurück zum Zitat Hines, M.: NEURON a program for simulation of nerve equations. In: Eeckman, F.H. (ed.) Neural Systems: Analysis and Modeling, pp. 127–136. Springer, Heidelberg (1993)CrossRef Hines, M.: NEURON a program for simulation of nerve equations. In: Eeckman, F.H. (ed.) Neural Systems: Analysis and Modeling, pp. 127–136. Springer, Heidelberg (1993)CrossRef
16.
Zurück zum Zitat Gewaltig, M.-O., Diesmann, M.: Nest (neural simulation tool). Scholarpedia 2(4), 1430 (2007)CrossRef Gewaltig, M.-O., Diesmann, M.: Nest (neural simulation tool). Scholarpedia 2(4), 1430 (2007)CrossRef
17.
Zurück zum Zitat Sarpeshkar, R., Watts, L., Mead, C.: Refractory Neuron Circuits. Caltech Authors, Pasadena (1992) Sarpeshkar, R., Watts, L., Mead, C.: Refractory Neuron Circuits. Caltech Authors, Pasadena (1992)
18.
Zurück zum Zitat Graas, E.L., Brown, E.A., Lee, R.H.: An FPGA-based approach to high-speed simulation of conductance-based neuron models. Neuroinformatics 2(4), 417–435 (2004)CrossRef Graas, E.L., Brown, E.A., Lee, R.H.: An FPGA-based approach to high-speed simulation of conductance-based neuron models. Neuroinformatics 2(4), 417–435 (2004)CrossRef
19.
Zurück zum Zitat Indiveri, G., Linares-Barranco, B., Hamilton, T.J., Van Schaik, A., Etienne-Cummings, R., Delbruck, T., Liu, S.-C., Dudek, P., Hafliger, P., Renaud, S., et al.: Neuromorphic silicon neuron circuits. Front. Neurosci. 5, 73 (2011) Indiveri, G., Linares-Barranco, B., Hamilton, T.J., Van Schaik, A., Etienne-Cummings, R., Delbruck, T., Liu, S.-C., Dudek, P., Hafliger, P., Renaud, S., et al.: Neuromorphic silicon neuron circuits. Front. Neurosci. 5, 73 (2011)
20.
Zurück zum Zitat Hasani, R.M., Ferrari, G., Yamamoto, H., Kono, S., Ishihara, K., Fujimori, S., Tanii, T., Prati, E.: Control of the correlation of spontaneous neuron activity in biological and noise-activated CMOS artificial neural microcircuits. arXiv preprint arXiv:1702.07426 (2017) Hasani, R.M., Ferrari, G., Yamamoto, H., Kono, S., Ishihara, K., Fujimori, S., Tanii, T., Prati, E.: Control of the correlation of spontaneous neuron activity in biological and noise-activated CMOS artificial neural microcircuits. arXiv preprint arXiv:​1702.​07426 (2017)
21.
Zurück zum Zitat Esser, S.K., Andreopoulos, A., Appuswamy, R., Datta, P., Barch, D., Amir, A., Arthur, J.V., Cassidy, A., Flickner, M., Merolla, P., Chandra, S., Basilico, N., Carpin, S., Zimmerman, T., Zee, F., Alvarez-Icaza, R., Kusnitz, J.A., Wong, T.M., Risk, W.P., McQuinn, E., Nayak, T.K., Singh, R., Modha, D.S.: Cognitive computing systems: algorithms and applications for networks of neurosynaptic cores. In: IJCNN, pp. 1–10. IEEE (2013) Esser, S.K., Andreopoulos, A., Appuswamy, R., Datta, P., Barch, D., Amir, A., Arthur, J.V., Cassidy, A., Flickner, M., Merolla, P., Chandra, S., Basilico, N., Carpin, S., Zimmerman, T., Zee, F., Alvarez-Icaza, R., Kusnitz, J.A., Wong, T.M., Risk, W.P., McQuinn, E., Nayak, T.K., Singh, R., Modha, D.S.: Cognitive computing systems: algorithms and applications for networks of neurosynaptic cores. In: IJCNN, pp. 1–10. IEEE (2013)
22.
Zurück zum Zitat Amir, A., Datta, P., Risk, W.P., Cassidy, A.S., Kusnitz, J.A., Esser, S.K., Andreopoulos, E., Wong, T.M., Flickner, M., Alvarez-icaza, R., Mcquinn, E., Shaw, B., Pass, N., Modha, D.S.: Cognitive computing programming paradigm: a corelet language for composing networks of neurosynaptic cores. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2013) Amir, A., Datta, P., Risk, W.P., Cassidy, A.S., Kusnitz, J.A., Esser, S.K., Andreopoulos, E., Wong, T.M., Flickner, M., Alvarez-icaza, R., Mcquinn, E., Shaw, B., Pass, N., Modha, D.S.: Cognitive computing programming paradigm: a corelet language for composing networks of neurosynaptic cores. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2013)
23.
Zurück zum Zitat Selyunin, K., Nguyen, T., Bartocci, E., Nickovic, D., Grosu, R.: Monitoring of MTL specifications with IBM’s spiking-neuron model. In: Proceedings of the 19th Design, Automation and Test in Europe Conference and Exhibition, DATE 2016, Dresden, Germany, 14–18 March 2016 (2016) Selyunin, K., Nguyen, T., Bartocci, E., Nickovic, D., Grosu, R.: Monitoring of MTL specifications with IBM’s spiking-neuron model. In: Proceedings of the 19th Design, Automation and Test in Europe Conference and Exhibition, DATE 2016, Dresden, Germany, 14–18 March 2016 (2016)
24.
Zurück zum Zitat Van Vreeswijk, C., Abbott, L.F., Bard Ermentrout, G.: When inhibition not excitation synchronizes neural firing. J. Comput. Neurosci. 1(4), 313–321 (1994)CrossRef Van Vreeswijk, C., Abbott, L.F., Bard Ermentrout, G.: When inhibition not excitation synchronizes neural firing. J. Comput. Neurosci. 1(4), 313–321 (1994)CrossRef
25.
Zurück zum Zitat Dayan, P., Abbott, L.F.: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. The MIT Press, Cambridge (2005)MATH Dayan, P., Abbott, L.F.: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. The MIT Press, Cambridge (2005)MATH
Metadaten
Titel
Computing with Biophysical and Hardware-Efficient Neural Models
verfasst von
Konstantin Selyunin
Ramin M. Hasani
Denise Ratasich
Ezio Bartocci
Radu Grosu
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-59153-7_46