Skip to main content
Erschienen in: Cognitive Computation 5/2016

01.10.2016

Parallel Brain Simulator: A Multi-scale and Parallel Brain-Inspired Neural Network Modeling and Simulation Platform

verfasst von: Xin Liu, Yi Zeng, Tielin Zhang, Bo Xu

Erschienen in: Cognitive Computation | Ausgabe 5/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The brain is naturally a parallel and distributed system. Reverse engineering a cognitive brain is considered to be a grand challenge. In this paper, we present the parallel brain simulator (PBS), a parallel and distributed platform for modeling the cognitive brain at multiple scales. Inspired by large-scale graph computation, PBS can be considered as a universal parallel execution engine, which is aimed at reducing the complexity of distributed programming and providing an easy to use programmable platform for computational neuroscientists and artificial intelligence researchers for modeling and simulation of large-scale neural networks. As illustrative examples and validations, three brain-inspired neural networks which are built on PBS are introduced, including the 1:1 human hippocampus network, the 1:1 mouse whole-brain network and the CASIA brain simulator built for cognitive robotics. We deploy PBS on both commodity clusters and supercomputers, and a scalable performance is achieved. In addition, we provide evaluations on the scalability and performance of both lumped synapse-based simulation and non-lumped synapse-based simulation with different data-graph distribution methods to show the effectiveness and usability of the PBS platform.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aleksander I, Morton H. An introduction to neural computing. London: Chapman and Hall; 1990. Aleksander I, Morton H. An introduction to neural computing. London: Chapman and Hall; 1990.
2.
Zurück zum Zitat Ananthanarayanan R, Esser S, Simon H, Modha D. The cat is out of the bag: cortical simulations with 109 neurons and 1013 synapses. In: Proceedings of the SC conference on high performance networking and computing, 2009. 2009;1: p. 1–12 IEEE. Ananthanarayanan R, Esser S, Simon H, Modha D. The cat is out of the bag: cortical simulations with 109 neurons and 1013 synapses. In: Proceedings of the SC conference on high performance networking and computing, 2009. 2009;1: p. 1–12 IEEE.
3.
Zurück zum Zitat Azevedo F, Carvalho L, Grinberg L, Farfel JM, Ferretti R, Leite R, Jilho WJ, Lent R, Herculano-Houzel S. Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled-up primate brain. J Comp Neurol. 2009;513(5):532–41.CrossRefPubMed Azevedo F, Carvalho L, Grinberg L, Farfel JM, Ferretti R, Leite R, Jilho WJ, Lent R, Herculano-Houzel S. Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled-up primate brain. J Comp Neurol. 2009;513(5):532–41.CrossRefPubMed
4.
Zurück zum Zitat Beeman D, Wang Z, Edwards M, Bhalla U, Cornelis H, Bower JM. The GENESIS 3.0 project: a universal graphical user interface and database for research, collaboration, and education in computational neuroscience. BMC Neurosci. 2007;8(suppl 2):4.CrossRef Beeman D, Wang Z, Edwards M, Bhalla U, Cornelis H, Bower JM. The GENESIS 3.0 project: a universal graphical user interface and database for research, collaboration, and education in computational neuroscience. BMC Neurosci. 2007;8(suppl 2):4.CrossRef
5.
Zurück zum Zitat Boss BD, Peterson GM, Cowan WM. On the number of neurons in the dentate gyrus of the rat. Brain Res. 1985;338(1):144–50.CrossRefPubMed Boss BD, Peterson GM, Cowan WM. On the number of neurons in the dentate gyrus of the rat. Brain Res. 1985;338(1):144–50.CrossRefPubMed
6.
Zurück zum Zitat Brette R, Rudolph M, Carnevale T, Hines M, Beeman D, Bower JM, Diesmann M, Morrison A, Goodman PH, Zirpe M, Natschlger T, Pecevski D, Ermentrout B, Djurfeldt M, Lansner A, Rochel O, Vieville T, Muller E, Davison AP, Boustani SE, Destexh A. Simulation of networks of spiking neurons: a review of tools and strategies. J Comp Neurosci. 2007;23(3):349–98.CrossRef Brette R, Rudolph M, Carnevale T, Hines M, Beeman D, Bower JM, Diesmann M, Morrison A, Goodman PH, Zirpe M, Natschlger T, Pecevski D, Ermentrout B, Djurfeldt M, Lansner A, Rochel O, Vieville T, Muller E, Davison AP, Boustani SE, Destexh A. Simulation of networks of spiking neurons: a review of tools and strategies. J Comp Neurosci. 2007;23(3):349–98.CrossRef
7.
Zurück zum Zitat Carnevale N, Hines M. The NEURON book. Cambridge: Cambridge University Press; 2006.CrossRef Carnevale N, Hines M. The NEURON book. Cambridge: Cambridge University Press; 2006.CrossRef
8.
Zurück zum Zitat Cutsuridis V, Graham B, Cobb S, Vida I. Hippocampal microcircuits. New York: Springer; 2010.CrossRef Cutsuridis V, Graham B, Cobb S, Vida I. Hippocampal microcircuits. New York: Springer; 2010.CrossRef
9.
Zurück zum Zitat Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters. In: Proceedings of the USENIX symposium on operating systems design and implementation, 2004. OSDI, 2004. 2004; IEEE. Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters. In: Proceedings of the USENIX symposium on operating systems design and implementation, 2004. OSDI, 2004. 2004; IEEE.
10.
Zurück zum Zitat Eliasmith C. How to build a brain: a neural architecture for biological cognition. Oxford: Oxford University Press; 2013.CrossRef Eliasmith C. How to build a brain: a neural architecture for biological cognition. Oxford: Oxford University Press; 2013.CrossRef
11.
Zurück zum Zitat Eliasmith C, Anderson C. Neural engineering: computation, representation, and dynamics in neurobiological systems. Cambridge: MIT press; 2004. Eliasmith C, Anderson C. Neural engineering: computation, representation, and dynamics in neurobiological systems. Cambridge: MIT press; 2004.
12.
Zurück zum Zitat Eliasmith C, Stewart T, Choo X, Bekolay T, Dewolf T, Tang Y, Rasmussen D. A large-scale model of the functioning brain. Science. 2012;338:1202–5.CrossRefPubMed Eliasmith C, Stewart T, Choo X, Bekolay T, Dewolf T, Tang Y, Rasmussen D. A large-scale model of the functioning brain. Science. 2012;338:1202–5.CrossRefPubMed
13.
Zurück zum Zitat Eliasmith C, Trujilo O. The use and abuse of large-scale brain models. Curr Option Neurobiol. 2014;25:1–6.CrossRef Eliasmith C, Trujilo O. The use and abuse of large-scale brain models. Curr Option Neurobiol. 2014;25:1–6.CrossRef
14.
Zurück zum Zitat Gewaltig MO, Morrison A, Plesser HE. NEST by example: an introduction to the Neural Simulation Tool NEST. In: Le Novère N, editor. Computational systems neurobiology. Springer; 2012. p. 533–558. Gewaltig MO, Morrison A, Plesser HE. NEST by example: an introduction to the Neural Simulation Tool NEST. In: Le Novère N, editor. Computational systems neurobiology. Springer; 2012. p. 533–558.
15.
Zurück zum Zitat Gonzalez J, Low Y, Gu H, Bickson D. Powergraph: distributed graph-parallel computation on natural graphs. In: Proceedings of the USENIX symposium on operating systems design and implementation, 2012. OSDI, 2012. 2012; IEEE. Gonzalez J, Low Y, Gu H, Bickson D. Powergraph: distributed graph-parallel computation on natural graphs. In: Proceedings of the USENIX symposium on operating systems design and implementation, 2012. OSDI, 2012. 2012; IEEE.
17.
Zurück zum Zitat Hammarlund P, Ekeberg O. Large neural network simulations on multiple hardware platforms. J Comput Neurosci. 1998;5(4):443–59.CrossRefPubMed Hammarlund P, Ekeberg O. Large neural network simulations on multiple hardware platforms. J Comput Neurosci. 1998;5(4):443–59.CrossRefPubMed
18.
Zurück zum Zitat Hodgkin AL, Huxley AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol. 1952;117(4):500–544.CrossRefPubMedPubMedCentral Hodgkin AL, Huxley AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol. 1952;117(4):500–544.CrossRefPubMedPubMedCentral
19.
20.
Zurück zum Zitat Jaeger H. The “echo state” approach to analysing and training recurrent neural networks-with an erratum note. In: Technical report, German National Research Center for Information Technology. 2001. Jaeger H. The “echo state” approach to analysing and training recurrent neural networks-with an erratum note. In: Technical report, German National Research Center for Information Technology. 2001.
21.
Zurück zum Zitat Kunkel S, Schmidt M, Eppler JM, Plesser HE, Masumoto G, Igarashi J, Ishii S, Fukai T, Morrison A, Diesmann M, Helias M. Spiking network simulation code for petascale computers. Front Neuroinform. 2014;10(8):78. Kunkel S, Schmidt M, Eppler JM, Plesser HE, Masumoto G, Igarashi J, Ishii S, Fukai T, Morrison A, Diesmann M, Helias M. Spiking network simulation code for petascale computers. Front Neuroinform. 2014;10(8):78.
22.
Zurück zum Zitat Lansner A, Diesmann M. Virtues, pitfalls, and methodology of neuronal network modeling and simulations on supercomputers. In: Proceedings of the Chapter 10 in Nicolas Le Novre computational systems biology, Springer 2012. Lansner A, Diesmann M. Virtues, pitfalls, and methodology of neuronal network modeling and simulations on supercomputers. In: Proceedings of the Chapter 10 in Nicolas Le Novre computational systems biology, Springer 2012.
23.
Zurück zum Zitat Le NN. Computational systems neurobiology. New York: Springer; 2012. Le NN. Computational systems neurobiology. New York: Springer; 2012.
24.
Zurück zum Zitat Low Y, Gonzalez J, Kyrola A, Bickson D, Guestrin C, Hellerstein JM. Distributed graphlab: a framework for machine learning and data mining in the cloud. In: Proceedings of the very large database endowment, 2012. VLDB, 2012. 2012;5(8), IEEE. Low Y, Gonzalez J, Kyrola A, Bickson D, Guestrin C, Hellerstein JM. Distributed graphlab: a framework for machine learning and data mining in the cloud. In: Proceedings of the very large database endowment, 2012. VLDB, 2012. 2012;5(8), IEEE.
25.
Zurück zum Zitat Malewicz G, Austern MH, Bik AJC, Dehnert JC, Horn I, Leiser N, Czajkowski G. Pregel: a system for large-scale graph processing. In: ACM special interest group on management of data, 2010. SIGMOD, 2010. 2010; IEEE. Malewicz G, Austern MH, Bik AJC, Dehnert JC, Horn I, Leiser N, Czajkowski G. Pregel: a system for large-scale graph processing. In: ACM special interest group on management of data, 2010. SIGMOD, 2010. 2010; IEEE.
26.
Zurück zum Zitat Miller G. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol Rev. 1956;63(2):81–97.CrossRefPubMed Miller G. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol Rev. 1956;63(2):81–97.CrossRefPubMed
27.
Zurück zum Zitat Morrison A, Aertsen A, Diesmann M. Spike-timing dependent plasticity in balanced random networks. Neural Comput. 2007;19:1437–67.CrossRefPubMed Morrison A, Aertsen A, Diesmann M. Spike-timing dependent plasticity in balanced random networks. Neural Comput. 2007;19:1437–67.CrossRefPubMed
28.
Zurück zum Zitat Oh SW, Harris JA, Ng L, Winslow B, Cain N, Mihalas S, Wang Q, Lau C, Kuan L, Henry AM, Mortrud MT, Ouellette B, Nguyen TN, Sorensen SA, Slaughterbeck CR, Wakeman W, Li Y, Feng D, Ho A, Nicholas E, Hirokawa KE, Bohn P, Joines KM, Peng H, Hawrylycz MJ, Phillips JW, Hohmann JG, Wohnoutka P, Gerfen CR, Koch C, Bernard A, Dang C, Jones AR, Zeng H. A mesoscale connectome of the mouse brain. Nature. 2014;508:207–14.CrossRefPubMed Oh SW, Harris JA, Ng L, Winslow B, Cain N, Mihalas S, Wang Q, Lau C, Kuan L, Henry AM, Mortrud MT, Ouellette B, Nguyen TN, Sorensen SA, Slaughterbeck CR, Wakeman W, Li Y, Feng D, Ho A, Nicholas E, Hirokawa KE, Bohn P, Joines KM, Peng H, Hawrylycz MJ, Phillips JW, Hohmann JG, Wohnoutka P, Gerfen CR, Koch C, Bernard A, Dang C, Jones AR, Zeng H. A mesoscale connectome of the mouse brain. Nature. 2014;508:207–14.CrossRefPubMed
29.
Zurück zum Zitat Pecevski D, Natschlger T, Schuch K. Pcsim: a parallel simulation environment for neural circuits fully integrated with python. Front Neuroinform. 2009;3:11.CrossRefPubMedPubMedCentral Pecevski D, Natschlger T, Schuch K. Pcsim: a parallel simulation environment for neural circuits fully integrated with python. Front Neuroinform. 2009;3:11.CrossRefPubMedPubMedCentral
30.
Zurück zum Zitat Rotter S, Diesman M. Exact digital simulation of time-invariant linear systems with applications to neuronal modeling. Biol Cybern. 1999;81(5/6):381–402.CrossRefPubMed Rotter S, Diesman M. Exact digital simulation of time-invariant linear systems with applications to neuronal modeling. Biol Cybern. 1999;81(5/6):381–402.CrossRefPubMed
31.
Zurück zum Zitat Seress L. Interspecies comparison of the hippocampal formation shows increased emphasis on the region superior in the ammon’s horn of the human brain. J Hirnforsch. 1988;29:335–40.PubMed Seress L. Interspecies comparison of the hippocampal formation shows increased emphasis on the region superior in the ammon’s horn of the human brain. J Hirnforsch. 1988;29:335–40.PubMed
32.
Zurück zum Zitat Song S, Miller KD, Abbott LF. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci. 2000;3:919–26.CrossRefPubMed Song S, Miller KD, Abbott LF. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci. 2000;3:919–26.CrossRefPubMed
33.
Zurück zum Zitat Yonezawa A, Watanabe T, Yokokawa M, Sato M, Hirao K. Advanced institute for computational science (aics): Japanese national high-performance computing research institute and its 10-petaflops supercomputer. In: Proceedings of the SC conference on high performance networking and computing, 2011 2011.13, pp. 1–8 IEEE. Yonezawa A, Watanabe T, Yokokawa M, Sato M, Hirao K. Advanced institute for computational science (aics): Japanese national high-performance computing research institute and its 10-petaflops supercomputer. In: Proceedings of the SC conference on high performance networking and computing, 2011 2011.13, pp. 1–8 IEEE.
34.
Zurück zum Zitat Zhang T, Zeng Y, Xu B. A computational effort towards the microscale mouse brain connectome from the mesoscale. Manuscript, 2015. Zhang T, Zeng Y, Xu B. A computational effort towards the microscale mouse brain connectome from the mesoscale. Manuscript, 2015.
Metadaten
Titel
Parallel Brain Simulator: A Multi-scale and Parallel Brain-Inspired Neural Network Modeling and Simulation Platform
verfasst von
Xin Liu
Yi Zeng
Tielin Zhang
Bo Xu
Publikationsdatum
01.10.2016
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 5/2016
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-016-9411-y

Weitere Artikel der Ausgabe 5/2016

Cognitive Computation 5/2016 Zur Ausgabe

Premium Partner