Skip to main content

2017 | OriginalPaper | Buchkapitel

10. Neuromorphic Hardware Acceleration Enabled by Emerging Technologies

verfasst von : Zheng Li, Chenchen Liu, Hai Li, Yiran Chen

Erschienen in: Emerging Technology and Architecture for Big-data Analytics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The explosion of big data applications imposes severe challenges of data processing speed and scalability on computing system. However, the performance of the von Neumann machine is greatly hindered by the increasing performance gap between CPU and memory, motivating the active research on new or alternative computing architectures. One important instance is the neuromorphic computing engine, which provides the capability of information processing within a compact and energy-efficient platform. Recently, many research efforts have been investigated in utilizing the latest discovered memristors array in neuromorphic systems due to the similarity of memristors to biological synapses. In this chapter, we proposed two neuromorphic system designs with feedback and feedforward methodologies, respectively. Favorable performance in terms of robustness and recognition accuracy are demonstrated by simulation results and corresponding analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat W.A. Wulf, S.A. McKee, Hitting the memory wall: implications of the obvious. ACM SIGARCH Comput. Archit. News 23 (1), 20–24 (1995)CrossRef W.A. Wulf, S.A. McKee, Hitting the memory wall: implications of the obvious. ACM SIGARCH Comput. Archit. News 23 (1), 20–24 (1995)CrossRef
2.
Zurück zum Zitat P. Camilleri, M. Giulioni, V. Dante, D. Badoni, G. Indiveri, B. Michaelis, J. Braun, P. Del Giudice, A neuromorphic avlsi network chip with configurable plastic synapses, in 7th International Conference on Hybrid Intelligent Systems (HIS 2007) (IEEE, 2007), pp. 296–301 P. Camilleri, M. Giulioni, V. Dante, D. Badoni, G. Indiveri, B. Michaelis, J. Braun, P. Del Giudice, A neuromorphic avlsi network chip with configurable plastic synapses, in 7th International Conference on Hybrid Intelligent Systems (HIS 2007) (IEEE, 2007), pp. 296–301
3.
Zurück zum Zitat M. Wang, B. Yan, J. Hu, P. Li, Simulation of large neuronal networks with biophysically accurate models on graphics processors, in The 2011 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2011), pp. 3184–3193 M. Wang, B. Yan, J. Hu, P. Li, Simulation of large neuronal networks with biophysically accurate models on graphics processors, in The 2011 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2011), pp. 3184–3193
4.
Zurück zum Zitat H. Shayani, P.J. Bentley, A.M. Tyrrell, Hardware implementation of a bio-plausible neuron model for evolution and growth of spiking neural networks on FPGA, in NASA/ESA Conference on Adaptive Hardware and Systems (AHS) (IEEE, 2008), pp. 236–243 H. Shayani, P.J. Bentley, A.M. Tyrrell, Hardware implementation of a bio-plausible neuron model for evolution and growth of spiking neural networks on FPGA, in NASA/ESA Conference on Adaptive Hardware and Systems (AHS) (IEEE, 2008), pp. 236–243
5.
Zurück zum Zitat J.A. Anderson, J.W. Silverstein, S.A. Ritz, R.S. Jones, Distinctive features, categorical perception, and probability learning: Some applications of a neural model. Psychol. Rev. 84 (5), 413 (1977) J.A. Anderson, J.W. Silverstein, S.A. Ritz, R.S. Jones, Distinctive features, categorical perception, and probability learning: Some applications of a neural model. Psychol. Rev. 84 (5), 413 (1977)
6.
Zurück zum Zitat T. Kohonen, Self-Organization and Associative Memory, vol. 8 (Springer Science & Business Media, New York, 2012)MATH T. Kohonen, Self-Organization and Associative Memory, vol. 8 (Springer Science & Business Media, New York, 2012)MATH
7.
Zurück zum Zitat W.E. Lillo, D.C. Miller, S. Hui, S.H. Zak, Synthesis of brainstate-in-a-box (BSB) based associative memories. IEEE Trans. Neural Netw. 5 (5), 730–737 (1994)CrossRef W.E. Lillo, D.C. Miller, S. Hui, S.H. Zak, Synthesis of brainstate-in-a-box (BSB) based associative memories. IEEE Trans. Neural Netw. 5 (5), 730–737 (1994)CrossRef
8.
Zurück zum Zitat A. Schultz, Collective recall via the brain-state-in-a-box network. IEEE Trans. Neural Netw. 4 (4), 580–587 (1993)CrossRef A. Schultz, Collective recall via the brain-state-in-a-box network. IEEE Trans. Neural Netw. 4 (4), 580–587 (1993)CrossRef
9.
Zurück zum Zitat Q. Qiu, Q. Wu, M. Bishop, R.E. Pino, R.W. Linderman, A parallel neuromorphic text recognition system and its implementation on a heterogeneous high-performance computing cluster. IEEE Trans. Comput. 62 (5), 886–899 (2013)MathSciNetCrossRef Q. Qiu, Q. Wu, M. Bishop, R.E. Pino, R.W. Linderman, A parallel neuromorphic text recognition system and its implementation on a heterogeneous high-performance computing cluster. IEEE Trans. Comput. 62 (5), 886–899 (2013)MathSciNetCrossRef
10.
Zurück zum Zitat M. Kubat, Neural networks: a comprehensive foundation by Simon Haykin, Macmillan, 1994. Knowl. Eng. Rev. 13, 409–412 (1999). ISBN:0-02-352781-7 M. Kubat, Neural networks: a comprehensive foundation by Simon Haykin, Macmillan, 1994. Knowl. Eng. Rev. 13, 409–412 (1999). ISBN:0-02-352781-7
11.
Zurück zum Zitat J. Partzsch, R. Schuffny, Analyzing the scaling of connectivity in neuromorphic hardware and in models of neural networks. IEEE Trans. Neural Netw. 22 (6), 919–935 (2011)CrossRef J. Partzsch, R. Schuffny, Analyzing the scaling of connectivity in neuromorphic hardware and in models of neural networks. IEEE Trans. Neural Netw. 22 (6), 919–935 (2011)CrossRef
12.
Zurück zum Zitat L. Chua, Memristor-the missing circuit element. IEEE Trans. Circuit Theory 18 (5), 507–519 (1971)CrossRef L. Chua, Memristor-the missing circuit element. IEEE Trans. Circuit Theory 18 (5), 507–519 (1971)CrossRef
13.
Zurück zum Zitat D.B. Strukov, G.S. Snider, D.R. Stewart, R.S. Williams, The missing memristor found. Nature 453, 80–83 (2008)CrossRef D.B. Strukov, G.S. Snider, D.R. Stewart, R.S. Williams, The missing memristor found. Nature 453, 80–83 (2008)CrossRef
14.
Zurück zum Zitat Y. Ho, G.M. Huang, P. Li, Nonvolatile memristor memory: device characteristics and design implications, in Proceedings of the 2009 International Conference on Computer-Aided Design (ACM, 2009), pp. 485–490 Y. Ho, G.M. Huang, P. Li, Nonvolatile memristor memory: device characteristics and design implications, in Proceedings of the 2009 International Conference on Computer-Aided Design (ACM, 2009), pp. 485–490
15.
Zurück zum Zitat D. Niu, Y. Chen, C. Xu, Y. Xie, Impact of process variations on emerging memristor, in 2010 47th ACM/IEEE Design Automation Conference (DAC) (IEEE, 2010), pp. 877–882 D. Niu, Y. Chen, C. Xu, Y. Xie, Impact of process variations on emerging memristor, in 2010 47th ACM/IEEE Design Automation Conference (DAC) (IEEE, 2010), pp. 877–882
16.
Zurück zum Zitat D.B. Strukov, J.L. Borghetti, R.S. Williams, Coupled ionic and electronic transport model of thin-film semiconductor memristive behavior. Small 5 (9), 1058–1063 (2009)CrossRef D.B. Strukov, J.L. Borghetti, R.S. Williams, Coupled ionic and electronic transport model of thin-film semiconductor memristive behavior. Small 5 (9), 1058–1063 (2009)CrossRef
17.
Zurück zum Zitat Y.V. Pershin, M. Di Ventra, Experimental demonstration of associative memory with memristive neural networks. Neural Netw. 23 (7), 881–886 (2010)CrossRef Y.V. Pershin, M. Di Ventra, Experimental demonstration of associative memory with memristive neural networks. Neural Netw. 23 (7), 881–886 (2010)CrossRef
18.
Zurück zum Zitat Q. Qiu, Q. Wu, M. Bishop, R.E. Pino, R.W. Linderman, A parallel neuromorphic text recognition system and its implementation on a heterogeneous high-performance computing cluster. IEEE Trans. Comput. 62 (5), 886–899 (2013)MathSciNetCrossRef Q. Qiu, Q. Wu, M. Bishop, R.E. Pino, R.W. Linderman, A parallel neuromorphic text recognition system and its implementation on a heterogeneous high-performance computing cluster. IEEE Trans. Comput. 62 (5), 886–899 (2013)MathSciNetCrossRef
19.
Zurück zum Zitat Y.V. Pershin, M. Di Ventra, Practical approach to programmable analog circuits with memristors. IEEE Trans. Circuits Syst. I Regul. Pap. 57 (8), 1857–1864 (2010)MathSciNetCrossRef Y.V. Pershin, M. Di Ventra, Practical approach to programmable analog circuits with memristors. IEEE Trans. Circuits Syst. I Regul. Pap. 57 (8), 1857–1864 (2010)MathSciNetCrossRef
20.
Zurück zum Zitat A. Heittmann, T.G. Noll, Limits of writing multivalued resistances in passive nanoelectronic crossbars used in neuromorphic circuits, in Proceedings of the great lakes symposium on VLSI (ACM, 2012), pp. 227–232 A. Heittmann, T.G. Noll, Limits of writing multivalued resistances in passive nanoelectronic crossbars used in neuromorphic circuits, in Proceedings of the great lakes symposium on VLSI (ACM, 2012), pp. 227–232
21.
Zurück zum Zitat U. Ramacher, C. von der Malsburg, On the Construction of Artificial Brains (Springer Science & Business Media, New York, 2010)CrossRef U. Ramacher, C. von der Malsburg, On the Construction of Artificial Brains (Springer Science & Business Media, New York, 2010)CrossRef
22.
Zurück zum Zitat T. Hasegawa, T. Ohno, K. Terabe, T. Tsuruoka, T. Nakayama, J.K. Gimzewski, M. Aono, Learning abilities achieved by a single solid-state atomic switch. Adv. Mater. 22 (16), 1831–1834 (2010)CrossRef T. Hasegawa, T. Ohno, K. Terabe, T. Tsuruoka, T. Nakayama, J.K. Gimzewski, M. Aono, Learning abilities achieved by a single solid-state atomic switch. Adv. Mater. 22 (16), 1831–1834 (2010)CrossRef
23.
Zurück zum Zitat Y. Cassuto, S. Kvatinsky, E. Yaakobi, Sneak-path constraints in memristor crossbar arrays, in 2013 IEEE International Symposium on Information Theory Proceedings (ISIT) (IEEE, 2013), pp. 156–160 Y. Cassuto, S. Kvatinsky, E. Yaakobi, Sneak-path constraints in memristor crossbar arrays, in 2013 IEEE International Symposium on Information Theory Proceedings (ISIT) (IEEE, 2013), pp. 156–160
24.
Zurück zum Zitat J.-J. Huang, Y.-M. Tseng, C.-W. Hsu, T.-H. Hou, Bipolar nonlinear selector for 1s1r crossbar array applications. IEEE Electron Device Lett. 32 (10), 1427–1429 (2011)CrossRef J.-J. Huang, Y.-M. Tseng, C.-W. Hsu, T.-H. Hou, Bipolar nonlinear selector for 1s1r crossbar array applications. IEEE Electron Device Lett. 32 (10), 1427–1429 (2011)CrossRef
25.
Zurück zum Zitat S. Yu, Y. Wu, H.-S.P. Wong, Investigating the switching dynamics and multilevel capability of bipolar metal oxide resistive switching memory. Appl. Phys. Lett. 98 (10), 103514 (2011) S. Yu, Y. Wu, H.-S.P. Wong, Investigating the switching dynamics and multilevel capability of bipolar metal oxide resistive switching memory. Appl. Phys. Lett. 98 (10), 103514 (2011)
26.
Zurück zum Zitat S.H. Jo, K.-H. Kim, W. Lu, High-density crossbar arrays based on a si memristive system. Nano Lett. 9 (2), 870–874 (2009)CrossRef S.H. Jo, K.-H. Kim, W. Lu, High-density crossbar arrays based on a si memristive system. Nano Lett. 9 (2), 870–874 (2009)CrossRef
27.
Zurück zum Zitat M. Hu, H. Li, Y. Chen, Q. Wu, G.S. Rose, R.W. Linderman, Memristor crossbar-based neuromorphic computing system: a case study. IEEE Trans. Neural Netw. Learn. Syst. 25 (10), 1864–1878 (2014)CrossRef M. Hu, H. Li, Y. Chen, Q. Wu, G.S. Rose, R.W. Linderman, Memristor crossbar-based neuromorphic computing system: a case study. IEEE Trans. Neural Netw. Learn. Syst. 25 (10), 1864–1878 (2014)CrossRef
28.
Zurück zum Zitat W. Gerstner, W.M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity (Cambridge University Press, Cambridge, 2002)CrossRefMATH W. Gerstner, W.M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity (Cambridge University Press, Cambridge, 2002)CrossRefMATH
29.
Zurück zum Zitat Y. Park, Optimal and robust design of brain-state-in-a-box neural associative memories. Neural Netw. 23 (2), 210–218 (2010)CrossRef Y. Park, Optimal and robust design of brain-state-in-a-box neural associative memories. Neural Netw. 23 (2), 210–218 (2010)CrossRef
30.
Zurück zum Zitat W.E. Lillo, D.C. Miller, S. Hui, S.H. Zak, Synthesis of brain-state-in-a-box (BSB) based associative memories. IEEE Trans. Neural Netw. 5 (5), 730–737 (1994)CrossRef W.E. Lillo, D.C. Miller, S. Hui, S.H. Zak, Synthesis of brain-state-in-a-box (BSB) based associative memories. IEEE Trans. Neural Netw. 5 (5), 730–737 (1994)CrossRef
31.
Zurück zum Zitat R. Perfetti, A synthesis procedure for brain-state-in-a-box neural networks. IEEE Trans. Neural Netw. 6 (5), 1071–1080 (1995)CrossRef R. Perfetti, A synthesis procedure for brain-state-in-a-box neural networks. IEEE Trans. Neural Netw. 6 (5), 1071–1080 (1995)CrossRef
32.
Zurück zum Zitat Q. Qiu, Q. Wu, R. Linderman, Unified perception-prediction model for context aware text recognition on a heterogeneous many-core platform, in The 2011 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2011), pp. 1714–1721 Q. Qiu, Q. Wu, R. Linderman, Unified perception-prediction model for context aware text recognition on a heterogeneous many-core platform, in The 2011 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2011), pp. 1714–1721
Metadaten
Titel
Neuromorphic Hardware Acceleration Enabled by Emerging Technologies
verfasst von
Zheng Li
Chenchen Liu
Hai Li
Yiran Chen
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-54840-1_10

Neuer Inhalt