Skip to main content
Top

2017 | OriginalPaper | Chapter

Novel Biomimetic Si Devices for Neuromorphic Computing Architecture

Authors : U. Ganguly, Bipin Rajendran

Published in: Advances in Neuromorphic Hardware Exploiting Emerging Nanoscale Devices

Publisher: Springer India

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Neuromorphic computing requires low-power devices and circuits in cross-point architecture. On-chip learning is a significant challenge that requires the implementation of learning rules like spike-timing-dependent plasticity (STDP)—a method that modifies synaptic strength depending upon the time correlation between the presynaptic and postsynaptic neuron spikes in a specific function. To implement this capability in phase-change memory (PCM) or resistance RAM (RRAM)-based cross-point arrays, two schemes have been proposed in the literature where the time correlations are captured by an address event representation scheme using an universal bus or superposition of long custom waveforms. In comparison, in biology, the pulses are sharp and the time correlation information is processed at the synapse by the natural dynamics of the synapse. These are attractive attributes for minimizing power and complexity/area. Another challenge is realizing an area- and power-efficient implementation of the electronic neuron. A leaky integrate-and-fire (LIF) neuron has been implemented using analog and digital circuits which are highly power and area inefficient. To improve area and power efficiency, we have recently proposed: (i) A Si diode-based synaptic device where the charge carrier internal dynamics is used to capture the time correlation based on sharp pulses (100\(\times \) sharper than custom waveforms to improve energy per spike) which can operate at 10\(^{3}\)–10\(^{6}\) times faster than biology (providing accelerated learning) and (ii) A compact Si neuronal device that has a 60\(\times \) area and 5\(\times \) power benefit compared to analog implementation of neurons. These are novel devices that are based on SiGe CMOS technology, and they are highly manufacturable. The synaptic devices are based on natural transients of the impact ionization-based n\(^{+}\) p n\(^{+}\) diode (I-NPN diode). STDP and Hebbian learning rules have been implemented. The neuron requires further modification of the I-NPN diode requiring a gating structure and some simple circuits. A leaky integrate-and-fire (LIF) neuron has also been demonstrated. Based on their device-level area and power efficiency, system-level power and area of neural networks will be highly enhanced.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Anil, K.G., Mahapatra, S., Eisele, I.: A detailed experimental investigation of impact ionization in n-channel metal-oxide-semiconductor field-effect-transistors at very low drain voltages. Solid-State Electron. 47(6), 995–1001 (2003). doi:10.1016/S0038-1101(02)00458-6 CrossRef Anil, K.G., Mahapatra, S., Eisele, I.: A detailed experimental investigation of impact ionization in n-channel metal-oxide-semiconductor field-effect-transistors at very low drain voltages. Solid-State Electron. 47(6), 995–1001 (2003). doi:10.​1016/​S0038-1101(02)00458-6 CrossRef
2.
go back to reference Bafna, P., Karkare, P., Srinivasan, S., Chopra, S., Lashkare, S., Kim, Y., ... Ganguly, U.: Epitaxial Si punch-through based selector for bipolar RRAM. In: 2012 70th Annual Device Research Conference (DRC) (2012). doi:10.1109/DRC.2012.6256979 Bafna, P., Karkare, P., Srinivasan, S., Chopra, S., Lashkare, S., Kim, Y., ... Ganguly, U.: Epitaxial Si punch-through based selector for bipolar RRAM. In: 2012 70th Annual Device Research Conference (DRC) (2012). doi:10.​1109/​DRC.​2012.​6256979
3.
go back to reference Bi, G., Poo, M.: Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18(24), 10464–10472 (1998) Bi, G., Poo, M.: Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18(24), 10464–10472 (1998)
4.
go back to reference Chopra, S., Bafna, P., Karkare, P., Srinivasan, S., Lashkare, S., Kumbhare, P., et al.: A two terminal vertical selector device for bipolar RRAM. Meeting Abstracts, No. 37, p. 2804 (2012) Chopra, S., Bafna, P., Karkare, P., Srinivasan, S., Lashkare, S., Kumbhare, P., et al.: A two terminal vertical selector device for bipolar RRAM. Meeting Abstracts, No. 37, p. 2804 (2012)
5.
go back to reference Chou, T., Liu, J.-C., Chiu, L.-W., Wang, I.-T., Tsai, C.-M., Hou, T.-H.: Neuromorphic pattern learning using HBM electronic synapse with excitatory and inhibitory plasticity. In: 2015 International Symposium on VLSI Technology, Systems and Application (VLSI-TSA) (2015). doi:10.1109/VLSI-TSA.2015.7117582 Chou, T., Liu, J.-C., Chiu, L.-W., Wang, I.-T., Tsai, C.-M., Hou, T.-H.: Neuromorphic pattern learning using HBM electronic synapse with excitatory and inhibitory plasticity. In: 2015 International Symposium on VLSI Technology, Systems and Application (VLSI-TSA) (2015). doi:10.​1109/​VLSI-TSA.​2015.​7117582
7.
go back to reference Culurciello, E., Andreou, A.G.: A comparative study of access topologies for chip-level address-event communication channels. IEEE Trans. Neural Netw. (2003). doi:10.1109/TNN.2003.816385 Culurciello, E., Andreou, A.G.: A comparative study of access topologies for chip-level address-event communication channels. IEEE Trans. Neural Netw. (2003). doi:10.​1109/​TNN.​2003.​816385
8.
go back to reference Das, B., Meshram, R., Ostwal, V., Schulze, J., Ganguly, U.: Observation of impact ionization at sub-0.5V and resultant improvement in ideality in I-NPN selector device by Si epitaxy for RRAM applications. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.1109/DRC.2014.6872336 Das, B., Meshram, R., Ostwal, V., Schulze, J., Ganguly, U.: Observation of impact ionization at sub-0.5V and resultant improvement in ideality in I-NPN selector device by Si epitaxy for RRAM applications. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.​1109/​DRC.​2014.​6872336
9.
go back to reference Deshmukh, S., Lashkare, S., Rajendran, B., Ganguly, U.: I-NPN: A sub-60mV/decade, sub-0.6V selection diode for STTRAM. In: 2013 71st Annual Device Research Conference (DRC) (2013). doi:10.1109/DRC.2013.6633819 Deshmukh, S., Lashkare, S., Rajendran, B., Ganguly, U.: I-NPN: A sub-60mV/decade, sub-0.6V selection diode for STTRAM. In: 2013 71st Annual Device Research Conference (DRC) (2013). doi:10.​1109/​DRC.​2013.​6633819
11.
go back to reference Fried, S.I., Cai, C., Ren, Q.: High frequency electric stimulation of retinal neurons elicits physiological signaling patterns. In: Conference Proceedings?: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference, 2011, pp. 1077–1080 (2011). doi:10.1109/IEMBS.2011.6090251 Fried, S.I., Cai, C., Ren, Q.: High frequency electric stimulation of retinal neurons elicits physiological signaling patterns. In: Conference Proceedings?: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference, 2011, pp. 1077–1080 (2011). doi:10.​1109/​IEMBS.​2011.​6090251
12.
go back to reference Garbin, D., Vianello, E., Bichler, O., Rafhay, Q., Gamrat, C., Ghibaudo, G., Perniola, L.: HfO\(_2\)-based OxRAM devices as synapses for convolutional neural networks. IEEE Trans. Electron Devices (2015). doi:10.1109/TED.2015.2440102 Garbin, D., Vianello, E., Bichler, O., Rafhay, Q., Gamrat, C., Ghibaudo, G., Perniola, L.: HfO\(_2\)-based OxRAM devices as synapses for convolutional neural networks. IEEE Trans. Electron Devices (2015). doi:10.​1109/​TED.​2015.​2440102
13.
go back to reference Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500–544 (1952)CrossRef Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500–544 (1952)CrossRef
14.
go back to reference Imam, N., Manohar, R.: Address-Event Communication Using Token-Ring Mutual Exclusion. In: 2011 17th IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC) (2011). doi:10.1109/ASYNC.2011.20 Imam, N., Manohar, R.: Address-Event Communication Using Token-Ring Mutual Exclusion. In: 2011 17th IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC) (2011). doi:10.​1109/​ASYNC.​2011.​20
16.
go back to reference Jackson, B.L., Rajendran, B., Corrado, G.S., Breitwisch, M., Burr, G.W., Cheek, R., ... Modha, D.S.: Nanoscale electronic synapses using phase change devices. J. Emerg. Technol. Comput. Syst. 9(2), 12:1–12:20 (2013). doi:10.1145/2463585.2463588 Jackson, B.L., Rajendran, B., Corrado, G.S., Breitwisch, M., Burr, G.W., Cheek, R., ... Modha, D.S.: Nanoscale electronic synapses using phase change devices. J. Emerg. Technol. Comput. Syst. 9(2), 12:1–12:20 (2013). doi:10.​1145/​2463585.​2463588
17.
go back to reference Kuzum, D., Jeyasingh, R.G.D., Wong, H.-S.P.: Energy efficient programming of nanoelectronic synaptic devices for large-scale implementation of associative and temporal sequence learning. In: 2011 IEEE International Electron Devices Meeting (IEDM) (2011). doi:10.1109/IEDM.2011.6131643 Kuzum, D., Jeyasingh, R.G.D., Wong, H.-S.P.: Energy efficient programming of nanoelectronic synaptic devices for large-scale implementation of associative and temporal sequence learning. In: 2011 IEEE International Electron Devices Meeting (IEDM) (2011). doi:10.​1109/​IEDM.​2011.​6131643
18.
go back to reference Lashkare, S., Karkare, P., Bafna, P., Deshmukh, S., Srinivasan, V.S.S., Lodha, S., Ganguly, U.: Design of epitaxial Si punch-through diode based selector for high density bipolar RRAM. In: 2012 International Conference on Emerging Electronics (ICEE) (2012). doi:10.1109/ICEmElec.2012.6636237 Lashkare, S., Karkare, P., Bafna, P., Deshmukh, S., Srinivasan, V.S.S., Lodha, S., Ganguly, U.: Design of epitaxial Si punch-through diode based selector for high density bipolar RRAM. In: 2012 International Conference on Emerging Electronics (ICEE) (2012). doi:10.​1109/​ICEmElec.​2012.​6636237
19.
go back to reference Lashkare, S., Karkare, P., Bafna, P., Raju, M.V.S., Srinivasan, V.S.S., Lodha, S., ... Chopra, S.: A bipolar RRAM selector with designable polarity dependent on-voltage asymmetry. In: 2013 5th IEEE International Memory Workshop (IMW) (2013). doi:10.1109/IMW.2013.6582128 Lashkare, S., Karkare, P., Bafna, P., Raju, M.V.S., Srinivasan, V.S.S., Lodha, S., ... Chopra, S.: A bipolar RRAM selector with designable polarity dependent on-voltage asymmetry. In: 2013 5th IEEE International Memory Workshop (IMW) (2013). doi:10.​1109/​IMW.​2013.​6582128
20.
go back to reference Mandapati, R., Shrivastava, S., Das, B., Sushama, Ostwal, V., Schulze, J., Ganguly, U.: High performance sub-430\({}^{\circ }\)C epitaxial silicon PIN selector for 3D RRAM. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.1109/DRC.2014.6872387 Mandapati, R., Shrivastava, S., Das, B., Sushama, Ostwal, V., Schulze, J., Ganguly, U.: High performance sub-430\({}^{\circ }\)C epitaxial silicon PIN selector for 3D RRAM. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.​1109/​DRC.​2014.​6872387
21.
go back to reference Merolla, P., Arthur, J., Akopyan, F., Imam, N., Manohar, R., Modha, D.S.: A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm. In: 2011 IEEE Custom Integrated Circuits Conference (CICC) (2011). doi:10.1109/CICC.2011.6055294 Merolla, P., Arthur, J., Akopyan, F., Imam, N., Manohar, R., Modha, D.S.: A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm. In: 2011 IEEE Custom Integrated Circuits Conference (CICC) (2011). doi:10.​1109/​CICC.​2011.​6055294
22.
go back to reference Meshram, R., Das, B., Mandapati, R., Lashkare, S., Deshmukh, S., Lodha, S., ... Schulze, J.: High performance triangular barrier engineered NIPIN selector for bipolar RRAM. In: 2014 IEEE 6th International Memory Workshop (IMW) (2014). doi:10.1109/IMW.2014.6849388 Meshram, R., Das, B., Mandapati, R., Lashkare, S., Deshmukh, S., Lodha, S., ... Schulze, J.: High performance triangular barrier engineered NIPIN selector for bipolar RRAM. In: 2014 IEEE 6th International Memory Workshop (IMW) (2014). doi:10.​1109/​IMW.​2014.​6849388
23.
go back to reference Meshram, R., Rajendran, B., Ganguly, U.: Biomimetic 4F\(^{2}\) synapse with intrinsic timescale for pulse based STDP by I-NPN selection device. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.1109/DRC.2014.6872301 Meshram, R., Rajendran, B., Ganguly, U.: Biomimetic 4F\(^{2}\) synapse with intrinsic timescale for pulse based STDP by I-NPN selection device. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.​1109/​DRC.​2014.​6872301
24.
go back to reference Mitra, S., Indiveri, G., Fusi, S.: Learning to classify complex patterns using a VLSI network of spiking neurons. In: Proceedings of the 21th Conference on Advances in Neural Information Processing Systems (NIPS) (2008). doi:10.3929/ethz-a-005665372 Mitra, S., Indiveri, G., Fusi, S.: Learning to classify complex patterns using a VLSI network of spiking neurons. In: Proceedings of the 21th Conference on Advances in Neural Information Processing Systems (NIPS) (2008). doi:10.​3929/​ethz-a-005665372
28.
go back to reference Panwar, N., Kumar, D., Upadhyay, N.K., Arya, P., Ganguly, U., Rajendran, B.: Memristive synaptic plasticity in Pr\(<\)inf\(>\)0.7\(<\)/inf\(>\)Ca\(<\)inf\(>\)0.3\(<\)/inf\(>\)MnO\(<\)inf\(>\)3\(<\)/inf\(>\) RRAM by bio-mimetic programming. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.1109/DRC.2014.6872334 Panwar, N., Kumar, D., Upadhyay, N.K., Arya, P., Ganguly, U., Rajendran, B.: Memristive synaptic plasticity in Pr\(<\)inf\(>\)0.7\(<\)/inf\(>\)Ca\(<\)inf\(>\)0.3\(<\)/inf\(>\)MnO\(<\)inf\(>\)3\(<\)/inf\(>\) RRAM by bio-mimetic programming. In: 2014 72nd Annual Device Research Conference (DRC) (2014). doi:10.​1109/​DRC.​2014.​6872334
29.
go back to reference Park, S., Kim, H., Choo, M., Noh, J., Sheri, A., Jung, S., ... Hwang, H.: RRAM-based synapse for neuromorphic system with pattern recognition function. In: 2012 IEEE International Electron Devices Meeting (IEDM) (2012). doi:10.1109/IEDM.2012.6479016 Park, S., Kim, H., Choo, M., Noh, J., Sheri, A., Jung, S., ... Hwang, H.: RRAM-based synapse for neuromorphic system with pattern recognition function. In: 2012 IEEE International Electron Devices Meeting (IEDM) (2012). doi:10.​1109/​IEDM.​2012.​6479016
31.
go back to reference Rajendran, B., Liu, Y., Seo, J., Gopalakrishnan, K., Chang, L., Friedman, D., Ritter, M.: RRAM devices for large neuromorphic systems. In: Non-Volatile Memories Workshop (2013) Rajendran, B., Liu, Y., Seo, J., Gopalakrishnan, K., Chang, L., Friedman, D., Ritter, M.: RRAM devices for large neuromorphic systems. In: Non-Volatile Memories Workshop (2013)
32.
go back to reference Rajendran, B., Member, S., Liu, Y., Seo, J., Gopalakrishnan, K., Chang, L.: Ritter, M.B.: Specifications of nanoscale devices and circuits for neuromorphic computational systems. IEEE Trans. Electron Devices 60(1), 246–253 (2013)CrossRef Rajendran, B., Member, S., Liu, Y., Seo, J., Gopalakrishnan, K., Chang, L.: Ritter, M.B.: Specifications of nanoscale devices and circuits for neuromorphic computational systems. IEEE Trans. Electron Devices 60(1), 246–253 (2013)CrossRef
33.
go back to reference Seo, J., Brezzo, B., Liu, Y., Parker, B.D., Esser, S.K., Montoye, R.K., ... Friedman, D.J.: A 45nm CMOS neuromorphic chip with a scalable architecture for learning in networks of spiking neurons. In: 2011 IEEE Custom Integrated Circuits Conference (CICC) (2011). doi:10.1109/CICC.2011.6055293 Seo, J., Brezzo, B., Liu, Y., Parker, B.D., Esser, S.K., Montoye, R.K., ... Friedman, D.J.: A 45nm CMOS neuromorphic chip with a scalable architecture for learning in networks of spiking neurons. In: 2011 IEEE Custom Integrated Circuits Conference (CICC) (2011). doi:10.​1109/​CICC.​2011.​6055293
34.
go back to reference Srinivasan, V.S.S., Chopra, S., Karkare, P., Bafna, P., Lashkare, S., Kumbhare, P., Ganguly, U.: Punchthrough-diode-based bipolar RRAM selector by Si epitaxy. IEEE Electron Device Lett. (2012). doi:10.1109/LED.2012.2209394 Srinivasan, V.S.S., Chopra, S., Karkare, P., Bafna, P., Lashkare, S., Kumbhare, P., Ganguly, U.: Punchthrough-diode-based bipolar RRAM selector by Si epitaxy. IEEE Electron Device Lett. (2012). doi:10.​1109/​LED.​2012.​2209394
36.
go back to reference Suri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., ... DeSalvo, B.: Phase change memory as synapse for ultra-dense neuromorphic systems: application to complex visual pattern extraction. In: 2011 International Electron Devices Meeting, pp. 4.4.1–4.4.4 (2011). doi:10.1109/IEDM.2011.6131488 Suri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., ... DeSalvo, B.: Phase change memory as synapse for ultra-dense neuromorphic systems: application to complex visual pattern extraction. In: 2011 International Electron Devices Meeting, pp. 4.4.1–4.4.4 (2011). doi:10.​1109/​IEDM.​2011.​6131488
37.
go back to reference Wang, G., Cheng, K., Ho, H., Faltermeier, J., Kong, W., Kim, H., ... Iyer, S.S.: A 0.127 \(\upmu {\rm m}^2\) high performance 65nm SOI based embedded DRAM for on-processor applications. In: 2006 International Electron Devices Meeting, vol. 1, pp. 0–3 (2006) Wang, G., Cheng, K., Ho, H., Faltermeier, J., Kong, W., Kim, H., ... Iyer, S.S.: A 0.127 \(\upmu {\rm m}^2\) high performance 65nm SOI based embedded DRAM for on-processor applications. In: 2006 International Electron Devices Meeting, vol. 1, pp. 0–3 (2006)
38.
go back to reference Wang, I.-T., Lin, Y.-C., Wang, Y.-F., Hsu, C.-W., Hou, T.-H.: 3D synaptic architecture with ultralow sub-10 fJ energy per spike for neuromorphic computation. In: 2014 IEEE International Electron Devices Meeting (IEDM) (2014). doi:10.1109/IEDM.2014.7047127 Wang, I.-T., Lin, Y.-C., Wang, Y.-F., Hsu, C.-W., Hou, T.-H.: 3D synaptic architecture with ultralow sub-10 fJ energy per spike for neuromorphic computation. In: 2014 IEEE International Electron Devices Meeting (IEDM) (2014). doi:10.​1109/​IEDM.​2014.​7047127
Metadata
Title
Novel Biomimetic Si Devices for Neuromorphic Computing Architecture
Authors
U. Ganguly
Bipin Rajendran
Copyright Year
2017
Publisher
Springer India
DOI
https://doi.org/10.1007/978-81-322-3703-7_8