Skip to main content
Top

2019 | OriginalPaper | Chapter

RRAM Solutions for Stochastic Computing

Authors : Phil Knag, Siddharth Gaba, Wei Lu, Zhengya Zhang

Published in: Stochastic Computing: Techniques and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Stochastic computing is a low-cost form of computing. To perform stochastic computing, inputs need to be converted to stochastic bit streams using stochastic number generators (SNGs). The random number generation presents a significant overhead, which partially defeats the benefits of stochastic computing. In this work, we show that stochastic computing can be implemented in memory, through temporally varying resistive RAM (RRAM) devices. We can take advantage of the temporal variations in the resistance switching of RRAM devices for stochastic computing. By adopting a group write approach, an RRAM memory can be used to generate random bit streams and reshuffle bit streams, accomplishing two essential functions for stochastic computing without expensive SNGs. We demonstrate in-memory stochastic computing in two test applications, a gradient descent solver and a k-means clustering processor.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Gaines, Brian R. “Stochastic computing systems.” In Advances in information systems science, pp. 37–172. Springer, Boston, MA, 1969.CrossRef Gaines, Brian R. “Stochastic computing systems.” In Advances in information systems science, pp. 37–172. Springer, Boston, MA, 1969.CrossRef
2.
go back to reference Poppelbaum, W. J., C. Afuso, and J. W. Esch. “Stochastic computing elements and systems.” In Proceedings of the November 14–16, 1967, fall joint computer conference, pp. 635–644. ACM, 1967. Poppelbaum, W. J., C. Afuso, and J. W. Esch. “Stochastic computing elements and systems.” In Proceedings of the November 14–16, 1967, fall joint computer conference, pp. 635–644. ACM, 1967.
3.
go back to reference Ribeiro, Sergio T. “Random-pulse machines.” IEEE Transactions on Electronic Computers 3 (1967): 261–276.CrossRef Ribeiro, Sergio T. “Random-pulse machines.” IEEE Transactions on Electronic Computers 3 (1967): 261–276.CrossRef
4.
go back to reference Li, Xin, Weikang Qian, Marc D. Riedel, Kia Bazargan, and David J. Lilja. “A reconfigurable stochastic architecture for highly reliable computing.” In Proceedings of the 19th ACM Great Lakes symposium on VLSI, pp. 315–320. ACM, 2009. Li, Xin, Weikang Qian, Marc D. Riedel, Kia Bazargan, and David J. Lilja. “A reconfigurable stochastic architecture for highly reliable computing.” In Proceedings of the 19th ACM Great Lakes symposium on VLSI, pp. 315–320. ACM, 2009.
5.
go back to reference Qian, Weikang, Xin Li, Marc D. Riedel, Kia Bazargan, and David J. Lilja. “An architecture for fault-tolerant computation with stochastic logic.” IEEE Transactions on Computers 60, no. 1 (2011): 93–105.MathSciNetCrossRef Qian, Weikang, Xin Li, Marc D. Riedel, Kia Bazargan, and David J. Lilja. “An architecture for fault-tolerant computation with stochastic logic.” IEEE Transactions on Computers 60, no. 1 (2011): 93–105.MathSciNetCrossRef
6.
go back to reference Qian, Weikang, and Marc D. Riedel. “The synthesis of robust polynomial arithmetic with stochastic logic.” In Proceedings of the 45th annual Design Automation Conference, pp. 648–653. ACM, 2008. Qian, Weikang, and Marc D. Riedel. “The synthesis of robust polynomial arithmetic with stochastic logic.” In Proceedings of the 45th annual Design Automation Conference, pp. 648–653. ACM, 2008.
7.
go back to reference Toral, S. L., J. M. Quero, and L. G. Franquelo. “Stochastic pulse coded arithmetic.” In Circuits and Systems, 2000. Proceedings. ISCAS 2000 Geneva. The 2000 IEEE International Symposium on, vol. 1, pp. 599–602. IEEE, 2000. Toral, S. L., J. M. Quero, and L. G. Franquelo. “Stochastic pulse coded arithmetic.” In Circuits and Systems, 2000. Proceedings. ISCAS 2000 Geneva. The 2000 IEEE International Symposium on, vol. 1, pp. 599–602. IEEE, 2000.
8.
go back to reference Dickson, Jeffery A., Robert D. McLeod, and H. C. Card. “Stochastic arithmetic implementations of neural networks with in situ learning.” In Neural Networks, 1993., IEEE International Conference on, pp. 711–716. IEEE, 1993. Dickson, Jeffery A., Robert D. McLeod, and H. C. Card. “Stochastic arithmetic implementations of neural networks with in situ learning.” In Neural Networks, 1993., IEEE International Conference on, pp. 711–716. IEEE, 1993.
9.
go back to reference Kim, Young-Chul, and Michael A. Shanblatt. “Architecture and statistical model of a pulse-mode digital multilayer neural network.” IEEE transactions on neural networks 6, no. 5 (1995): 1109–1118.CrossRef Kim, Young-Chul, and Michael A. Shanblatt. “Architecture and statistical model of a pulse-mode digital multilayer neural network.” IEEE transactions on neural networks 6, no. 5 (1995): 1109–1118.CrossRef
10.
go back to reference Brown, Bradley D., and Howard C. Card. “Stochastic neural computation. I. Computational elements.” IEEE Transactions on computers 50, no. 9 (2001): 891–905.MathSciNetCrossRef Brown, Bradley D., and Howard C. Card. “Stochastic neural computation. I. Computational elements.” IEEE Transactions on computers 50, no. 9 (2001): 891–905.MathSciNetCrossRef
11.
go back to reference Hammadou, Tarik, Magnus Nilson, Amine Bermak, and Philip Ogunbona. “A 96/spl times/64 intelligent digital pixel array with extended binary stochastic arithmetic.” In Circuits and Systems, 2003. ISCAS’03. Proceedings of the 2003 International Symposium on, vol. 4, pp. IV-IV. IEEE, 2003. Hammadou, Tarik, Magnus Nilson, Amine Bermak, and Philip Ogunbona. “A 96/spl times/64 intelligent digital pixel array with extended binary stochastic arithmetic.” In Circuits and Systems, 2003. ISCAS’03. Proceedings of the 2003 International Symposium on, vol. 4, pp. IV-IV. IEEE, 2003.
12.
go back to reference Gaudet, Vincent C., and Anthony C. Rapley. “Iterative decoding using stochastic computation.” Electronics Letters 39, no. 3 (2003): 1.CrossRef Gaudet, Vincent C., and Anthony C. Rapley. “Iterative decoding using stochastic computation.” Electronics Letters 39, no. 3 (2003): 1.CrossRef
13.
go back to reference Tehrani, S. Sharifi, Warren J. Gross, and Shie Mannor. “Stochastic decoding of LDPC codes.” IEEE Communications Letters 10, no. 10 (2006): 716–718.CrossRef Tehrani, S. Sharifi, Warren J. Gross, and Shie Mannor. “Stochastic decoding of LDPC codes.” IEEE Communications Letters 10, no. 10 (2006): 716–718.CrossRef
14.
go back to reference Govoreanu, B., G. S. Kar, Y. Y. Chen, V. Paraschiv, S. Kubicek, A. Fantini, I. P. Radu et al. “10 10nm 2 Hf/HfO x crossbar resistive RAM with excellent performance, reliability and low-energy operation.” In Electron Devices Meeting (IEDM), 2011 IEEE International, pp. 31–6. IEEE, 2011. Govoreanu, B., G. S. Kar, Y. Y. Chen, V. Paraschiv, S. Kubicek, A. Fantini, I. P. Radu et al. “10 10nm 2 Hf/HfO x crossbar resistive RAM with excellent performance, reliability and low-energy operation.” In Electron Devices Meeting (IEDM), 2011 IEEE International, pp. 31–6. IEEE, 2011.
15.
go back to reference Lee, Myoung-Jae, Chang Bum Lee, Dongsoo Lee, Seung Ryul Lee, Man Chang, Ji Hyun Hur, Young-Bae Kim et al. “A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta 2 O 5? x/TaO 2? x bilayer structures.” Nature materials 10, no. 8 (2011): 625.CrossRef Lee, Myoung-Jae, Chang Bum Lee, Dongsoo Lee, Seung Ryul Lee, Man Chang, Ji Hyun Hur, Young-Bae Kim et al. “A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta 2 O 5? x/TaO 2? x bilayer structures.” Nature materials 10, no. 8 (2011): 625.CrossRef
16.
go back to reference Chin, Albert, C. H. Cheng, Y. C. Chiu, Z. W. Zheng, and Ming Liu. “Ultra-low switching power RRAM using hopping conduction mechanism.” ECS Transactions 50, no. 4 (2013): 3–8.CrossRef Chin, Albert, C. H. Cheng, Y. C. Chiu, Z. W. Zheng, and Ming Liu. “Ultra-low switching power RRAM using hopping conduction mechanism.” ECS Transactions 50, no. 4 (2013): 3–8.CrossRef
17.
go back to reference Strachan, John Paul, Antonio C. Torrezan, Gilberto Medeiros-Ribeiro, and R. Stanley Williams. “Measuring the switching dynamics and energy efficiency of tantalum oxide memristors.” Nanotechnology 22, no. 50 (2011): 505402.CrossRef Strachan, John Paul, Antonio C. Torrezan, Gilberto Medeiros-Ribeiro, and R. Stanley Williams. “Measuring the switching dynamics and energy efficiency of tantalum oxide memristors.” Nanotechnology 22, no. 50 (2011): 505402.CrossRef
18.
go back to reference Park, Jubong, K. P. Biju, Seungjae Jung, Wootae Lee, Joonmyoung Lee, Seonghyun Kim, Sangsu Park, Jungho Shin, and Hyunsang Hwang. “Multibit Operation of TiOx-Based ReRAM by Schottky Barrier Height Engineering.” IEEE Electron Device Letters 32, no. 4 (2011): 476–478.CrossRef Park, Jubong, K. P. Biju, Seungjae Jung, Wootae Lee, Joonmyoung Lee, Seonghyun Kim, Sangsu Park, Jungho Shin, and Hyunsang Hwang. “Multibit Operation of TiOx-Based ReRAM by Schottky Barrier Height Engineering.” IEEE Electron Device Letters 32, no. 4 (2011): 476–478.CrossRef
19.
go back to reference Baek, I. G., D. C. Kim, M. J. Lee, H-J. Kim, E. K. Yim, M. S. Lee, J. E. Lee et al. “Multi-layer cross-point binary oxide resistive memory (OxRRAM) for post-NAND storage application.” In Electron Devices Meeting, 2005. IEDM Technical Digest. IEEE International, pp. 750–753. IEEE, 2005. Baek, I. G., D. C. Kim, M. J. Lee, H-J. Kim, E. K. Yim, M. S. Lee, J. E. Lee et al. “Multi-layer cross-point binary oxide resistive memory (OxRRAM) for post-NAND storage application.” In Electron Devices Meeting, 2005. IEDM Technical Digest. IEEE International, pp. 750–753. IEEE, 2005.
20.
go back to reference Baek, I. G., C. J. Park, H. Ju, D. J. Seong, H. S. Ahn, J. H. Kim, M. K. Yang et al. “Realization of vertical resistive memory (VRRAM) using cost effective 3D process.” In Electron Devices Meeting (IEDM), 2011 IEEE International, pp. 31–8. IEEE, 2011. Baek, I. G., C. J. Park, H. Ju, D. J. Seong, H. S. Ahn, J. H. Kim, M. K. Yang et al. “Realization of vertical resistive memory (VRRAM) using cost effective 3D process.” In Electron Devices Meeting (IEDM), 2011 IEEE International, pp. 31–8. IEEE, 2011.
21.
go back to reference Yu, Shimeng, Ximeng Guan, and H-S. Philip Wong. “On the switching parameter variation of metal oxide RRAM?Part II: Model corroboration and device design strategy.” IEEE Transactions on Electron Devices 59, no. 4 (2012): 1183–1188.CrossRef Yu, Shimeng, Ximeng Guan, and H-S. Philip Wong. “On the switching parameter variation of metal oxide RRAM?Part II: Model corroboration and device design strategy.” IEEE Transactions on Electron Devices 59, no. 4 (2012): 1183–1188.CrossRef
22.
go back to reference Chen, An, and Ming-Ren Lin. “Variability of resistive switching memories and its impact on crossbar array performance.” In Reliability Physics Symposium (IRPS), 2011 IEEE International, pp. MY-7. IEEE, 2011. Chen, An, and Ming-Ren Lin. “Variability of resistive switching memories and its impact on crossbar array performance.” In Reliability Physics Symposium (IRPS), 2011 IEEE International, pp. MY-7. IEEE, 2011.
23.
go back to reference Gaba, Siddharth, Patrick Sheridan, Jiantao Zhou, Shinhyun Choi, and Wei Lu. “Stochastic memristive devices for computing and neuromorphic applications.” Nanoscale 5, no. 13 (2013): 5872–5878.CrossRef Gaba, Siddharth, Patrick Sheridan, Jiantao Zhou, Shinhyun Choi, and Wei Lu. “Stochastic memristive devices for computing and neuromorphic applications.” Nanoscale 5, no. 13 (2013): 5872–5878.CrossRef
24.
go back to reference Jo, Sung Hyun, Kuk-Hwan Kim, and Wei Lu. “Programmable resistance switching in nanoscale two-terminal devices.” Nano letters 9, no. 1 (2008): 496–500.CrossRef Jo, Sung Hyun, Kuk-Hwan Kim, and Wei Lu. “Programmable resistance switching in nanoscale two-terminal devices.” Nano letters 9, no. 1 (2008): 496–500.CrossRef
25.
go back to reference Strukov, Dmitri B., and R. Stanley Williams. “Exponential ionic drift: fast switching and low volatility ofthin-film memristors.” Applied Physics A 94, no. 3 (2009): 515–519.CrossRef Strukov, Dmitri B., and R. Stanley Williams. “Exponential ionic drift: fast switching and low volatility ofthin-film memristors.” Applied Physics A 94, no. 3 (2009): 515–519.CrossRef
26.
go back to reference Schroeder, Herbert, Victor V. Zhirnov, Ralph K. Cavin, and Rainer Waser. “Voltage-time dilemma of pure electronic mechanisms in resistive switching memory cells.” Journal of applied physics 107, no. 5 (2010): 054517.CrossRef Schroeder, Herbert, Victor V. Zhirnov, Ralph K. Cavin, and Rainer Waser. “Voltage-time dilemma of pure electronic mechanisms in resistive switching memory cells.” Journal of applied physics 107, no. 5 (2010): 054517.CrossRef
27.
go back to reference Nocedal, Jorge, and Stephen J. Wright. “Numerical optimization 2nd.” (2006). Nocedal, Jorge, and Stephen J. Wright. “Numerical optimization 2nd.” (2006).
28.
go back to reference MacQueen, James. “Some methods for classification and analysis of multivariate observations.” In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, vol. 1, no. 14, pp. 281–297. 1967.MathSciNetMATH MacQueen, James. “Some methods for classification and analysis of multivariate observations.” In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, vol. 1, no. 14, pp. 281–297. 1967.MathSciNetMATH
29.
go back to reference Knag, Phil, Wei Lu, and Zhengya Zhang. “A native stochastic computing architecture enabled by memristors.” IEEE Transactions on Nanotechnology 13, no. 2 (2014): 283–293.CrossRef Knag, Phil, Wei Lu, and Zhengya Zhang. “A native stochastic computing architecture enabled by memristors.” IEEE Transactions on Nanotechnology 13, no. 2 (2014): 283–293.CrossRef
Metadata
Title
RRAM Solutions for Stochastic Computing
Authors
Phil Knag
Siddharth Gaba
Wei Lu
Zhengya Zhang
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-03730-7_8