Skip to main content
Erschienen in: Cognitive Neurodynamics 5/2019

04.05.2019 | Research Article

Adaptive sparse coding based on memristive neural network with applications

verfasst von: Xun Ji, Xiaofang Hu, Yue Zhou, Zhekang Dong, Shukai Duan

Erschienen in: Cognitive Neurodynamics | Ausgabe 5/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Memristor is a nanoscale circuit element with nonvolatile, binary, multilevel and analog states. Its conductance (resistance) plasticity is similar to biological synapses. Information sparse coding is considered as the key mechanism of biological neural systems to process mass complex perception data, which is applied in the fields of signal processing, computer vision and so on. This paper proposes a soft-threshold adaptive sparse coding algorithm named MMN-SLCA based on the memristor, neural network and sparse coding theory. Specifically, the memristor crossbar array is used to realize the dictionary set. And by leveraging its unique vector–matrix operation advantages and biological synaptic characteristic, two key compositions of the sparse coding, namely, pattern matching and lateral neuronal inhibition are realized conveniently and efficiently. Besides, threshold variability further enhances the adaptive ability of the intelligent sparse coding. Furthermore, a hardware implementation framework of the sparse coding algorithm is designed to provide feasible solutions for hardware acceleration, real-time processing and embedded applications. Finally, the application of MMN-SLCA in image super-resolution reconstruction is discussed. Experimental simulations and result analysis verify the effectiveness of the proposed scheme and show its superior potentials in large-scale low-power intelligent information coding and processing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Adhikari SP, Yang C, Kim H (2012) Memristor bridge synapse-based neural network and its learning. IEEE Trans Neural Netw Learn Syst 23(9):1426–1435CrossRefPubMed Adhikari SP, Yang C, Kim H (2012) Memristor bridge synapse-based neural network and its learning. IEEE Trans Neural Netw Learn Syst 23(9):1426–1435CrossRefPubMed
Zurück zum Zitat Bao B, Jiang T, Wang G (2017) Two-memristor-based Chua’s hyperchaotic circuit with plane equilibrium and its extreme multistability. Nonlinear Dyn 89(2):1157–1171CrossRef Bao B, Jiang T, Wang G (2017) Two-memristor-based Chua’s hyperchaotic circuit with plane equilibrium and its extreme multistability. Nonlinear Dyn 89(2):1157–1171CrossRef
Zurück zum Zitat Bao H, Wang N, Bao B (2018) Initial condition-dependent dynamics and transient period in memristor-based hypogenetic jerk system with four line equilibria. Commun Nonlinear Sci Numer Simul 57:264–275CrossRef Bao H, Wang N, Bao B (2018) Initial condition-dependent dynamics and transient period in memristor-based hypogenetic jerk system with four line equilibria. Commun Nonlinear Sci Numer Simul 57:264–275CrossRef
Zurück zum Zitat Bao H, Liu W, Hu A (2019) Coexisting multiple firing patterns in two adjacent neurons coupled by memristive electromagnetic induction. Nonlinear Dyn 95(1):43–56CrossRef Bao H, Liu W, Hu A (2019) Coexisting multiple firing patterns in two adjacent neurons coupled by memristive electromagnetic induction. Nonlinear Dyn 95(1):43–56CrossRef
Zurück zum Zitat Candès EJ, Wakin MB (2008) An introduction to compressive sampling. IEEE Signal Process Mag 25(2):21–30CrossRef Candès EJ, Wakin MB (2008) An introduction to compressive sampling. IEEE Signal Process Mag 25(2):21–30CrossRef
Zurück zum Zitat Chen L, Li C, Huang T (2013) A synapse memristor model with forgetting effect. Phys Lett A 377(45–48):3260–3265CrossRef Chen L, Li C, Huang T (2013) A synapse memristor model with forgetting effect. Phys Lett A 377(45–48):3260–3265CrossRef
Zurück zum Zitat Chua L (1971) Memristor-the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519CrossRef Chua L (1971) Memristor-the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519CrossRef
Zurück zum Zitat Donoho DL, Elad M (2003) Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization. Proc Natl Acad Sci 100(5):2197–2202CrossRefPubMed Donoho DL, Elad M (2003) Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization. Proc Natl Acad Sci 100(5):2197–2202CrossRefPubMed
Zurück zum Zitat Field DJ (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc 4(12):2379–2394CrossRef Field DJ (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc 4(12):2379–2394CrossRef
Zurück zum Zitat Field DJ (1989) What the statistics of natural images tell us about visual coding. Hum Vis Vis Process Digit Disp 1077:269–277CrossRef Field DJ (1989) What the statistics of natural images tell us about visual coding. Hum Vis Vis Process Digit Disp 1077:269–277CrossRef
Zurück zum Zitat Hu X, Feng G, Duan S (2017) A memristive multilayer cellular neural network with applications to image processing. IEEE Trans Neural Netw Learn Syst 28(8):1889–1901CrossRefPubMed Hu X, Feng G, Duan S (2017) A memristive multilayer cellular neural network with applications to image processing. IEEE Trans Neural Netw Learn Syst 28(8):1889–1901CrossRefPubMed
Zurück zum Zitat Itoh M, Chua L (2014) Memristor cellular automata and memristor discrete-time cellular neural networks. In: Memristor networks. Springer, Cham, pp 649–713 Itoh M, Chua L (2014) Memristor cellular automata and memristor discrete-time cellular neural networks. In: Memristor networks. Springer, Cham, pp 649–713
Zurück zum Zitat Jo SH, Chang T (2010) Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett 10(4):1297–1301CrossRefPubMed Jo SH, Chang T (2010) Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett 10(4):1297–1301CrossRefPubMed
Zurück zum Zitat Kawahara A, Azuma R, Ikeda Y (2013) An 8 Mb multi-layered cross-point ReRAM macro with 443 MB/s write throughput. IEEE J Solid-State Circuits 48(1):178–185CrossRef Kawahara A, Azuma R, Ikeda Y (2013) An 8 Mb multi-layered cross-point ReRAM macro with 443 MB/s write throughput. IEEE J Solid-State Circuits 48(1):178–185CrossRef
Zurück zum Zitat Kvatinsky S, Friedman EG, Kolodny A (2013) TEAM: threshold adaptive memristor model. IEEE Trans Circuits Syst I Regul Pap 60(1):211–221CrossRef Kvatinsky S, Friedman EG, Kolodny A (2013) TEAM: threshold adaptive memristor model. IEEE Trans Circuits Syst I Regul Pap 60(1):211–221CrossRef
Zurück zum Zitat Lazzaro J, Ryckebusch S, Mahowald M A (1989) Winner-take-all networks of O(n) complexity. In: Advances in neural information processing systems, pp 703–711 Lazzaro J, Ryckebusch S, Mahowald M A (1989) Winner-take-all networks of O(n) complexity. In: Advances in neural information processing systems, pp 703–711
Zurück zum Zitat Li Y, Cichocki A, Amari S (2004) Analysis of sparse representation and blind source separation. Neural Comput 16(6):1193–1234CrossRefPubMed Li Y, Cichocki A, Amari S (2004) Analysis of sparse representation and blind source separation. Neural Comput 16(6):1193–1234CrossRefPubMed
Zurück zum Zitat Long S, Perniola L, Cagli C (2013) Voltage and power-controlled regimes in the progressive unipolar RESET transition of HfO 2-based RRAM. Sci Rep 3:2929CrossRefPubMedPubMedCentral Long S, Perniola L, Cagli C (2013) Voltage and power-controlled regimes in the progressive unipolar RESET transition of HfO 2-based RRAM. Sci Rep 3:2929CrossRefPubMedPubMedCentral
Zurück zum Zitat Muenstermann R, Menke T, Dittmann R (2010) Coexistence of filamentary and homogeneous resistive switching in Fe-doped SrTiO3 thin-film memristive devices. Adv Mater 22(43):4819–4822CrossRefPubMed Muenstermann R, Menke T, Dittmann R (2010) Coexistence of filamentary and homogeneous resistive switching in Fe-doped SrTiO3 thin-film memristive devices. Adv Mater 22(43):4819–4822CrossRefPubMed
Zurück zum Zitat Olshausen BA, Field DJ (1997) Sparse coding with an overcomplete basis set: A strategy employed by V1? Vis Res 37(23):3311–3325CrossRefPubMed Olshausen BA, Field DJ (1997) Sparse coding with an overcomplete basis set: A strategy employed by V1? Vis Res 37(23):3311–3325CrossRefPubMed
Zurück zum Zitat Pershin YV, Di Ventra M (2010) Practical approach to programmable analog circuits with memristors. IEEE Trans Circuits Syst I Regul Pap 57(8):1857–1864CrossRef Pershin YV, Di Ventra M (2010) Practical approach to programmable analog circuits with memristors. IEEE Trans Circuits Syst I Regul Pap 57(8):1857–1864CrossRef
Zurück zum Zitat Rozell CJ, Johnson DH, Baraniuk RG (2008) Sparse coding via thresholding and local competition in neural circuits. Neural Comput 20(10):2526–2563CrossRefPubMed Rozell CJ, Johnson DH, Baraniuk RG (2008) Sparse coding via thresholding and local competition in neural circuits. Neural Comput 20(10):2526–2563CrossRefPubMed
Zurück zum Zitat Sheridan PM, Cai F, Du C (2017) Sparse coding with memristor networks. Nat Nanotechnol 12(8):784CrossRefPubMed Sheridan PM, Cai F, Du C (2017) Sparse coding with memristor networks. Nat Nanotechnol 12(8):784CrossRefPubMed
Zurück zum Zitat Snider G, Amerson R, Carter D (2011) From synapses to circuitry: using memristive memory to explore the electronic brain. Computer 44(2):21–28CrossRef Snider G, Amerson R, Carter D (2011) From synapses to circuitry: using memristive memory to explore the electronic brain. Computer 44(2):21–28CrossRef
Zurück zum Zitat Strukov DB, Snider GS, Stewart DR (2008) The missing memristor found. Nature 453(7191):80–83CrossRefPubMed Strukov DB, Snider GS, Stewart DR (2008) The missing memristor found. Nature 453(7191):80–83CrossRefPubMed
Zurück zum Zitat Wang X, Chen Y, Xi H (2009) Spintronic memristor through spin-torque-induced magnetization motion. IEEE Electron Device Lett 30(3):294–297CrossRef Wang X, Chen Y, Xi H (2009) Spintronic memristor through spin-torque-induced magnetization motion. IEEE Electron Device Lett 30(3):294–297CrossRef
Zurück zum Zitat Wang M, Cai S, Pan C (2018) Robust memristors based on layered two-dimensional materials. Nat Electron 1(2):130CrossRef Wang M, Cai S, Pan C (2018) Robust memristors based on layered two-dimensional materials. Nat Electron 1(2):130CrossRef
Zurück zum Zitat Wright J, Ma Y, Mairal J (2010) Sparse representation for computer vision and pattern recognition. Proc IEEE 98(6):1031–1044CrossRef Wright J, Ma Y, Mairal J (2010) Sparse representation for computer vision and pattern recognition. Proc IEEE 98(6):1031–1044CrossRef
Zurück zum Zitat Yan B, Chen Y, Li H (2018) Challenges of memristor based neuromorphic computing system. Sci China Inf Sci 61(6):060425 Yan B, Chen Y, Li H (2018) Challenges of memristor based neuromorphic computing system. Sci China Inf Sci 61(6):060425
Zurück zum Zitat Yang JJ, Strukov DB, Stewart DR (2013) Memristive devices for computing. Nat Nanotechnol 8(1):13CrossRefPubMed Yang JJ, Strukov DB, Stewart DR (2013) Memristive devices for computing. Nat Nanotechnol 8(1):13CrossRefPubMed
Zurück zum Zitat Yang Y, Chang T, Lu W (2014) Memristive devices: switching effects, modeling, and applications. In: Memristors and memristive systems. Springer, New York, NY, pp 195–221 Yang Y, Chang T, Lu W (2014) Memristive devices: switching effects, modeling, and applications. In: Memristors and memristive systems. Springer, New York, NY, pp 195–221
Zurück zum Zitat Yesil A (2018) A new grounded memristor emulator based on MOSFET-C. AEU-Int J Electron Commun 91:143–149CrossRef Yesil A (2018) A new grounded memristor emulator based on MOSFET-C. AEU-Int J Electron Commun 91:143–149CrossRef
Zurück zum Zitat Zakhidov AA, Jung B, Slinker JD (2010) A light-emitting memristor. Org Electron 11(1):150–153CrossRef Zakhidov AA, Jung B, Slinker JD (2010) A light-emitting memristor. Org Electron 11(1):150–153CrossRef
Metadaten
Titel
Adaptive sparse coding based on memristive neural network with applications
verfasst von
Xun Ji
Xiaofang Hu
Yue Zhou
Zhekang Dong
Shukai Duan
Publikationsdatum
04.05.2019
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 5/2019
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-019-09537-w

Weitere Artikel der Ausgabe 5/2019

Cognitive Neurodynamics 5/2019 Zur Ausgabe

Neuer Inhalt