Skip to main content
Top
Published in: Cognitive Neurodynamics 4/2023

24-09-2022 | Research Article

Memristive neural network circuit implementation of associative learning with overshadowing and blocking

Authors: Jinying Liu, Yue Zhou, Shukai Duan, Xiaofang Hu

Published in: Cognitive Neurodynamics | Issue 4/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the field of second language acquisition, overshadowing and blocking by cue competition effects in classical conditioning affect the learning and expression of human cognitive associations. In this work, a memristive neural network circuit based on neurobiological mechanisms is proposed, which consists of synapse module, neuron module, and control module. In particular, the designed network introduces an inhibitory interneuron to divide memristive synapses into excitatory and inhibitory memristive synapses, so as to mimic synaptic plasticity better. In addition, the proposed circuit can implement six functions of second language acquisition conditioning, including learning, overshadowing, blocking, recovery from overshadowing, recovery from blocking, and long-term effect of overshadowing over time leading to blocking. Overshadowing, which denotes that the more salient stimulus overshadows the learning of the less salient stimulus when two stimuli differ in salience, reduces the associative strength acquired by the less salient stimulus. Blocking, which indicates that pretraining on one stimulus blocks learning about a second stimulus, inhibits the associative strength acquired by a second stimulus. Finally, the correctness and effectiveness of implementing functions mentioned above are verified by the simulation results in PSPICE. Through further research, the proposed circuit is applied to bionic devices such as social robots or educational robots, which can address language and cognitive disorders via assisted learning and training.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Arcediano F, Escobar M, Matute H (2001) Reversal from blocking in humans as a result of posttraining extinction of the blocking stimulus. Anim Learn Behav 29(4):354–366 Arcediano F, Escobar M, Matute H (2001) Reversal from blocking in humans as a result of posttraining extinction of the blocking stimulus. Anim Learn Behav 29(4):354–366
go back to reference Biolek Z, Biolek D, Biolkova V (2009) Spice model of memristor with nonlinear dopant drift. Radioengineering 18(2):210–214 Biolek Z, Biolek D, Biolkova V (2009) Spice model of memristor with nonlinear dopant drift. Radioengineering 18(2):210–214
go back to reference Boelens H, La Heij W (2017) The development of semantic blocking in children. Brit J Dev Psychol 35(2):310–315 Boelens H, La Heij W (2017) The development of semantic blocking in children. Brit J Dev Psychol 35(2):310–315
go back to reference Boybat I, Le Gallo M, Nandakumar S et al (2018) Neuromorphic computing with multimemristive synapses. Nat Commun 9(1):1–12 Boybat I, Le Gallo M, Nandakumar S et al (2018) Neuromorphic computing with multimemristive synapses. Nat Commun 9(1):1–12
go back to reference Chicca E, Stefanini F, Bartolozzi C et al (2014) Neuromorphic electronic circuits for building autonomous cognitive systems. Proc IEEE 102(9):1367–1388 Chicca E, Stefanini F, Bartolozzi C et al (2014) Neuromorphic electronic circuits for building autonomous cognitive systems. Proc IEEE 102(9):1367–1388
go back to reference Chua L (1971) Memristor-the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519 Chua L (1971) Memristor-the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519
go back to reference CintrÓn-Valentίn MC, Ellis NC (2016) Salience in second language acquisition: physical form, learner attention, and instructional focus. Front Psychol 7:1284 CintrÓn-Valentίn MC, Ellis NC (2016) Salience in second language acquisition: physical form, learner attention, and instructional focus. Front Psychol 7:1284
go back to reference Denniston JC, Miller RR, Matute H (1996) Biological significance as a determinant of cue competition. Psychol Sci 7(6):325–331 Denniston JC, Miller RR, Matute H (1996) Biological significance as a determinant of cue competition. Psychol Sci 7(6):325–331
go back to reference Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18(1):193–222PubMed Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18(1):193–222PubMed
go back to reference Ellis NC (2006) Selective attention and transfer phenomena in l2 acquisition: contingency, cue competition, salience, interference, overshadowing, blocking, and perceptual learning. Appl Linguist 27(2):164–194 Ellis NC (2006) Selective attention and transfer phenomena in l2 acquisition: contingency, cue competition, salience, interference, overshadowing, blocking, and perceptual learning. Appl Linguist 27(2):164–194
go back to reference Hong Q, Yan R, Wang C et al (2020) Memristive circuit implementation of biological nonassociative learning mechanism and its applications. IEEE Trans Biomed Circuits Syst 14(5):1036–1050PubMed Hong Q, Yan R, Wang C et al (2020) Memristive circuit implementation of biological nonassociative learning mechanism and its applications. IEEE Trans Biomed Circuits Syst 14(5):1036–1050PubMed
go back to reference Hou X (2021) Learning two syntactic constructions simultaneously: a case of overshadowing. Lang Cogn 13(3):467–493 Hou X (2021) Learning two syntactic constructions simultaneously: a case of overshadowing. Lang Cogn 13(3):467–493
go back to reference Hu X, Feng G, Duan S et al (2016) A memristive multilayer cellular neural network with applications to image processing. IEEE Trans Neural Netw Learn Syst 28(8):1889–1901PubMed Hu X, Feng G, Duan S et al (2016) A memristive multilayer cellular neural network with applications to image processing. IEEE Trans Neural Netw Learn Syst 28(8):1889–1901PubMed
go back to reference Hu X, Duan S, Chen G et al (2017) Modeling affections with memristor-based associative memory neural networks. Neurocomputing 223:129–137 Hu X, Duan S, Chen G et al (2017) Modeling affections with memristor-based associative memory neural networks. Neurocomputing 223:129–137
go back to reference Ji X, Hu X, Zhou Y et al (2019) Adaptive sparse coding based on memristive neural network with applications. Cogn Neurodyn 13(5):475–488PubMedPubMedCentral Ji X, Hu X, Zhou Y et al (2019) Adaptive sparse coding based on memristive neural network with applications. Cogn Neurodyn 13(5):475–488PubMedPubMedCentral
go back to reference Jiao X, Wang R (2010) Synchronous firing patterns of neuronal population with excitatory and inhibitory connections. Int J Non-Lin Mech 45(6):647–651 Jiao X, Wang R (2010) Synchronous firing patterns of neuronal population with excitatory and inhibitory connections. Int J Non-Lin Mech 45(6):647–651
go back to reference Jo SH, Chang T, Ebong I et al (2010) Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett 10(4):1297–1301PubMed Jo SH, Chang T, Ebong I et al (2010) Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett 10(4):1297–1301PubMed
go back to reference Kamin LJ (1967) Predictability, surprise, attention, and conditioning. In: SYMP. ON PUNISHMENT, TR-13 Kamin LJ (1967) Predictability, surprise, attention, and conditioning. In: SYMP. ON PUNISHMENT, TR-13
go back to reference Kvatinsky S, Friedman EG, Kolodny A et al (2012) Team: Threshold adaptive memristor model. IEEE Trans Circuits Syst I Reg Papers 60(1):211–221 Kvatinsky S, Friedman EG, Kolodny A et al (2012) Team: Threshold adaptive memristor model. IEEE Trans Circuits Syst I Reg Papers 60(1):211–221
go back to reference Kvatinsky S, Ramadan M, Friedman EG et al (2015) Vteam: A general model for voltagecontrolled memristors. IEEE Trans Circuits Syst II Exp Briefs 62(8):786–790 Kvatinsky S, Ramadan M, Friedman EG et al (2015) Vteam: A general model for voltagecontrolled memristors. IEEE Trans Circuits Syst II Exp Briefs 62(8):786–790
go back to reference Liu X, Zeng Z, Wen S (2016) Implementation of memristive neural network with full-function pavlov associative memory. IEEE Trans Circuits Syst I 63(9):1454–1463 Liu X, Zeng Z, Wen S (2016) Implementation of memristive neural network with full-function pavlov associative memory. IEEE Trans Circuits Syst I 63(9):1454–1463
go back to reference LÖwel S, Singer W (1992) Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. Science 255(5041):209–212PubMed LÖwel S, Singer W (1992) Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. Science 255(5041):209–212PubMed
go back to reference Mackintosh NJ (1971) An analysis of overshadowing and blocking. Q J ExpPsychol 23(1):118–125 Mackintosh NJ (1971) An analysis of overshadowing and blocking. Q J ExpPsychol 23(1):118–125
go back to reference Matzel LD, Schachtman TR, Miller RR (1985) Recovery of an overshadowed association achieved by extinction of the overshadowing stimulus. Learn Motiv 16(4):398–412 Matzel LD, Schachtman TR, Miller RR (1985) Recovery of an overshadowed association achieved by extinction of the overshadowing stimulus. Learn Motiv 16(4):398–412
go back to reference Pearce JM, Graham M, Good MA et al (2006) Potentiation, overshadowing, and blocking of spatial learning based on the shape of the environment. J Exp Psychol Anim Behav Process 32(3):201PubMed Pearce JM, Graham M, Good MA et al (2006) Potentiation, overshadowing, and blocking of spatial learning based on the shape of the environment. J Exp Psychol Anim Behav Process 32(3):201PubMed
go back to reference Perlovsky L (2011) Language and cognition interaction neural mechanisms. Comput Intel Neurosc 2011(3):1–13 Perlovsky L (2011) Language and cognition interaction neural mechanisms. Comput Intel Neurosc 2011(3):1–13
go back to reference Pershin YV, Di Ventra M (2010) Experimental demonstration of associative memory with memristive neural networks. Neural Netw 23(7):881–886PubMed Pershin YV, Di Ventra M (2010) Experimental demonstration of associative memory with memristive neural networks. Neural Netw 23(7):881–886PubMed
go back to reference Sedra A, Smith K (1970) A second-generation current conveyor and its applications. IEEE Trans Circuit Theory 17(1):132–134 Sedra A, Smith K (1970) A second-generation current conveyor and its applications. IEEE Trans Circuit Theory 17(1):132–134
go back to reference Skehan P (1998) A cognitive approach to language learning. Oxford University Press Skehan P (1998) A cognitive approach to language learning. Oxford University Press
go back to reference Smith LB, Colunga E, Yoshida H (2010) Knowledge as process: contextually cued attention and early word learning. Cognitive Sci 34(7):1287–1314 Smith LB, Colunga E, Yoshida H (2010) Knowledge as process: contextually cued attention and early word learning. Cognitive Sci 34(7):1287–1314
go back to reference Strukov DB, Snider GS, Stewart DR et al (2008) The missing memristor found. Nature 453(7191):80–83PubMed Strukov DB, Snider GS, Stewart DR et al (2008) The missing memristor found. Nature 453(7191):80–83PubMed
go back to reference Sun J, Han G, Zeng Z et al (2019) Memristorbased neural network circuit of full-function pavlov associative memory with time delay and variable learning rate. IEEE Trans Cybern 50(7):2935–2945PubMed Sun J, Han G, Zeng Z et al (2019) Memristorbased neural network circuit of full-function pavlov associative memory with time delay and variable learning rate. IEEE Trans Cybern 50(7):2935–2945PubMed
go back to reference Wan CJ, Zhu LQ, Liu YH et al (2016) Protonconducting graphene oxide-coupled neuron transistors for brain-inspired cognitive systems. Adv Mater 28(18):3557–3563PubMed Wan CJ, Zhu LQ, Liu YH et al (2016) Protonconducting graphene oxide-coupled neuron transistors for brain-inspired cognitive systems. Adv Mater 28(18):3557–3563PubMed
go back to reference Wang Z, Wang X (2017) A novel memristorbased circuit implementation of full-function pavlov associative memory accorded with biological feature. IEEE Trans Circuits Syst I Reg Papers 65(7):2210–2220 Wang Z, Wang X (2017) A novel memristorbased circuit implementation of full-function pavlov associative memory accorded with biological feature. IEEE Trans Circuits Syst I Reg Papers 65(7):2210–2220
go back to reference Wang L, Li H, Duan S et al (2016) Pavlov associative memory in a memristive neural network and its circuit implementation. Neurocomputing 171:23–29 Wang L, Li H, Duan S et al (2016) Pavlov associative memory in a memristive neural network and its circuit implementation. Neurocomputing 171:23–29
go back to reference Wang Z, Hong Q, Wang X (2019) Memristive circuit design of emotional generation and evolution based on skin-like sensory processor. IEEE Trans Biomed Circuits Syst 13(4):631–644PubMed Wang Z, Hong Q, Wang X (2019) Memristive circuit design of emotional generation and evolution based on skin-like sensory processor. IEEE Trans Biomed Circuits Syst 13(4):631–644PubMed
go back to reference Wang Z, Wang X, Lu Z et al (2020) The design of memristive circuit for affective multiassociative learning. IEEE Trans Biomed Circuits Syst 14(2):173–185PubMed Wang Z, Wang X, Lu Z et al (2020) The design of memristive circuit for affective multiassociative learning. IEEE Trans Biomed Circuits Syst 14(2):173–185PubMed
go back to reference Yang L, Zeng Z, Wen S (2018) A full-function pavlov associative memory implementation with memristance changing circuit. Neurocomputing 272:513–519 Yang L, Zeng Z, Wen S (2018) A full-function pavlov associative memory implementation with memristance changing circuit. Neurocomputing 272:513–519
go back to reference Zhang Y, Zeng Z (2021) A multi-functional memristive pavlov associative memory circuit based on neural mechanisms. IEEE Trans Biomed Circuits Syst 15(5):978–993PubMed Zhang Y, Zeng Z (2021) A multi-functional memristive pavlov associative memory circuit based on neural mechanisms. IEEE Trans Biomed Circuits Syst 15(5):978–993PubMed
go back to reference Zhang Y, Wang X, Li Y et al (2016) Memristive model for synaptic circuits. IEEE Trans Circuits Syst II Exp Briefs 64(7):767–771 Zhang Y, Wang X, Li Y et al (2016) Memristive model for synaptic circuits. IEEE Trans Circuits Syst II Exp Briefs 64(7):767–771
go back to reference Zhou Y, Hu X, Wang L et al (2021) Quantbayes: weight optimization for memristive neural networks via quantization-aware Bayesian inference. IEEE Trans Circuits Syst i, 68(12):4851–4861 Zhou Y, Hu X, Wang L et al (2021) Quantbayes: weight optimization for memristive neural networks via quantization-aware Bayesian inference. IEEE Trans Circuits Syst i, 68(12):4851–4861
Metadata
Title
Memristive neural network circuit implementation of associative learning with overshadowing and blocking
Authors
Jinying Liu
Yue Zhou
Shukai Duan
Xiaofang Hu
Publication date
24-09-2022
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics / Issue 4/2023
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-022-09882-3

Other articles of this Issue 4/2023

Cognitive Neurodynamics 4/2023 Go to the issue