Top

Cognitive Neurodynamics

Published in:

01-10-2012 | Review Article

Towards a unified model of pavlovian conditioning: short review of trace conditioning models

Author: V. I. Kryukov

Published in: Cognitive Neurodynamics | Issue 5/2012

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

There are three basic paradigms of classical conditioning: delay, trace and context conditioning where presentation of a conditioned stimulus (CS) or a context typically predicts an unconditioned stimulus (US). In delay conditioning CS and US normally coterminate, whereas in trace conditioning an interval of time exists between CS termination and US onset. The modeling of trace conditioning is a rather difficult computational problem and is a challenge to the behavior and connectionist approaches mainly due to a time gap between CS and US. To account for trace conditioning, Pavlov (Conditioned reflexes: an investigation of the physiological activity of the cerebral cortex, Oxford University Press, London, 1927) postulated the existence of a stimulus “trace” in the nervous system. Meanwhile, there exist many other options for solving this association problem. There are several excellent reviews of computational models of classical conditioning but none has thus far been devoted to trace conditioning. Eight representative models of trace conditioning aimed at building a prospective model are being reviewed below in a brief form. As a result, one of them, comprising the most important features of its predecessors, can be suggested as a real candidate for a unified model of trace conditioning.

next article Context and the renewal of conditioned taste aversion: the role of rat dorsal hippocampus examined by electrolytic lesion

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

In classical conditioning, it is often assumed that presynaptic inputs from CSs and US converge on one or more postsynaptic units. The postsynaptic unit initially responds strongly to the US input, but only weakly to the CS input. Through repeated CS–US pairings, the connection strength of the CS input is altered so that the CS becomes capable of eliciting a robust output from the postsynaptic unit. Alternatively, both CS and US can converge presynaptically, thus performing non-Hebbian learning as in Zipser (1986). However, both the Hebbian and non-Hebbian learning rules are problematic for trace conditioning in view of the unsolved problem of shifting information from the hippocampus to the cortex (see Frey and Morris 1997; Lesburguères et al. 2011).

Habituation is a decrease in responsiveness to a stimulus when that stimulus is presented repeatedly or for a prolonged time. The latent inhibition refers to the effect that preexposure to a CS followed by CS–US pairings retard the generation of the CR.

The answer to this question is given in biological terms by Vinogradova (2001) and in computational ones by Kryukov (2008)

A phase-locked loop (PLL) is an electronic control system that generates a signal of controlled oscillator that is locked to the phase of an input signal. A phase-locked loop circuit responds to both the frequency and the phase of the input signals, automatically raising or lowering the frequency of a controlled oscillator until it is matched to the input in both frequency and phase. For description of the PLL system see Gardner’s text-book (1979), for application in the neuronal modeling based on PLL see Songnian et al. (2003) and for the numerical simulation of PLL with CO and several POs see Kazanovich et al. (1991).

Lability as temporal unsteadiness in the case of oscillatory networks can be characterized quantitatively by the value of natural frequency. The lability is the basic concept of the Russian neurophysiological school of Vvedensky-Ukhtomsky who maintained that connections between nervous structures are promoted trough the correspondence in their frequency characteristics that is in equalizing their excitation cycle rate (Ukhtomsky 1966/1936). Thence follows our Isolability Assumption.

We are grateful to Reviewer #1 for this list of problems.

K _o and K _d are transfer coefficients for the septal VCO and the CA3 phase detector, respectively.

In fact, the supposition (9) is not true according to Lindquist et al. (2009), but it helps in simple explanation of many so far unexplained experimental findings. .

For the explanation of habituation and dehabituation mechanism see Kryukov (2008, p. 152) .

For the difference between the phase and the frequency synchronization (acquisition) (see Gardner, 1979, Ch. 5).

Formally our model explains this asymmetry in learning by less favorable initial state for Eq. 7 to reach the stationary state if US comes before CS.

Ang CW, Carlson GC, Coulter DA (2005) Hippocampal CA1 circuitry dynamically gates direct cortical inputs preferentially at theta frequencies. J Neurosci 25(42):9567–9580PubMedCrossRef

Balsam PD, Drew MR, Yang C (2002) Timing at the start of associative learning. Learn Motiv 33:141–155CrossRef

Batuev AS (1993) An hypothesis regarding the cortical mechanisms of operative memory. Neurosci Behav Physiol 23(2):130–134PubMedCrossRef

Berry SD, Hoffmann LC (2011) Hippocampal theta-dependent eyeblink classical conditioning: coordination of a distributed learning system. Neurobiol Learn Mem 95(2):185–189PubMedCrossRef

Berry SD, Swain RA (1989) Water deprivation optimizes hippocampal activity and facilitates nictitating membrane conditioning. Behav Neurosci 103(1):71–76PubMedCrossRef

Beylin AV, Gandhi CC, Wood GE et al (2001) The role of the hippocampus in trace conditioning: temporal discontinuity or task difficulty? Neurobiol Learn Mem 76(3):447–461PubMedCrossRef

Bolles RC, Collier AC, Bouton ME et al (1978) Some tricks for ameliorating the trace-conditioning deficit. Bull Psychonomic Soc 11(6):403–406

Borisyuk R, Cooke T (2007) Metastable states, phase transitions, and persistent neural activity. Biosystems 89:30–37PubMedCrossRef

Bradley MM, Sabatinelli D, Lang PJ et al (2003) Activation of the visual cortex in motivated attention. Behav Neurosci 117(2):369–380PubMedCrossRef

Brooks DC, Bowker JL (2001) Further evidence that conditioned inhibition is not the mechanism of an extinction cue’s effect: a reinforced cue prevents spontaneous recovery. Anim Learn Behav 29(4):381–388CrossRef

Buhusi CV, Meck WH (2005) What makes us tick? Functional and neural mechanisms of interval timing. Nat Rev Neurosci 6(10):755–765PubMedCrossRef

Burman MA, Gewirtz JC (2004) Timing of fear expression in trace and delay conditioning measured by fear-potentiated startle in rats. Learn Mem 11(2):205–212PubMedCrossRef

Burman MA, Gewirtz JC (2007) Hippocampal activity, but not plasticity, is required for early consolidation of fear conditioning with a short trace interval. Eur J Neurosci 25(8):2483–2490PubMedCrossRef

Burman MA, Starr MJ, Gewirtz JC (2006) Dissociable effects of hippocampus lesions on expression of fear and trace fear conditioning memories in rats. Hippocampus 16(2):103–113PubMedCrossRef

Chen G, Wang LP, Tsien JZ (2009) Neural population-level memory traces in the mouse hippocampus. PLoS One 4(12):e8256PubMedCrossRef

Cheng DT, Disterhoft JF, Power JM et al (2008) Neural substrates underlying human delay and trace eyeblink conditioning. Proc Natl Acad Sci USA 105(23):8108–8113PubMedCrossRef

Chowdhury N, Quinn JJ, Fanselow MS (2005) Dorsal hippocampus involvement in trace fear conditioning with long, but not short, trace intervals in mice. Behav Neurosci 119(5):1396–1402PubMedCrossRef

Claflin DI, Garrett T, Buffington ML (2005) A developmental comparison of trace and delay eyeblink conditioning in rats using matching interstimulus intervals. Dev Psychobiol 47(1):77–88PubMedCrossRef

Clark RE, Squire LR (1998) Classical conditioning and brain systems: the role of awareness. Science 280(5360):77–81PubMedCrossRef

Clark RE, Squire LR (2004) The importance of awareness for eyeblink conditioning is conditional: theoretical comment on Bellebaum and Daum. Behav Neurosci 118(6):1466–1468PubMedCrossRef

Clark RE, Manns JR, Squire LR (2001) Trace and delay eyeblink conditioning: contrasting phenomena of declarative and nondeclarative memory. Psychol Sci 12(4):304–308PubMedCrossRef

Clark RE, Manns JR, Squire LR (2002) Classical conditioning, awareness, and brain systems. Trends Cogn Sci 6(12):524–531PubMedCrossRef

Darling RD, Takatsuki K, Griffin AL et al (2011) Eyeblink conditioning contingent on hippocampal theta enhances hippocampal and medial prefrontal responses. J Neurophysiol 105(5):2213–2224PubMedCrossRef

Desmond JE, Moore JW (1991) Altering the synchrony of stimulus trace processes: tests of a neural-network model. Biol Cybern 65:161–169PubMedCrossRef

Edeline JM (2003) The thalamo-cortical auditory receptive fields: regulation by the states of vigilance, learning and the neuromodulatory systems. Exp Brain Res 153(4):554–572PubMedCrossRef

Engert F, Bonhoeffer T (1997) Synapse specificity of long-term potentiation breaks down at short distances. Nature 388(6639):279–284PubMedCrossRef

Floresco SB, Seamans JK, Phillips AG (1997) Selective roles for hippocampal, prefrontal cortical, and ventral striatal circuits in radial-arm maze tasks with or without a delay. J Neurosci 17(5):1880–1890PubMed

Fontán-Lozano A, Troncoso J, Múnera A et al (2005) Cholinergic septo-hippocampal innervation is required for trace eyeblink classical conditioning. Learn Mem 12(6):557–563PubMedCrossRef

Frey U, Morris RG (1997) Synaptic tagging and long-term potentiation. Nature 385(6616):533–536PubMedCrossRef

Fritz JB, Elhilali M, David SV et al (2007) Does attention play a role in dynamic receptive field adaptation to changing acoustic salience in A1? Hear Res 229(1–2):186–203PubMedCrossRef

Gabbott PL, Warner TA, Jays PR et al (2005) Prefrontal cortex in the rat: projections to subcortical autonomic, motor, and limbic centers. J Comp Neurol 492(2):145–177PubMedCrossRef

Galvez R, Weiss C, Weible AP et al (2006) Vibrissa-signaled eyeblink conditioning induces somatosensory cortical plasticity. J Neurosci 26(22):6062–6068PubMedCrossRef

Galvez R, Weible AP, Disterhoft JF (2007) Cortical barrel lesions impair whisker-CS trace eyeblink conditioning. Learn Mem 14(1):94–100PubMedCrossRef

Gardner FM (1979) Phaselock techniques, 2nd edn. Wiley, New York

Gilmartin MR, Helmstetter FJ (2010) Trace and contextual fear conditioning require neural activity and NMDA receptor-dependent transmission in the medial prefrontal cortex. Learn Mem 17(6):289–296PubMedCrossRef

Gilmartin MR, McEchron MD (2005) Single neurons in the medial prefrontal cortex of the rat exhibit tonic and phasic coding during trace fear conditioning. Behav Neurosci 119(6):1496–1510PubMedCrossRef

Griffin AL, Asaka Y, Darling RD et al (2004) Theta-contingent trial presentation accelerates learning rate and enhances hippocampal plasticity during trace eyeblink conditioning. Behav Neurosci 118(2):403–411PubMedCrossRef

Grossberg S, Schmajuk NA (1989) Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Netw 2(2):79–102CrossRef

Gruart A, Muñoz MD, Delgado-García JM (2006) Involvement of the CA3–CA1 synapse in the acquisition of associative learning in behaving mice. J Neurosci 26(4):1077–1087PubMedCrossRef

Han CJ, O’Tuathaigh CM, van Trigt L et al (2003) Trace but not delay fear conditioning requires attention and the anterior cingulate cortex. Proc Natl Acad Sci USA 100(22):13087–13092PubMedCrossRef

Howland JG, Harrison RA, Hannesson DK et al (2008) Ventral hippocampal involvement in temporal order, but not recognition, memory for spatial information. Hippocampus 18(3):251–257PubMedCrossRef

Huerta PT, Sun LD, Wilson MA, Tonegawa S (2000) Formation of temporal memory requires NMDA receptors within CA1 pyramidal neurons. Neuron 25(2):473–480PubMedCrossRef

Hunsaker MR, Tran GT, Kesner RP (2009) A behavioral analysis of the role of CA3 and CA1 subcortical efferents during classical fear conditioning. Behav Neurosci 123(3):624–630PubMedCrossRef

Jaholkowski P, Kiryk A, Jedynak P et al (2009) New hippocampal neurons are not obligatory for memory formation; cyclin D2 knockout mice with no adult brain neurogenesis show learning. Learn Mem 16(7):439–451PubMedCrossRef

Kato HK, Watabe AM, Manabe T (2009) Non-Hebbian synaptic plasticity induced by repetitive postsynaptic action potentials. J Neurosci 29(36):11153–11160PubMedCrossRef

Kazanovich YB, Kryukov VI, Lyuzyanina TB (1991) Synchronization and phase locking in oscillatory models of neural networks. In: Holden AV, Kryukov VI (eds) Neurocomputers and attention. I. Neurobiology, synchronization and chaos, Manchester Press, Manchester, pp. 319–351

Kehoe EJ, Ludvig EA, Sutton RS (2009) Magnitude and timing of conditioned responses in delay and trace classical conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus). Behav Neurosci 123(5):1095–1101PubMedCrossRef

Kehoe EJ, Ludvig EA, Sutton RS (2010) Timing in trace conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus): scalar, nonscalar, and adaptive features. Learn Mem 17(12):600–604

Kirillov A et al (1989) A model of neural oscillator for a unified submodule. In: Touretsky D (ed) NIPS’1988 advance in neural information processing systems I. Morgan Kauffman, San Mateo, CA, p 560

Kishimoto Y, Nakazawa K, Tonegawa S et al (2006) Hippocampal CA3 NMDA receptors are crucial for adaptive timing of trace eyeblink conditioned response. J Neurosci 26(5):1562–1570PubMedCrossRef

Kitchigina VF (2010) Theta oscillations and reactivity of hippocampal stratum oriens neurons. Sci World J 10:930–943CrossRef

Knight DC, Cheng DT, Smith CN et al (2004) Neural substrates mediating human delay and trace fear conditioning. J Neurosci 24(1):218–228PubMedCrossRef

Krasne FB, Fanselow MS, Zelikowsky M (2011) Design of a neurally plausible model of fear learning. Front Behav Neurosci 5:41PubMedCrossRef

Kryukov VI (1976) Wald’s Identity and random walk models for neuron firing. Adv Appl Prob 8:257–277CrossRef

Kryukov VI (2005) A model of attention and memory based on the principle of the dominant and the comparator function of the hippocampus. Neurosci Behav Physiol 35(3):235–252PubMed

Kryukov VI (2008) The role of the hippocampus in long-term memory: is it memory store or comparator? J Integr Neurosci 7(1):117–184PubMedCrossRef

Kryukov (2011a) Towards a unified model of Pavlovian conditioning: solution to the extinction problem. In Braissant O et al (eds) Recent researches in modern medicine: 330–340, 2nd International conference on MEDICAL PHYSIOLOGY (PHYSIOLOGY ‘11), WSEAS Press, Cambridge, UK February 23–25

Kryukov (2011b) Towards a unified model of Pavlovian conditioning: a solution to the reconsolidation problem. In: Mastarakis N et al. (eds) Recent researches in geography, geology, energy, evironment and biomedicine: 193-202, Proceedings of the 5th International conference on energy and Development - Environment - Biomedicine 2011 (EDEB ‘11), WSEAS Press, Corfu Island, Greece, July 14–16

Kryukov VI, Borisyuk GN, Borisyuk RM, Kirillov AB, Kovalenko YI (1990) Metastable and unstable states in the brain. In: Dobrushin RL, Kryukov VI, Toom AL (eds) Stochastic cellular systems: ergodicity, memory, morphogenesis. Manchester University Press, Manchester, pp 225–358

Kyd RJ, Pearce JM, Haselgrove M, Amin E, Aggleton JP (2008) The effects of hippocampal system lesions on a novel temporal discrimination task for rats. Behav Brain Res 187(1):159–171PubMedCrossRef

Larrauri JA, Schmajuk NA (2008) Attentional, associative, and configural mechanisms in extinction. Psychol Rev 115(3):640–676PubMedCrossRef

Lavoie P, Grondin S (2004) Information processing limitations as revealed by temporal discrimination. Brain Cogn 54(3):198–200PubMedCrossRef

Lee I, Kesner RP (2003) Time-dependent relationship between the dorsal hippocampus and the prefrontal cortex in spatial memory. J Neurosci 23(4):1517–1523PubMed

Lejeune H, Wearden JH (2006) Scalar properties in animal timing: conformity and violations. Q J Exp Psychol (Colchester) 59(11):1875–1908CrossRef

Lejeune H, Richelle M, Wearden JH (2006) About Skinner and time: behavior-analytic contributions to research on animal timing. J Exp Anal Behav 85(1):125–142PubMedCrossRef

Lesburguères E, Gobbo OL, Alaux-Cantin S et al (2011) Early tagging of cortical networks is required for the formation of enduring associative memory. Science 331(6019):924–928PubMedCrossRef

Levy WB, Sanyal A, Rodriguez P et al (2005a) The formation of neural codes in the hippocampus: trace conditioning as a prototypical paradigm for studying the random recoding hypothesis. Biol Cybern 92(6):409–426PubMedCrossRef

Levy WB, Hocking AB, Wu X (2005b) Interpreting hippocampal function as recoding and forecasting. Neural Netw 18(9):1242–1264PubMedCrossRef

Lewis PA, Miall RC (2009) The precision of temporal judgement: milliseconds, many minutes, and beyond. Philos Trans R Soc Lond B Biol Sci 364(1525):1897–1905PubMedCrossRef

Lindquist DH, Vogel RW, Steinmetz JE (2009)Associative and non-associative blinking in classically conditioned adult rats. Physiol Behav 96(3):399–411

Ludvig EA et al. (2008) A computational model of hippocampal function in trace conditioning. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Advances in neural information processing systems 21. MIT Press, Cambridge, pp 993–1000

Marchand AR, Luck D, Di Scala G (2004) Trace fear conditioning: a role for context? Arch Ital Biol 142(3):251–263PubMed

Matell MS, Meck WH (2000) Neuropsychological mechanisms of interval timing behavior. Bioessays 22(1):94–103PubMedCrossRef

Matus-Amat P, Higgins EA, Sprunger D et al (2007) The role of dorsal hippocampus and basolateral amygdala NMDA receptors in the acquisition and retrieval of context and contextual fear memories. Behav Neurosci 121(4):721–731PubMedCrossRef

McEchron MD, Tseng W, Disterhoft JF (2003) Single neurons in CA1 hippocampus encode trace interval duration during trace heart rate (fear) conditioning in rabbit. J Neurosci 23(4):1535–1547PubMed

McGlinchey RE, Capozzi SM, Fortier CB et al (2008) Procedural memory system supports single cue trace eyeblink conditioning in medial temporal lobe amnesia. Neuropsychology 22(2):278–282PubMedCrossRef

Meeter M, Myers CE, Gluck MA (2005) Integrating incremental learning and episodic memory models of the hippocampal region. Psychol Rev 112(3):560–585PubMedCrossRef

Miller MJ, Weiss C, Song X et al (2008) Functional magnetic resonance imaging of delay and trace eyeblink conditioning in the primary visual cortex of the rabbit. J Neurosci 28(19):4974–4981PubMedCrossRef

Misane I, Tovote P, Meyer M et al (2005) Time-dependent involvement of the dorsal hippocampus in trace fear conditioning in mice. Hippocampus 15(4):418–426PubMedCrossRef

Moore JW, Desmond JE, Berthier NE (1989) Adaptively timed conditioned responses and the cerebellum: a neural network approach. Biol Cybern 62(1):17–28PubMedCrossRef

Moustafa AA, Myers CE, Gluck MA (2009) A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning. Brain Res 1276:180–195PubMedCrossRef

Moyer JR Jr, Deyo RA, Disterhoft JF (1990) Hippocampectomy disrupts trace eye-blink conditioning in rabbits. Behav Neurosci 104(2):243–252PubMedCrossRef

Nieuwenhuis IL, Takashima A (2011) The role of the ventromedial prefrontal cortex in memory consolidation. Behav Brain Res 218(2):325–334PubMedCrossRef

Onoda K, Takahashi E, Sakata S (2003) Event-related potentials in the frontal cortex, hippocampus, and cerebellum during a temporal discrimination task in rats. Brain Res Cogn Brain Res 17(2):380–387PubMedCrossRef

Oswald B, Knuckley B, Mahan K et al (2006) Prefrontal control of trace versus delay eyeblink conditioning: role of the unconditioned stimulus in rabbits (Oryctolagus cuniculus). Behav Neurosci 120(5):1033–1042PubMedCrossRef

Oswald BB, Knuckley B, Mahan K et al (2009) Prefrontal control of trace eyeblink conditioning in rabbits (Oryctolagus cuniculus) II: effects of type of unconditioned stimulus (airpuff vs. periorbital shock) and unconditioned stimulus intensity. Physiol Behav 96(1):67–72PubMedCrossRef

Pavlov IP (1927) Conditioned reflexes: an investigation of the physiological activity of the cerebral cortex. Oxford University Press, London

Quinn JJ, Oommen SS, Morrison GE et al (2002) Post-training excitotoxic lesions of the dorsal hippocampus attenuate forward trace, backward trace, and delay fear conditioning in a temporally specific manner. Hippocampus 12(4):495–504PubMedCrossRef

Quinn JJ, Loya F, Ma QD, Fanselow MS (2005) Dorsal hippocampus NMDA receptors differentially mediate trace and contextual fear conditioning. Hippocampus 15(5):665–674PubMedCrossRef

Quinn JJ, Ma QD, Tinsley MR et al (2008) Inverse temporal contributions of the dorsal hippocampus and medial prefrontal cortex to the expression of long-term fear memories. Learn Mem 15(5):368–372PubMedCrossRef

Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and non-reinforcement. In: Black A, Prokasy W (eds) Classical conditioning, volume 2: Current research and theory. Appleton-Century-Crofts, New York, pp 64–99

Risold PY, Swanson LW (1996) Structural evidence for functional domains in the rat hippocampus. Science 272(5267):1484–1486

Risterucci C, Terramorsi D, Nieoullon A, Amalric M (2003) Excitotoxic lesions of the prelimbic-infralimbic areas of the rodent prefrontal cortex disrupt motor preparatory processes. Eur J Neurosci 17(7):1498–1508PubMedCrossRef

Rivest F, Kalaska JF, Bengio Y (2009) Alternative time representation in dopamine models J Comput Neurosci. 28(1):107–130

Rodriguez P, Levy WB (2001) A model of hippocampal activity in trace conditioning: where’s the trace? Behav Neurosci 115(6):1224–1238PubMedCrossRef

Sakamoto T, Takatsuki K, Kawahara S et al (2005) Role of hippocampal NMDA receptors in trace eyeblink conditioning. Brain Res 1039(1–2):130–136PubMedCrossRef

Sauseng P, Klimesch W, Gruber WR et al (2008) Cross-frequency phase synchronization: a brain mechanism of memory matching and attention. Neuroimage 40(1):308–317PubMedCrossRef

Schmajuk NA (2008) Computational models of classical conditioning. Scholarpedia 3(3):1664CrossRef

Schmajuk NA, Larrauri JA (2006) Experimental challenges to theories of classical conditioning: application of an attentional model of storage and retrieval. J Exp Psychol Anim Behav Process 32(1):1–20PubMedCrossRef

Schmajuk NA, Gray JA, Lam YW (1996) Latent inhibition: a neural network approach. J Exp Psychol Anim Behav Process 22(3):321–349PubMedCrossRef

Seo DO, Pang MH, Shin MS et al (2008) Hippocampal NMDA receptors are necessary for auditory trace fear conditioning measured with conditioned hypoalgesia in rats. Behav Brain Res 192(2):264–268PubMedCrossRef

Shors TJ (2001) Acute stress rapidly and persistently enhances memory formation in the male rat. Neurobiol Learn Mem 75(1):10–29PubMedCrossRef

Shors TJ (2004) Memory traces of trace memories: neurogenesis, synaptogenesis and awareness. Trends Neurosci 27(5):250–256PubMedCrossRef

Shuler MG, Bear MF (2006) Reward timing in the primary visual cortex. Science 311(5767):1606–1609PubMedCrossRef

Sirota A, Montgomery S, Fujisawa S et al (2008) Entrainment of neocortical neurons and gamma oscillations by the hippocampal theta rhythm. Neuron 60(4):683–697PubMedCrossRef

Songnian Z, Xiaoyun X, Guozheng Y, Zhi F (2003) A computational model as neurodecoder based on synchronous oscillation in the visual cortex. Neural Comput 15(10):2399–2418

Steele-Russell I, Russell MI, Castiglioni JA et al (2006) Selective attention and Pavlovian conditioning. Exp Brain Res 173(4):587–602PubMedCrossRef

Stein RB (1967) Some models of neuronal variability. Biophys J 7(1):37–68PubMedCrossRef

Steinmetz AB, Skosnik PD, Edwards CR et al (2011) Evaluation of bidirectional interstimulus interval (ISI) shift in auditory delay eye-blink conditioning in healthy humans. Learn Behav 39(4):358–370PubMedCrossRef

Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. IEEE Trans Neural Netw 9(5):1054CrossRef

Takács VT, Freund TF, Gulyás AI (2008) Types and synaptic connections of hippocampal inhibitory neurons reciprocally connected with the medial septum. Eur J Neurosci 28(1):148–64

Takehara K, Kawahara S, Kirino Y (2003) Time-dependent reorganization of the brain components underlying memory retention in trace eyeblink conditioning. J Neurosci 23(30):9897–9905PubMed

Thibaudeau G, Potvin O, Allen K et al (2007) Dorsal, ventral, and complete excitotoxic lesions of the hippocampus in rats failed to impair appetitive trace conditioning. Behav Brain Res 185(1):9–20PubMedCrossRef

Thibaudeau G, Doré FY, Goulet S (2009) Additional evidence for intact appetitive trace conditioning in hippocampal-lesioned rats. Behav Neurosci 123(3):707–712PubMedCrossRef

Timmann D, Drepper J, Frings M et al (2010) The human cerebellum contributes to motor, emotional and cognitive associative learning. A Review Cortex 46(7):845–857CrossRef

Tsukamoto M, Yasui T, Yamada MK et al (2003) Mossy fibre synaptic NMDA receptors trigger non-Hebbian long-term potentiation at entorhino-CA3 synapses in the rat. J Physiol 546(Pt 3):665–675PubMedCrossRef

Ukhtomsky AA (1966/1936) Labilnost kak uslovie crochnosti I koordinirovaniya nervnih aktov (Lability as a condition of urgency and coordination of neural acts). In: Dominanta, Nauka, Moskva, p 128

Vinogradova OS (2001) Hippocampus as comparator: Role of the two input and two output systems of the hippocampus in selection and registration of information. Hippocampus 11(5):578–598

Vinogradova OS, Kitchigina VF, Zenchenko CI (1998) Pacemaker neurons of the forebrain medical septal area and theta rhythm of the hippocampus. Membr Cell Biol 11(6):715–725PubMed

Vogel EH, Brandon SE, Wagner AR (2003) Stimulus representation in SOP: II. An application to inhibition of delay. Behav Processes 62(1–3):27–48PubMedCrossRef

Vogel EH, Castro ME, Saavedra MA (2004) Quantitative models of Pavlovian conditioning. Brain Res Bull 63(3):173–202PubMedCrossRef

Wallenstein GV, Eichenbaum H, Hasselmo ME (1998) The hippocampus as an associator of discontiguous events. Trends Neurosci 21(8):317–323PubMedCrossRef

Wanisch K, Tang J, Mederer A et al (2005) Trace fear conditioning depends on NMDA receptor activation and protein synthesis within the dorsal hippocampus of mice. Behav Brain Res 157(1):63–69PubMedCrossRef

Weidemann G, Broderick J, Lovibond PF et al (2011) Both trace and delay conditioned eyeblink responding can be dissociated from outcome expectancy. J Exp Psychol Anim Behav Process 38(1):1–10

Weinberger NM (2003) The nucleus basalis and memory codes: auditory cortical plasticity and the induction of specific, associative behavioral memory. Neurobiol Learn Mem 80(3):268–284PubMedCrossRef

Witter MP, Naber PA, van Haeften T et al (2000) Cortico-hippocampal communication by way of parallel parahippocampal-subicular pathways. Hippocampus 10(4):398–410PubMedCrossRef

Yamazaki T, Tanaka S (2005) A neural network model for trace conditioning. Int J Neural Syst 15(1–2):23–30PubMedCrossRef

Yoon T, Otto T (2007) Differential contributions of dorsal vs. ventral hippocampus to auditory trace fear conditioning. Neurobiol Learn Mem 87(4):464–475PubMedCrossRef

Zipser D (1986) A model of hippocampal learning during classical conditioning. Behav Neurosci 100(5):764–776PubMedCrossRef

Title: Towards a unified model of pavlovian conditioning: short review of trace conditioning models
Author: V. I. Kryukov
Publication date: 01-10-2012
Publisher: Springer Netherlands
Published in: Cognitive Neurodynamics / Issue 5/2012
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI: https://doi.org/10.1007/s11571-012-9195-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 5/2012

Bursts shape the NMDA-R mediated spike timing dependent plasticity curve: role of burst interspike interval and GABAergic inhibition

Stimulus detection after interruption of the feedforward response in a backward masking paradigm

Mean square stability of uncertain stochastic BAM neural networks with interval time-varying delays

Dynamic characteristics of multisensory facilitation and inhibition

Context and the renewal of conditioned taste aversion: the role of rat dorsal hippocampus examined by electrolytic lesion