Abstract
Three experiments were designed to study the effects of contextual conditioning on the extinction of instrumental leverpressing that had been reinforced on a random-interval schedule. In Experiment 1, noncontingent food retarded extinction, but signaling food delivery, a treatment that should reduce contextual conditioning, reduced the interference. Experiment 2 replicated the results of Experiment 1 and demonstrated that if the food preceded rather than followed the signal, the retardation of extinction was not reduced but was enhanced. In Experiment 3, non-contingent leverpressing was used to directly verify that the three treatments—forward signaling, noncontingent food, and backward signaling—differentially influenced contextual conditioning. Forward signaling produced the least, and backward signaling produced the most, contextual conditioning. This monotonic relationship between contextual conditioning and interference with extinction was used as evidence to support the argument that context-food associations are important in controlling instrumental responding.
Article PDF
Similar content being viewed by others
References
Adams, C. D., &Dickinson, A. (1981). Actions and habits: Variations in associative representations during instrumental training. In N. E. Spear & R. R. Miller (Eds.),Information processing in animals: Memory mechanisms (pp. 143–165). Hillsdale, NI: Erlbaum.
Ayres, J. J. B., &DeCosta, M. J. (1971). The truly random control as an extinction procedure.Psychonomic Science,24, 31–33.
Baker, A. G., Mercier, P. A., Gabel, J., &Baker, P. A. (1981). Contextual conditioning and the US preexposure effect in conditioned fear.Journal of Experimental Psychology: Animal Behavior Processes,7, 109–128.
Baker, A. G., Singh, M., &Bindra, D. B. (1985). Some effects of contextual conditioning and US predictability on Pavlovian conditioning. In P. D. Balsam & A. Tomie (Eds.),Context and conditioning (pp. 73–103). New York: Academic Press.
Balsam, P. D. (1985). The functions of the context in learning and performance. In P. D. Balsam & A. Tomie (Eds.),Context and conditioning (pp. 1–21). New York: Academic Press.
Balsam, P. D., &Gibbon, J. G. (1988). Formation of tone-US associations does not interfere with the formation of context-US associations in pigeons.Journal of Experimental Psychology: Animal Behavior Processes,14, 401–412.
Boakes, R. A. (1973). Response decrements produced by extinction and response-independent reinforcement.Journal of the Experimental Analysis of Behavior,19, 293–302.
Bouton, M. E. (1984). Differential control by context in the inflation and reinstatement paradigms.Journal of Experimental Psychology: Animal Behavior Processes,10, 56–74.
Capaldi, E. J. (1967). Effect of N-length and number of different N-lengths and number of reinforcements on extinction.Journal of Experimental Psychology,68, 230–239.
Colwill, R. M., &Rescorla, R. A. (1986). Associative structures in instrumental learning. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 20, pp. 55–104). New York: Academic Press.
Dickinson, A., &Charnock, D. J. (1985). Contingency effects with maintained reinforcement.Quarterly Journal of Experimental Psychology,37B, 397–416.
Durlach, P. J. (1983). Effect of signaling intertrial unconditioned stimuli in autoshaping.Journal of Experimental Psychology: Animal Behavior Processes,9, 374–379.
Fanselow, M. S. (1980). Signaled shock-free periods and preference for signaled shock.Journal of Experimental Psychology: Animal Behavior Processes,6, 65–80.
Gibbon, J. (1977). Scalar expectancy theory and Weber’s law in animal learning.Psychological Review,84, 279–352.
Gibbon, J., &Balsam, P. D. (1981). The spread of association in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.),Autoshaping and conditioning theory (pp. 219–253). New York: Academic Press.
Grau, J. W., &Rescorla, R. A. (1984). Role of context in autoshaping.Journal of Erperimental Psychology: Animal Behavior Processes,10, 324–332.
Herrnstein, R. I. (1966). Superstition: A corollary of the principle of Operant conditioning. In W. K. Honig (Ed.),Operant behavior: Areas of research and application (pp. 33–51). New York: Appleton-Century-Crofts.
Herrnstein, R. J., &Morse, W. H. (1957). Some effects of response-independent reinforcement on maintained operant behavior.Journal of Comparative & Physiological Psychology,50, 461–467.
Holland, P. C. (1983). Occasion setting in Pavlovian feature positive discriminations. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner (Eds.),Quantitative analyses of behavior: Discrimination processes (Vol. 4, pp. 223–345). New York: Ballinger.
Hurwitz, H. M. B., &Cutts, J. (1957). Discrimination and operant extinction.British Journal of Psychology,48, 90–92.
Kamin, L. J. (1969). Selective association and conditioning. In N. J. Mackintosh & W. K. Honig (Eds.),Fundamental issues in associative learning (pp. 42–64). Halifax, Nova Scotia: Daihousie University Press.
Karpicke, J. (1978). Directed approach responses and positive suppression in the rat.Animal Learning & Behavior,6, 216–224.
Karpicke, J., Christoph, G., Peterson, G., &Hearst, E. (1977). Signal location and positive vs. negative conditioned suppression in the rat.Journal of Experimental Psychology: Animal Behavior Processes,3, 105–118.
Mackintosh, N. J. (1974).The psychology of animal learning. London: Academic Press.
Melching, W. H. (1954). The acquired reward value of an intermittently presented stimulus.Journal of Comparative & Physiological Psychology,47, 370–374.
Meltzer, D., &Hamm, R. J. (1974). Conditioned enhancement as a function of the percentage of CS-US pairings and CS duration.Bulletin of the Psychonomic Society,4, 467–470.
Miczek, K. A., &Grossman, S. P. (1971). Positive conditioned suppresion: Effects of CS duration.Journal of the Experimental Analyses of Behavior,15, 243–247.
Moscovitch, A., &LoLordo, V. M. (1968). Role of safety in the Pavlovian backward fear conditioning procedure.Journal of Comparative & Physiological Psychology,66, 673–678.
Neuringer, A. J. (1970). Superstitious keypecking after three response-produced reinforcements.Journal of the Experimental Analysis of Behavior,13, 127–134.
Odling-Smee, F. J. (1978). The overshadowing of background stimuli by an informative CS in aversive Pavlovian conditioning with rats.Animal Learning & Behavior,6, 43–51.
Pavlov, I. P. (1927).Conditioned reflexes. Oxford: Oxford University Press.
Pearce, I. M., &Hall, G. (1978). Overshadowing of instrumental conditioning of a lever press by a more valid predictor of reinforcement.Journal of Experimental Psychology: Animal Behavior Processes,4, 356–367.
Pearce, J. M., &Hall, G. (1979). The influence of context-reinforcer associations on instrumental performance.Animal Learning & Behavior,7, 504–508.
Randich, A., &LoLorno, V. M. (1979). Associative and nonassociative theories of the UCS preexposure phenomenon.Psychological Bulletin,86, 523–548.
Rescorla, R. A. (1966). Predictability and number of pairings in Pavlovian fear conditioning.Psychonomic Science,4, 383–384.
Rescorla, R. A., Durlach, P., &Grau, J. W. (1985). Contextual learning in Pavlovian conditioning. In P. D. Balsam & A. Tomie (Eds.),Context and learning (pp. 23–56). Hillsdale, NJ: Erlbaum.
Rescorla, R. A. &Skucy, J. C. (1969). Effect of response-independent reinforcers during extinction.Journal of Comparative & Physiological Psychology,67, 381–389.
Rodger, R. S. (1967). Type II errors and their decision basis.British Journal of Mathematical & Statistical Psychology,20, 187–204.
Ross, R. T., &LoLordo, V. M. (1987). Evaluation of the relationship between occasion-setting and instrumental discriminative stimuli: A blocking analysis.Journal of Experimental Psychology: Animal Behavior Processes,13, 3–16.
St. Claire-Smith, R. (1979). The overshadowing of instrumental conditioning by a stimulus that predicts reinforcement better than the response.Animal Learning & Behavior,7, 224–228.
Schefé, H. (1953). A method of judging all contrasts in the analysis of variance.Biometrika,40, 87–104.
Schull, J. (1979). A conditioned opponent theory of Pavlovian conditioning and habituation. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 13, pp. 52–90). New York: Academic Press.
Skinner, B. F. (1948). Superstition in the pigeon.Journal of Erperimental Psychology,38, 168–172.
Solomon, R. L., &Corbitt, J. D. (1974). An opponent process theory of motivation: 1. Temporal dynamics of affect.Psychological Review,81, 119–145.
Spence, K. W. (1966). Cognitive and drive factors in the extinction of the conditioned eyeblink in humans.Psychological Review,73, 445–458.
Uhl, C. N., &Garcia, E. E. (1969). Comparison of omission with extinction in response elimination in rats.Journal of Comparative & Physiological Psychology,69, 554–562.
Wagner, A. R., &Larew, M. B. (1985). Opponent processes and conditioned inhibition. In R. R. Miller & N. E. Spear (Eds.),Information processing in animals: Conditioned inhibition (pp. 233–265). Hills-dale, NJ: Erlbaum.
Wagner, A. R., &Rescorla, R. A. (1972). Inhibition in Pavlovian conditioning: An application of a theory. In R. A. Boakes & M. S. Halliday (Eds.),Classical conditioning (Vol. 2, pp. 64–99). New York: Appleton-Century-Crofts.
Williams, B. A. (1982). Blocking the response-reinforcer association. In A. R. Wagner, R. Hermstein, & M. L. Commons (Eds.),Quantitative analyses of behavior: Acquisition processes (Vol. 3, pp. 427–447).
Zamble, E. (1969). Conditioned motivational patterns in instrumental responding in the rat.Journal of Comparative & Physiological Psychology,69, 536–543.
Author information
Authors and Affiliations
Additional information
This research was supported by a Natural Sciences and Engineering Research Council of Canada operating grant.
Rights and permissions
About this article
Cite this article
Baker, A.G. Contextual conditioning during free-operant extinction: Unsignaled, signaled, and backward-signaled noncontingent food. Animal Learning & Behavior 18, 59–70 (1990). https://doi.org/10.3758/BF03205240
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03205240