Top

Learning & Behavior

Published in:

01-03-2013

Adjunctive behaviors are operants

Authors: Peter R. Killeen, Ricardo Pellón

Published in: Learning & Behavior | Issue 1/2013

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Adjunctive behaviors such as schedule-induced polydipsia are said to be induced by periodic delivery of incentives, but not reinforced by them. That standard treatment assumes that contingency is necessary for conditioning and that delay of reinforcement gradients are very steep. The arguments and evidence for this position are reviewed and rejected. In their place, data are presented that imply different gradients for different classes of responses. Proximity between response and reinforcer, rather than contingency or contiguity, is offered as a key principle of association. These conceptions organize a wide variety of observations and provide the rudiments for a more general theory of conditioning.

next article Associative foundation of causal learning in rats

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Ainslie, G. (1992). Picoeconomics. New York: Cambridge University Press.

Ainslie, G. (2001). Breakdown of will. Cambridge University Press.

Albert, D., & Mah, C. (1972). An examination of conditioned reinforcement using a one-trial learning procedure. Learning and Motivation, 3, 369–388.CrossRef

Alcock, J. (2005). Animal behavior: An evolutionary approach. Sunderland: Sinauer Association.

Álvarez, A., Íbias, J., & Pellón, R. (2011). Facilitación de la adquisición de bebida adjuntiva tras la entrega de comida más que en anticipación a la misma [Facilitation of acquisition of adjunctive drinking after food delivery more than in anticipation to food]. In H. Martínez, J. J. Irigoyen, F. Cabrera, J. Varela, P. Covarrubias & A. Jiménez (Eds.), Estudios sobre Comportamiento y Aplicaciones (Vol. II, pp. 55–69). Tlajomulco de Zúñiga, Jalisco, México: Segunda Generación. .

Amsel, A., & Work, M. S. (1961). The role of learned factors in "spontaneous" activity. Journal of Comparative and Physiological Psychology, 54, 527–532.PubMedCrossRef

Amsel, A., Work, M. S., & Penick, E. C. (1962). Activity during and between periods of stimulus change related to feeding. Journal of Comparative and Physiological Psychology, 55, 1114–1117.PubMedCrossRef

Anderson, M. C., & Shettleworth, S. J. (1977). Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters. Journal of the Experimental Analysis of Behavior, 25, 33–49.CrossRef

Anselme, P. (2010). The uncertainty processing theory of motivation. Behavioural Brain Research, 208, 291–310.PubMedCrossRef

Arcediano, F., Escobar, M., & Miller, R. R. (2003). Temporal integration and temporal backward associations in human and nonhuman subjects. Learning & Behavior, 31, 242–256.CrossRef

Arcediano, F., Escobar, M., & Miller, R. R. (2005). Bidirectional associations in humans and rats. Journal of Experimental Psychology. Animal Behavior Processes, 31, 301–318.PubMedCrossRef

Armstrong, C. M., DeVito, L. M., & Cleland, T. A. (2006). One-trial associative odor learning in neonatal mice. Chemical Senses, 31, 343–349.PubMedCrossRef

Avila, R., & Bruner, C. A. (1994). Varying the temporal placement of a drinking opportunity in a fixed-interval schedule. Journal of the Experimental Analysis of Behavior, 62, 307–314.PubMedCrossRef

Baerends, G. P. (1976). The functional organization of behaviour. Animal Behaviour, 24, 726–738.CrossRef

Balleine, B. W., & Dickinson, A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407–419.PubMedCrossRef

Baum, W. M. (1973). The correlation-based law of effect. Journal of the Experimental Analysis of Behavior, 20, 137–153.PubMedCrossRef

Baum, W. M. (2005). Understanding behaviorism: Behavior, culture, and evolution (2nd ed.). Malden, MA: Blackwell Publishing.

Baum, W. M. (2012). Rethinking reinforcement: Allocation, induction, and contingency. Journal of the Experimental Analysis of Behavior, 97, 101–124.PubMedCrossRef

Bevins, R. A., & Besheer, J. (2006). Object recognition in rats and mice: A one-trial non-matching-to-sample learning task to study'recognition memory'. Nature Protocols, 1, 1306–1311.PubMedCrossRef

Bickel, W. K., Higgins, S. T., Kirby, K., & Johnson, L. M. (1988). An inverse relationship between baseline fixed-interval response rate and the effects of a tandem response requirement. Journal of the Experimental Analysis of Behavior, 50, 211–218.PubMedCrossRef

Bindra, D. (1972). A unified account of classical conditioning and operant training. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 453–481). New York: Appleton-Century-Crofts.

Blass, E. (Ed.). (2001). Developmental psychobiology (Vol. 13). New York: Kluwer Academic.

Boakes, R. A. (1977). Performance on learning to associate a stimulus with positive reinforcement. In H. David & H. M. B. Hurwitz (Eds.), Operant-Pavlovian interactions (pp. 67–101). Hillsdale, NJ: Erlbaum.

Boakes, R. A. (1984). From Darwin to behaviourism: Psychology and the minds of animals. Cambridge: Cambridge University Press.

Boakes, R. A., Halliday, M. S., & Poli, M. (1975). Response additivity: Effects of superimposed free reinforcement on a variable-interval baseline. Journal of the Experimental Analysis of Behavior, 23, 177–191.PubMedCrossRef

Boakes, R. A., Poli, M., Lockwood, M. J., & Goodall, G. (1978). A study of misbehavior: Token reinforcement in the rat. Journal of the Experimental Analysis of Behavior, 29, 115–134.PubMedCrossRef

Bolles, R. C. (1970). Species-specific defense reactions and avoidance learning. Psychological Review, 71, 32–48.CrossRef

Bolles, R. C. (1983). The explanation of behavior. Psychological Record, 33, 31–48.

Bouton, M. E. (2007). Learning and behavior: A contemporary synthesis. Sunderland, MA: Sinauer Associates, Inc.

Brackney, R. (2012). Habits and actions. In P. Killeen (Ed.) (Observation ed.). Tempe, AZ.

Bradshaw, C. M., & Killeen, P. R. (2012). A theory of behaviour on progressive ratio schedules, with applications in behavioural pharmacology. Psychopharmacology, OnLine First.

Breland, K., & Breland, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681–684.CrossRef

Brown, B. L., Hemmes, N. S., & Cabeza de Vaca, S. (1997). Timing of the CS-US interval by pigeons in trace and delay autoshaping. The Quarterly Journal of Experimental Psychology. B, 50, 40–53.CrossRef

Brown, B. L., Hemmes, N. S., Cabeza de Vaca, S., & Pagano, C. (1993). Sign and goal tracking during delay and trace autoshaping in pigeons. Animal Learning & Behavior, 21, 360–368.CrossRef

Brush, M. E., & Schaeffer, R. W. (1974). Effects of water deprivation on schedule-induced polydipsia. Bulletin of the Psychonomic Society, 4, 69–72.

Campbell, B. A., Smith, N. F., Misanin, J. R., & Jaynes, J. (1966). Species differences in activity during hunger and thirst. Journal of Comparative and Physiological Psychology, 61, 123–127.PubMedCrossRef

Capaldi, E. J. (1978). Effects of schedule and delay of reinforcement on acquisition speed. Animal Learning & Behavior, 6, 330–334.CrossRef

Catania, A. C. (Ed.). (1968). Contemporary research in operant behavior. Glenview, IL: Scott, Foresman and Company.

Catania, A. (1971a). Elicitation, reinforcement, and stimulus control. In R. Glaser (Ed.), The nature of reinforcement (pp. 196–220). New York: Academic Press.

Catania, A. C. (1971b). Reinforcement schedules: The role of responses preceding the one that produces the reinforcer. Journal of the Experimental Analysis of Behavior, 15, 271–287.PubMedCrossRef

Catania, A. C. (1973). The concept of the operant in the analysis of behavior. Behaviorism, 1, 103–116.

Catania, A. C. (2005a). Attention-deficit/hyperactivity disorder (ADHD): Delay-of-reinforcement gradients and other behavioral mechanisms. The Behavioral and Brain Sciences, 28, 419–424.

Catania, A. C. (2005b). The operant reserve: A computer simulation in (accelerated) real time. Behavioural Processes, 69, 257–278.PubMedCrossRef

Catania, A. C., Sagvolden, T., & Keller, K. J. (1988). Reinforcement schedules: Retroactive and proactive effects of reinforcers inserted into fixed-interval performances. Journal of the Experimental Analysis of Behavior, 49, 49–73.PubMedCrossRef

Chapman, H. W., & Richardson, H. M. (1974). The role of systemic hydration in the acquisition of schedule-induced polydipsia by rats. Behavioral Biology, 12, 501–508.PubMedCrossRef

Cherot, C., Jones, A., & Neuringer, A. (1996). Reinforced variability decreases with approach to reinforcers. Journal of Experimental Psychology. Animal Behavior Processes, 22, 497–508.PubMedCrossRef

Christian, W. P., Schaeffer, R. W., & King, G. D. (1977). Schedule-induced behavior: Research and theory. Montreal: Eden Press.

Clark, F. C. (1962). Some observations on the adventitious reinforcement of drinking under food reinforcement. Journal of the Experimental Analysis of Behavior, 5, 61–63.PubMedCrossRef

Cleaveland, J. M., Jäger, R., Rößner, P., & Delius, J. D. (2003). Ontogeny has a phylogeny: Background to adjunctive behaviors in pigeons and budgerigars. Behavioural Processes, 61, 143–158.PubMedCrossRef

Cope, C. L., Sanger, D. J., & Blackman, D. E. (1976). Intragastric water and the acquisition of schedule-induced drinking. Behavioral Biology, 17, 267–270.PubMedCrossRef

Costa, D. S. J., & Boakes, R. A. (2007). Maintenance of responding when reinforcement becomes delayed. Learning & Behavior, 35, 95–105.CrossRef

Costa, D. S. J., & Boakes, R. A. (2009). Context blocking in rat autoshaping: Sign-tracking versus goal-tracking. Learning and Motivation, 40, 178–185.CrossRef

Critchfield, T. S., & Lattal, K. A. (1993). Acquisition of a spatially defined operant with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 59, 373–387.PubMedCrossRef

D'Amato, M. R., Safarjan, W. R., & Salmon, D. (1981). Long-delay conditioning and instrumental leaming: Some new findings. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 113–142). Mawah, NJ: Lawrence Earlbaum Associates.

Davey, G. C. L., Phillips, J. H., & Witty, S. (1989). Signal-directed behavior in the rat: Interactions between the nature of the CS and the nature of the UCS. Learning & Behavior, 17, 447–456.CrossRef

Davis, H., & Hubbard, J. (1972). An analysis of superstitious behavior in the rat. Behaviour, 43, 1–12.CrossRef

Davis, E. R., & Platt, J. R. (1983). Contiguity and contingency in the acquisition and maintenance of an operant. Learning and Motivation, 14, 487–512.CrossRef

Dickinson, A. (1985). Actions and habits: The development of behavioural autonomy. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 308, 67–78.CrossRef

Dickinson, A. (2001). Causal learning: An associative analysis (The 28th Bartlett Memorial Lecture). The Quarterly Journal of Experimental Psychology. B, 54, 3–26.CrossRef

Dickinson, A., Balleine, B., Watt, A., Gonzalez, F., & Boakes, R. A. (1995). Motivational control after extended instrumental training. Animal Learning & Behavior, 23, 197–206.CrossRef

Dickinson, A., Watt, A., & Griffiths, W. J. H. (1992). Free-operant acquisition with delayed reinforcement. The Quarterly Journal of Experimental Psychology. B, 45, 241–258.

Domjan, M. (1983). Biological constraints on instrumental and classical conditioning: Implications for general process theory. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 19, pp. 215–277). New York: Academic Press.

Donahoe, J. W. (2006). Contingency: Its meaning in the experimental analysis of behavior. European Journal of Behavior Analysis, 7, 111–114.

Donahoe, J. W., Palmer, D. C., & Burgos, J. E. (1997). The SR issue: its status in behavior analysis and in Donahoe and Palmer's learning and complex behavior. Journal of the Experimental Analysis of Behavior, 67, 193.

Egger, M. D., & Miller, N. E. (1962). Secondary reinforcement in rats as a function of information value and reliability of the stimulus. Journal of Experimental Psychology, 64, 97–104.PubMedCrossRef

Falk, J. L. (1961). Production of polydipsia in normal rats by an intermittent food schedule. Science, 133, 195–196.PubMedCrossRef

Falk, J. L. (1966). Schedule-induced polydipsia as a function of fixed interval length. Journal of the Experimental Analysis of Behavior, 9, 37–39.PubMedCrossRef

Falk, J. L. (1971). The nature and determinants of adjunctive behavior. Physiology & Behavior, 6, 577–588.CrossRef

Fanselow, M. S. (1989). The adaptive function of conditioned defensive behavior: an ecological approach to Pavlovian stimulus-substitution theory. NATO Advanced Study Institutes series. Series D, Behavioural and social sciences, 48, 151–166.

Fanselow, M. S., & Sigmundi, R. A. (1986). Species-specific danger signals, endogenous opioid analgesia, and defensive behavior. Journal of Experimemal Psychology, 12, 301–309.

Fentress, J. C. (1983). Ethological models of hierarchy and patterning of species-specific behavior. In P. Teitelbaum & E. Satinoff (Eds.), Handbook of behavioral neurobiology (Vol. 6, pp. 185–234). New York: Plenum Press.

Ferrell, J. E. (2012). Bistability, bifurcations, and Waddington's epigenetic landscape. Current Biology, 22, R458–R466.PubMedCrossRef

Fetterman, J. G., Killeen, P. R., & Hall, S. (1998). Watching the clock. Behavioural Processes, 44, 211–222.PubMedCrossRef

Flory, R. K. (1971). The control of schedule-induced polydipsia: Frequency and amount of reinforcement. Learning and Motivation, 2, 215–227.CrossRef

Gallistel, C. R. (1980). The organization of action: A new synthesis (Vol. 13). New York: Erlbaum Associates.

Gallo, A., Duchatelle, E., Elkhessaimi, A., Lepape, G. L., & Desportes, J. P. (1995). Topographic analysis of the rat's bar behaviour in the Skinner box. Behavioural Processes, 33, 319–327.CrossRef

Garcia, J., McGowan, B. K., & Green, K. F. (1972). Biological constraints on conditioning. In H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 3–27). New York: Appleton-Century-Crofts.

Gharib, A., Gade, C., & Roberts, S. (2004). Control of variation by reward probability. Journal of Experimental Psychology. Animal Behavior Processes, 30, 271–282.PubMedCrossRef

Gibbon, J., Baldock, M. D., Locurto, C. M., Gold, L., & Terrace, H. S. (1977). Trial and intertrial durations in autoshaping. Journal of Experimental Psychology. Animal Behavior Processes, 3, 264–284.CrossRef

Gibbon, J., Berryman, R., & Thompson, R. L. (1974). Contingency spaces and measures in classical and instrumental conditioning. Journal of the Experimental Analysis of Behavior, 21, 585–605.PubMedCrossRef

Gibbon, J., Farrell, L., Locurto, C. M., Duncan, H. J., & Terrace, H. S. (1980). Partial reinforcement in autoshaping with pigeons. Animal Learning and Behavior, 8, 45–59.CrossRef

Good, I. J. (1961). A causal calculus. The British Journal for the Philosophy of Science, 11, 305–318.CrossRef

Gottlieb, D. A. (2006). Effects of partial reinforcement and time between reinforced trials on terminal response rate in pigeon autoshaping. Behavioural Processes, 72, 6–13.PubMedCrossRef

Graham, C. L. D., & John, H. (1989). Signal-directed behavior in the rat: Interactions between the nature of the CS and the nature of the UCS. Animal Learning & Behavior, 17, 447–456.CrossRef

Haight, P. A., & Killeen, P. R. (1991). Adjunctive behavior in multiple schedules of reinforcement. Animal Learning & Behavior, 19, 257–263.CrossRef

Hanson, S. J. (1977). The Rescorla-Wagner model and the temporal control of behavior. Unpublished Master's thesis, Arizona State University, Tempe, AZ.

Harris, J. A., Gharaei, S., & Pincham, H. L. (2011). Response rates track the history of reinforcement times. Journal of Experimental Psychology. Animal Behavior Processes, 37, 277–286.PubMedCrossRef

Herrnstein, R. J. (1966). Superstition: A Corollary of the principles of operant conditioning. In W. K. Honig (Ed.), Operant behavior: Areas of research and application (pp. 33–51). New York: Appleton-Century-Crofts.

Herrnstein, R. J. (1977). The evolution of behaviorism. American Psychologist, 32, 593–603.CrossRef

Hinson, J. M., & Staddon, J. E. R. (1978). Behavioral competition: A mechanism for schedule interactions. Science, 202, 432–434.PubMedCrossRef

Hogan, J. A. (1994). Structure and development of behavior systems. Psychonomic Bulletin & Review, 1, 439–450.CrossRef

Holland, P. C. (1979). The effects of qualitative and quantitative variation in the US on individual components of Pavlovian appetitive conditioned behavior in rats. Learning & Behavior, 7, 424–432.CrossRef

Holland, P. C. (1980). CS-US interval as a determinant of the form of Pavlovian appetitive conditioned responses. Journal of Experimental Psychology. Animal Behavior Processes, 6, 155–174.PubMedCrossRef

Holland, P. C. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology. Animal Behavior Processes, 30, 104–117.PubMedCrossRef

Innis, N. K., Simmelhag-Grant, V. L., & Staddon, J. E. R. (1983). Behavior induced by periodic food delivery: The effects of interfood interval. Journal of the Experimental Analysis of Behavior, 39, 309–322.PubMedCrossRef

Iwata, B. A., Kahng, S. W., Wallace, M. D., & Lindberg, J. S. (2000). The functional analysis model of behavioral assessment. In J. Austin & J. E. Carr (Eds.), Handbook of applied behavior analysis (pp. 61–89). Reno, NV: Context Press.

Jenkins, W. O. (1943a). Studies in the spread of effect. I. The bi-directional gradient in the performance of white rats on a linear maze. Journal of Comparative Psychology, 35, 41–56.CrossRef

Jenkins, W. O. (1943b). Studies in the spread of effect. II. The effect of increased motivation upon the bi-directional gradient. Journal of Comparative Psychology, 35, 57–63.CrossRef

Jenkins, W. O. (1943c). Studies in the spread of effect. III. The effect of increased incentive upon the bi-directional gradient. Journal of Comparative Psychology, 35, 65–72.CrossRef

Jenkins, H. M. (1970). Sequential organization in schedules of reinforcement. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 63–109). New York: Appleton-Century-Crofts.

Johansen, E. B., Killeen, P. R., Russell, V. A., Tripp, G., Wickens, J. R., Tannock, R., et al. (2009). Origins of altered reinforcement effects in ADHD. Behavior and Brain Functions, 5, 7.CrossRef

Johansen, E. B., Killeen, P. R., & Sagvolden, T. (2007). Behavioral variability, elimination of responses, and delay-of-reinforcement gradients in SHR and WKY rats. Behavior Brain Functions.

Johnson, L. M., Bickel, W. K., Higgins, S. T., & Morris, E. K. (1991). The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement. Journal of the Experimental Analysis of Behavior, 55, 313–322.PubMedCrossRef

Jozefowiez, J., Staddon, J. E. R., & Cerutti, D. T. (2009). The behavioral economics of choice and interval timing. Psychological Review, 116, 519–539.PubMedCrossRef

Keehn, J. D., & Burton, M. (1978). Schedule-induced drinking: Entrainment by fixed-and random-interval schedule-controlled feeding. T.-I.-T. Journal of Life Sciences, 8, 93.PubMed

Keith-Lucas, T., & Guttman, N. (1975). Robust-single-trial delayed backward conditioning. Journal of Comparative and Physiological Psychology, 88, 468–476.CrossRef

Killeen, P. R. (1975). On the temporal control of behavior. Psychological Review, 82, 89–115.CrossRef

Killeen, P. R. (1978). Superstition: A matter of bias, not detectability. Science, 199, 88–90.PubMedCrossRef

Killeen, P. R. (1981). Learning as causal inference. In M. Commons & J. A. Nevin (Eds.), Quantitative studies of behavior (pp. 289–312). New York: Pergamon.

Killeen, P. R. (1994). Mathematical principles of reinforcement. The Behavioral and Brain Sciences, 17, 105–172.CrossRef

Killeen, P. R. (2002). Scalar counters. Learning and Motivation, 33, 63–87.CrossRef

Killeen, P. R. (2005). Gradus ad parnassum: Ascending strength gradients or descending memory traces? The Behavioral and Brain Sciences, 28, 432–434.CrossRef

Killeen, P. R. (2011). Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid. Behavioural Processes, 8, 57–63.CrossRef

Killeen, P. R., & Fetterman, J. G. (1993). Behavioral theory of timing: Transition analyses. Journal of the Experimental Analysis of Behavior, 59, 411–422.PubMedCrossRef

Killeen, P. R., Fetterman, J. G., & Bizo, L. A. (1997). Time's causes. In C. M. Bradshaw & E. Szabadi (Eds.), Time and behaviour: Psychological and neurobiological analyses (pp. 79–131). Amsterdam: Elsevier Science Publishers BV.CrossRef

Killeen, P. R., Hanson, S. J., & Osborne, S. R. (1978). Arousal: Its genesis and manifestation as response rate. Psychological Review, 85, 571–581.PubMedCrossRef

Killeen, P. R., Sanabria, F., & Dolgov, I. (2009). The dynamics of conditioning and extinction. Journal of Experimental Psychology. Animal Behavior Processes, 35, 447–472.PubMedCrossRef

Killeen, P. R., & Sitomer, M. T. (2003). MPR. Behavioural Processes, 62, 49–64.PubMedCrossRef

Killeen, P. R., & Smith, J. P. (1984). Perception of contingency in conditioning: Scalar timing, response bias, and the erasure of memory by reinforcement. Journal of Experimental Psychology. Animal Behavior Processes, 10, 333–345.CrossRef

Killeen, P. R., & Taylor, T. J. (2000a). How the propagation of error through stochastic counters affects time discrimination and other psychophysical judgments. Psychological Review, 107, 430–459.PubMedCrossRef

Killeen, P. R., & Taylor, T. J. (2000b). Stochastic adding machines. Nonlinearity, 13, 1889–1903.PubMedCrossRef

King, G. D. (1974a). The enhancement of schedule-induced polydipsia by preschedule noncontingent shock. Bulletin of the Psychonomic Society, 3, 46–48.

King, G. D. (1974b). Wheel running in the rat induced by a fixed-time presentation of water. Animal Learning & Behavior, 2, 325–328.CrossRef

Kissileff, H. R. (1969). Food-associated drinking in the rat. Journal of Comparative and Physiological Psychology, 67, 284–300.PubMedCrossRef

Kohman, R., Leising, K., Shaffer, M., & Higa, J. J. (2006). Effects of breaks in the interval cycle on temporal tracking in pigeons. Behavioural Processes, 71, 126–134.PubMedCrossRef

Kwok, D.W.S., Livesey, E.J., & Boakes, R.A. (2012). Serial overshadowing of taste aversion learning by stimuli preceding the target taste. Learning & Behavior [Epub].

Lamas, E., & Pellón, R. (1995). Food-deprivation effects on punished schedule-induced drinking in rats. Journal of the Experimental Analysis of Behavior, 64, 47–60.PubMedCrossRef

Lamas, E., & Pellón, R. (1997). Food deprivation and food-delay effects on the development of adjunctive drinking. Physiology & Behavior, 61, 153–158.CrossRef

LaMon, B. C., & Zeigler, H. P. (1984). Grasping in the pigeon (Columba livia): Stimulus control during conditioned and consummatory responses. Animal Learning & Behavior, 12, 223–231.CrossRef

Lattal, K. A. (1995). Contingency and behavior analysis. Behavior Analyst, 18, 209–224.PubMed

Lattal, K. A. (2010). Delayed reinforcement of operant behavior. Journal of the Experimental Analysis of Behavior, 93, 129–139.PubMedCrossRef

Lattal, K. A., & Abreu-Rodrigues, J. (1997). Response-independent events in the behavior stream. Journal of the Experimental Analysis of Behavior, 68, 375–398.PubMedCrossRef

Lattal, K. A., & Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology. Animal Behavior Processes, 16, 27–39.PubMedCrossRef

Lattal, K. A., & Williams, A. M. (1997). Body weight and response acquisition with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 67, 131–143.PubMedCrossRef

Lett, B. T. (1975). Long-delay learning in the T-maze. Learning and Motivation, 6, 80–90.CrossRef

Lieberman, D. A., Davidson, F. H., & Thomas, G. V. (1985). Marking in pigeons: The role of memory in delayed reinforcement. Journal of Experimental Psychology. Animal Behavior Processes, 11, 611–624.CrossRef

Lieberman, D. A., McIntosh, D. C., & Thomas, G. V. (1979). Learning when reward is delayed: A marking hypothesis. Journal of Experimental Psychology. Animal Behavior Processes, 5, 224–242.PubMedCrossRef

Livnat, A., & Pippenger, N. (2006). An optimal brain can be composed of conflicting agents. Proceedings of the National Academy of Sciences of the United States of America, 103, 3198–3202.PubMedCrossRef

Locurto, C., Travers, T., Terrace, H., & Gibbon, J. (1980). Physical restraint produces rapid acquisition of the pigeon's key peck. Journal of the Experimental Analysis of Behavior, 34, 13–21.PubMedCrossRef

Looney, T.A., & Cohen, P.S. (1982). Aggression induced by intermittent positive reinforcement. Neuroscience and Biobehavioral Reviews, 15–37.

López-Crespo, G., Rodríguez, M., Pellón, R., & Flores, P. (2004). Acquisition of schedule-induced polydipsia by rats in proximity to upcoming food delivery. Learning & Behavior, 32, 491–499.CrossRef

Lucas, G. A., Timberlake, W., & Gawley, D. J. (1988). Adjunctive behavior of the rat under periodic food delivery in a 24-hour environment. Animal Learning & Behavior, 16, 19–30.CrossRef

Machado, A. (1997). Learning the temporal dynamics of behavior. Psychological Review, 104, 241–265.PubMedCrossRef

Machado, A., & Silva, F. J. (2007). Toward a richer view of the scientific method: The role of conceptual analysis. American Psychologist, 62, 671–681.PubMedCrossRef

Mackintosh, N. J. (1974). The psychology of animal learning. New York: Academic Press.

Madden, G. J., & Perone, M. (2003). Effects of alternative reinforcement on human behavior: The source does matter. Journal of the Experimental Analysis of Behavior, 79, 193–206.PubMedCrossRef

Millenson, J. R., Allen, R. B., & Pinker, S. (1977). Adjunctive drinking during variable and random-interval food reinforcement schedules. Animal Learning & Behavior, 5, 285–290.CrossRef

Moore, B. W. (1973). The role of directed Pavlovian reactions in simple instrumental learning in the pigeon. In R. A. Hinde & J. Stevenson-Hinde (Eds.), Constraints on learning: Limitations and predispositions (pp. 159–188). New York: Academic Press.

Moran, G., & Rudolph, R. (1980). Some effects of lick-contingent delays on the development of schedule-induced polydipsia. Learning and Motivation, 11, 366–385.CrossRef

Myerson, J., & Christiansen, B. (1979). Temporal control of eating on periodic water schedules. Physiology & Behavior, 23, 279–282.CrossRef

Myerson, J., & Miezin, F. M. (1980). The kinetics of choice: An operant systems analysis. Psychological Review, 87, 160–174.CrossRef

Neuringer, A. J. (1970). Superstitious key pecking after three peck-produced reinforcements. Journal of the Experimental Analysis of Behavior, 13, 127–134.PubMedCrossRef

Okouchi, H. (2009). Response acquisition by humans with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 91, 377–390.PubMedCrossRef

Osborne, S. R. (1978). A quantitative analysis of the effects of amount of reinforcement on two response classes. Journal of Experimental Psychology. Animal Behavior Processes, 4, 297–317.CrossRef

Osborne, S. R., & Killeen, P. R. (1977). Temporal properties of responding during stimuli that preceed response-independent food. Learning and Motivation, 8, 533–550.CrossRef

Palya, W. L., & Zacny, J. P. (1980). Stereotyped adjunctive pecking by caged pigeons. Animal Learning & Behavior, 8, 293–303.CrossRef

Papini, M. R., & Bitterman, M. E. (1990). The role of contingency in classical conditioning. Psychological Review, 97, 396–403.PubMedCrossRef

Patterson, A. E. (2009). Schedule-induced drinking: A re-examination of the “superstitious conditioning” hypothesis. Unpublished Dissertation, University of Sydney, Sydney.

Patterson, A.E., & Boakes, R.A. (2012). Interval, blocking and marking effects during the development of schedule-induced drinking. Journal of Experimental Psychology: Animal Behavior Processes [Epub], 1–12.

Pear, J. J., Moody, J. E., & Persinger, M. A. (1972). Lever attacking by rats during free-operant avoidance. Journal of the Experimental Analysis of Behavior, 18, 517.PubMedCrossRef

Pellón, R., Bayeh, L., & Pérez-Padilla, Á. (2006). Schedule-induced polydipsia under explicit positive reinforcement. Paper presented at the Winter Conference on Animal Learning and Behavior.

Pellón, R., & Blackman, D. E. (1987). Punishment of schedule-induced drinking in rats by signaled and unsignaled delays in food presentation. Journal of the Experimental Analysis of Behavior, 48, 417–434.PubMedCrossRef

Pellón, R., & Pérez-Padilla, Á. (2013). Response-food delay gradients for lever pressing and schedule-induced licking in rats. Learning & Behavior, accepted.

Penney, J., & Schull, J. (1977). Functional differentiation of adjunctive drinking and wheel running in rats. Animal Learning & Behavior, 5, 272–280.CrossRef

Plonsky, M., Driscoll, C. D., Warren, D. A., & Rosellini, R. A. (1984). Do random time schedules induce polydipsia in the rat? Animal Learning and Behavior, 12, 355–362.CrossRef

Porter, J. H., Young, R., & Moeschl, T. P. (1978). Effects of water and saline preloads on schedule-induced polydipsia in the rat. Physiology & Behavior, 21, 333–338.CrossRef

Powell, R. W., & Curley, M. (1976). Instinctive drift in nondomesticated rodents. Bulletin of the Psychonomic Society, 8, 175–178.

Premack, D. (1965). Reinforcement theory. In D. Levine (Ed.), Nebraska Symposium on Motivation: Lincoln: University of Nebraska Press.

Rachlin, H. (1988). Molar behaviorism. In D. B. Fishman, F. Rotgers, & C. M. Franks (Eds.), Paradigms in behavior therapy: Present and promise (pp. 77–105). New York: Springer.

Rachlin, H. (1994). Behavior and mind: The roots of modern psychology. New York: Oxford University Press.

Rachlin, H. (2000). The science of self-control. Cambridge, MA: Harvard University Press.

Reid, A. K., Bachá, G., & Morán, C. (1993). The temporal organization of behavior on periodic food schedules. Journal of the Experimental Analysis of Behavior, 59, 1–27.PubMedCrossRef

Reid, A. K., & Dale, R. H. I. (1985). Dynamic effects of food magnitude on interim-terminal interaction. Journal of the Experimental Analysis of Behavior, 39, 135–148.CrossRef

Reid, A. K., & Staddon, J. E. R. (1982). Schedule-induced drinking: Elicitation, anticipation, or behavioral interaction? Journal of the Experimental Analysis of Behavior, 38, 1–18.PubMedCrossRef

Reid, A. K., Vazquez, P. P., & Rico, J. A. (1985). Schedule induction and the temporal distributions of adjunctive behavior on periodic water schedules. Learning & Behavior, 13, 321–326.CrossRef

Reilly, M. P., & Lattal, K. A. (2004). Within-session delay-of-reinforcement gradients. Journal of the Experimental Analysis of Behavior, 82, 21–35.PubMedCrossRef

Rescorla, R. A. (1967). Pavlovian conditioning and its proper control procedures. Psychological Review, 74, 71–80.PubMedCrossRef

Rescorla, R. A. (1972). "Configural" conditioning in discrete-trial bar pressing. Journal of Comparative and Physiological Psychology, 79, 307–317.PubMedCrossRef

Rescorla, R. A. (1988). Pavlovian conditioning: It's not what you think it is. American Psychologist, 43, 151–160.PubMedCrossRef

Revusky, S., & Garcia, J. (1970). Learned associations over long delays. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 6, pp. 1–83). San Diego: Academic Press.

Revusky, S., & Parker, L. A. (1976). Aversions to unflavored water and cup drinking produced by delayed sickness. Journal of Experimental Psychology. Animal Behavior Processes, 2, 342–353.PubMedCrossRef

Reynierse, J. H., & Spanier, D. (1968). Excessive drinking in rats' adaptation to the schedule of feeding. Psychonomic Science, 10, 95–96.

Riley, A. L., Hyson, R. L., Baker, C. S., & Kulkosky, P. J. (1980). The interaction of conditioned taste aversions and schedule-induced polydipsia: Effects of repeated conditioning trials. Learning & Behavior, 8, 211–217.CrossRef

Roca, A., & Bruner, C. A. (2011a). An analysis of the origin of excessive water intake of schedule-induced drinking. Revista Mexicana de Análisis de la Conducta, 37, 177–204.CrossRef

Roca, A., & Bruner, C. A. (2011b). Effects of reinforcement frequency on lever pressing for water in food-deprived rats. Revista Mexicana de Análisis de la Conducta, 29, 119–130.CrossRef

Roper, T. J. (1978). Diversity and substitutability of adjunctive activities under fixed-interval schedules of food reinforcement. Journal of the Experimental Analysis of Behavior, 30, 83–96.PubMedCrossRef

Roper, T. J., & Crossland, G. (1982). Schedule-induced wood-chewing in rats and its dependence on body weight. Animal Learning & Behavior, 10, 65–71.CrossRef

Roper, T. J., & Nieto, J. (1979). Schedule-induced drinking and other behavior in the rat, as a function of body weight deficit. Physiology & Behavior, 23, 673–678.CrossRef

Roper, T. J., & Posadas-Andrews, A. (1981). Are schedule-induced drinking and displacement activities causally related? The Quarterly Journal of Experimental Psychology. B, 33, 181–193.

Sanabria, F., Sitomer, M. T., & Killeen, P. R. (2006). Negative automaintenance omission training is effective. Journal of the Experimental Analysis of Behavior, 86, 1–10.PubMedCrossRef

Schaal, D. W., & Branch, M. N. (1990). Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: Effects of delay-signal duration. Journal of the Experimental Analysis of Behavior, 53, 103–121.PubMedCrossRef

Segal, E. F. (1972). Induction and the provenance of operants. In R. M. Gilbert & J. R. Millenson (Eds.), Reinforcement: Behavioral analyses (pp. 1–34). New York: Academic Press.

Segal, E. F., Oden, D. L., & Deadwyler, S. A. (1965). Determinants of polydipsia: IV. Free-reinforcement schedules. Psychonomic Science, 3, 11–12.

Seligman, M. E. P. (1970). On the generality of the laws of learning. Psychological Review, 77, 406–418.CrossRef

Sheffield, F. D., & Campbell, B. A. (1954). The role of experience in the "spontaneous" activity of hungry rats. Journal of Comparative and Physiological Psychology, 47, 97–100.PubMedCrossRef

Shettleworth, S. J. (1988). Foraging as operant behavior and operant behavior as foraging: What have we learned. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 22, pp. 1–49). New York: Academic Press.

Shettleworth, S. J., & Juergensen, M. R. (1980). Reinforcement and the organization of behavior in golden hamsters: Brain stimulation reinforcement for seven action patterns. Journal of Experimental Psychology. Animal Behavior Processes, 6, 352–375.PubMedCrossRef

Shimp, C. P. (1981). The local organization of behavior: Discrimination of and memory for simple behavioral patterns. Journal of the Experimental Analysis of Behavior, 36, 303–315.PubMedCrossRef

Shull, R. L. (1970). A response-initiated fixed-interval schedule of reinforcement. Journal of the Experimental Analysis of Behavior, 13, 13–15.PubMedCrossRef

Silva, F. J., Silva, K. M., & Pear, J. J. (1992). Sign-versus goal-tracking: Effects of conditioned-stimulus-to-unconditioned-stimulus distance. Journal of the Experimental Analysis of Behavior, 57, 17–31.PubMedCrossRef

Silva, K. M., & Timberlake, W. (1997). A behavior systems view of conditioned states during long and short CS-US intervals. Learning and Motivation, 28, 465–490.CrossRef

Silva, K. M., & Timberlake, W. (1998). The organization and temporal properties of appetitive behavior in rats. Animal Learning & Behavior, 26, 182–195.CrossRef

Silva, F. J., & Timberlake, W. (2000). A clarification of the nature of backward excitatory conditioning. Learning and Motivation, 31, 67–80.CrossRef

Silva, F. J., Timberlake, W., & Ozlem Cevik, M. (1998). A behavior systems approach to the expression of backward associations. Learning and Motivation, 29, 1–22.CrossRef

Skinner, B. F. (1948). Superstition in the pigeon. Journal of Experimental Psychology, 38, 168–172.PubMedCrossRef

Skinner, B. F. (1984). The phylogeny and ontogeny of behavior. The Behavioral and Brain Sciences, 7, 669–711.CrossRef

Slater, P. J. B., & Ollason, J. C. (1972). The temporal pattern of behaviour in isolated male zebra finches: Transition analysis. Behaviour, 42, 248–269.CrossRef

Smith, S. S., & Renner, K. E. (1976). Preference for food and water in rats as a function of delay of reward. Animal Learning & Behavior, 4, 299–302.CrossRef

Sosa, R., dos Santos, C. V., & Flores, C. (2011). Training a new response using conditioned reinforcement. Behavioural Processes, 87, 231–236.PubMedCrossRef

Spetch, M. L., & Honig, W. K. (1988). Characteristics of pigeons' spatial working memory in an open-field task. Learning & Behavior, 16, 123–131.CrossRef

Spetch, M. L., Wilkie, D. M., & Pinel, J. P. (1981). Backward conditioning: A reevaluation of the empirical evidence. Psychological Bulletin, 89, 163–175.PubMedCrossRef

Staddon, J. E. R. (1977). Schedule-induced behavior. In W. K. Honig & Staddon (Eds.), Handbook of operant behavior (pp. 125–152). Englewood Clifffs, NJ: Prentice-Hall.

Staddon, J. E. R. (1983). Adaptive behavior and learning. New York: Cambridge University Press.

Staddon, J. E. R., & Simmelhag, V. (1971). The "superstition" experiment: A re-examination of its implications for the principles of adaptive behavior. Psychological Review, 78, 3–43.CrossRef

Staddon, J. E. R., & Zhang, Y. (1989). Response selection in operant learning. Behavioural Processes, 20, 189–197.CrossRef

Staddon, J. E. R., & Zhang, Y. (1991). On the assignment-of-credit problem in operant learning. In M. Commons, S. Grossberg & Staddon (Eds.), Neural network models of conditioning and action (pp. 279–293). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.

Stahlman, W. D., Roberts, S., & Blaisdell, A. P. (2010). Effect of reward probability on spatial and temporal variation. Journal of Experimental Psychology. Animal Behavior Processes, 36, 77–91.PubMedCrossRef

Stein, L. (1964). Excessive drinking in the rat: Superstition or thirst? Journal of Comparative and Physiological Psychology, 58, 237–242.PubMedCrossRef

Stokes, P. D., & Balsam, P. D. (1991). Effects of reinforcing preselected approximations on the topography of the rat's bar press. Journal of the Experimental Analysis of Behavior, 55, 213–231.PubMedCrossRef

Stout, S. C., & Miller, R. R. (2007). Sometimes-competing retrieval (SOCR): A formalization of the comparator hypothesis. Psychological Review, 114, 759–783.PubMedCrossRef

Sutphin, G., Byrne, T., & Poling, A. (1998). Response acquisition with delayed reinforcement: A comparison of two- lever procedures. Journal of the Experimental Analysis of Behavior, 69, 17–28.PubMedCrossRef

Tang, M., Williams, S. L., & Falk, J. L. (1988). Prior schedule exposure reduces the acquisition of schedule-induced polydipsia. Physiology & Behavior, 44, 817–820.CrossRef

Thorndike, E.L. (1933). An experimental study of rewards. Teachers College Contributions to Education.

Timberlake, W. (1993). Behavior systems and reinforcement: An integrative approach. Journal of the Experimental Analysis of Behavior, 60, 105–128.PubMedCrossRef

Timberlake, W. (1994). Behavior systems, associationism, and Pavlovian conditioning. Psychonomic Bulletin & Review, 1, 405–420.CrossRef

Timberlake, W. (1995). Reconceptualizing reinforcement - a causal, system approach to reinforcement and behavior-change. In W. Odonohue & L. Krasner (Eds.), Theories of behavior therapy (pp. 59–96). 750 First Street NE, Washington, DC 20002: Amer Psychological Assoc.

Timberlake, W. (2000). Motivational modes in behavior systems. In R. R. Mowrer & S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 155–209). Mawah, NJ: Erlbaum Associates.

Timberlake, W. (2001). Integrating niche-related and general process approaches in the study of learning. Behavioural Processes, 54, 79–94.PubMedCrossRef

Timberlake, W., & Lucas, G. A. (1985). The basis of superstitious behavior: Chance contingency, stimulus substitution, or appetitive behavior? Journal of the Experimental Analysis of Behavior, 44, 279–299.PubMedCrossRef

Timberlake, W., & Lucas, G. A. (1989). Behavior systems and learning: From misbehavior to general principles. In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Instrumental conditioning theory and the impact of constraints on learning (pp. 237–275). Hillsdale, NJ: Erlbaum.

Toates, F.M. (1971). The effect of pretraining on schedule induced polydipsia. Psychonomic Science, 219–220.

Tonneau, F. (2005). Windows. Behavioural Processes, 69, 237–247.PubMedCrossRef

Wallace, M., & Singer, G. (1976). Schedule induced behavior: A review of its generality, determinants and pharmacological data. Pharmacology Biochemistry and Behavior, 5, 483–490.CrossRef

Ward, R.D., Gallistel, C., Jensen, G., Richards, V.L., Fairhurst, S., & Balsam, P.D. (2012). Conditioned stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability. Journal of Experimental Psychology: Animal Behavior Processes, in press.

Wearden, J., & Lejeune, H. (2006). "The stone which the builders rejected": Delay of reinforcement and response rate on fixed-interval and related schedules. Behavioural Processes, 71, 77–87.PubMedCrossRef

Whishaw, I. Q., & Gorny, B. P. (1991). Postprandial scanning by the rat (Rattus norvegicus): The importance of eating time and an application of "warm-up" movements. Journal of Comparative Psychology, 105, 39–44.PubMedCrossRef

Wilkenfield, J., Nickel, M., Blakely, E., & Poling, A. (1992). Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures. Journal of the Experimental Analysis of Behavior, 58, 431–443.PubMedCrossRef

Williams, B. A. (1975). The blocking of reinforcement control. Journal of the Experimental Analysis of Behavior, 24, 215–226.PubMedCrossRef

Williams, B. A. (1981). The following schedule of reinforcement as a fundamental determinant of steady state contrast in multiple schedules. Journal of the Experimental Analysis of Behavior, 35, 293–310.PubMedCrossRef

Williams, B. A. (1991). Marking and bridging versus conditioned reinforcement. Animal Learning & Behavior, 19, 264–269.CrossRef

Williams, B. A. (1999). Associative competition in operant conditioning: Blocking the response-reinforcer association. Psychonomic Bulletin & Review, 6, 618–623.CrossRef

Williams, D. A., Johns, K. W., & Brindas, M. (2008). Timing during inhibitory conditioning. Journal of Experimental Psychology. Animal Behavior Processes, 34, 237–246.PubMedCrossRef

Williams, S. L., Tang, M., & Falk, J. L. (1992). Prior exposure to a running wheel and scheduled food attenuates polydipsia acquisition. Physiology & Behavior, 52, 481–483.CrossRef

Williams, D. R., & Williams, H. (1969). Auto-maintenance in the pigeon: Sustained pecking despite contingent non-reinforcement. Journal of the Experimental Analysis of Behavior, 12, 511–520.PubMedCrossRef

Wong, P. T. P. (1977). A behavioral field approach to instrumental learning in the rat: I. Partial reinforcement effects and sex differences. Animal Learning and Behavior, 5, 5–13.CrossRef

Title: Adjunctive behaviors are operants
Authors: Peter R. Killeen
Ricardo Pellón
Publication date: 01-03-2013
Publisher: Springer-Verlag
Published in: Learning & Behavior / Issue 1/2013
Print ISSN: 1543-4494
Electronic ISSN: 1543-4508
DOI: https://doi.org/10.3758/s13420-012-0095-1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 1/2013

Overshadowing and associability change: Examining the contribution of differential stimulus exposure

Conditioned suppression is an inverted-U function of footshock intensity

Revisiting the role of within-compound associations in cue-interaction phenomena

Do adjustments in search behavior depend on the precision of spatial memory?

Associative foundation of causal learning in rats

The effects of response cost and species-typical behaviors on a daily time–place learning task

Premium Partner