nach oben

Learning & Behavior

Erschienen in:

16.06.2015

Regularities in responding during performance of a complex choice task

verfasst von: Eduardo Mercado III, Vladimir Orduña

Erschienen in: Learning & Behavior | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Systematic variations in the rate and temporal patterns of responding under a multiple concurrent-chains schedule were quantified using recurrence metrics and self-organizing maps to assess whether individual rats showed consistent or idiosyncratic patterns. The results indicated that (1) the temporal regularity of response patterns varied as a function of number of training sessions, time on task, magnitude of reinforcement, and reinforcement contingencies; (2) individuals showed heterogeneous, stereotyped patterns of responding, despite similarities in matching behavior; (3) the specific trajectories of behavioral variation shown by individuals were less evident in group-level analyses; and (4) reinforcement contingencies within terminal links strongly modulated response patterns within initial links. Temporal regularity in responding was most evident for responses that led to minimally delayed reinforcers of larger magnitude. Models of response production and selection that take into account the time between individual responses, probabilities of transitions between response options, periodicity within response sequences, and individual differences in response dynamics can clarify the mechanisms that drive behavioral adjustments during operant conditioning.

Vorheriger Artikel Erratum to: The goldfish conditioned withdrawal preparation: effects of some basic methodological variables

Nächster Artikel Training order and structural location of meaningful stimuli: Effects on equivalence class formation

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

In the following, the term regularity is used to refer to patterning in the timing, sequencing, or form of responses. Stereotypy is used to specify regularity in the form of movements, and periodicity is used to indicate that responses occur at regular/rhythmic intervals.

Barton, G. J. (2006). Visualisation of clinical gait data using a self-organising artificial neural network. In R. Begg & M. Palaniswami (Eds.), Computational intelligence for movement sciences: Neural networks and other emerging techniques (pp. 197–216). Hershey, PA: Idea Group.CrossRef

Baum, W. M. (2002). From molecular to molar: A paradigm shift in behavior analysis. Journal of the Experimental Analysis of Behavior, 78, 95–116. doi:10.1901/jeab.2002.78-95 PubMedCentralCrossRefPubMed

Baum, W. M., & Rachlin, H. C. (1969). Choice as time allocation. Journal of the Experimental Analysis of Behavior, 12, 861–874.PubMedCentralCrossRefPubMed

Berg, M. E., & Grace, R. C. (2006). Initial-link duration and acquisition of preference in concurrent chains. Learning & Behavior, 34, 50–60.CrossRef

Blough, D. S. (1963). Interresponse time as a function of continuous variables: A new method and some data. Journal of the Experimental Analysis of Behavior, 6, 237–246.PubMedCentralCrossRefPubMed

Budaev. (2010). Using principal components and factor analysis in animal behaviour research: Caveats and guidelines. Ethology, 116, 472–480.CrossRef

Cerutti, D. T., & Staddon, J. E. (2004). Time and rate measures in choice transitions. Journal of the Experimental Analysis of Behavior, 81, 135–154. doi:10.1901/jeab.2004.81-135 PubMedCentralCrossRefPubMed

Cleaveland, J. M. (1999). Interresponse-time sensitivity during discrete-trial and free-operant concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior, 72, 317–339. doi:10.1901/jeab.1999.72-317 PubMedCentralCrossRefPubMed

Davison, M., & McCarthy, D. (1988). The matching law: A research review. Hillsdale, NJ: Erlbaum.

Delprato, D. J. (1986). Response patterns. In H. W. Reese & L. J. Parrott (Eds.), Behavior science: Philosophical, methodological, and empirical advances (pp. 61–113). Hillsdale, NJ: Erlbaum.

Demsar, J., Zupan, B., Leban, G., & Curk, T. (2004). Orange: From experimental machine learning to interactive data mining. Lecture Notes in Computer Science, 3202, 537–539.CrossRef

Dugatkin, L. A., & Alfieri, M. S. (2003). Boldness, behavioral inhibition and learning. Ethology Ecology & Evolution, 15, 43–49.CrossRef

Eckmann, J.-P., Oliffson Kamphorst, S., & Ruelle, D. (1987). Recurrence plots of dynamical systems. Europhysics Letters, 4, 973–977.CrossRef

Fantino, E., & Royalty, P. (1987). A molecular analysis of choice on concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 48, 145–159. doi:10.1901/jeab.1987.48-145 PubMedCentralCrossRefPubMed

Ferster, C. B. (1953). Sustained behavior under delayed reinforcement. Journal of Experimental Psychology, 45, 218–224.CrossRefPubMed

Ferster, C. B., & Hammer, C. (1965). Variables determining the effects of delay in reinforcement. Journal of the Experimental Analysis of Behavior, 8, 243–254.PubMedCentralCrossRefPubMed

Galbicka, G. (1992). The dynamics of behavior. Journal of the Experimental Analysis of Behavior, 57, 243–248.PubMedCentralCrossRefPubMed

Gallistel, C. R., Fairhurst, S., & Balsam, P. (2004). The learning curve: Implications of a quantitative analysis. Proceedings of the National Academy of Sciences, 101, 13124–13131. doi:10.1073/pnas.0404965101 CrossRef

Gallistel, C. R., King, A. P., Gottlieb, D., Balci, F., Papachristos, E. B., Szalecki, M., & Carbone, K. S. (2007). Is matching innate? Journal of the Experimental Analysis of Behavior, 87, 161–199.PubMedCentralCrossRefPubMed

Gentry, G. D., Weiss, B., & Laties, V. G. (1983). The microanalysis of fixed-interval responding. Journal of the Experimental Analysis of Behavior, 39, 327–343.PubMedCentralCrossRefPubMed

Grace, R. C., Berg, M. E., & Kyonka, E. G. (2006). Choice and timing in concurrent chains: Effects of initial-link duration. Behavioral Processes, 71, 188–200. doi:10.1016/j.beproc.2005.11.002 CrossRef

Guillette, L. M., Hahn, A. H., Hoeschele, M., Przyslupski, A. M., & Sturdy, C. B. (2014). Individual differences in learning speed, performance accuracy and exploratory behaviour in black-capped chickadees. Animal Cognition, 18, 165–178. doi:10.1007/s10071-014-0787-3 CrossRefPubMed

Guthrie, E. R., & Horton, G. P. (1946). Cats in a puzzle box. New York, NY: Rinehart & Company.

Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243–266.PubMedCentralCrossRefPubMed

Iversen, I. H. (1991). Methods of analyzing behavior patterns. In I. H. Iversen & K. A. Lattal (Eds.), Experimental analysis of behavior (pp. 193–241). Amsterdam, The Netherlands: Elsevier.CrossRef

Kirkpatrick, K., & Church, R. M. (2003). Tracking of the expected time to reinforcement in temporal conditioning procedures. Learning & Behavior, 31, 3–21.CrossRef

Kirt, T., & Vainik, E. (2007). Comparison of the methods of self-organizing maps and multidimensional scaling in analysis of Estonian emotion concepts. In J. Nivre, H.-J. Kaalep, K. Muiscnek, & M. Koit (Eds.), Proceedings of the 16th Nordic conference on computational linguistics (pp. 113–120). Tartu, Estonia: University of Tartu.

Kohonen, T. (2001). Self-organizing maps. Berlin, Germany: Springer.CrossRef

Kohonen, T. (2013). Essentials of the self-organizing map. Neural Networks, 37, 52–65. doi:10.1016/j.neunet.2012.09.018 CrossRefPubMed

Laquitaine, S., Piron, C., Abellanas, D., Loewenstein, Y., & Boraud, T. (2013). Complex population response of dorsal putamen neurons predicts the ability to learn. PLoS One, 8, e80683. doi:10.1371/journal.pone.0080683 PubMedCentralCrossRefPubMed

Li, J. S., & Huston, J. P. (2002). Non-linear dynamics of operant behavior. Reviews in the Neurosciences, 13, 31–57.CrossRefPubMed

Li, J. S., Krauth, J., & Huston, J. P. (2006). Operant behavior of rats under fixed-interval reinforcement schedules: A dynamical analysis via the extended return map. Nonlinear Dynamics, Psychology, and Life Sciences, 10, 215–240.PubMed

Little, M. A., McSharry, P. E., Moroz, I. M., & Roberts, S. J. (2006, May 14–19). Nonlinear, biophysically-informed speech pathology detection (pp. 1080–1083). IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2006, Toulouse, France.

Little, M. A., McSharry, P. E., Roberts, S. J., Costello, D. A. E., & Moroz, I. M. (2007). Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomedical Engineering Online, 6, 23. doi:10.1186/1475-925X-6-23 PubMedCentralCrossRefPubMed

Lloyd, G. R., Wongravee, K., Silwood, C. J. L., Grootveld, M., & Brereton, R. G. (2009). Self organising maps for variable selection: Application to human saliva analysis by nuclear magnetic resonance spectroscopy to investigate the effect of an oral healthcare product. Chemometrics and Intelligent Laboratory Systems, 98, 149–161.CrossRef

MacDonall, J. S. (2009). The stay/switch model of concurrent choice. Journal of the Experimental Analysis of Behavior, 91, 21–39.PubMedCentralCrossRefPubMed

Marr, M. J. (1992). Behavior dynamics: One perspective. Journal of the Experimental Analysis of Behavior, 57, 249–266.PubMedCentralCrossRefPubMed

Mercado, E., III. (2011). Mapping individual variations in learning capacity. International Journal of Comparative Psychology, 24, 4–35.

Misak, P., & Cleaveland, J. M. (2011). Preference as a function of active interresponse times: A test of the active time model. Journal of the Experimental Analysis of Behavior, 96, 215–225. doi:10.1901/jeab.2011.96-215 PubMedCentralCrossRefPubMed

Neuringer, A. J. (1969). Delayed reinforcement versus reinforcement after a fixed interval. Journal of the Experimental Analysis of Behavior, 12, 375–383.PubMedCentralCrossRefPubMed

Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. Behavioral and Brain Sciences, 23, 73–90.CrossRefPubMed

Newland, M. C. (1997). Quantifying the molecular structure of behavior: Separate effects of caffeine, cocaine, and adenosine agonists on interresponse times and lever-press durations. Behavioral Pharmacology, 8, 1–16.

Orduña, V., Valencia-Torres, L., Cruz, G., & Bouzas, A. (2013). Sensitivity to delay is affected by magnitude of reinforcement in rats. Behavioural Processes, 98, 18–24. doi:10.1016/j.beproc.2013.04.011 CrossRefPubMed

Orduña, V., Valencia-Torres, L., & Bouzas, A. (2009). DRL performance of spontaneously hypertensive rats: Dissociation of timing and inhibition of responses. Behavioural Brain Research, 201, 158–165. doi:10.1016/j.bbr.2009.02.016 CrossRefPubMed

Ossenkopp, K. P., Sorenson, L., & Mazmanian, D. S. (1994). Factor analysis of open-field behavior in the rat (Rattus norvegicus): Application of the three-way PARAFAC model to a longitudinal data set. Behavioural Processes, 31, 129–144. doi:10.1016/0376-6357(94)90001-9 CrossRefPubMed

Palya, W. L. (1992). Dynamics in the fine structure of schedule-controlled behavior. Journal of the Experimental Analysis of Behavior, 57, 267–287. doi:10.1901/jeab.1992.57-267 PubMedCentralCrossRefPubMed

Pavlov, I. P. (1927). Conditioned reflexes. London, England: Oxford University Press.

Pear, J. J. (1985). Spatiotemporal patterns of behavior produced by variable-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 44, 217–231.PubMedCentralCrossRefPubMed

Pear, J. J. (2001). The science of learning. Philadelphia, PA: Taylor & Francis.

Perl, J., & Dauscher, P. (2006). Dynamic pattern recognition in sport by means of artificial neural networks. In R. Begg & M. Palaniswami (Eds.), Computational intelligence for movement sciences: Neural networks and other emerging techniques (pp. 299–319). Hershey, PA: Idea Group.CrossRef

Rachlin, H. C. (2000). The science of self-control. Cambridge, MA: Harvard University Press.

Shimp, C. P. (1966). Probabilistically reinforced choice behavior in pigeons. Journal of the Experimental Analysis of Behavior, 9, 443–455. doi:10.1901/jeab.1966.9-443 PubMedCentralCrossRefPubMed

Shimp, C. P. (1969). The concurrent reinforcement of two interresponse times: The relative frequency of an interresponse time equals its relative harmonic length. Journal of the Experimental Analysis of Behavior, 12, 403–411.PubMedCentralCrossRefPubMed

Shimp, C. P. (1981). Local structure of steady-state operant behavior. In C. M. Bradshaw, E. Szabadi, & C. F. Lowe (Eds.), Quantification of steady-state operant behaviour (pp. 189–203). Amsterdam: Elsevier.

Shimp, C. P. (1992). Computational behavior dynamics: An alternative description of Nevin (1969). Journal of the Experimental Analysis of Behavior, 57, 289–299. doi:10.1901/jeab.1992.57-289 PubMedCentralCrossRefPubMed

Shimp, C. P. (2014). How molecular, molar and unified analyses change the meaning of behavioral variability. International Journal of Comparative Psychology, 27, 224–247.

Shimp, C. P., Fremouw, T., Ingebritsen, L. M., & Long, K. A. (1994). Molar function depends on molecular structure of behavior. Journal of Experimental Psychology: Animal Behavior Processes, 20, 96–107.PubMed

Shull, R. L., Gaynor, S. T., & Grimes, J. A. (2001). Response rate viewed as engagement bouts: Effects of relative reinforcement and schedule type. Journal of the Experimental Analysis of Behavior, 75, 247–274. doi:10.1901/jeab.2001.75-247 PubMedCentralCrossRefPubMed

Sidman, M. (1954). The temporal distribution of avoidance responses. Journal of Comparative and Physiological Psychology, 47, 399–402.CrossRefPubMed

Silva, F. J., & Pear, J. J. (1995). Stereotypy of spatial movements during noncontingent and contingent reinforcement. Animal Learning and Behavior, 23, 245–255.CrossRef

Silva, F. J., Pear, J. J., Tait, R. W., & Forest, J. J. (1996). Fourier analysis of movement patterns in pigeons. Behavior Research Methods, Instruments, & Computers, 28, 27–37.CrossRef

Staddon, J. E., & Cerutti, D. T. (2003). Operant conditioning. Annual Review of Psychology, 54, 115–144. doi:10.1146/annurev.psych.54.101601.145124 PubMedCentralCrossRefPubMed

Staddon, J. E., Chelaru, I. M., & Higa, J. J. (2002). A tuned-trace theory of interval-timing dynamics. Journal of the Experimental Analysis of Behavior, 77, 105–124. doi:10.1901/jeab.2002.77-105 PubMedCentralCrossRefPubMed

Tanno, T., & Silberberg, A. (2012). The copyist model of response emission. Psychonomic Bulletin & Review, 19, 759–778. doi:10.3758/s13423-012-0267-1 CrossRef

Tryon, R. C. (1940). Studies of individual differences in maze ability: VII. The specific components of maze ability and a general theory of psychological components. Journal of Comparative Psychology, 30, 283–335.CrossRef

Webber, C. L., Jr., & Zbilut, J. P. (1994). Dynamical assessment of physiological systems and states using recurrence plot strategies. Journal of Applied Physiology, 76, 965–973.PubMed

Weiss, B. (1970). The fine structure of operant behavior during transition states. In W. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 277–311). New York, NY: Appleton-Century-Crofts.

Williams, B. A. (1988). Reinforcement, choice, and response strength. In R. C. Atkinson, R. J. Herrnstein, G. Lindzey, & R. D. Luce (Eds.), Stevens handbook of experimental psychology (Vol. 2, pp. 167–244). New York, NY: John Wiley & Sons.

Williams, B. A. (1990). Enduring problems for molecular accounts of operant behavior. Journal of the Experimental Analysis of Behavior, 16, 213–216.

Worthy, D. A., Hawthorne, M. J., & Otto, A. R. (2013). Heterogeneity of strategy use in the Iowa gambling task: A comparison of win-stay/lose-shift and reinforcement learning models. Psychonomic Bulletin & Review, 20, 364–371. doi:10.3758/s13423-012-0324-9 CrossRef

Wünstel, M., Polani, D., Uthmann, T., & Perl, J. (2001). Behavior classification with self-organizing maps. In P. Stone, T. Balch, & G. Kraetzschmar (Eds.), Robocup 2000, LNAI 2019 (pp. 108–118). Berlin, Germany: Springer-Verlag.

Wynne, C. D., Staddon, J. E., & Delius, J. D. (1996). Dynamics of waiting in pigeons. Journal of the Experimental Analysis of Behavior, 65, 603–618.PubMedCentralCrossRefPubMed

Titel: Regularities in responding during performance of a complex choice task
verfasst von: Eduardo Mercado III
Vladimir Orduña
Publikationsdatum: 16.06.2015
Verlag: Springer US
Erschienen in: Learning & Behavior / Ausgabe 4/2015
Print ISSN: 1543-4494
Elektronische ISSN: 1543-4508
DOI: https://doi.org/10.3758/s13420-015-0182-1

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 4/2015

The goldfish conditioned withdrawal preparation: Effects of some basic methodological variables

Latent inhibition in flavor-preference conditioning: Effects of motivational state and the nature of the reinforcer

Training order and structural location of meaningful stimuli: Effects on equivalence class formation

Comparing the context specificity of extinction and latent inhibition

Erratum to: The goldfish conditioned withdrawal preparation: effects of some basic methodological variables

Learning to write without writing: Writing accurate descriptions of interactions after learning graph-printed description relations