Skip to main content
Erschienen in: Minds and Machines 1-2/2016

01.03.2016

Adaptively Rational Learning

verfasst von: Sarah Wellen, David Danks

Erschienen in: Minds and Machines | Ausgabe 1-2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Research on adaptive rationality has focused principally on inference, judgment, and decision-making that lead to behaviors and actions. These processes typically require cognitive representations as input, and these representations must presumably be acquired via learning. Nonetheless, there has been little work on the nature of, and justification for, adaptively rational learning processes. In this paper, we argue that there are strong reasons to believe that some learning is adaptively rational in the same way as judgment and decision-making. Indeed, overall adaptive rationality can only properly be assessed for pairs of learning and decision processes. We thus present a formal framework for modeling such pairs of cognitive processes, and thereby assessing their adaptive rationality relative to the environment and the agent’s goals. We then use this high-level formal framework on specific cases by (a) demonstrating how natural formal constraints on decision-making can lead to substantive predictions about adaptively rational learning and representation; and (b) characterizing adaptively rational learning for fast-and-frugal one-reason decision-making.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
That is, methods for which there are proofs of their asymptotic and/or short-run reliability.
 
2
In particular, the sums of probabilities within each partition element must be the same.
 
3
There are many ways to have “representations at the level of partition elements,” including both coarsened representations and inattention to particular distinctions in the world.
 
4
More precisely, for each representation r, let O r be the vector of “optimal responses” for the N goals (i.e., O r  = < a 1,…,a N  > where a i  = D(r, V Gi )). It is straightforward to prove: if all partitions are equally costly, then r and s are in the same element of the optimal partition if and only if O r  = O s .
 
5
R could be the space of possible cue validities or another similar representational structure.
 
Literatur
Zurück zum Zitat Bailenson, J. N., Shum, M. S., Atran, S., Medin, D. L., & Coley, J. D. (2002). A bird’s eye view: Biological categorization and reasoning within and across cultures. Cognition, 84, 1–53.CrossRef Bailenson, J. N., Shum, M. S., Atran, S., Medin, D. L., & Coley, J. D. (2002). A bird’s eye view: Biological categorization and reasoning within and across cultures. Cognition, 84, 1–53.CrossRef
Zurück zum Zitat Bonawitz, E., Denison, S., Chen, A., Gopnik, G., & Griffiths, T. L. (2011). A simple sequential algorithm for approximating Bayesian inference. Proceedings of the Thirty-third Cognitive Science Society. Bonawitz, E., Denison, S., Chen, A., Gopnik, G., & Griffiths, T. L. (2011). A simple sequential algorithm for approximating Bayesian inference. Proceedings of the Thirty-third Cognitive Science Society.
Zurück zum Zitat Bröder, A. (2000). Assessing the empirical validity of the “Take-the-Best” heuristic as a model of human probabilistic inference. Journal of Experimental Psychology. Learning, Memory, and Cognition, 26, 1332–1346.CrossRef Bröder, A. (2000). Assessing the empirical validity of the “Take-the-Best” heuristic as a model of human probabilistic inference. Journal of Experimental Psychology. Learning, Memory, and Cognition, 26, 1332–1346.CrossRef
Zurück zum Zitat Bröder, A. (2003). Decision making with the “adaptive toolbox”: influence of environmental structure, intelligence, and working memory load. Journal of Experimental Psychology. Learning, Memory, and Cognition, 29, 611–625.CrossRef Bröder, A. (2003). Decision making with the “adaptive toolbox”: influence of environmental structure, intelligence, and working memory load. Journal of Experimental Psychology. Learning, Memory, and Cognition, 29, 611–625.CrossRef
Zurück zum Zitat Chin-Parker, S., & Ross, B. H. (2002). The effect of category learning on sensitivity to within-category correlations. Memory and Cognition, 30, 353–362.CrossRef Chin-Parker, S., & Ross, B. H. (2002). The effect of category learning on sensitivity to within-category correlations. Memory and Cognition, 30, 353–362.CrossRef
Zurück zum Zitat Dana, J. (2008). What makes improper linear models tick. In J. I. Krueger (Ed.), Rationality and social responsibility: Essays in honor of Robyn Mason Dawes. Mahwah: Lawrence Erlbaum Associates. Dana, J. (2008). What makes improper linear models tick. In J. I. Krueger (Ed.), Rationality and social responsibility: Essays in honor of Robyn Mason Dawes. Mahwah: Lawrence Erlbaum Associates.
Zurück zum Zitat Danks, D. (2014). Unifying the mind: Cognitive representations as graphical models. Cambridge: The MIT Press. Danks, D. (2014). Unifying the mind: Cognitive representations as graphical models. Cambridge: The MIT Press.
Zurück zum Zitat Danks, D. (in press). Goal dependence in (scientific) ontology. Synthese. Danks, D. (in press). Goal dependence in (scientific) ontology. Synthese.
Zurück zum Zitat Denison, S., Bonawitz, E. B., Gopnik, A., & Griffiths, T. L. (2013). Rational variability in children’s causal inferences: The sampling hypothesis. Cognition, 126(2), 285–300.CrossRef Denison, S., Bonawitz, E. B., Gopnik, A., & Griffiths, T. L. (2013). Rational variability in children’s causal inferences: The sampling hypothesis. Cognition, 126(2), 285–300.CrossRef
Zurück zum Zitat Dieckmann, A., & Todd, P. M. (2012). Simple rules for ordering cues in one-reason decision making. In P. M. Todd & G. Gigerenzer (Eds.), Ecological rationality: Intelligence in the world (pp. 274–308). Oxford: Oxford University Press. Dieckmann, A., & Todd, P. M. (2012). Simple rules for ordering cues in one-reason decision making. In P. M. Todd & G. Gigerenzer (Eds.), Ecological rationality: Intelligence in the world (pp. 274–308). Oxford: Oxford University Press.
Zurück zum Zitat Dougherty, M. R., Franco-Watkins, A. M., & Thomas, R. (2008). Psychological plausibility of the theory of probabilistic mental models and the fast and frugal heuristics. Psychological Review, 115(1), 199–213.CrossRef Dougherty, M. R., Franco-Watkins, A. M., & Thomas, R. (2008). Psychological plausibility of the theory of probabilistic mental models and the fast and frugal heuristics. Psychological Review, 115(1), 199–213.CrossRef
Zurück zum Zitat Geman, S., Bienenstock, E., & Doursat, R. (1992). Neural networks and the bias/variance dilemma. Neural Computation, 4, 1–58.CrossRef Geman, S., Bienenstock, E., & Doursat, R. (1992). Neural networks and the bias/variance dilemma. Neural Computation, 4, 1–58.CrossRef
Zurück zum Zitat Gigerenzer, G. (1996). On narrow norms and vague heuristics: A rebuttal to Kahneman and Tversky. Psychological Review, 103, 592–596.CrossRef Gigerenzer, G. (1996). On narrow norms and vague heuristics: A rebuttal to Kahneman and Tversky. Psychological Review, 103, 592–596.CrossRef
Zurück zum Zitat Gigerenzer, G., & Brighton, H. (2009). Homo heuristicus: Why biased minds make better inferences. Topics in Cognitive Science, 1, 107–143.CrossRef Gigerenzer, G., & Brighton, H. (2009). Homo heuristicus: Why biased minds make better inferences. Topics in Cognitive Science, 1, 107–143.CrossRef
Zurück zum Zitat Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103(4), 650–669.CrossRef Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103(4), 650–669.CrossRef
Zurück zum Zitat Gigerenzer, G., Todd, P. M., & the ABC Research Group. (1999). Simple heuristics that make us smart. New York: Oxford University Press. Gigerenzer, G., Todd, P. M., & the ABC Research Group. (1999). Simple heuristics that make us smart. New York: Oxford University Press.
Zurück zum Zitat Goldstein, D. G., & Gigerenzer, G. (2002). Models of ecological rationality: The recognition heuristic. Psychological Review, 109, 75–90.CrossRef Goldstein, D. G., & Gigerenzer, G. (2002). Models of ecological rationality: The recognition heuristic. Psychological Review, 109, 75–90.CrossRef
Zurück zum Zitat Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevitable error, unavailable injustice. New York: Oxford University Press. Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevitable error, unavailable injustice. New York: Oxford University Press.
Zurück zum Zitat Hertwig, R., Fanselow, C., & Hoffrage, U. (2003). Hindsight bias: How knowledge and heuristics affect our reconstruction of the past. Memory, 11, 357–377.CrossRef Hertwig, R., Fanselow, C., & Hoffrage, U. (2003). Hindsight bias: How knowledge and heuristics affect our reconstruction of the past. Memory, 11, 357–377.CrossRef
Zurück zum Zitat Hertwig, R., Hoffrage, U., & the ABC Research Group. (2012). Simple heuristics in a social world. Oxford: Oxford University Press.CrossRef Hertwig, R., Hoffrage, U., & the ABC Research Group. (2012). Simple heuristics in a social world. Oxford: Oxford University Press.CrossRef
Zurück zum Zitat Hills, T. T., & Hertwig, R. (2010). Information search in decisions from experience: Do our patterns of sampling foreshadow our decisions? Psychological Science, 21, 1787–1792.CrossRef Hills, T. T., & Hertwig, R. (2010). Information search in decisions from experience: Do our patterns of sampling foreshadow our decisions? Psychological Science, 21, 1787–1792.CrossRef
Zurück zum Zitat Hoffman, A. B., & Rehder, B. (2010). The costs of supervised classification: The effect of learning task on conceptual flexibility. Journal of Experimental Psychology: General, 139(2), 319–340.CrossRef Hoffman, A. B., & Rehder, B. (2010). The costs of supervised classification: The effect of learning task on conceptual flexibility. Journal of Experimental Psychology: General, 139(2), 319–340.CrossRef
Zurück zum Zitat Hoffrage, U., Hertwig, R., & Gigerenzer, G. (2000). Hindsight bias: A by-product of knowledge updating? Journal of Experimental Psychology. Learning, Memory, and Cognition, 26, 566–581.CrossRef Hoffrage, U., Hertwig, R., & Gigerenzer, G. (2000). Hindsight bias: A by-product of knowledge updating? Journal of Experimental Psychology. Learning, Memory, and Cognition, 26, 566–581.CrossRef
Zurück zum Zitat Juslin, P., & Persson, M. (2002). PROBabilities from EXemplars (PROBEX): a “lazy” algorithm for probabilistic inference from generic knowledge. Cognitive Science, 26, 563–607.CrossRef Juslin, P., & Persson, M. (2002). PROBabilities from EXemplars (PROBEX): a “lazy” algorithm for probabilistic inference from generic knowledge. Cognitive Science, 26, 563–607.CrossRef
Zurück zum Zitat Kahneman, D., & Tversky, A. (1996). On the reality of cognitive illusions. Psychological Review, 103, 582–591.CrossRef Kahneman, D., & Tversky, A. (1996). On the reality of cognitive illusions. Psychological Review, 103, 582–591.CrossRef
Zurück zum Zitat Katsikopoulos, K. V., Schooler, L. J., & Hertwig, R. (2010). The robust beauty of ordinary information. Psychological Review, 117, 1259–1266.CrossRef Katsikopoulos, K. V., Schooler, L. J., & Hertwig, R. (2010). The robust beauty of ordinary information. Psychological Review, 117, 1259–1266.CrossRef
Zurück zum Zitat Lagnado, D. A., & Sloman, S. A. (2006). Time as a guide to cause. Journal of Experimental Psychology. Learning, Memory, and Cognition, 32, 451–460.CrossRef Lagnado, D. A., & Sloman, S. A. (2006). Time as a guide to cause. Journal of Experimental Psychology. Learning, Memory, and Cognition, 32, 451–460.CrossRef
Zurück zum Zitat Lagnado, D. A., Waldmann, M. R., Hagmayer, Y., & Sloman, S. A. (2007). Beyond covariation: Cues to causal structure. In A. Gopnik & L. E. Schulz (Eds.), Causal learning: Psychology, philosophy, and computation (pp. 154–172). Oxford: Oxford University Press.CrossRef Lagnado, D. A., Waldmann, M. R., Hagmayer, Y., & Sloman, S. A. (2007). Beyond covariation: Cues to causal structure. In A. Gopnik & L. E. Schulz (Eds.), Causal learning: Psychology, philosophy, and computation (pp. 154–172). Oxford: Oxford University Press.CrossRef
Zurück zum Zitat Markman, Art B., & Ross, B. H. (2003). Category use and category learning. Psychological Bulletin, 129, 592–613.CrossRef Markman, Art B., & Ross, B. H. (2003). Category use and category learning. Psychological Bulletin, 129, 592–613.CrossRef
Zurück zum Zitat Martignon, L., & Hoffrage, U. (1999). Where and why is Take The Best fast, frugal and fit? In G. Gigerenzer & P. M. Todd (Eds.), Simple heuristics that make us smart (pp. 119–140). Oxford: Oxford University Press. Martignon, L., & Hoffrage, U. (1999). Where and why is Take The Best fast, frugal and fit? In G. Gigerenzer & P. M. Todd (Eds.), Simple heuristics that make us smart (pp. 119–140). Oxford: Oxford University Press.
Zurück zum Zitat Martignon, L., & Hoffrage, U. (2002). Fast, frugal, and fit: Simple heuristics for paired comparison. Theory and Decision, 52, 29–71.CrossRefMATH Martignon, L., & Hoffrage, U. (2002). Fast, frugal, and fit: Simple heuristics for paired comparison. Theory and Decision, 52, 29–71.CrossRefMATH
Zurück zum Zitat Newell, B. R., Rakow, T., Weston, N. J., & Shanks, D. R. (2004). Search strategies in decision making: The success of “success”. Journal of Behavioral Decision Making, 17(2), 117–137.CrossRef Newell, B. R., Rakow, T., Weston, N. J., & Shanks, D. R. (2004). Search strategies in decision making: The success of “success”. Journal of Behavioral Decision Making, 17(2), 117–137.CrossRef
Zurück zum Zitat Newell, B. R., & Shanks, D. R. (2003). Take the best or look at the rest? Factors influencing ‘one-reason’ decision making. Journal of Experimental Psychology. Learning, Memory, and Cognition, 29, 53–65.CrossRef Newell, B. R., & Shanks, D. R. (2003). Take the best or look at the rest? Factors influencing ‘one-reason’ decision making. Journal of Experimental Psychology. Learning, Memory, and Cognition, 29, 53–65.CrossRef
Zurück zum Zitat Rieskamp, J., & Otto, P. E. (2006). SSL: A theory of how people learn to select strategies. Journal of Experimental Psychology: General, 135, 207–236.CrossRef Rieskamp, J., & Otto, P. E. (2006). SSL: A theory of how people learn to select strategies. Journal of Experimental Psychology: General, 135, 207–236.CrossRef
Zurück zum Zitat Ross, B. H. (1997). The use of categories affects classification. Journal of Memory and Language, 37, 240–267.CrossRef Ross, B. H. (1997). The use of categories affects classification. Journal of Memory and Language, 37, 240–267.CrossRef
Zurück zum Zitat Ross, B. H. (2000). The effects of category use on learned categories. Memory and Cognition, 28(1), 51–63.CrossRef Ross, B. H. (2000). The effects of category use on learned categories. Memory and Cognition, 28(1), 51–63.CrossRef
Zurück zum Zitat Samuels, R., Stich, S., & Bishop, M. (2002). Ending the rationality wars: How to make disputes about human rationality disappear. In R. Elio (Ed.), Common sense, reasoning, and rationality (pp. 236–268). New York: Oxford University Press.CrossRef Samuels, R., Stich, S., & Bishop, M. (2002). Ending the rationality wars: How to make disputes about human rationality disappear. In R. Elio (Ed.), Common sense, reasoning, and rationality (pp. 236–268). New York: Oxford University Press.CrossRef
Zurück zum Zitat Schooler, L. J., & Anderson, J. R. (1997). The role of process in the rational analysis of memory. Cognitive Psychology, 32, 219–250.CrossRef Schooler, L. J., & Anderson, J. R. (1997). The role of process in the rational analysis of memory. Cognitive Psychology, 32, 219–250.CrossRef
Zurück zum Zitat Shi, L., Griffiths, T. L., Feldman, N. H., & Sanborn, A. N. (2010). Exemplar models as a mechanism for performing Bayesian inference. Psychonomic Bulletin & Review, 17(4), 443–464.CrossRef Shi, L., Griffiths, T. L., Feldman, N. H., & Sanborn, A. N. (2010). Exemplar models as a mechanism for performing Bayesian inference. Psychonomic Bulletin & Review, 17(4), 443–464.CrossRef
Zurück zum Zitat Simon, H. A. (1976). From substantive to procedural rationality. In S. J. Latsis (Ed.), Method and appraisal in economics. Cambridge: Cambridge University Press. Simon, H. A. (1976). From substantive to procedural rationality. In S. J. Latsis (Ed.), Method and appraisal in economics. Cambridge: Cambridge University Press.
Zurück zum Zitat Sloman, S. A., & Lagnado, D. A. (2005). Do we “do”? Cognitive Science, 29, 5–39.CrossRef Sloman, S. A., & Lagnado, D. A. (2005). Do we “do”? Cognitive Science, 29, 5–39.CrossRef
Zurück zum Zitat Todd, P. M., & Dieckmann, A. (2005). Heuristics for ordering cue search in decision making. In Lawrence K. Saul, Yair Weiss, & Leon Bottou (Eds.), Advances in Neural Information Processing Systems 17 (pp. 1393–1400). Cambridge: MIT Press. Todd, P. M., & Dieckmann, A. (2005). Heuristics for ordering cue search in decision making. In Lawrence K. Saul, Yair Weiss, & Leon Bottou (Eds.), Advances in Neural Information Processing Systems 17 (pp. 1393–1400). Cambridge: MIT Press.
Zurück zum Zitat von Winterfeldt, D., & Edwards, W. (1986). Decision analysis and behavioral research. Cambridge: Cambridge University Press. von Winterfeldt, D., & Edwards, W. (1986). Decision analysis and behavioral research. Cambridge: Cambridge University Press.
Metadaten
Titel
Adaptively Rational Learning
verfasst von
Sarah Wellen
David Danks
Publikationsdatum
01.03.2016
Verlag
Springer Netherlands
Erschienen in
Minds and Machines / Ausgabe 1-2/2016
Print ISSN: 0924-6495
Elektronische ISSN: 1572-8641
DOI
https://doi.org/10.1007/s11023-015-9370-1

Weitere Artikel der Ausgabe 1-2/2016

Minds and Machines 1-2/2016 Zur Ausgabe

Premium Partner