Skip to main content
Erschienen in: Artificial Intelligence Review 2/2019

09.12.2017

Evaluating representational systems in artificial intelligence

verfasst von: John Licato, Zhitian Zhang

Erschienen in: Artificial Intelligence Review | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

All artificial reasoners work within representational systems. These systems, which may have varying levels of formality or detail, determine the space of possible representations over which the artificial reasoner can operate, by defining the syntactic and semantic properties of the symbols, structures, and inferences that they manipulate. But we are now seeing an increasing need for the ability to reason over representational systems, rather than just working within them. A prerequisite of performing such reasoning is the ability to evaluate and compare representational objects (and to know the difference between them). We survey the criteria that are used for such evaluations in AI, machine learning, and other AI-related fields. To aid our survey, we introduce a formalism of representations, representational systems, and representational spaces that lends itself nicely to an analysis of the criteria typically used for evaluating them.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
By “AI-related research” we mean the areas of research that have criteria for comparing or evaluating representational objects which might be of use to AI researchers.
 
2
It is sometimes claimed (e.g. Griffiths et al. 2012) that frameworks should be thought of as tools for describing models, and cannot be falsified. If the analogy from frameworks and models to RSes and representations holds, then, we might infer that RSes cannot be falsified. That is, however, not a claim we support in this paper; we instead argue that there exist criteria, in regular use, to evaluate RSes. Whether a negative evaluation of an RS counts as a falsification is to be determined.
 
3
E.g., a cat can purr, or meow; and a legislator can legislate. A legislator can also conceivably purr or meow, but these are not actions we typically associate with them, and would thus likely not be members of the legislator RS.
 
4
Those familiar with object-oriented programming may notice this is a weakened version of the inheritance relationship; e.g., no multiple inheritances or polymorphisms are defined. This is because the work in this paper does not require specifying relationships any more complex than what we present here.
 
5
But it is interesting to note that this RS seems to be falling out of favor in the machine learning community. Popular implementations of neural networks, such as Google’s TensorFlow, view networks not as collections of neurons, but rather as tensors in a “computational graph” (Abadi et al. 2015). Our OO-inspired formalism would describe this as a shift in RSes, to one that views the propagations of activations and gradients to be operations defined over tensors. Such tensor operations can be easier to optimize mathematically and computationally, a clear benefit of the tensor-based RS.
 
6
We leave the proof of this discovery to the reader.
 
7
In the latter cases, it is often not clearly specified what the neural networks are supposed to be representations of.
 
8
E.g., see Gentner and Forbus (2011) for a review of models of analogical reasoning.
 
9
Though cognitive architectures are supposed to be more general than cognitive models of particular phenomena, in practice many cognitive architectures tend to focus on some subset of cognitive phenomena, rendering the authors’ claim of model generality difficult to verify. See Kotseruba et al. (2016) for a comprehensive review of cognitive architectures and their foci.
 
10
We can refer to these RSes nested within other RSes as level RSes.
 
11
It is outside of the scope of this paper to take a definitive position on the level of ontological commitment in our OO-inspired formalism, other than saying that it is typically the case that the inclusion of members or methods in an RS constitutes an ontological commitment to the realism of those elements. We have drawn some ideas from Floridi’s theory of levels of abstraction, which itself comes with a theory of ontological commitment built in. Interested readers can refer to Floridi (2011b) for more.
 
12
‘Contact’ here means something akin to theoretical or field utility, a criterion we will define in Sect. 6.
 
13
Podsakoff et al. (2016) give an example in which candidate attributes for a definition of “submarine” are compared to objects that are or are not considered submarines: diving bells, viking longboats, fishing boats, etc.
 
Literatur
Zurück zum Zitat Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Mané D, Monga R, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Viégas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2015) TensorFlow: large-scale machine learning on heterogeneous systems. Software available from tensorflow.org. http://tensorflow.org/ Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Mané D, Monga R, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Viégas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2015) TensorFlow: large-scale machine learning on heterogeneous systems. Software available from tensorflow.org. http://​tensorflow.​org/​
Zurück zum Zitat Anderson B (2011) The myth of computational level theory and the vacuity of rational analysis. Behav Brain Sci 34:189–190CrossRef Anderson B (2011) The myth of computational level theory and the vacuity of rational analysis. Behav Brain Sci 34:189–190CrossRef
Zurück zum Zitat Barker-Plummer D, Barwise J, Etchemendy J (2011) Language proof and logic, 2nd edn. Center for the Study of Language and Information, StanfordMATH Barker-Plummer D, Barwise J, Etchemendy J (2011) Language proof and logic, 2nd edn. Center for the Study of Language and Information, StanfordMATH
Zurück zum Zitat Bauer AJ, Just MA (2015) Monitoring the growth of the neural representations of new animal concepts. Hum Brain Mapp 36:3213CrossRef Bauer AJ, Just MA (2015) Monitoring the growth of the neural representations of new animal concepts. Hum Brain Mapp 36:3213CrossRef
Zurück zum Zitat Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828CrossRef Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828CrossRef
Zurück zum Zitat Besnard P, Garcia A, Hunter A, Modgil S, Prakken H, Simari G, Toni F (2014) Introduction to structured argumentation. Argum Comput 5(1):1–4CrossRef Besnard P, Garcia A, Hunter A, Modgil S, Prakken H, Simari G, Toni F (2014) Introduction to structured argumentation. Argum Comput 5(1):1–4CrossRef
Zurück zum Zitat Borsboom D, Wagenmakers EJ, Romejin JW (2011) Mechanistic curiosity will not kill the Bayesian cat. Behav Brain Sci 34:192–194CrossRef Borsboom D, Wagenmakers EJ, Romejin JW (2011) Mechanistic curiosity will not kill the Bayesian cat. Behav Brain Sci 34:192–194CrossRef
Zurück zum Zitat Bowers JS, Davis CJ (2012a) Bayesian just-so stories in psychology and neuroscience. Psychol Bull 138(3):389–414CrossRef Bowers JS, Davis CJ (2012a) Bayesian just-so stories in psychology and neuroscience. Psychol Bull 138(3):389–414CrossRef
Zurück zum Zitat Bowers JS, Davis CJ (2012) Is that what Bayesians believe? Reply to Griffiths, Chater, Norris, and Pouget (2012). Psychol Bull 138(3):423–426CrossRef Bowers JS, Davis CJ (2012) Is that what Bayesians believe? Reply to Griffiths, Chater, Norris, and Pouget (2012). Psychol Bull 138(3):423–426CrossRef
Zurück zum Zitat Bricker P (2016) Ontological commitment. In: Zalta EN (ed) The Stanford encyclopedia of philosophy, winter 2016 edn. Metaphysics Research Lab, Stanford University, Stanford Bricker P (2016) Ontological commitment. In: Zalta EN (ed) The Stanford encyclopedia of philosophy, winter 2016 edn. Metaphysics Research Lab, Stanford University, Stanford
Zurück zum Zitat Bringsjord S (1991) Is the connectionist–logicist clash one of AI’s wonderful red herrings? J Exp Theor AI 3(4):319–349CrossRef Bringsjord S (1991) Is the connectionist–logicist clash one of AI’s wonderful red herrings? J Exp Theor AI 3(4):319–349CrossRef
Zurück zum Zitat Bringsjord S, Ferrucci D (1998) Logic and artificial intelligence: divorced, separated, still married...? Mind Mach 8:273–308CrossRef Bringsjord S, Ferrucci D (1998) Logic and artificial intelligence: divorced, separated, still married...? Mind Mach 8:273–308CrossRef
Zurück zum Zitat Bringsjord S, Licato J, Bringsjord A (2016) The contemporary craft of creating characters meets today’s cognitive architectures: a case study in expressivity. In: Turner J, Nixon M, Bernardet U, DiPaola S (eds) Integrating cognitive architectures into virtual character design, Advances in computational intelligence and robotics (ACIR), Information science reference. IGI Global, Hershey Bringsjord S, Licato J, Bringsjord A (2016) The contemporary craft of creating characters meets today’s cognitive architectures: a case study in expressivity. In: Turner J, Nixon M, Bernardet U, DiPaola S (eds) Integrating cognitive architectures into virtual character design, Advances in computational intelligence and robotics (ACIR), Information science reference. IGI Global, Hershey
Zurück zum Zitat Brooks RA (1990) Elephants don’t play chess. Robot Auton Syst 6:3–15CrossRef Brooks RA (1990) Elephants don’t play chess. Robot Auton Syst 6:3–15CrossRef
Zurück zum Zitat Brun G (2015) Explication as a method of conceptual re-engineering. Erkenntnis 1:1–31 Brun G (2015) Explication as a method of conceptual re-engineering. Erkenntnis 1:1–31
Zurück zum Zitat Bundy A, Ireland A, Hutter D, Basin D (2005) Rippling: meta-level guidance for mathematical reasoning, vol 56. Cambridge University Press, CambridgeMATHCrossRef Bundy A, Ireland A, Hutter D, Basin D (2005) Rippling: meta-level guidance for mathematical reasoning, vol 56. Cambridge University Press, CambridgeMATHCrossRef
Zurück zum Zitat Carnap R (1950) Logical foundations of probability. University of Chicago Press, ChicagoMATH Carnap R (1950) Logical foundations of probability. University of Chicago Press, ChicagoMATH
Zurück zum Zitat Chater N, Goodman N, Griffiths TL, Kemp C, Oaksford M, Tenenbaum JB (2011) The imaginary fundamentalists: the unshocking truth about bayesian cognitive science. Behav Brain Sci 34:194–196CrossRef Chater N, Goodman N, Griffiths TL, Kemp C, Oaksford M, Tenenbaum JB (2011) The imaginary fundamentalists: the unshocking truth about bayesian cognitive science. Behav Brain Sci 34:194–196CrossRef
Zurück zum Zitat Cheng PCH (2002) Electrifying diagrams for learning: principles for complex representational systems. Cogn Sci 26:685–736CrossRef Cheng PCH (2002) Electrifying diagrams for learning: principles for complex representational systems. Cogn Sci 26:685–736CrossRef
Zurück zum Zitat Cheng PCH (2016) What constitutes an effective representation? In: Jamnik M, Uesaka Y, Elzer Schwartz S (eds) Diagrammatic representation and inference: proceedings from the 9th international conference, Diagrams 2016, Lecture Notes in Computer Science vol 9781. Springer Cheng PCH (2016) What constitutes an effective representation? In: Jamnik M, Uesaka Y, Elzer Schwartz S (eds) Diagrammatic representation and inference: proceedings from the 9th international conference, Diagrams 2016, Lecture Notes in Computer Science vol 9781. Springer
Zurück zum Zitat Cunningham P (2009) A taxonomy of similarity mechanisms for case-based reasoning. IEEE Trans Knowl Data Eng 21(11):1532CrossRef Cunningham P (2009) A taxonomy of similarity mechanisms for case-based reasoning. IEEE Trans Knowl Data Eng 21(11):1532CrossRef
Zurück zum Zitat Doumas LA, Hummel JE (2013) Comparison and mapping facilitate relation discovery and predication. PLoS ONE 8(6):e63889CrossRef Doumas LA, Hummel JE (2013) Comparison and mapping facilitate relation discovery and predication. PLoS ONE 8(6):e63889CrossRef
Zurück zum Zitat Doumas LA, Hummel JE, Sandhofer C (2008) A theory of the discovery and predication of relational concepts. Psychol Rev 115(1):1–43CrossRef Doumas LA, Hummel JE, Sandhofer C (2008) A theory of the discovery and predication of relational concepts. Psychol Rev 115(1):1–43CrossRef
Zurück zum Zitat Eickenberg M, Gramfort A, Varoquaux G, Thirion B (2016) Seeing it all: convolutional network layers map the function of the human visual system. NeuroImage 152:184CrossRef Eickenberg M, Gramfort A, Varoquaux G, Thirion B (2016) Seeing it all: convolutional network layers map the function of the human visual system. NeuroImage 152:184CrossRef
Zurück zum Zitat Eliasmith C, Thagard P (2001) Integrating structure and meaning: a distributed model of analogical mapping. Cogn Sci 25(2):245–286CrossRef Eliasmith C, Thagard P (2001) Integrating structure and meaning: a distributed model of analogical mapping. Cogn Sci 25(2):245–286CrossRef
Zurück zum Zitat Emruli B, Sandin F (2013) Analogical mapping with sparse distributed memory: a simple model that learns to generalize from examples. Cogn Comput 6:74CrossRef Emruli B, Sandin F (2013) Analogical mapping with sparse distributed memory: a simple model that learns to generalize from examples. Cogn Comput 6:74CrossRef
Zurück zum Zitat Falkenhainer B, Forbus KD, Gentner D (1989) The structure-mapping engine: algorithm and examples. Artif Intell 41(1):1–63MATHCrossRef Falkenhainer B, Forbus KD, Gentner D (1989) The structure-mapping engine: algorithm and examples. Artif Intell 41(1):1–63MATHCrossRef
Zurück zum Zitat Fernbach PM, Sloman SA (2011) Don’t throw out the Bayes with the bathwater. Behav Brain Sci 34:198–199CrossRef Fernbach PM, Sloman SA (2011) Don’t throw out the Bayes with the bathwater. Behav Brain Sci 34:198–199CrossRef
Zurück zum Zitat Floridi L (2011a) A defence of constructionism: philosophy as conceptual engineering. Metaphilosophy 42(3):282–304CrossRef Floridi L (2011a) A defence of constructionism: philosophy as conceptual engineering. Metaphilosophy 42(3):282–304CrossRef
Zurück zum Zitat Fodor JA (1980) The language of thought, 2nd edn. Harvard University Press, Cambridge Fodor JA (1980) The language of thought, 2nd edn. Harvard University Press, Cambridge
Zurück zum Zitat Fodor J (1998) Concepts: where cognitive science went wrong. Oxford University Press, New YorkCrossRef Fodor J (1998) Concepts: where cognitive science went wrong. Oxford University Press, New YorkCrossRef
Zurück zum Zitat Fodor JA, Pylyshyn Z (1988) Connectionism and cogntive architecture: a critical analysis. Cognition 28(1–2):3–71CrossRef Fodor JA, Pylyshyn Z (1988) Connectionism and cogntive architecture: a critical analysis. Cognition 28(1–2):3–71CrossRef
Zurück zum Zitat Forbus K, Mostek T, Ferguson R (2002) An analogy ontology for integrating analogical processing and first-principles reasoning. In: AAAI/IAAI, pp 878–885 Forbus K, Mostek T, Ferguson R (2002) An analogy ontology for integrating analogical processing and first-principles reasoning. In: AAAI/IAAI, pp 878–885
Zurück zum Zitat Forbus KD, Ferguson RW, Lovett A, Gentner D (2017) Extending SME to handle large-scale cognitive modeling. Cogn Sci 41:1152CrossRef Forbus KD, Ferguson RW, Lovett A, Gentner D (2017) Extending SME to handle large-scale cognitive modeling. Cogn Sci 41:1152CrossRef
Zurück zum Zitat Gauthier T, Kaliszyk C, Urban J, Vyskočil J (2016) Conjecturing over large corpora. In: Proceedings from the first conference on artificial intelligence and theorem proving (AITP 2016) Gauthier T, Kaliszyk C, Urban J, Vyskočil J (2016) Conjecturing over large corpora. In: Proceedings from the first conference on artificial intelligence and theorem proving (AITP 2016)
Zurück zum Zitat Gentner D (1983) Structure-mapping: a theoretical framework for analogy. Cogn Sci 7(2):155–170CrossRef Gentner D (1983) Structure-mapping: a theoretical framework for analogy. Cogn Sci 7(2):155–170CrossRef
Zurück zum Zitat Gentner D, Forbus K (2011) Computational models of analogy. Wiley Interdiscip Rev Cogn Sci 2(3):266–276CrossRef Gentner D, Forbus K (2011) Computational models of analogy. Wiley Interdiscip Rev Cogn Sci 2(3):266–276CrossRef
Zurück zum Zitat Gerring J (1999) What makes a concept good? A criterial framework for understanding concept formation in the social sciences. Polity 31(3):357–393CrossRef Gerring J (1999) What makes a concept good? A criterial framework for understanding concept formation in the social sciences. Polity 31(3):357–393CrossRef
Zurück zum Zitat Goodman N, Frank MC, Griffiths TL, Tenenbaum JB, Battaglia PW, Hamrick JB (2015) Relevant and robust: a response to Marcus and Davis (2013). Psychol Sci 26(4):539–541CrossRef Goodman N, Frank MC, Griffiths TL, Tenenbaum JB, Battaglia PW, Hamrick JB (2015) Relevant and robust: a response to Marcus and Davis (2013). Psychol Sci 26(4):539–541CrossRef
Zurück zum Zitat Gopnik A (2011) Probabilistic models as theories of children’s minds. Behav Brain Sci 34:200–201CrossRef Gopnik A (2011) Probabilistic models as theories of children’s minds. Behav Brain Sci 34:200–201CrossRef
Zurück zum Zitat Griffiths TL, Chater N, Norris D, Pouget A (2012) How the Bayesians got their beliefs (and what those beliefs actually are): comment on Bowers and Davis (2012). Psychol Bull 138(3):415–422CrossRef Griffiths TL, Chater N, Norris D, Pouget A (2012) How the Bayesians got their beliefs (and what those beliefs actually are): comment on Bowers and Davis (2012). Psychol Bull 138(3):415–422CrossRef
Zurück zum Zitat Guo J, Wang C, Roman-Rangel E, Chao H, Rui Y (2016) Building hierarchical representations for oracle character and sketch recognition. IEEE Trans Image Process 25(1):104–118MathSciNetMATHCrossRef Guo J, Wang C, Roman-Rangel E, Chao H, Rui Y (2016) Building hierarchical representations for oracle character and sketch recognition. IEEE Trans Image Process 25(1):104–118MathSciNetMATHCrossRef
Zurück zum Zitat Gust H, Kühnberger Ku, Schmid U (2003) Anti-Unification of Axiomatic Systems. University of Osnabrück, Technical report Gust H, Kühnberger Ku, Schmid U (2003) Anti-Unification of Axiomatic Systems. University of Osnabrück, Technical report
Zurück zum Zitat Gust H, Kühnberger Ku, Schmid U (2006) Metaphors and heuristic-driven theory projection (HDTP). Theor Comput Sci 354(1):98–117MathSciNetMATHCrossRef Gust H, Kühnberger Ku, Schmid U (2006) Metaphors and heuristic-driven theory projection (HDTP). Theor Comput Sci 354(1):98–117MathSciNetMATHCrossRef
Zurück zum Zitat Han J, Zhang D, Wen S, Guo L, Liu T, Li X (2016) Two-stage learning to predict human eye fixations via SDAEs. IEEE Trans Cybern 46(2):487–498CrossRef Han J, Zhang D, Wen S, Guo L, Liu T, Li X (2016) Two-stage learning to predict human eye fixations via SDAEs. IEEE Trans Cybern 46(2):487–498CrossRef
Zurück zum Zitat Hansson SO (2000) Formalization in philosophy. Bull Symb Logic 6(2):162–175CrossRef Hansson SO (2000) Formalization in philosophy. Bull Symb Logic 6(2):162–175CrossRef
Zurück zum Zitat Hinton GE, Zemel RS (1994) Autoencoders, minimum description length and Helmholtz free energy. In Advances in neural information processing systems, pp 3–10 Hinton GE, Zemel RS (1994) Autoencoders, minimum description length and Helmholtz free energy. In Advances in neural information processing systems, pp 3–10
Zurück zum Zitat Hinton GE, McClelland J, Rumelhart DE (1986) Distributed representations. In: Rumelhart DE, McClelland J (eds) Parallel distributed processing: explorations in the microstructure of cognition, vol 1. MIT Press, Cambridge Hinton GE, McClelland J, Rumelhart DE (1986) Distributed representations. In: Rumelhart DE, McClelland J (eds) Parallel distributed processing: explorations in the microstructure of cognition, vol 1. MIT Press, Cambridge
Zurück zum Zitat Hofstadter DR (2001) Epilogue: analogy as the core of cognition. In: Gentner D, Holyoak KJ, Kokinov BN (eds) The analogical mind: perspectives from cognitive science, chap 15. The MIT Press, Cambridge Hofstadter DR (2001) Epilogue: analogy as the core of cognition. In: Gentner D, Holyoak KJ, Kokinov BN (eds) The analogical mind: perspectives from cognitive science, chap 15. The MIT Press, Cambridge
Zurück zum Zitat Hofstadter DR, Sander E (2013) Surfaces and essences: analogy as the fuel and fire of thinking. Basic Books, London Hofstadter DR, Sander E (2013) Surfaces and essences: analogy as the fuel and fire of thinking. Basic Books, London
Zurück zum Zitat Holyoak KJ, Hummel JE (2000) The proper treatment of symbols in a connectionist architecture. In: Deitrich E, Markman A (eds) Cognitive dynamics: conceptual change in humans and machines. MIT Press, Cambridge Holyoak KJ, Hummel JE (2000) The proper treatment of symbols in a connectionist architecture. In: Deitrich E, Markman A (eds) Cognitive dynamics: conceptual change in humans and machines. MIT Press, Cambridge
Zurück zum Zitat Hummel JE (2001) Complementary solutions to the binding problem in vision: implications for shape perception and object recognition. Vis Cogn 8(3):489–517CrossRef Hummel JE (2001) Complementary solutions to the binding problem in vision: implications for shape perception and object recognition. Vis Cogn 8(3):489–517CrossRef
Zurück zum Zitat Hummel JE (2010) Symbolic versus associative learning. Cogn Sci 34:958–965CrossRef Hummel JE (2010) Symbolic versus associative learning. Cogn Sci 34:958–965CrossRef
Zurück zum Zitat Hummel JE (2016) Putting distributed representations into context. Lang Cogn Neurosci 32:359CrossRef Hummel JE (2016) Putting distributed representations into context. Lang Cogn Neurosci 32:359CrossRef
Zurück zum Zitat Hummel JE, Biederman I (1992) Dynamic binding in a neural network for shape recognition. Psychol Rev 99(3):480–517CrossRef Hummel JE, Biederman I (1992) Dynamic binding in a neural network for shape recognition. Psychol Rev 99(3):480–517CrossRef
Zurück zum Zitat Hummel JE, Holyoak KJ (1997) Distributed representations of structure: a theory of analogical access and mapping. Psychol Rev 104(3):427–466CrossRef Hummel JE, Holyoak KJ (1997) Distributed representations of structure: a theory of analogical access and mapping. Psychol Rev 104(3):427–466CrossRef
Zurück zum Zitat Hummel JE, Holyoak KJ (2003) Relational reasoning in a neurally-plausible cognitive architecture: an overview of the LISA Project. Cogn Stud Bull Jpn Cogn Sci Soc 10:58–75 Hummel JE, Holyoak KJ (2003) Relational reasoning in a neurally-plausible cognitive architecture: an overview of the LISA Project. Cogn Stud Bull Jpn Cogn Sci Soc 10:58–75
Zurück zum Zitat Jones M, Love BC (2011) Bayesian fundamentalism or enlightenment? On the explanatory status and theoretical contributions of Bayesian models of cognition. Behav Brain Sci 34:169–231CrossRef Jones M, Love BC (2011) Bayesian fundamentalism or enlightenment? On the explanatory status and theoretical contributions of Bayesian models of cognition. Behav Brain Sci 34:169–231CrossRef
Zurück zum Zitat Kahneman D (2011) Thinking, fast and slow. Farrar, Straus and Girous, New York Kahneman D (2011) Thinking, fast and slow. Farrar, Straus and Girous, New York
Zurück zum Zitat Kotseruba I, Gonzalez OJA, Tsotsos JK (2016) A review of 40 years of cognitive architecture research: focus on perception, attention, learning and applications. arXiv:1610.08602v1 Kotseruba I, Gonzalez OJA, Tsotsos JK (2016) A review of 40 years of cognitive architecture research: focus on perception, attention, learning and applications. arXiv:​1610.​08602v1
Zurück zum Zitat Li Y, Yosinski J, Clune J, Lipson H, Hopcroft J (2016) Convergent learning: do different neural networks learn the same representations? In: Proceedings of international conference on learning representation (ICLR) Li Y, Yosinski J, Clune J, Lipson H, Hopcroft J (2016) Convergent learning: do different neural networks learn the same representations? In: Proceedings of international conference on learning representation (ICLR)
Zurück zum Zitat Licato J (2015) Analogical constructivism: the emergence of reasoning through analogy and action schemas. PhD thesis, Rensselaer Polytechnic Institute, Troy Licato J (2015) Analogical constructivism: the emergence of reasoning through analogy and action schemas. PhD thesis, Rensselaer Polytechnic Institute, Troy
Zurück zum Zitat Licato J (2017) Two paradoxes and their implications for AI-assisted analysis. In: Proceedings of the 2017 conference of the International Association for Computing and Philosophy (IACAP 2017) Licato J (2017) Two paradoxes and their implications for AI-assisted analysis. In: Proceedings of the 2017 conference of the International Association for Computing and Philosophy (IACAP 2017)
Zurück zum Zitat Licato J, Bringsjord S (2016) A physically realistic, general-purpose simulation environment for developmental AI systems. In: Proceedings of the ECAI 2016 workshop on evaluating general-purpose AI (EGPAI 2016) Licato J, Bringsjord S (2016) A physically realistic, general-purpose simulation environment for developmental AI systems. In: Proceedings of the ECAI 2016 workshop on evaluating general-purpose AI (EGPAI 2016)
Zurück zum Zitat Licato J, Govindarajulu NS, Bringsjord S, Pomeranz M, Gittelson L (2013) Analogico-deductive generation of Gödel’s first incompleteness theorem from the liar paradox. In: Proceedings of the 23rd annual international joint conference on artificial intelligence (IJCAI-13) Licato J, Govindarajulu NS, Bringsjord S, Pomeranz M, Gittelson L (2013) Analogico-deductive generation of Gödel’s first incompleteness theorem from the liar paradox. In: Proceedings of the 23rd annual international joint conference on artificial intelligence (IJCAI-13)
Zurück zum Zitat Licato J, Bringsjord S, Govindarajulu NS (2014a) How models of creativity and analogy need to answer the tailorability concern. In: Besold TR, Kühnberger KU, Schorlemmer M, Smaill A (eds) Computational creativity research: towards creative machines, chap 5. Atlantis Press, Paris Licato J, Bringsjord S, Govindarajulu NS (2014a) How models of creativity and analogy need to answer the tailorability concern. In: Besold TR, Kühnberger KU, Schorlemmer M, Smaill A (eds) Computational creativity research: towards creative machines, chap 5. Atlantis Press, Paris
Zurück zum Zitat Licato J, Sun R, Bringsjord S (2014b) Using a hybrid cognitive architecture to model children’s errors in an analogy task. In: Proceedings of CogSci 2014 Licato J, Sun R, Bringsjord S (2014b) Using a hybrid cognitive architecture to model children’s errors in an analogy task. In: Proceedings of CogSci 2014
Zurück zum Zitat Licato J, Marton N, Dong B, Sun R, Bringsjord S (2015) Modeling the creation and development of cause-effect pairs for explanation generation in a cognitive architecture. In: Proceedings of the 2015 international workshop on artificial intelligence and cognition (AIC 2015) Licato J, Marton N, Dong B, Sun R, Bringsjord S (2015) Modeling the creation and development of cause-effect pairs for explanation generation in a cognitive architecture. In: Proceedings of the 2015 international workshop on artificial intelligence and cognition (AIC 2015)
Zurück zum Zitat Macagno F, Walton D (2009) Argument from analogy in law, the classical tradition, and recent theories. Philos Rhetor 42(2):154CrossRef Macagno F, Walton D (2009) Argument from analogy in law, the classical tradition, and recent theories. Philos Rhetor 42(2):154CrossRef
Zurück zum Zitat Marcus G, Davis E (2012) How robust are probabilistic models of higher-level cognition? Psychol Sci 24(12):2351–2360CrossRef Marcus G, Davis E (2012) How robust are probabilistic models of higher-level cognition? Psychol Sci 24(12):2351–2360CrossRef
Zurück zum Zitat Marcus G, Davis E (2015) Still searching for principles: a response to Goodman et al (2015). Psychol Sci 26(4):542–544CrossRef Marcus G, Davis E (2015) Still searching for principles: a response to Goodman et al (2015). Psychol Sci 26(4):542–544CrossRef
Zurück zum Zitat Markman AB, Otto AR (2011) Cognitive systems optimize energy rather than information. Behav Brain Sci 34:207CrossRef Markman AB, Otto AR (2011) Cognitive systems optimize energy rather than information. Behav Brain Sci 34:207CrossRef
Zurück zum Zitat Marr D (1982) Vision: a computational approach. Freeman and Co., New York Marr D (1982) Vision: a computational approach. Freeman and Co., New York
Zurück zum Zitat McClamrock R (1991) Marr’s three levels: a re-evaluation. Mind Mach 1(2):185–196CrossRef McClamrock R (1991) Marr’s three levels: a re-evaluation. Mind Mach 1(2):185–196CrossRef
Zurück zum Zitat Mikolov T, Chen K, Corrado G, Dean J (2013a) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 Mikolov T, Chen K, Corrado G, Dean J (2013a) Efficient estimation of word representations in vector space. arXiv preprint arXiv:​1301.​3781
Zurück zum Zitat Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013b) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119 Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013b) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119
Zurück zum Zitat Novaes CD, Reck E (2017) Carnapian explication, formalisms as cognitive tools, and the paradox of adequate formalization. Synthese 194(1):195–215MathSciNetMATHCrossRef Novaes CD, Reck E (2017) Carnapian explication, formalisms as cognitive tools, and the paradox of adequate formalization. Synthese 194(1):195–215MathSciNetMATHCrossRef
Zurück zum Zitat Pearl J (1996) The art and science of cause and effect. Lecture given as part of the UCLA Faculty Research Lectureship Program Pearl J (1996) The art and science of cause and effect. Lecture given as part of the UCLA Faculty Research Lectureship Program
Zurück zum Zitat Peirce CS (1933) Existential graphs. In: Hartshorne C, Weiss P (eds) The simplest mathematics, The collected papers of Charles Sanders Peirce, vol 4. Harvard University Press, Cambridge, pp 347–584 Peirce CS (1933) Existential graphs. In: Hartshorne C, Weiss P (eds) The simplest mathematics, The collected papers of Charles Sanders Peirce, vol 4. Harvard University Press, Cambridge, pp 347–584
Zurück zum Zitat Podsakoff PM, McKenzie SB, Podsakoff NP (2016) Recommendations for creating better concept definitions in the organizational, behavioral, and social sciences. Organ Res Methods 19(2):159–203CrossRef Podsakoff PM, McKenzie SB, Podsakoff NP (2016) Recommendations for creating better concept definitions in the organizational, behavioral, and social sciences. Organ Res Methods 19(2):159–203CrossRef
Zurück zum Zitat Pylyshyn Z (1984) Computation and cognition. MIT Press, Cambridge Pylyshyn Z (1984) Computation and cognition. MIT Press, Cambridge
Zurück zum Zitat Rachkovskij DA, Kussul EM, Baidyk TN (2013) Building a world model with structure-sensitive sparse binary distributed representations. Biologically inspired cognitive architectures 3:64–86CrossRef Rachkovskij DA, Kussul EM, Baidyk TN (2013) Building a world model with structure-sensitive sparse binary distributed representations. Biologically inspired cognitive architectures 3:64–86CrossRef
Zurück zum Zitat Reed C, Rowe G (2004) Araucaria: software for argument analysis, diagramming and representation. Int J AI Tools 14(3–4):961–980CrossRef Reed C, Rowe G (2004) Araucaria: software for argument analysis, diagramming and representation. Int J AI Tools 14(3–4):961–980CrossRef
Zurück zum Zitat Reed C, Budzynska K, Duthie R, Janier M, Konat B, Lawrence J, Pease A, Snaith M (2017) The argument web: an online ecosystem of tools, systems and services for argumentation. Philos Technol 30(2):137–160CrossRef Reed C, Budzynska K, Duthie R, Janier M, Konat B, Lawrence J, Pease A, Snaith M (2017) The argument web: an online ecosystem of tools, systems and services for argumentation. Philos Technol 30(2):137–160CrossRef
Zurück zum Zitat Satel S, Lilenfeld SO (2013) Brainwashed: the seductive appeal of mindless neuroscience, kindle edition. Basic Books, London Satel S, Lilenfeld SO (2013) Brainwashed: the seductive appeal of mindless neuroscience, kindle edition. Basic Books, London
Zurück zum Zitat Schmidt M, Krumnack U, Gust H, Kühnberger KU (2014) Heuristic-driven theory projection: an overview. In: Computational approaches to analogical reasoning: current trends studies in computational intelligence, vol 548 Schmidt M, Krumnack U, Gust H, Kühnberger KU (2014) Heuristic-driven theory projection: an overview. In: Computational approaches to analogical reasoning: current trends studies in computational intelligence, vol 548
Zurück zum Zitat Schwering A, Krumnack U, Kühnberger Ku, Gust H (2009) Syntactic principles of heuristic-driven theory projection. Cogn Syst Res 10(3):251–269CrossRef Schwering A, Krumnack U, Kühnberger Ku, Gust H (2009) Syntactic principles of heuristic-driven theory projection. Cogn Syst Res 10(3):251–269CrossRef
Zurück zum Zitat Searle J (2004) Mind: a brief introduction. Oxford University Press, New York Searle J (2004) Mind: a brief introduction. Oxford University Press, New York
Zurück zum Zitat Smith P (2007) An introduction to Gödel’s theorems. Cambridge University Press, CambridgeMATHCrossRef Smith P (2007) An introduction to Gödel’s theorems. Cambridge University Press, CambridgeMATHCrossRef
Zurück zum Zitat Stapleton G, Jamnik M, Shimojima A (2015) Effective representation of information: generalizing free rides. In: Proceedings of the 9th international conference on diagrammatic representation and inference, pp 296–299 Stapleton G, Jamnik M, Shimojima A (2015) Effective representation of information: generalizing free rides. In: Proceedings of the 9th international conference on diagrammatic representation and inference, pp 296–299
Zurück zum Zitat Stewart T, Eliasmith C (2012) Compositionality and biologically plausible models. In: Hinzen W, Werning M, Machery E (eds) Oxford handbook of compositionality. Oxford University Press, Oxford Stewart T, Eliasmith C (2012) Compositionality and biologically plausible models. In: Hinzen W, Werning M, Machery E (eds) Oxford handbook of compositionality. Oxford University Press, Oxford
Zurück zum Zitat Sun R (1991) Connectionist models of rule-based reasoning. In: Proceedings of the 13th cognitive science society conference. Lawrence Erlbaum, pp 437–442 Sun R (1991) Connectionist models of rule-based reasoning. In: Proceedings of the 13th cognitive science society conference. Lawrence Erlbaum, pp 437–442
Zurück zum Zitat Sun R (2001a) Computation, reduction and teleology of consciousness. J Cogn Syst Res 1(4):241–249CrossRef Sun R (2001a) Computation, reduction and teleology of consciousness. J Cogn Syst Res 1(4):241–249CrossRef
Zurück zum Zitat Sun R (2001b) From implicit skills to explicit knowledge: a bottom-up model of skill learning. Cogn Sci 25(2):203–244CrossRef Sun R (2001b) From implicit skills to explicit knowledge: a bottom-up model of skill learning. Cogn Sci 25(2):203–244CrossRef
Zurück zum Zitat Sun R (2002) Duality of the mind: a bottom up approach toward cognition. Lawrence Erlbaum, Mahwah Sun R (2002) Duality of the mind: a bottom up approach toward cognition. Lawrence Erlbaum, Mahwah
Zurück zum Zitat Sun R (2004) Desiderata for cognitive architectures. Philos Psychol 17(3):341–373 Sun R (2004) Desiderata for cognitive architectures. Philos Psychol 17(3):341–373
Zurück zum Zitat Taddeo M, Floridi L (2007) A praxical solution of the symbol grounding problem. Mind Mach 17(4):369–389CrossRef Taddeo M, Floridi L (2007) A praxical solution of the symbol grounding problem. Mind Mach 17(4):369–389CrossRef
Zurück zum Zitat Thibodeau PH, Sikos L, Durgin FH (2016) What do we learn from rating metaphors? In: Proceedings from the 2016 conference of the Cognitive Science Society (CogSci 2016) Thibodeau PH, Sikos L, Durgin FH (2016) What do we learn from rating metaphors? In: Proceedings from the 2016 conference of the Cognitive Science Society (CogSci 2016)
Zurück zum Zitat Turner R, Angius N (2017) The philosophy of computer science. In: Zalta EN (ed) The Stanford encyclopedia of philosophy, spring 2017 edn. Metaphysics Research Lab, Stanford University, Stanford Turner R, Angius N (2017) The philosophy of computer science. In: Zalta EN (ed) The Stanford encyclopedia of philosophy, spring 2017 edn. Metaphysics Research Lab, Stanford University, Stanford
Zurück zum Zitat Uesaka Y, Igarashi M, Suetsugu R (2016) Promoting multi-perspective integration as a 21st century skill: the effects of instructional methods encouraging students’ spontaneous use of tables for organizing information. In: Jamnik M, Uesaka Y, Elzer Schwartz S (eds) Diagrammatic representation and inference: proceedings from the 9th international conference, Diagrams 2016, Lecture Notes in Computer Science, vol 9781. Springer Uesaka Y, Igarashi M, Suetsugu R (2016) Promoting multi-perspective integration as a 21st century skill: the effects of instructional methods encouraging students’ spontaneous use of tables for organizing information. In: Jamnik M, Uesaka Y, Elzer Schwartz S (eds) Diagrammatic representation and inference: proceedings from the 9th international conference, Diagrams 2016, Lecture Notes in Computer Science, vol 9781. Springer
Zurück zum Zitat Urbas M, Jamnik M (2014) A framework for heterogeneous reasoning in formal and informal domains. In: Proceedings of the third international conference on diagrammatic representation and inference, pp 277–292 Urbas M, Jamnik M (2014) A framework for heterogeneous reasoning in formal and informal domains. In: Proceedings of the third international conference on diagrammatic representation and inference, pp 277–292
Zurück zum Zitat Vernon D, van Hofsten C, Fadiga L (2016) Desiderata for developmental cognitive architectures. Biol Inspir Cogn Archit 18:116–127 Vernon D, van Hofsten C, Fadiga L (2016) Desiderata for developmental cognitive architectures. Biol Inspir Cogn Archit 18:116–127
Zurück zum Zitat Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408MathSciNetMATH Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408MathSciNetMATH
Zurück zum Zitat Vorms M (2009) Formats of Representation in Scientific Theorising. In: Models and simulations 3: emergence, computation, and reality, Charlottesville, VA, USA Vorms M (2009) Formats of Representation in Scientific Theorising. In: Models and simulations 3: emergence, computation, and reality, Charlottesville, VA, USA
Zurück zum Zitat Walton D (1985) Arguer’s position: a pragmatic study of ad hominem attack, criticism, refutation, and fallacy. Greenwood Press, Westport Walton D (1985) Arguer’s position: a pragmatic study of ad hominem attack, criticism, refutation, and fallacy. Greenwood Press, Westport
Zurück zum Zitat Walton D (1999) One-sided arguments: a dialectical analysis of bias. State University of New York Press, Albany Walton D (1999) One-sided arguments: a dialectical analysis of bias. State University of New York Press, Albany
Zurück zum Zitat Walton D, Reed C, Macagno F (2008) Argumentation schemes. Cambridge University Press, CambridgeMATHCrossRef Walton D, Reed C, Macagno F (2008) Argumentation schemes. Cambridge University Press, CambridgeMATHCrossRef
Zurück zum Zitat Willingham DB, Nissen MJ, Bullemer P (1989) On the development of procedural knowledge. J Exp Psychol Learn Mem Cogn 15:1047–1060CrossRef Willingham DB, Nissen MJ, Bullemer P (1989) On the development of procedural knowledge. J Exp Psychol Learn Mem Cogn 15:1047–1060CrossRef
Zurück zum Zitat Winograd T (1975) Frame representations and the declarative-procedural controversy. In: Bobrow D, Collins A (eds) Representation and understanding: studies in cognitive science. Academic Press, New York Winograd T (1975) Frame representations and the declarative-procedural controversy. In: Bobrow D, Collins A (eds) Representation and understanding: studies in cognitive science. Academic Press, New York
Zurück zum Zitat Wyss M, Thieme A, Licato J (2017) Can AI reason over representational systems? In: Licato J, Hayes A (eds) Proceedings of the 28th modern artificial intelligence and cognitive science (MAICS) conference Wyss M, Thieme A, Licato J (2017) Can AI reason over representational systems? In: Licato J, Hayes A (eds) Proceedings of the 28th modern artificial intelligence and cognitive science (MAICS) conference
Zurück zum Zitat Xing C, Corter JE, Zahner D (2016) Diagrams affect choice of strategy in probability problem solving. In: Jamnik M, Uesaka Y, Elzer Schwartz S (eds) Diagrammatic representation and inference: proceedings from the 9th international conference, Diagrams 2016. Lecture Notes in Computer Science, vol 9781. Springer Xing C, Corter JE, Zahner D (2016) Diagrams affect choice of strategy in probability problem solving. In: Jamnik M, Uesaka Y, Elzer Schwartz S (eds) Diagrammatic representation and inference: proceedings from the 9th international conference, Diagrams 2016. Lecture Notes in Computer Science, vol 9781. Springer
Metadaten
Titel
Evaluating representational systems in artificial intelligence
verfasst von
John Licato
Zhitian Zhang
Publikationsdatum
09.12.2017
Verlag
Springer Netherlands
Erschienen in
Artificial Intelligence Review / Ausgabe 2/2019
Print ISSN: 0269-2821
Elektronische ISSN: 1573-7462
DOI
https://doi.org/10.1007/s10462-017-9598-7

Weitere Artikel der Ausgabe 2/2019

Artificial Intelligence Review 2/2019 Zur Ausgabe

Premium Partner