Skip to main content
Erschienen in: Cognitive Computation 3/2014

01.09.2014

Modular Composite Representation

verfasst von: Javier Snaider, Stan Franklin

Erschienen in: Cognitive Computation | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

High-dimensional vector spaces have noteworthy properties that make them attractive for representation models. A reduced description model is a mechanism for encoding complex structures as single high-dimensional vectors. Moreover, these vectors can be used to directly process complex operations such as analogies, inferences, and structural comparisons. Also, it is possible to reconstruct the whole structure from the reduced description vector. Here, we introduce the modular composite representation (MCR), a new reduced description model that employs long integer vectors. We also describe several experiments with them, and give a theoretical analysis of the distance distribution in this vector space, and of properties of this representation. Finally, we compare MCR with other two reduced description models: Spatter Code and holographic reduced representation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In the context of this work, we define elements as things that can be represented, for example, objects, actions, features, events, etc.
 
2
Some systems can create reduced descriptions without explicitly defining these operations. For example see RAAM [25].
 
3
Actually, XOR is a special case of the modular sum when r = 2.
 
4
This vector could have been omitted, but we chose to follow Plate’s example that included it.
 
Literatur
1.
Zurück zum Zitat Hinton GE, McClelland JL, Rumelhart DE. Distributed representations. In: Rumelhart DE, McClelland JL, editors. Parallel distributed processing: explorations in the microstructure of cognition volume 1: foundations. Cambridge, MA: MIT Press; 1986. p. 77–109. Hinton GE, McClelland JL, Rumelhart DE. Distributed representations. In: Rumelhart DE, McClelland JL, editors. Parallel distributed processing: explorations in the microstructure of cognition volume 1: foundations. Cambridge, MA: MIT Press; 1986. p. 77–109.
2.
Zurück zum Zitat Deerwester SC, Dumais ST, Furnas GW, Landauer TK, Harshman RA. Indexing by latent semantic analysis. J Am Soc Inf Sci. 1990;41(6):391–407.CrossRef Deerwester SC, Dumais ST, Furnas GW, Landauer TK, Harshman RA. Indexing by latent semantic analysis. J Am Soc Inf Sci. 1990;41(6):391–407.CrossRef
3.
Zurück zum Zitat Franklin S, Patterson FGJ. The LIDA architecture: adding new modes of learning to an intelligent, autonomous, software agent. In IDPT-2006 Proceedings (integrated design and process technology): society for design and process science; 2006. Franklin S, Patterson FGJ. The LIDA architecture: adding new modes of learning to an intelligent, autonomous, software agent. In IDPT-2006 Proceedings (integrated design and process technology): society for design and process science; 2006.
4.
Zurück zum Zitat Laird JE. Extending the Soar Cognitive Architecture. In: Wang P, Goertzel B, Franklin S, editors. Artificial general intelligence 2008. Amsterdam: IOS Press; 2008. Laird JE. Extending the Soar Cognitive Architecture. In: Wang P, Goertzel B, Franklin S, editors. Artificial general intelligence 2008. Amsterdam: IOS Press; 2008.
5.
Zurück zum Zitat Hinton GE. Mapping part-whole hierarchies into connectionist networks. Artif Intell. 1990;46:47–75.CrossRef Hinton GE. Mapping part-whole hierarchies into connectionist networks. Artif Intell. 1990;46:47–75.CrossRef
6.
Zurück zum Zitat Plate TA. Holographic reduced representations. IEEE Trans Neural Networks. 1995;6(3):623–41.CrossRef Plate TA. Holographic reduced representations. IEEE Trans Neural Networks. 1995;6(3):623–41.CrossRef
7.
Zurück zum Zitat Plate TA. Holographic reduced representation: distributed representation of cognitive structure. Stanford: CSLI; 2003. Plate TA. Holographic reduced representation: distributed representation of cognitive structure. Stanford: CSLI; 2003.
8.
Zurück zum Zitat Kanerva P. Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors. Cognit Comput. 2009;1(2):139–59.CrossRef Kanerva P. Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors. Cognit Comput. 2009;1(2):139–59.CrossRef
9.
Zurück zum Zitat Stewart TC, Eliasmith C, editors. Neural planning and reasoning using the synaptic connections of the basal ganglia and thalamus. Biologically inspired cognitive architectures 2011. Washington, DC: IOS Press; 2011. Stewart TC, Eliasmith C, editors. Neural planning and reasoning using the synaptic connections of the basal ganglia and thalamus. Biologically inspired cognitive architectures 2011. Washington, DC: IOS Press; 2011.
10.
Zurück zum Zitat Franklin S. Artificial minds. Cambridge, MA: MIT Press; 1995. Franklin S. Artificial minds. Cambridge, MA: MIT Press; 1995.
11.
Zurück zum Zitat Kanerva P. Sparse distributed memory. Cambridge, MA: The MIT Press; 1988. Kanerva P. Sparse distributed memory. Cambridge, MA: The MIT Press; 1988.
12.
Zurück zum Zitat Winston PH. Artificial intelligence. 3rd ed. Boston, MA: Addison Wesley; 1992. Winston PH. Artificial intelligence. 3rd ed. Boston, MA: Addison Wesley; 1992.
13.
Zurück zum Zitat Foundalis HE. PHAEACO: a cognitive architecture inspired by Bongard’s problems. PhD Thesis, Indiana University, Indiana; 2006. Foundalis HE. PHAEACO: a cognitive architecture inspired by Bongard’s problems. PhD Thesis, Indiana University, Indiana; 2006.
14.
Zurück zum Zitat Jockel S. Crossmodal learning and prediction of autobiographical episodic experiences using a sparse distributed memory. PhD Thesis, University of Hamburg, Hamburg; 2009. Jockel S. Crossmodal learning and prediction of autobiographical episodic experiences using a sparse distributed memory. PhD Thesis, University of Hamburg, Hamburg; 2009.
15.
Zurück zum Zitat Robertson P, Laddaga R. Learning to find structure in a complex world. In: Samsonovich AV, Jóhannsdóttir KR, editors. Biological inspired cognitive architectures 2011. Washington, DC: IOS Press; 2011. Robertson P, Laddaga R. Learning to find structure in a complex world. In: Samsonovich AV, Jóhannsdóttir KR, editors. Biological inspired cognitive architectures 2011. Washington, DC: IOS Press; 2011.
16.
Zurück zum Zitat Sahlgren M, editor. An introduction to random indexing. Methods and applications of semantic indexing workshop at the 7th international conference on terminology and knowledge engineering, TKE 2005. Copenhagen, Denmark; 2005. Sahlgren M, editor. An introduction to random indexing. Methods and applications of semantic indexing workshop at the 7th international conference on terminology and knowledge engineering, TKE 2005. Copenhagen, Denmark; 2005.
18.
Zurück zum Zitat Turney PD, Pantel P. From frequency to meaning: vector space models of semantics. J Artif Intell Res. 2010;37:141–88. Turney PD, Pantel P. From frequency to meaning: vector space models of semantics. J Artif Intell Res. 2010;37:141–88.
19.
20.
Zurück zum Zitat Grassi M, Cambria E, Hussain A, Piazza F. Sentic web: a new paradigm for managing social media affective information. Cognit Comput. 2011;3(3):480–9.CrossRef Grassi M, Cambria E, Hussain A, Piazza F. Sentic web: a new paradigm for managing social media affective information. Cognit Comput. 2011;3(3):480–9.CrossRef
21.
Zurück zum Zitat Wang QF, Cambria E, Liu CL, Hussain A. Common sense knowledge for handwritten Chinese recognition. Cognit Comput. 2013;5(2):234–42.CrossRef Wang QF, Cambria E, Liu CL, Hussain A. Common sense knowledge for handwritten Chinese recognition. Cognit Comput. 2013;5(2):234–42.CrossRef
22.
Zurück zum Zitat Cambria E, Hussain A. Sentic album: content-, concept-, and context-based online personal photo management system. Cognit Comput. 2012;4(4):477–96.CrossRef Cambria E, Hussain A. Sentic album: content-, concept-, and context-based online personal photo management system. Cognit Comput. 2012;4(4):477–96.CrossRef
23.
Zurück zum Zitat Jones MN, Mewhort DJK. Representing word meaning and order information in a composite holographic lexicon. Psychol Rev. 2007;114:1–37.PubMedCrossRef Jones MN, Mewhort DJK. Representing word meaning and order information in a composite holographic lexicon. Psychol Rev. 2007;114:1–37.PubMedCrossRef
24.
Zurück zum Zitat Kanerva P. The binary spatter code for encoding concepts at many levels. In: Marinaro M, Morasso P, editors. ICANN’94: proceedings of international conference on artificial neural networks. London: Springer; 1994. p. 226–9. Kanerva P. The binary spatter code for encoding concepts at many levels. In: Marinaro M, Morasso P, editors. ICANN’94: proceedings of international conference on artificial neural networks. London: Springer; 1994. p. 226–9.
25.
Zurück zum Zitat Pollack JB. Recursive distributed representations. Artif Intell. 1990;46(1–2):77–105.CrossRef Pollack JB. Recursive distributed representations. Artif Intell. 1990;46(1–2):77–105.CrossRef
26.
Zurück zum Zitat Willshaw DJ, Buneman OP, Longuet-Higgins HC. Non-holographic associative memory. Nature. 1969;222(5197):960–2.PubMedCrossRef Willshaw DJ, Buneman OP, Longuet-Higgins HC. Non-holographic associative memory. Nature. 1969;222(5197):960–2.PubMedCrossRef
27.
Zurück zum Zitat Rachkovskij DA, Kussul EM. Binding and normalization of binary sparse distributed representations by context-dependent thinning. Neural Comput. 2001;13(2):411–52.CrossRef Rachkovskij DA, Kussul EM. Binding and normalization of binary sparse distributed representations by context-dependent thinning. Neural Comput. 2001;13(2):411–52.CrossRef
28.
Zurück zum Zitat Snaider J, Franklin S. Extended sparse distributed memory and sequence storage. Cognit Comput. 2012;4(2):172–80.CrossRef Snaider J, Franklin S. Extended sparse distributed memory and sequence storage. Cognit Comput. 2012;4(2):172–80.CrossRef
29.
Zurück zum Zitat Snaider J, Franklin S, Strain S, George EO. Integer sparse distributed memory: analysis and results. Neural Netw. 2013;46:144–53.PubMedCrossRef Snaider J, Franklin S, Strain S, George EO. Integer sparse distributed memory: analysis and results. Neural Netw. 2013;46:144–53.PubMedCrossRef
30.
Zurück zum Zitat Snaider J, Franklin S, editors. Integer sparse distributed memory. The 25th Florida artificial intelligence research society conference FLAIRS-25. Marco Island, FL; 2012. Snaider J, Franklin S, editors. Integer sparse distributed memory. The 25th Florida artificial intelligence research society conference FLAIRS-25. Marco Island, FL; 2012.
31.
Zurück zum Zitat Snaider J. Integer sparse distributed memory and modular composite representation. PhD Thesis. University of Memphis, Memphis, TN; 2012. Snaider J. Integer sparse distributed memory and modular composite representation. PhD Thesis. University of Memphis, Memphis, TN; 2012.
32.
Zurück zum Zitat Serre T, Wolf L, Bileschi S, Riesenhuber M, Poggio T. Robust object recognition with cortex-like mechanisms. IEEE Trans Pattern Anal Mach Intell. 2007;29(3):411–26.PubMedCrossRef Serre T, Wolf L, Bileschi S, Riesenhuber M, Poggio T. Robust object recognition with cortex-like mechanisms. IEEE Trans Pattern Anal Mach Intell. 2007;29(3):411–26.PubMedCrossRef
33.
Zurück zum Zitat George D. How the brain might work: a hierarchical and temporal model for learning and recognition. PhD Thesis. Stanford University; 2008. George D. How the brain might work: a hierarchical and temporal model for learning and recognition. PhD Thesis. Stanford University; 2008.
34.
Zurück zum Zitat Arel I, Rose D, Coop R. DeSTIN: A scalable deep learning architecture with application to high-dimensional robust pattern recognition. In: Proceedings of the AAAI 2009 fall symposium on biologically inspired cognitive architectures (BICA); 2009. Arel I, Rose D, Coop R. DeSTIN: A scalable deep learning architecture with application to high-dimensional robust pattern recognition. In: Proceedings of the AAAI 2009 fall symposium on biologically inspired cognitive architectures (BICA); 2009.
35.
Zurück zum Zitat Hinton GE. Learning multiple layers of representation. TRENDS Cogn Sci. 2007;11(10):428–34.PubMedCrossRef Hinton GE. Learning multiple layers of representation. TRENDS Cogn Sci. 2007;11(10):428–34.PubMedCrossRef
36.
Zurück zum Zitat Hinton GE, Osindero S, Teh Y. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18:1527–54.PubMedCrossRef Hinton GE, Osindero S, Teh Y. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18:1527–54.PubMedCrossRef
37.
Zurück zum Zitat Snaider J, McCall R, Franklin S. The LIDA framework as a general tool for AGI. The fourth conference on artificial general intelligence. Mountain View, CA; 2011. Snaider J, McCall R, Franklin S. The LIDA framework as a general tool for AGI. The fourth conference on artificial general intelligence. Mountain View, CA; 2011.
38.
Zurück zum Zitat Starzyk JA, He H. Anticipation-based temporal sequences learning in hierarchical structure. IEEE Trans Neural Netw. 2007;18(2):344–58.PubMedCrossRef Starzyk JA, He H. Anticipation-based temporal sequences learning in hierarchical structure. IEEE Trans Neural Netw. 2007;18(2):344–58.PubMedCrossRef
39.
Zurück zum Zitat Sun R, Giles CL. Sequence learning: from recognition and prediction to sequential decision making. IEEE Intell Syst. 2001;16(4):67–70.CrossRef Sun R, Giles CL. Sequence learning: from recognition and prediction to sequential decision making. IEEE Intell Syst. 2001;16(4):67–70.CrossRef
Metadaten
Titel
Modular Composite Representation
verfasst von
Javier Snaider
Stan Franklin
Publikationsdatum
01.09.2014
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 3/2014
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-013-9243-y

Weitere Artikel der Ausgabe 3/2014

Cognitive Computation 3/2014 Zur Ausgabe