Abstract
Self-organized formation of topographic maps for abstract data, such as words, is demonstrated in this work. The semantic relationships in the data are reflected by their relative distances in the map. Two different simulations, both based on a neural network model that implements the algorithm of the selforganizing feature maps, are given. For both, an essential, new ingredient is the inclusion of the contexts, in which each symbol appears, into the input data. This enables the network to detect the “logical similarity” between words from the statistics of their contexts. In the first demonstration, the context simply consists of a set of attribute values that occur in conjunction with the words. In the second demonstration, the context is defined by the sequences in which the words occur, without consideration of any associated attributes. Simple verbal statements consisting of nouns, verbs, and adverbs have been analyzed in this way. Such phrases or clauses involve some of the abstractions that appear in thinking, namely, the most common categories, into which the words are then automatically grouped in both of our simulations. We also argue that a similar process may be at work in the brain.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Beach FA (eds) (1960) The neurophysiology of Lashley. Selected papers of KS Lashley. McGraw-Hill, New York
Caramazza A (1988) Some aspects of language processing revealed through the analysis of aquired aphasia: the lexical system. Ann Rev Neurosci 11:395–421
Collins AM, Loftus EF (1975) A spreading-activation theory of semantic processing. Psych Rev 82:407–428
Cottrell M, Fort JC (1986) A stochastic model of retinotopy: a self-organizing process. Biol Cybern 53:405–411
Essen D van (1985) Functional organization of primate visual cortex. In: Peters A, Jones EG (eds) Cerebral cortex, vol 3. Plenum Press, New York, pp 259–329
Goodglass H, Wingfield A, Hyde MR, Theurkauf JC (1986) Category specific dissociations in naming and recognition by aphasic patients. Cortex 22:87–102
Grossberg S (1976) Adaptive pattern classification and universal recoding. I. Parallel development and coding of neural feature detectors. Biol Cybern 23:121–134
Hart J, Berndt RS, Caramazza A (1985) Category-specific naming deficit following cerebral infarction. Nature 316:439–440
Jackson HJ (1878) On affections of speech from disease of the brain. Brain 1:304–330
Kertesz A (ed) (1983) Localization in neuropsychology. Academic Press, New York
Kohonen T (1982a) Self-organized formation of topologically correct feature maps. Biol Cybern 43:59–69
Kohonen T (1982b) Analysis of a simple self-organizing process. Biol Cybern 44:135–140
Kohonen T (1982c) Clustering, taxonomy and topological maps of patterns. Proceedings of the Sixth International Conference on Pattern Recognition. IEEE Computer Society Press, Silver Spring, pp 114–128
Kohonen T (1984) Self-organization and associative memory. Springer Series in Information Sciences, vol 8. Springer, Berlin Heidelberg New York
Kohonen T, Mäkisara K, Saramäki T (1984) Phonotopic maps insightful representation of phonological features for speech recognition. Proceedings of the IEEE Seventh International Conference on Pattern Recognition. IEEE Computer Society, Montreal, pp 182–185
Malsburg C von der, Bienenstock E (1986) Statistical coding and short term synaptic plasticity. A scheme for knowledge representation in the brain. In: Bienenstock E, Fogelman-Soulié F, Weisbuch G (eds) Disordered systems and biological organization. NATO ASI Series, vol F20. Springer, Berlin Heidelberg New York
McCarthy RA, Warrington EK (1988) Evidence for modalityspecific meaning systems in the brain. Nature 334:428–430
McKenna P, Warrington EK (1978) Category-specific naming preservation: a single case study. J Neurol Neurosurg Psychiatry 41:571–574
Miikkulainen R, Dyer MG (1988a) Forming global representations with extended backpropagation. Proceedings of the IEEE ICNN 88, San Diego, vol I. IEEE Computer Society Press, Silver Spring, pp 285–292
Miikkulainen R, Dyer MG (1988b) Encoding input/output representations in connectionist cognitive systems. In: Touretzky DS, Hinton GE, Sejnowski TJ (eds) Proceedings of the 1988 Connectionist Models Summer School, CMU. Morgan Kaufmann, Los Aeros, Calif
Nass MM, Cooper LN (1975) A theory for the development of feature detecting cells in visual cortex. Biol Cybern 19:1–18
Ojemann GA (1983) Brain organization for language from the perspective of electrical stimulation mapping. Behav Brain Sci 2:189–230
Perez R, Glass L, Shlaer RJ (1975) Development of specificity in the cat visual cortex. J Math Biol 1:275
Petersen SE, Fox PT, Posner MI, Mintun M, Raichle ME (1988) Positron emission tomographic studies of the cortical anatomy of single-word processing. Nature 331:585–589
Quillian MR (1968) Semantic memory. In: Minsky M (ed) Semantic information processing. MIT Press, Cambridge, Mass
Reale RA, Imig TH (1980) Tonotopic organization in auditory cortex of the cat. J Comp Neurol 192:265–291
Ritter H, Schulten K (1986) On the stationary state of Kohonen's self-organizing sensory mapping. Biol Cybern 54:99–106
Ritter H, Schulten K (1988) Kohonen's self-organizing maps: exploring their computational capabilities. Proceedings of the IEEE ICNN 88, San Diego, vol I. IEEE Computer Society Press, Silver Spring, pp 109–116
Ritter H, Schulten K (1989) Convergency properties of Kohonen's topology conserving maps: fluctuations, stability and dimension selection. Biol Cybern 60:59–71
Rolls ET (1984) Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. Hum Neurobiol 3:209–222
Rumelhart DE, McClelland JL (1984) Parallel distributed processing. MIT Press, Cambridge, Mass
Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by backpropagating errors. Nature 323:533–536
Sejnowski T, Rosenberg CR (1987) Parallel networks that learn to pronounce English text. Complex Syst 1:145–168
Suga N, O'Neill WE (1979) Neural axis representing target range in the auditory cortex of the mustache bat. Science 206:351–353
Tunturi AR (1950) Physiological determination of the arrangement of the afferent connections to the middle ectosylvian auditory area in the dog. Am J Physiol 162:489–502
Tunturi AR (1952) The auditory cortex of the dog. Am J Physiol 168:712–717
Warrington EK (1975) The selective impairment of semantic memory. Q J Exp Psychol 27:635–657
Warrington EK, McCarthy RA (1983) Category specific access dysphasia. Brain 106:859–878
Warrington EK, McCarthy RA (1987) Categories of knowledge. Brain 110:1273–1296
Warrington EK, Shallice T (1984) Category-specific impairments. Brain 107:829–854
Yamadori A, Albert ML (1973) Word category aphasia. Cortex 9:112–125
Zeki S (1980) The representation of colours in the cerebral cortex. Nature 284:412–418
Author information
Authors and Affiliations
Additional information
On leave from: Institut für Physik, Technische Universität München, James-Franck-Strasse, D-8046 Garching, FRG
Rights and permissions
About this article
Cite this article
Ritter, H., Kohonen, T. Self-organizing semantic maps. Biol. Cybern. 61, 241–254 (1989). https://doi.org/10.1007/BF00203171
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00203171