Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Cognitive Processing
Published in: Cognitive Processing 1/2011

01-02-2011 | Research Report

The effect of occlusion on the semantics of projective spatial terms: a case study in grounding language in perception

Authors: John D. Kelleher, Robert J. Ross, Colm Sloan, Brian Mac Namee

Published in: Cognitive Processing | Issue 1/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Although data-driven spatial template models provide a practical and cognitively motivated mechanism for characterizing spatial term meaning, the influence of perceptual rather than solely geometric and functional properties has yet to be systematically investigated. In the light of this, in this paper, we investigate the effects of the perceptual phenomenon of object occlusion on the semantics of projective terms. We did this by conducting a study to test whether object occlusion had a noticeable effect on the acceptance values assigned to projective terms with respect to a 2.5-dimensional visual stimulus. Based on the data collected, a regression model was constructed and presented. Subsequent analysis showed that the regression model that included the occlusion factor outperformed an adaptation of Regier & Carlson’s well-regarded AVS model for that same spatial configuration.
previous article Interpreting spatial language in image captions
next article Conceptual layers and strategies in tour planning

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Footnotes
1
See Mukerjee (1998) for an overview of seminal approaches.
 
2
In this paper, we use Logan & Sadler’s term spatial template to describe both Logan and Sadler’s (1996) psychological account of how people apprehend spatial relations using spatial templates and a set of computational models that are primarily based on geometric factors, such as distance between the trajector and landmark, e.g., (Gapp, 1994; Regier and Carlson 2001; Kelleher and Costello 2009). From a functional perspective, there is no distinction between these two groups. However, from a psychological perspective, they make different predictions: Logan & Sadler’s theory proposes that people apply a template over all of their visual field at once, meaning that factors such as distance between trajector and landmark should not play a role, whereas the computational models predict that these factors do play a role. Notwithstanding this distinction, we use the term spatial template to describe both accounts because fundamentally they both use a template-based semantic representation.
 
3
It should be noted that Logan & Sadler analysed a number of spatial relations in a similar fashion and that the general form of the spatial template presented in Fig. 1 is not specific to the preposition above or to a particular landmark shape (Carlson-Radvansky and Logan 1997; Logan and Sadler 1996).
 
4
See (Logan 1994; Logan 1995).
 
6
The condition 1 pairs where both trajectors occluded the landmark.
 
7
The condition 2 pairs where only the first trajector occluded the landmark
 
8
Similarly, it is interesting to note that for acceptability judgments for “to the right” and “to the left”, we see that landmark occlusion seems to have an effect on term acceptability. Namely, taking groups YL2–YL5 and YR2–YR5 for the case of “to the right” and “to the left”, respectively, the results indicate that occlusion of the landmark by the trajector results in an accelerated drop in acceptance values. For “to the right” |YR3–YR4| = 0.75 and |YR4–YR5| = 1.714, while for “to the left” |YL4–YL5| = 1.143 and |YL3–YL4| = 1.000.
 
9
In all of the correlation tests reported below, associated p-values of <0.001 were returned.
 
Literature
Brenner M, Hawes N, Kelleher J, Wyatt J (2007) Mediating between qualitative and quantitative representations for task-orientated human-robot interaction. In: Proceedings of the twentieth international joint conference on artificial intelligence (IJCAI), Hyderabad, India
Carlson-Radvansky LA, Logan GD (1997) The influence of reference frame selection on spatial template construction. J Mem Lang 37:411–437CrossRef
Carlson-Radvansky LA, Radvansky GA (1996) The influence of functional relations on spatial term selection. Psychol Sci 7:56–60CrossRef
Coventry KR, Garrod SC (2004) Saying, seeing and acting. The psychological semantics of spatial prepositions. Essays in cognitive psychology series. Psychology Press, Hove
Coventry KR, Prat-Sala M, Richards LV (2001) The interplay between geometry and function in the comprehension of ‘over’, ‘under’, ‘above’ and ‘below’. J Mem Lang 44:376–398CrossRef
Fuhr T, Socher G, Scheering C, Sagerer G (1998) A three-dimensional spatial model for the interpretation of image data. In: Olivier P, Gapp K (eds) Representation and processing of spatial expressions, Lawrence Erlbaum Associates, New Jersey, pp 103–118
Gapp K (1994a) Basic meanings of spatial relations: computation and evaluation in 3D space. In: Proceedings of AAAI-94. Seattle, Washington, pp 1393–1398
Gapp KP (1994b) Basic meanings of spatial relations: computation and evaluation in 3d space. In: AAAI’94, pp 1393–1398
Gorniak P, Roy D (2004) Grounded semantic composition for visual scenes. J Artif Intell Res 21:429–470
Jackendoff R (1999) The architecture of the linguistic-spatial interface. In: Bloom P, Peterson MA, Nadel L, Garrett MF (eds) Language and space. MIT Press, Cambride, MA, pp 1–30
Jackendoff R, Landau B (1992) Spatial language and spatial cognition. In: Jackendoff R (eds) Languages of the mind. MIT Press, Cambride, MA, pp 99–125
Kelleher J (2003) A perceptually based computational framework for the interpretation of spatial language. PhD thesis, Dublin City University
Kelleher J, Costello F (2005) Cognitive representations of projective prepositions. In: Kordoni V, Valencia A (eds) In Proceedings of the 2nd ACL-Sigsem workshop on the linguistic dimensions of prepositions and their use in computational linguistics formalisms and applications
Kelleher J, Kruijff GJ, Costello F (2006) Proximity in context: an empirically grounded computational model of proximity for processing topological spatial expression. In: Proceedings of Coling-ACL ’06, Sydney Australia
Langacker RW (1987) Foundations in cognitive grammar, vol 1. Theoretical prerequisites. Stanford University Press, Stanford, CA
Logan G (1994) Spatial attention and the apprehension of spatial relations. J Exp Psychol Hum Percept Perform 20:1015–1036CrossRefPubMed
Logan G (1995) Linguistic and conceptual control of visual spatial attention. Cognit Psychol 12:523–533CrossRef
Logan GD, Sadler DD (1996) A computational analysis of the apprehension of spatial relations. In: Bloom P, Peterson MA, Nadel L, Garrett MF (eds) Language and space. MIT Press, Cambride, MA, pp 493–530
Olivier P, Tsujii J (1994) Quantitative perceptual representation of prepositional semantics. Artif Int Rev 8:147–158
Regier T, Carlson LA (2001) Grounding spatial language in perception: an empirical and computational investigation. J Exp Psychol Gen 130(2):273–298CrossRefPubMed
Ross RJ (2009) Situated dialogue systems: agency & spatial meaning in task-oriented dialogue. PhD thesis, Universitat Bremen
Roy D, Reiter E (2005) Connecting language to the world. Artif Int 167(1–2):1–12CrossRef
Talmy L (2000) Towards a cognitive semantics. A bradford book. MIT Press, Cambridge, MA
Vandeloise C (1991) Spatial prepositions: a case study from French. The University of Chicago Press, Chicago
Yamada A (1993) Studies in spatial descriptions understanding based on geometric constraints satisfaction. PhD thesis, University of Kyoto
Metadata
Title
The effect of occlusion on the semantics of projective spatial terms: a case study in grounding language in perception
Authors
John D. Kelleher
Robert J. Ross
Colm Sloan
Brian Mac Namee
Publication date
01-02-2011
Publisher
Springer-Verlag
Published in
Cognitive Processing / Issue 1/2011
Print ISSN: 1612-4782
Electronic ISSN: 1612-4790
DOI
https://doi.org/10.1007/s10339-010-0380-x

Other articles of this Issue 1/2011

Cognitive Processing 1/2011 Go to the issue

Short Report

Effects of feedback from active and passive body parts on spatial and temporal parameters in sensorimotor synchronization

Research Report

Multimodal cognitive interface for robot navigation

Editorial

Modelling space and modelling spatially: presentation of the special corner on “Spatial Models and Models of Space”

Announcement

Announcing Interdisciplinary College 2011 (IK 2011)

Research Report

Pupillary Stroop effects

Research Report

Interpreting spatial language in image captions