Activate Activate Activate
contact  
Hello. Sign in to personalize your visit. New user? Register now.  

In
By author
Computational Linguistics

Quarterly (March, June, September, December)
160 pp. per issue
6 3/4 x 10
Founded: 1974
ISSN 0891-2017
E-ISSN 1530-9312
2008 ISI Impact Factor: 2.656

Computational Linguistics

June 2009, Vol. 35, No. 2, Pages 271-306
Posted Online May 14, 2009.
(doi:10.1162/coli.06-78-prep14)
© 2008 Association for Computational Linguistics
Applying Computational Models of Spatial Prepositions to Visually Situated Dialog

John D. Kelleher*Fintan J. Costello**

* School of Computing, Dublin Institute of Technology, Kevin Street, Dublin 8, Ireland. E-mail: .

** School of Computer Science and Informatics, University College Dublin, Belfield, Dublin 4, Ireland. E-mail: .

PDF (821.091 KB) PDF Plus (646.869 KB)

This article describes the application of computational models of spatial prepositions to visually situated dialog systems. In these dialogs, spatial prepositions are important because people often use them to refer to entities in the visual context of a dialog. We first describe a generic architecture for a visually situated dialog system and highlight the interactions between the spatial cognition module, which provides the interface to the models of prepositional semantics, and the other components in the architecture. Following this, we present two new computational models of topological and projective spatial prepositions. The main novelty within these models is the fact that they account for the contextual effect which other distractor objects in a visual scene can have on the region described by a given preposition. We next present psycholinguistic tests evaluating our approach to distractor interference on prepositional semantics, and illustrate how these models are used for both interpretation and generation of prepositional expressions.

Cited by

Dennis Hofs, Mariët Theune, Rieks Akker. (2010) Natural interaction with a virtual guide in a virtual environment. Journal on Multimodal User Interfaces
Online publication date: 5-Jan-2010.
CrossRef
Timothy Baldwin, Valia Kordoni, Aline Villavicencio. (2009) Prepositions in Applications: A Survey and Introduction to the Special Issue. Computational Linguistics 35:2, 119-149
Online publication date: 1-Jun-2009.
Citation | PDF (190 KB) | PDF Plus (191 KB) 

Technology Partner - Atypon Systems, Inc.
  CrossRef member COUNTER member