Context based semantics for multimodal retrieval

Alexandra Dumitrescu; Simone Santini

doi:10.1117/12.807621

19 January 2009 Context based semantics for multimodal retrieval

Proceedings Volume 7255, Multimedia Content Access: Algorithms and Systems III; 72550C (2009) https://doi.org/10.1117/12.807621
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

This paper proposes an alternative to formal annotation for the representation of semantics, and presents an extension to it capable of handling multimedia (text and images) documents. The article argues that meaning is not a property of a document, but an outcome of a contextualized and situated process of interpretation. The consequence of this position is that one should not quite try to represent the meaning of a document (the way formal annotation does), but the context of the activity of which search is part. We present some general considerations on the representation and use of the context, and a simple example of a technique to encode the context represented by the documents collected in the computer in which one is working, and to use them to direct search. We show preliminary results showing that even this rather simpleminded context representation can lead to considerable improvements with respect to commercial search engines both for text and images.

Citation Download Citation

Alexandra Dumitrescu and Simone Santini "Context based semantics for multimodal retrieval", Proc. SPIE 7255, Multimedia Content Access: Algorithms and Systems III, 72550C (19 January 2009); https://doi.org/10.1117/12.807621

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available