Using video objects and relevance feedback in video retrieval

Sorin Sav; Hyowon Lee; Alan F. Smeaton; Noel E. O'Connor; Noel Murphy

doi:10.1117/12.629654

24 October 2005 Using video objects and relevance feedback in video retrieval

Sorin Sav, Hyowon Lee, Alan F. Smeaton, Noel E. O'Connor, Noel Murphy

Proceedings Volume 6015, Multimedia Systems and Applications VIII; 601512 (2005) https://doi.org/10.1117/12.629654
Event: Optics East 2005, 2005, Boston, MA, United States

Abstract

Video retrieval is mostly based on using text from dialogue and this remains the most significant component, despite progress in other aspects. One problem with this is when a searcher wants to locate video based on what is appearing in the video rather than what is being spoken about. Alternatives such as automatically-detected features and image-based keyframe matching can be used, though these still need further improvement in quality. One other modality for video retrieval is based on segmenting objects from video and allowing endusers to use these as part of querying. This uses similarity between query objects and objects from video, and in theory allows retrieval based on what is actually appearing on-screen. The main hurdles to greater use of this are the overhead of object segmentation on large amounts of video and the issue of whether we can actually achieve effective object-based retrieval. We describe a system to support object-based video retrieval where a user selects example video objects as part of the query. During a search a user builds up a set of these which are matched against objects previously segmented from a video library. This match is based on MPEG-7 Dominant Colour, Shape Compaction and Texture Browsing descriptors. We use a user-driven semi-automated segmentation process to segment the video archive which is very accurate and is faster than conventional video annotation.

Citation Download Citation

Sorin Sav, Hyowon Lee, Alan F. Smeaton, Noel E. O'Connor, and Noel Murphy "Using video objects and relevance feedback in video retrieval", Proc. SPIE 6015, Multimedia Systems and Applications VIII, 601512 (24 October 2005); https://doi.org/10.1117/12.629654

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available