Efficient re-indexing of automatically annotated image collections using keyword combination

Alexei Yavlinsky; Stefan Rüger

doi:10.1117/12.702913

29 January 2007 Efficient re-indexing of automatically annotated image collections using keyword combination

Alexei Yavlinsky, Stefan Rüger

Proceedings Volume 6506, Multimedia Content Access: Algorithms and Systems; 650608 (2007) https://doi.org/10.1117/12.702913
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

This paper presents a framework for improving the image index obtained by automated image annotation. Within this framework, the technique of keyword combination is used for fast image re-indexing based on initial automated annotations. It aims to tackle the challenges of limited vocabulary size and low annotation accuracies resulting from differences between training and test collections. It is useful for situations when these two problems are not anticipated at the time of annotation. We show that based on example images from the automatically annotated collection, it is often possible to find multiple keyword queries that can retrieve new image concepts which are not present in the training vocabulary, and improve retrieval results of those that are already present. We demonstrate that this can be done at a very small computational cost and at an acceptable performance tradeoff, compared to traditional annotation models. We present a simple, robust, and computationally efficient approach for finding an appropriate set of keywords for a given target concept. We report results on TRECVID 2005, Getty Image Archive, and Web image datasets, the last two of which were specifically constructed to support realistic retrieval scenarios.

Citation Download Citation

Alexei Yavlinsky and Stefan Rüger "Efficient re-indexing of automatically annotated image collections using keyword combination", Proc. SPIE 6506, Multimedia Content Access: Algorithms and Systems, 650608 (29 January 2007); https://doi.org/10.1117/12.702913

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available