A tree-based paradigm for content-based video retrieval and management

H. Fang; Y. Yin; J. Jiang

doi:10.1117/12.642160

16 January 2006 A tree-based paradigm for content-based video retrieval and management

H. Fang, Y. Yin, J. Jiang

Proceedings Volume 6073, Multimedia Content Analysis, Management, and Retrieval 2006; 60730V (2006) https://doi.org/10.1117/12.642160
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

As video databases become increasingly important for full exploitation of multimedia resources, this paper aims at describing our recent efforts in feasibility studies towards building up a content-based and high-level video retrieval/management system. The study is focused on constructing a semantic tree structure via combination of low-level image processing techniques and high-level interpretation of visual content. Specifically, two separate algorithms were developed to organise input videos in terms of two layers: the shot layer and the key-frame layer. While the shot layer is derived by developing a multi-featured shot cut detection, the key frame layer is extracted automatically by a genetic algorithm. This paves the way for applying pattern recognition techniques to analyse those key frames and thus extract high level information to interpret the visual content or objects. Correspondingly, content-based video retrieval can be conducted in three stages. The first stage is to browse the digital video via the semantic tree at structural level, the second stage is match the key frame in terms of low-level features, such as colour, shape of objects, and texture etc. Finally, the third stage is to match the high-level information, such as conversation with indoor background, moving vehicles along a seaside road etc. Extensive experiments are reported in this paper for shot cut detection and key frame extraction, enabling the tree structure to be constructed.

Citation Download Citation

H. Fang, Y. Yin, and J. Jiang "A tree-based paradigm for content-based video retrieval and management", Proc. SPIE 6073, Multimedia Content Analysis, Management, and Retrieval 2006, 60730V (16 January 2006); https://doi.org/10.1117/12.642160

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Semantic video

Feature extraction

Video processing

Databases

Detection and tracking algorithms

Visualization

Show All Keywords

Keywords/Phrases

Search In:

Publication Years