Video abstraction based on asymmetric similarity values

Sorin Marcel Iacob; Reginald L. Lagendijk; M. E. Iacob

doi:10.1117/12.360422

24 August 1999 Video abstraction based on asymmetric similarity values

Sorin Marcel Iacob, Reginald L. Lagendijk, M. E. Iacob

Proceedings Volume 3846, Multimedia Storage and Archiving Systems IV; (1999) https://doi.org/10.1117/12.360422
Event: Photonics East '99, 1999, Boston, MA, United States

Abstract

The paper addresses visual similarity measuring and hierarchical groping of the most representative frames for the purpose of video abstraction. Our approach concentrates on measuring similarity of image regions. To produce a visual similarity measure we used as primary information the color histograms in the YUV color space. The difference from previous histogram based approaches is that we divide the input images into rectangles whose sizes depend on the local 'structure' of the image. We assume that similar regions in two different images would have approximately the same rectangle structure. Therefore, it should ge enough to compare the color histogram of the pixels within these rectangles in order to determine the similarity of two regions in two different images. We measure similarity between regions by a similarity score that is asymmetric. Such a measure cannot be used in classical clustering techniques for grouping representative frames. Our approach is therefore based on graph theoretic techniques. First, we construct an oriented weighted graph having as vertices the original set of key-frames. Next, we construct the set of weighted edges, according to the similarity values computed for each ordered pair of key-frames. Finally, we transform this graph into a collection of two-level trees, whose root key-frames form an abstract of the original ones. For graph construction and transformation, we present here two algorithms. The experiments we performed with the proposed technique showed improvements with respect to the way the visual content is represented. This conclusion is based on subjective assessment of the result groupings and the selection of the most representative key-frame.

Citation Download Citation

Sorin Marcel Iacob, Reginald L. Lagendijk, and M. E. Iacob "Video abstraction based on asymmetric similarity values", Proc. SPIE 3846, Multimedia Storage and Archiving Systems IV, (24 August 1999); https://doi.org/10.1117/12.360422

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available