Non-supervised macro segmentation of large-scale TV videos

Hongliang Bai; Chengyu Dong; Lezi Wang; Gang Qin; Kun Tao; Xiaofu Chang; Yuan Dong

doi:10.1117/12.872095

17 February 2011 Non-supervised macro segmentation of large-scale TV videos

Hongliang Bai, Chengyu Dong, Lezi Wang, Gang Qin, Kun Tao, Xiaofu Chang, Yuan Dong

Proceedings Volume 7881, Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V; 78811F (2011) https://doi.org/10.1117/12.872095
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

In this paper, a novel non-supervised macro segmentation algorithm is presented by detecting duplicate sequences of large-scale TV videos. Motivated by the fact that "Inter-Programs" are repeatedly inserted into the TV videos, the macro structure of the videos can be effectively and automatically generated by identifying the special sequences. There are four sections in the algorithm, namely, keyframe extraction, discrete cosine transformbased feature generation(a fixed-size 64D signature), Locality-Sensitive Hashing (LSH)-based frame retrieval and macro segmentation through the duplicated sequence detection and the dynamic programming. The main contributions are: (1) supply one effective and efficient algorithm for the macro segmentation in the large-scale TV videos, (2) LSH can quickly query the similar frames, and (3) the non-supervised learned duplicate sequence models are used to find the lost duplicate sequences by the dynamic programming. The algorithm has been tested in 15-day different-type TV streams. The F-measure of the system is greater than 96%. The experiments show that it is efficient and effective for the macro segmentation.

Citation Download Citation

Hongliang Bai, Chengyu Dong, Lezi Wang, Gang Qin, Kun Tao, Xiaofu Chang, and Yuan Dong "Non-supervised macro segmentation of large-scale TV videos", Proc. SPIE 7881, Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V, 78811F (17 February 2011); https://doi.org/10.1117/12.872095

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available