Shot boundary detection based on block-wise principal component analysis

Dacheng Zhang; Weimin Lei; Wei Zhang; Xinyi Chen

doi:10.1117/1.JEI.28.2.023029

9 April 2019 Shot boundary detection based on block-wise principal component analysis

Dacheng Zhang, Weimin Lei, Wei Zhang, Xinyi Chen

Author Affiliations +

Funded by: National Key Research and Development Program of China, Natural Science Foundation of Liaoning Province (Liaoning Natural Science Foundation), National Natural Science Foundation of China (NSFC)

Journal of Electronic Imaging, Vol. 28, Issue 2, 023029 (April 2019). https://doi.org/10.1117/1.JEI.28.2.023029

Abstract

With the rapid development of digital video, shot boundary detection (SBD) has attracted much attention since it is the fundamental preprocessing for video indexing, annotation, retrieval, and other content-based operations. However, most state-of-the-art SBD methods are based on the spatial features of video image, and the overall characteristics of video shots are not fully considered. We propose a feature extraction method based on shot characteristics and a more robust SBD process. First, a video is divided into several segments, the segments containing consecutive video frames inside a shot are considered as training segments and others are called candidate segments. Afterward, using block-wise principal component analysis on the training segments, shot eigenspaces are established. The video frames in the candidate segment are then projected onto the corresponding shot eigenspace to extract the feature vectors. Finally, analysis and pattern matching for feature vectors are performed to extract the video shot boundary. Experiments on TRECVID test data demonstrate that the mean values of F1 in cut transition detection and gradual transition (GT) detection of our method are 0.901 and 0.866, respectively, obviously higher than the values of the compared methods, especially in GT detection, thus providing better accuracy in SBD.

Citation Download Citation

Dacheng Zhang, Weimin Lei, Wei Zhang, and Xinyi Chen "Shot boundary detection based on block-wise principal component analysis," Journal of Electronic Imaging 28(2), 023029 (9 April 2019). https://doi.org/10.1117/1.JEI.28.2.023029

Received: 28 December 2018; Accepted: 13 March 2019; Published: 9 April 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE