Temporal video segmentation using unsupervised clustering and semantic object tracking

Bilge Gunsel; Ahmet Mufit Ferman; A. Murat Tekalp

doi:10.1117/1.482613

1 July 1998 Temporal video segmentation using unsupervised clustering and semantic object tracking

Bilge Gunsel, Ahmet Mufit Ferman, A. Murat Tekalp

Journal of Electronic Imaging, Vol. 7, Issue 3, (July 1998). https://doi.org/10.1117/1.482613

This paper proposes a content-based temporal video segmentation system that integrates syntactic (domain-independent) and semantic (domain-dependent) features for automatic management of video data. Temporal video segmentation includes scene change detection and shot classification. The proposed scene change detection method consists of two steps: detection and tracking of semantic objects of interest specified by the user, and an unsupervised method for detection of cuts, and edit effects. Object detection and tracking is achieved using a region matching scheme, where the region of interest is defined by the boundary of the object. A new unsupervised scene change detection method based on two-class clustering is introduced to eliminate the data dependency of threshold selection. The proposed shot classification approach relies on semantic image features and exploits domain-dependent visual properties such as shape, color, and spatial configuration of tracked semantic objects. The system has been applied to segmentation and classification of TV programs collected from different channels. Although the paper focuses on news programs, the method can easily be applied to other TV programs with distinct semantic structure.

Citation Download Citation

Bilge Gunsel, Ahmet Mufit Ferman, and A. Murat Tekalp "Temporal video segmentation using unsupervised clustering and semantic object tracking," Journal of Electronic Imaging 7(3), (1 July 1998). https://doi.org/10.1117/1.482613

Published: 1 July 1998

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available