Modeling sports highlights using a time-series clustering framework and model interpretation

Regunathan Radhakrishnan; Isao Otsuka; Ziyou Xiong; Ajay Divakaran

doi:10.1117/12.588059

17 January 2005 Modeling sports highlights using a time-series clustering framework and model interpretation

Regunathan Radhakrishnan, Isao Otsuka, Ziyou Xiong, Ajay Divakaran

Proceedings Volume 5682, Storage and Retrieval Methods and Applications for Multimedia 2005; (2005) https://doi.org/10.1117/12.588059
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

In our past work on sports highlights extraction, we have shown the utility of detecting audience reaction using an audio classification framework. The audio classes in the framework were chosen based on intuition. In this paper, we present a systematic way of identifying the key audio classes for sports highlights extraction using a time series clustering framework. We treat the low-level audio features as a time series and model the highlight segments as "unusual" events in a background of an "usual" process. The set of audio classes to characterize the sports domain is then identified by analyzing the consistent patterns in each of the clusters output from the time series clustering framework. The distribution of features from the training data so obtained for each of the key audio classes, is parameterized by a Minimum Description Length Gaussian Mixture Model (MDL-GMM). We also interpret the meaning of each of the mixture components of the MDL-GMM for the key audio class (the "highlight" class) that is correlated with highlight moments. Our results show that the "highlight" class is a mixture of audience cheering and commentator's excited speech. Furthermore, we show that the precision-recall performance for highlights extraction based on this "highlight" class is better than that of our previous approach which uses only audience cheering as the key highlight class.

Citation Download Citation

Regunathan Radhakrishnan, Isao Otsuka, Ziyou Xiong, and Ajay Divakaran "Modeling sports highlights using a time-series clustering framework and model interpretation", Proc. SPIE 5682, Storage and Retrieval Methods and Applications for Multimedia 2005, (17 January 2005); https://doi.org/10.1117/12.588059

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available