Video classification using speaker identification

Nilesh V. Patel; Ishwar K. Sethi

doi:10.1117/12.263411

15 January 1997 Video classification using speaker identification

Nilesh V. Patel, Ishwar K. Sethi

Proceedings Volume 3022, Storage and Retrieval for Image and Video Databases V; (1997) https://doi.org/10.1117/12.263411
Event: Electronic Imaging '97, 1997, San Jose, CA, United States

Abstract

Video content characterization is a challenging problem in video databases. The aim of such characterization is to generate indices that can describe a video clip in terms of objects and their actions in the clip. Generally, such indices are extracted by performing image analysis on the video clips. Many such indices can also be generated by analyzing the embedded audio information of video clips. Indices pertaining to context, scene emotion, and actors or characters present in a video clip appear especially suitable for generation via audio analysis techniques of keyword spotting, and speech and speaker recognition. In this paper, we examine the potential of speaker identification techniques for characterizing video clips in terms of actors present in them. We describe a three-stage processing system consisting of a shot boundary detection stage, an audio classification stage, and a speaker identification stage to determine the presence of different actors in isolated shots. Experimental results using the movie A Few Good Men are presented to show the efficacy of speaker identification for labeling video clips in terms of persons present in them.

Citation Download Citation

Nilesh V. Patel and Ishwar K. Sethi "Video classification using speaker identification", Proc. SPIE 3022, Storage and Retrieval for Image and Video Databases V, (15 January 1997); https://doi.org/10.1117/12.263411

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available