A robust technique for semantic annotation of group activities based on recognition of extracted features in video streams

Vinayak Elangovan; Amir Shirkhodaie

doi:10.1117/12.2018626

23 May 2013 A robust technique for semantic annotation of group activities based on recognition of extracted features in video streams

Vinayak Elangovan, Amir Shirkhodaie

Author Affiliations +

Proceedings Volume 8745, Signal Processing, Sensor Fusion, and Target Recognition XXII; 87450M (2013) https://doi.org/10.1117/12.2018626
Event: SPIE Defense, Security, and Sensing, 2013, Baltimore, Maryland, United States

Abstract

Recognition and understanding of group activities can significantly improve situational awareness in Surveillance Systems. To maximize reliability and effectiveness of Persistent Surveillance Systems, annotations of sequential images gathered from video streams (i.e. imagery and acoustic features) must be fused together to generate semantic messages describing group activities (GA). To facilitate efficient fusion of extracted features from any physical sensors a common structure will suffice to ease integration of processed data into new comprehension. In this paper, we describe a framework for extraction and management of pertinent features/attributes vital for annotation of group activities reliably. A robust technique is proposed for fusion of generated events and entities’ attributes from video streams. A modified Transducer Markup Language (TML) is introduced for semantic annotation of events and entities attributes. By aggregation of multi-attribute TML messages, we have demonstrated that salient group activities can be spatiotemporal can be reliable annotated. This paper discusses our experimental results; our analysis of a set of simulated group activities performed under different contexts and demonstrates the efficiency and effectiveness of the proposed modified TML data structure which facilitates seamless fusion of extracted information from video streams.

Citation Download Citation

Vinayak Elangovan and Amir Shirkhodaie "A robust technique for semantic annotation of group activities based on recognition of extracted features in video streams", Proc. SPIE 8745, Signal Processing, Sensor Fusion, and Target Recognition XXII, 87450M (23 May 2013); https://doi.org/10.1117/12.2018626

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available