Acoustic semantic labeling and fusion of human-vehicle interactions

Amir Shirkhodaie; Vinayak Elangovan; Aaron Rababaah

doi:10.1117/12.883544

5 May 2011 Acoustic semantic labeling and fusion of human-vehicle interactions

Amir Shirkhodaie, Vinayak Elangovan, Aaron Rababaah

Proceedings Volume 8050, Signal Processing, Sensor Fusion, and Target Recognition XX; 80500Q (2011) https://doi.org/10.1117/12.883544
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

Situational awareness in a Persistent Surveillance System (PSS) can be significantly improved by fusion of Data from physical (Hard) sensors and information provided by human observers (as Soft/biological sensors) from the field. One of the major limitations that this trend brings about is, however, the integration and fusion of the sensory data collected from hard sensors along with soft data gathered from human agents in a consistent and cohesive way. This paper presents a proposed approach for semantic labeling of vehicular non-stationary acoustic events in the context of PSS. Two techniques for feature extraction based on discrete wavelet and short-time Fourier transforms are described. A correlation-based classifier is proposed for classifying and semantic labeling of vehicular acoustic events. The presented result demonstrates the proposed solution is both reliable and effective, and can be extended to future PSS applications.

Citation Download Citation

Amir Shirkhodaie, Vinayak Elangovan, and Aaron Rababaah "Acoustic semantic labeling and fusion of human-vehicle interactions", Proc. SPIE 8050, Signal Processing, Sensor Fusion, and Target Recognition XX, 80500Q (5 May 2011); https://doi.org/10.1117/12.883544

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available