Scene recognition with audio-visual sensor fusion

Deepak Devicharan; Kishan G. Mehrotra; Chilukuri Krishna Mohan; Pramod K. Varshney; Long Zuo

doi:10.1117/12.605751

28 March 2005 Scene recognition with audio-visual sensor fusion

Deepak Devicharan, Kishan G. Mehrotra, Chilukuri Krishna Mohan, Pramod K. Varshney, Long Zuo

Proceedings Volume 5813, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2005; (2005) https://doi.org/10.1117/12.605751
Event: Defense and Security, 2005, Orlando, Florida, United States

Abstract

Several surveillance applications are characterized by the ability to gather information about the scene from more than one sensor modality, and heterogeneous sensor data must then be fused by the decision-maker. In this paper, we discuss the issues relevant to developing a model for fusion of information from audio and visual sensors, and present a framework to enhance decision-making capabilities. In particular, our methodology focuses on the issues of temporal reasoning, uncertainty representations, and coupling between features inferred from data streams coming from different sensors. We propose a conditional probability-based representation for uncertainty, along with fuzzy rules to assist decision-making, and a matrix representation of the coupling between sensor data streams. We also develop a fusion algorithm that utilizes these representations.

Citation Download Citation

Deepak Devicharan, Kishan G. Mehrotra, Chilukuri Krishna Mohan, Pramod K. Varshney, and Long Zuo "Scene recognition with audio-visual sensor fusion", Proc. SPIE 5813, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2005, (28 March 2005); https://doi.org/10.1117/12.605751

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available