Presentation
5 October 2018 Multi-camera multi-target perceptual activity recognition via meta-data fusion (Conference Presentation)
Amir Shirkhodaie, Kalyankumar Bogi
Author Affiliations +
Abstract
Human activity detection and recognition capabilities have broad applications for civilian, military, and homeland security. However, monitoring of human activities are very complicated and tedious tasks especially when multiple persons involved perform activities in confined spaces that impose significant obstruction, occultation and observability uncertainty. These applications require fast and reliable tracking systems to observe and inference dynamic objects from multiple coherent video sequences. In compact surveillance systems utilization of multi-cameras monitoring system is highly imperative for tracking, inference, and recognition of variety of group activities. With multi-cameras systems, complexity of occultation can be dealt with by finding and correlating the correspondences from within multiple cameras views observing the same target at once. In this paper, we demonstrate one such a multi-person tracking system developed in a virtual environment. By example, we demonstrate an efficient and effective technique for multi-target tracking, discrimination, and activity recognition in confined spaces. The exemplary scenario considered under this study represents a bus activity where multiple passengers arrive, take seats, and leave while being monitoring by four concurrently operating surveillance camera systems. In this paper, we present how processing tasks of multiple cameras are shared, what objects features they detect, track, and identify jointly. Furthermore, we present the computational intelligence techniques for processing multi-camera images for recognition of objects of interest as well as for annotation of observed individual and group activities via meta-data imagery fusion. The proposed multi-camera processing system is shown to have efficiency and effectively to track multiple targets with different degree of social interactions either with one another or with objects involved with their activities.
Conference Presentation
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Amir Shirkhodaie and Kalyankumar Bogi "Multi-camera multi-target perceptual activity recognition via meta-data fusion (Conference Presentation)", Proc. SPIE 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII, 106460T (5 October 2018); https://doi.org/10.1117/12.2305283
Advertisement
Advertisement
KEYWORDS
Cameras

Image fusion

Imaging systems

Homeland security

Image processing

Surveillance

Surveillance systems

RELATED CONTENT

Panoramic vehicular imaging system
Proceedings of SPIE (April 28 2017)
Real-time automatic inspection under adverse conditions
Proceedings of SPIE (March 01 1991)
Network transcoder with seamless switching function
Proceedings of SPIE (October 25 2004)
Object tracking using multiple camera video streams
Proceedings of SPIE (May 04 2010)
Real-time implementation of image alignment and fusion
Proceedings of SPIE (March 28 2005)

Back to Top