A robust target recognition and tracking panoramic surveillance system based on deep learning

Qiang Fan; Yin Xu

doi:10.1117/12.2543434

18 December 2019 A robust target recognition and tracking panoramic surveillance system based on deep learning

Qiang Fan, Yin Xu

Proceedings Volume 11342, AOPC 2019: AI in Optics and Photonics; 113420A (2019) https://doi.org/10.1117/12.2543434
Event: Applied Optics and Photonics China (AOPC2019), 2019, Beijing, China

Abstract

A panoramic surveillance system is designed to achieve continuous monitoring of the surrounding environment. The image acquisition module of the system is composed of five fixed-focal-length cameras and one variable-focal-length camera, which realizes 360 degree environmental surveillance. An adaptive threshold is used to dynamically update the background template in order to better accommodate various weather changes. Further, a pixel-level video moving target detection algorithm is applied to effectively detect whether an intruding target exists and determine the direction of the target. It shows the advantages of less computation and preferable detection accuracy. Once an intrusive target is found, the deep convolution neural network SSD is employed to recognize the specific target quickly. As common sense, visual object tracking is one of the most attractive issue in computer vision. Recently, deep neural network has been widely developed in object tracking and shown great achievement. Here, we propose an end-to-end lightweight siamese convolution neural network to achieve fast and robust target tracking. The experiment result shows panoramic surveillance system can effectively and robustly perform security tasks such as panoramic imaging, target recognition and fast target tracking. At the same time, the deep convolution neural network can recognize and track the target accurately and quickly, which meets the real-time and accuracy requirements of practical task.

Citation Download Citation

Qiang Fan and Yin Xu "A robust target recognition and tracking panoramic surveillance system based on deep learning", Proc. SPIE 11342, AOPC 2019: AI in Optics and Photonics, 113420A (18 December 2019); https://doi.org/10.1117/12.2543434

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Panoramic photography

Target detection

Target recognition

Cameras

Imaging systems

Neural networks

Surveillance systems

Show All Keywords

Keywords/Phrases

Search In:

Publication Years