Abnormal events detection method for surveillance video using an improved autoencoder with multi-modal input

Haichun Yue; Shigang Wang; Jian Wei; Yan Zhao

doi:10.1117/12.2538160

18 November 2019 Abnormal events detection method for surveillance video using an improved autoencoder with multi-modal input

Haichun Yue, Shigang Wang, Jian Wei, Yan Zhao

Author Affiliations +

Proceedings Volume 11187, Optoelectronic Imaging and Multimedia Technology VI; 111870U (2019) https://doi.org/10.1117/12.2538160
Event: SPIE/COS Photonics Asia, 2019, Hangzhou, China

Abstract

This paper introduces an algorithm to solve the the anomaly behavior detection problem of surveillance video through an improved autoencoder with multimodal inputs. Using 3D convolution and 3D deconvolution, and the decoder adds a feature map corresponding to the encoder on a specific layer to enhance the image detail information. Taking the RGB frame and the optical flow as inputs, abnormality scores are calculated according to the reconstruction error for locating the abnormal segment. Experiments conducted in the CUHK Avenue dataset, the UCSD Pedestrian dataset and the Behave dataset, our approach works best compare to the original approach. While improving the AUC, due to the use of unsupervised learning, a lot of labeling time is saved, which is more in line with the diversity and contingency of abnormal behavior in real life.

Citation Download Citation

Haichun Yue, Shigang Wang, Jian Wei, and Yan Zhao "Abnormal events detection method for surveillance video using an improved autoencoder with multi-modal input", Proc. SPIE 11187, Optoelectronic Imaging and Multimedia Technology VI, 111870U (18 November 2019); https://doi.org/10.1117/12.2538160

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available