Fusion of optical flow based motion pattern analysis and silhouette classification for person tracking and detection

Johan W. H. Tangelder; Ed Lebert; Gertjan J. Burghouts; Kasper van Zon; Marten J. den Uyl

doi:10.1117/12.2066460

7 October 2014 Fusion of optical flow based motion pattern analysis and silhouette classification for person tracking and detection

Johan W. H. Tangelder, Ed Lebert, Gertjan J. Burghouts, Kasper van Zon, Marten J. den Uyl

Author Affiliations +

Proceedings Volume 9253, Optics and Photonics for Counterterrorism, Crime Fighting, and Defence X; and Optical Materials and Biomaterials in Security and Defence Systems Technology XI; 92530L (2014) https://doi.org/10.1117/12.2066460
Event: SPIE Security + Defence, 2014, Amsterdam, Netherlands

Abstract

This paper presents a novel approach to detect persons in video by combining optical flow based motion analysis and silhouette based recognition. A new fast optical flow computation method is described, and its application in a motion based analysis framework unifying human tracking and detection is outlined. Our optical flow algorithm represents optical flow by grid based motion vectors, which are computed very efficiently and robustly applying template matching. We model the motion patterns of the tracked human and non-human objects by the positions, velocities, motion magnitudes, and motion directions of their optical flow vectors, and build a random forest on these features. For recognition, the random forest computes a normalized score measuring the similarity of a track to a human track. Using edge detection on a motion image for each motion blob its silhouette is computed. Recognition scores are computed, which measure the similarity of the silhouettes with human silhouettes. The optical flow classifier and the silhouette classifier are used as a combined classifier. We analyze the ROC curve to set different decision thresholds on the recognition score for different scenarios. The experiments on the VIRAT test set demonstrate that for human detection the combination of the optical flow based motion method with one based on human silhouette analysis, obtains superior results, compared to the constituent methods.

Citation Download Citation

Johan W. H. Tangelder, Ed Lebert, Gertjan J. Burghouts, Kasper van Zon, and Marten J. den Uyl "Fusion of optical flow based motion pattern analysis and silhouette classification for person tracking and detection", Proc. SPIE 9253, Optics and Photonics for Counterterrorism, Crime Fighting, and Defence X; and Optical Materials and Biomaterials in Security and Defence Systems Technology XI, 92530L (7 October 2014); https://doi.org/10.1117/12.2066460

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Optical flow

Motion analysis

Optical tracking

Video

Video surveillance

Neural networks

Edge detection

Show All Keywords

Keywords/Phrases

Search In:

Publication Years