Forward looking anomaly detection via fusion of infrared and color imagery

K. Stone; J. M. Keller; M. Popescu; T. C. Havens; K. C. Ho

doi:10.1117/12.851370

29 April 2010 Forward looking anomaly detection via fusion of infrared and color imagery

K. Stone, J. M. Keller, M. Popescu, T. C. Havens, K. C. Ho

Proceedings Volume 7664, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XV; 766425 (2010) https://doi.org/10.1117/12.851370
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

This paper develops algorithms for the detection of interesting and abnormal objects in color and infrared imagery taken from cameras mounted on a moving vehicle, observing a fixed scene. The primary purpose of detection is to cue a human-in-the-loop detection system. Algorithms for direct detection and change detection are investigated, as well as fusion of the two. Both methods use temporal information to reduce the number of false alarms. The direct detection algorithm uses image self-similarity computed between local neighborhoods to determine interesting, or unique, parts of an image. Neighborhood similarity is computed using Euclidean distance in CIELAB color space for the color imagery, and Euclidean distance between grey levels in the infrared imagery. The change detection algorithm uses the affine scale-invariant feature transform (ASIFT) to transform multiple background frames into the current image space. Each transformed image is then compared to the current image, and the multiple outputs are fused to produce a single difference image. Changes in lighting and contrast between the background run and the current run are adjusted for in both color and infrared imagery. Frame-to-frame motion is modeled using a perspective transformation, the parameters of which are computed using scale-invariant feature transform (SIFT) keypoint correspondences. This information is used to perform temporal accumulation of single frame detections for both the direct detection and change detection algorithms. Performance of the proposed algorithms is evaluated on multiple lanes from a data collection at a US Army test site.

Citation Download Citation

K. Stone, J. M. Keller, M. Popescu, T. C. Havens, and K. C. Ho "Forward looking anomaly detection via fusion of infrared and color imagery", Proc. SPIE 7664, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XV, 766425 (29 April 2010); https://doi.org/10.1117/12.851370

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available