Multisensor image fusion and mining in a COTS exploitation environment

David A. Fay; Richard T. Ivey; Neil Bomberger; Allen M. Waxman

doi:10.1117/12.497424

Translator Disclaimer

10 October 2003 Multisensor image fusion and mining in a COTS exploitation environment

David A. Fay, Richard T. Ivey, Neil Bomberger, Allen M. Waxman

Author Affiliations +

Proceedings Volume 5074, Infrared Technology and Applications XXIX; (2003) https://doi.org/10.1117/12.497424
Event: AeroSense 2003, 2003, Orlando, Florida, United States

Abstract

We have continued development of a system for multisensor image fusion and interactive mining based on neural models of color vision processing, learning and pattern recognition. We pioneered this work while at MIT Lincoln Laboratory, initially for color fused night vision (low-light visible and uncooled thermal imagery) and later extended it to multispectral IR and 3D ladar. We also developed a proof-of-concept system for EO, IR, SAR fusion and mining. Over the last year we have generalized this approach and developed a user-friendly system integrated into a COTS exploitation environment known as ERDAS Imagine. In this paper, we will summarize the approach and the neural networks used, and demonstrate fusion and interactive mining (i.e., target learning and search) of low-light visible/SWIR/MWIR/LWIR night imagery, and IKONOS multispectral and high-resolution panchromatic imagery. In addition, we will demonstrate how target learning and search can be enabled over extended operating conditions by allowing training over multiple scenes. This will be illustrated for the detection of small boats in coastal waters using fused visible/MWIR/LWIR imagery.

Citation Download Citation

David A. Fay, Richard T. Ivey, Neil Bomberger, and Allen M. Waxman "Multisensor image fusion and mining in a COTS exploitation environment", Proc. SPIE 5074, Infrared Technology and Applications XXIX, (10 October 2003); https://doi.org/10.1117/12.497424

ACCESS THE FULL ARTICLE