Automated simulation-generated EO/IR image library for artificial intelligence applications

Corey D. Packard; Mark D. Klein; Timothy S. Viola; David C. Bell; Peter L. Rynes

doi:10.1117/12.2558843

23 April 2020 Automated simulation-generated EO/IR image library for artificial intelligence applications

Corey D. Packard, Mark D. Klein, Timothy S. Viola, David C. Bell, Peter L. Rynes

Proceedings Volume 11406, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXXI; 1140606 (2020) https://doi.org/10.1117/12.2558843
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

The emergence of machine learning into scientific fields has created opportunities for novel and powerful image processing techniques. Algorithms that can perform complex tasks without a “man-in-the-loop” or explicit instructions are invaluable artificial intelligence tools. These algorithms typically require a large set of training data on which to base statistical predictions. In the case of electro-optical infrared (EO/IR) remote sensing, algorithm designers often seek a substantial library of images comprising many weather conditions, times of day, sensor resolutions, etc. These images may be synthetic (predicted) or measured, but should encompass a large variety of targets imaged from a variety of vantage points against numerous backgrounds. Acquiring such a large set of measured imagery with sufficient variation can be difficult, requiring numerous field campaigns. Alternatively, accurate prediction of target signatures in cluttered outdoor scenes may be a viable option. In this work, sensor imagery is generated using CoTherm, a co-simulation tool which operates MuSES (an EO/IR simulation code) in an automated fashion to create a large library of synthetic images. The relevant MuSES inputs – which might include environmental factors, global location, date and time, vehicle engine state, human clothing and activity level, or sensor waveband – can be manipulated by a CoTherm workflow process. The output of this process is a large library of MuSES-generated EO/IR sensor radiance images suitable for algorithm development. If desired, synthetic target pixels can be inserted into measured background images for added realism.

Conference Presentation

Citation Download Citation

Corey D. Packard, Mark D. Klein, Timothy S. Viola, David C. Bell, and Peter L. Rynes "Automated simulation-generated EO/IR image library for artificial intelligence applications", Proc. SPIE 11406, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXXI, 1140606 (23 April 2020); https://doi.org/10.1117/12.2558843

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available