RT-ROC: a near-real-time performance evaluation tool

James M. Baumann; James L. Jackson III; Gregory D. Sterling; Erik P. Blasch

doi:10.1117/12.606011

19 May 2005 RT-ROC: a near-real-time performance evaluation tool

James M. Baumann, James L. Jackson III, Gregory D. Sterling, Erik P. Blasch

Proceedings Volume 5807, Automatic Target Recognition XV; (2005) https://doi.org/10.1117/12.606011
Event: Defense and Security, 2005, Orlando, Florida, United States

Abstract

While modern sensors allow vast amounts of data to be collected in seconds, it can take weeks or months to analyze the data and determine sensor performance. Because of this lag between data collection and usable results, issues such as sensor calibration and algorithm biases are not detected until well after an experiment or test, when it is too late to correct them. Recognizing that a rapid performance snapshot would be extremely valuable in many situations, the AFRL COMPASE Center developed tools to produce receiver operating characteristic (ROC) curves in near real-time for an advanced technology demonstration (ATD) program. These tools, called real-time (RT-ROC) and identification (ID-ROC), gave the evaluation team timely insight into overall system performance, and when substandard results were obtained, diagnostic tests were initiated to determine the underlying causes. These tools have been experiment demonstrated, allowing the COMPASE team to find and fix a sensor error in a matter of hours. This paper will concentrate on RT-ROC and will address analysis tool requirements, operation of the tool during experiments, a walkthrough of the tool using simulated data, and future uses for this application.

Citation Download Citation

James M. Baumann, James L. Jackson III, Gregory D. Sterling, and Erik P. Blasch "RT-ROC: a near-real-time performance evaluation tool", Proc. SPIE 5807, Automatic Target Recognition XV, (19 May 2005); https://doi.org/10.1117/12.606011

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available