Derived operating conditions for classifier performance understanding

Joshua P. Blackburn; Timothy D. Ross; Adam R. Nolan; John C. Mossing; John U. Sherwood; David J. Pikas; Edmund G. Zelnio

doi:10.1117/12.886515

4 May 2011 Derived operating conditions for classifier performance understanding

Joshua P. Blackburn, Timothy D. Ross, Adam R. Nolan, John C. Mossing, John U. Sherwood, David J. Pikas, Edmund G. Zelnio

Author Affiliations +

Proceedings Volume 8051, Algorithms for Synthetic Aperture Radar Imagery XVIII; 805111 (2011) https://doi.org/10.1117/12.886515
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

The target classification algorithm community is making a special effort to explicitly treat operating conditions (OCs) in classifier assessments and performance modeling. This is necessary because humans do not intuitively appreciate what makes classification difficult for computers-it just seems so easy to us. In analyzing OCs, some OCs are more direct or primitive while others are more abstract or integrating. These more abstract or "Derived OCs" provide an intermediate step between direct OCs and classifier performance. Similar to the target, sensor, environment partition of OCs, the AFRL COMPASE Center introduces the "Mossing 3" partition of derived OCs into "Clarity," "Uniqueness," and "Conformity." Clarity is primarily concerned with the relevant information content available in the sensor data. Uniqueness is about the inherent separability between the types of objects to be classified (i.e., the library) and between all those types and objects not known to the classifier. Conformity is about the relationship between the OCs of the test instances and the OCs represented in the library types or training data. Furthermore, by analyzing derived OCs from multiple perspectives, informative subpartitions of the Mossing 3 are created. Clarity measures are well developed, particularly as image quality metrics. The other partitions are less well developed, but relevant work exists and is brought into context. While derived OCs and the Mossing 3 partition are not a complete solution to performance modeling, they help bring in powerful existing technologies and should enrich and facilitate dialogue on classifier performance theory and modeling.

Citation Download Citation

Joshua P. Blackburn, Timothy D. Ross, Adam R. Nolan, John C. Mossing, John U. Sherwood, David J. Pikas, and Edmund G. Zelnio "Derived operating conditions for classifier performance understanding", Proc. SPIE 8051, Algorithms for Synthetic Aperture Radar Imagery XVIII, 805111 (4 May 2011); https://doi.org/10.1117/12.886515

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available