PAHD: perception-action-based human decision making using explainable graph neural networks on SAR images

Sasindu Wijeratne; Bingyi Zhang; Rajgopal Kannan; Viktor Prasanna; Carl Busart

doi:10.1117/12.2663699

13 June 2023 PAHD: perception-action-based human decision making using explainable graph neural networks on SAR images

Sasindu Wijeratne, Bingyi Zhang, Rajgopal Kannan, Viktor Prasanna, Carl Busart

Proceedings Volume 12521, Automatic Target Recognition XXXIII; 125210D (2023) https://doi.org/10.1117/12.2663699
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Synthetic Aperture Radar (SAR) images are commonly utilized in military applications for automatic target recognition (ATR). Machine learning (ML) methods, such as Convolutional Neural Networks (CNN) and Graph Neural Networks (GNN), are frequently used to identify ground-based objects, including battle tanks, personnel carriers, and missile launchers. Determining the vehicle class, such as the BRDM2 tank, BMP2 tank, BTR60 tank, and BTR70 tank, is crucial, as it can help determine whether the target object is an ally or an enemy. While the ML algorithm provides feedback on the recognized target, the final decision is left to the commanding officers. Therefore, providing detailed information alongside the identified target can significantly impact their actions. This detailed information includes the SAR image features that contributed to the classification, the classification confidence, and the probability of the identified object being classified as a different object type or class. We propose a GNN-based ATR framework that provides the final classified class and outputs the detailed information mentioned above. This is the first study to provide a detailed analysis of the classification class, making final decisions more straightforward. Moreover, our GNN framework achieves an overall accuracy of 99.2% when evaluated on the MSTAR dataset, improving over previous state-of-the-art GNN methods.

Conference Presentation

Citation Download Citation

Sasindu Wijeratne, Bingyi Zhang, Rajgopal Kannan, Viktor Prasanna, and Carl Busart "PAHD: perception-action-based human decision making using explainable graph neural networks on SAR images", Proc. SPIE 12521, Automatic Target Recognition XXXIII, 125210D (13 June 2023); https://doi.org/10.1117/12.2663699

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available