Intelligence augmentation for urban warfare operation planning using deep reinforcement learning

Paolo B. U. L. de Heer; Nico M. de Reus; Lucia Tealdi; Philip J. M. Kerbusch

doi:10.1117/12.2520051

10 May 2019 Intelligence augmentation for urban warfare operation planning using deep reinforcement learning

Paolo B. U. L. de Heer, Nico M. de Reus, Lucia Tealdi, Philip J. M. Kerbusch

Proceedings Volume 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications; 1100611 (2019) https://doi.org/10.1117/12.2520051
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

The density, diversity, connectedness and scale of urban environments make military operations challenging. This paper shows that different artificial intelligence techniques can be combined to provide the commander with various form of intelligence augmentation and to support the decision making process. A warfare model has been developed where an AI system, representing a red unit, learns how to select the position for a target and for several improvised explosive devices (IEDs) in order to prevent the blue unit to locate the target. The blue unit is trained to reach the target by using deep reinforcement learning, while an evolutionary algorithm is used to train the red unit. These techniques do not rely on large amounts of historical data. Different approaches have been used and discussed to optimise the co-learning of the two agents, showing that optimal behaviour can be learned in an urban environment. Information about the most likely positions of the target and the IEDs can be extracted from the policy learned by the system, and used by the commander to provide intelligence augmentation while planning an operation and evaluating different possible courses of action. The reliability of this information depends on the realism of the AI system simulating the red unit, that is strictly dependent on the model used for the blue unit during the training.

Conference Presentation

Citation Download Citation

Paolo B. U. L. de Heer, Nico M. de Reus, Lucia Tealdi, and Philip J. M. Kerbusch "Intelligence augmentation for urban warfare operation planning using deep reinforcement learning", Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 1100611 (10 May 2019); https://doi.org/10.1117/12.2520051

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available