Online gaming for learning optimal team strategies in real time

Gregory Hudas; F. L. Lewis; K. G. Vamvoudakis

doi:10.1117/12.850231

22 April 2010 Online gaming for learning optimal team strategies in real time

Gregory Hudas, F. L. Lewis, K. G. Vamvoudakis

Proceedings Volume 7692, Unmanned Systems Technology XII; 76920W (2010) https://doi.org/10.1117/12.850231
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

This paper first presents an overall view for dynamical decision-making in teams, both cooperative and competitive. Strategies for team decision problems, including optimal control, zero-sum 2-player games (H-infinity control) and so on are normally solved for off-line by solving associated matrix equations such as the Riccati equation. However, using that approach, players cannot change their objectives online in real time without calling for a completely new off-line solution for the new strategies. Therefore, in this paper we give a method for learning optimal team strategies online in real time as team dynamical play unfolds. In the linear quadratic regulator case, for instance, the method learns the Riccati equation solution online without ever solving the Riccati equation. This allows for truly dynamical team decisions where objective functions can change in real time and the system dynamics can be time-varying.

Citation Download Citation

Gregory Hudas, F. L. Lewis, and K. G. Vamvoudakis "Online gaming for learning optimal team strategies in real time", Proc. SPIE 7692, Unmanned Systems Technology XII, 76920W (22 April 2010); https://doi.org/10.1117/12.850231

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available