Navigation and collision avoidance with human augmented supervisory training and fine tuning via reinforcement learning

Christopher J. Maxey; E. Jared Shamwell

doi:10.1117/12.2518551

13 May 2019 Navigation and collision avoidance with human augmented supervisory training and fine tuning via reinforcement learning

Christopher J. Maxey, E. Jared Shamwell

Author Affiliations +

Proceedings Volume 10982, Micro- and Nanotechnology Sensors, Systems, and Applications XI; 1098228 (2019) https://doi.org/10.1117/12.2518551
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Robust navigation and orientation under complex conditions is a must for autonomous drones operating in new and varied environments. Creating drones with adequate behaviors can be a challenge from both a training standpoint and a generalization standpoint. Using human expertise data is an option to help bootstrap the learning process; however, using the human data can lead to side consequences that are not immediately intuitive. This study focuses on applying varying levels of human input to an agent to determine how this input affects the agent's performance. The Unreal Engine and the Airsim plugin are used to train a quadcopter agent in an abstract "blocks world" type environment. Six agents in total are trained, with the first five having increasing amounts of human input and the sixth agent having no human input. A variety of metrics are looked at, including total goals achieved and time to achieve some number of goals.

Citation Download Citation

Christopher J. Maxey and E. Jared Shamwell "Navigation and collision avoidance with human augmented supervisory training and fine tuning via reinforcement learning", Proc. SPIE 10982, Micro- and Nanotechnology Sensors, Systems, and Applications XI, 1098228 (13 May 2019); https://doi.org/10.1117/12.2518551

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available