A real-time object detection framework for aerial imagery using deep neural networks and synthetic training images

Priya Narayanan; Christoph Borel-Donohue; Hyungtae Lee; Heesung Kwon; Raghuveer Rao

doi:10.1117/12.2306154

27 April 2018 A real-time object detection framework for aerial imagery using deep neural networks and synthetic training images

Priya Narayanan, Christoph Borel-Donohue, Hyungtae Lee, Heesung Kwon, Raghuveer Rao

Author Affiliations +

Proceedings Volume 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII; 1064614 (2018) https://doi.org/10.1117/12.2306154
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

Efficient and accurate real-time perception systems are critical for Unmanned Aerial Vehicle (UAV) applications that aim to provide enhanced situational awareness to users. Specifically, object recognition is a crucial element for surveillance and reconnaissance missions since it provides fundamental semantic information of the aerial scene. In this study, we describe the development and implementation of a perception frame-work on an embedded computer vision platform, mounted on a hexacopter for real-time object detection. The framework includes a camera driver and a deep neural network based object detection module and has distributed computing capabilities between the aerial platform and the corresponding ground station. Preliminary aerial real-time object detections using YOLO are performed onboard a UAV and a sequence of images are streamed to the base station where an advanced computer vision algorithm, referred to as Multi-Expert Region-based CNN (ME- RCNN), is leveraged to provide enhanced and fine-grained analytics on the aerial video feeds. Since annotated aerial imagery in the UAV domain is hard to obtain and not routinely available, we use a combination of aerial data as well as air-to-ground synthetic images, such as vehicles, generated by video gaming engines for training the neural network. Through this study, we quantify the level of improvements with the use of the synthetic dataset and the efficacy of using advanced object detection algorithms.

Conference Presentation

Citation Download Citation

Priya Narayanan, Christoph Borel-Donohue, Hyungtae Lee, Heesung Kwon, and Raghuveer Rao "A real-time object detection framework for aerial imagery using deep neural networks and synthetic training images", Proc. SPIE 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII, 1064614 (27 April 2018); https://doi.org/10.1117/12.2306154

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available