How to practically deploy deep neural networks to distributed network environments for scene perception

Hyungtae Lee; Heesung Kwon

doi:10.1117/12.2519885

10 May 2019 How to practically deploy deep neural networks to distributed network environments for scene perception

Hyungtae Lee, Heesung Kwon

Proceedings Volume 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications; 110061R (2019) https://doi.org/10.1117/12.2519885
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Recently, intelligent machine agents, such as a deep neural network (DNN), have been showing unparalleled capabilities in recognizing visual patterns, objects, semantic activities/events embedded in real-world images and videos. Hence, there has been an increasing need to deploy DNNs, to a battlefield to provide the Solider with realtime situational understanding by capturing a holistic view of battlespace. Soldiers engaged in tactical operations can greatly benefit from leveraging advanced at-the-point-of-need data analytics running on multimodal and heterogeneous platforms in distributed and constrained network environments. The proposed work aims to decompose DNNs and then distribute over edge nodes in such a way that a trade-off between resources available in the constrained network and recognition performance can be optimized. In this work, we decompose DNNs into two stages: an initial stage on an edge device and the remaining portion running on an edge cloud. To effectively and efficiently divide DNNs into two separate stages, we will rigorously analyze multiple widely used DNN architectures with respect to its memory size and FLOPs (Floating Point Operations) per each layer. Based on these analyses, we will develop advanced splitting strategies for DNNs to handle various network constraints.

Citation Download Citation

Hyungtae Lee and Heesung Kwon "How to practically deploy deep neural networks to distributed network environments for scene perception", Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 110061R (10 May 2019); https://doi.org/10.1117/12.2519885

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available