Evolution of hardware-aware neural architecture search (NAS) on the edge

Blake Richey; Mitchell Clay; Christos Grecos; Mukul Shirvaikar

doi:10.1117/12.2664894

13 June 2023 Evolution of hardware-aware neural architecture search (NAS) on the edge

Blake Richey, Mitchell Clay, Christos Grecos, Mukul Shirvaikar

Proceedings Volume 12528, Real-Time Image Processing and Deep Learning 2023; 125280A (2023) https://doi.org/10.1117/12.2664894
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Neural Architecture Search (NAS) is a method of autonomously designing deep learning models to achieve top performance for tasks such as data classification and data retrieval by using defined search spaces and strategies. These strategies have demonstrated improvements in a variety of tasks over ad-hoc deep neural architectures, but have presented unique challenges related to bias in search spaces, the intensive training requirements of various search strategies, and inefficient model performance evaluation. These challenges have been a primary focus for NAS research until recently. However, artificial intelligence (AI) on the edge has emerged as a significant area of research and producing models that achieve top performance on small devices with limited resources has become a priority. NAS research has primarily been focused on improving models by using more diverse search spaces, improving search strategies, and evaluating models faster. A limitation when applied to edge devices is that NAS has historically been finding superior deep neural networks that have become increasingly more difficult to port to embedded devices due to memory limitations, computational bottlenecks, latency requirements, and power restrictions. In recent years, researchers have begun to consider these limitations and develop methods for porting deep neural networks to these embedded devices, but few methods have incorporated the device itself in the training process efficiently. In this paper, we compile a list of methods actively being explored and discuss their limitations. We also present our evidence in support of the use of genetic algorithms as a method for hardware-aware NAS that efficiently considers hardware, power, and latency requirements during training.

Conference Presentation

Citation Download Citation

Blake Richey, Mitchell Clay, Christos Grecos, and Mukul Shirvaikar "Evolution of hardware-aware neural architecture search (NAS) on the edge", Proc. SPIE 12528, Real-Time Image Processing and Deep Learning 2023, 125280A (13 June 2023); https://doi.org/10.1117/12.2664894

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available