Exploring the two-stage approach in neural network compression for object detection

Xiao Meng; Lixin Yu D.D.S.; Zhiyong Qin D.D.S.

doi:10.1117/12.2522911

15 March 2019 Exploring the two-stage approach in neural network compression for object detection

Xiao Meng, Lixin Yu D.D.S., Zhiyong Qin D.D.S.

Proceedings Volume 11041, Eleventh International Conference on Machine Vision (ICMV 2018); 110411W (2019) https://doi.org/10.1117/12.2522911
Event: Eleventh International Conference on Machine Vision (ICMV 2018), 2018, Munich, Germany

Abstract

Recently, convolutional neural network (CNN) has been widely implemented in the compute vision, nature language processing and automatic driving. However, it makes much difficulties to employ the neural network in the embedded system because of the limit of memory storage and the computation bandwidth. To address those limitations, we explore a two-stage approach in neural network compression for the scene, object detection. In this paper, we first propose an effective pruning approach on a trained neural network, and achieve total 81.86%-91.54% sparse rate with the accuracy losing 1-3%. Then we explore the quantization method to apply on the pruned neural network, and propose an adaptive codebook to store the quantized weight parameters and the index of the weight parameters. We utilize the two-stage model compression approach, model pruning and weights quantization, to implement on tiny-YOLO, the state-of-art object detection model, achieving total 41.9-62.7X compression rate with the accuracy loss less than 3.3%.

Citation Download Citation

Xiao Meng, Lixin Yu D.D.S., and Zhiyong Qin D.D.S. "Exploring the two-stage approach in neural network compression for object detection", Proc. SPIE 11041, Eleventh International Conference on Machine Vision (ICMV 2018), 110411W (15 March 2019); https://doi.org/10.1117/12.2522911

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available