In-the-loop training algorithm for neural network implementation with digital weights

Jinming Yang; Graham A. Jullien; Majid A. Ahmadi; W. C. Miller

doi:10.1117/12.326913

9 October 1998 In-the-loop training algorithm for neural network implementation with digital weights

Jinming Yang, Graham A. Jullien, Majid A. Ahmadi, W. C. Miller

Proceedings Volume 3517, Intelligent Systems in Design and Manufacturing; (1998) https://doi.org/10.1117/12.326913
Event: Photonics East (ISAM, VVDC, IEMB), 1998, Boston, MA, United States

Abstract

In this paper, we propose a training algorithm for VLSI neural networks with digital weights and analog neurons using in-the-loop training strategy. The use of digital weights in a neural network implementation imposes new issues that are not present in simulation environments. One of the problems is that a neural network implementation will not work properly when using the digitized version of the continuous weight solution. This phenomenon is especially evident when the digital weight resolution is very low due to some fabrication constraints. In this paper the training strategies for dealing with digital weights are investigated. The proposed training algorithm is by measuring the sensitivity of each weight to its error function and then by perturbing the weights of higher sensitivity values to perform retraining process. Our experimental results indicate that the algorithm is feasible and particularly suitable for the digital weights with low number of bits.

Citation Download Citation

Jinming Yang, Graham A. Jullien, Majid A. Ahmadi, and W. C. Miller "In-the-loop training algorithm for neural network implementation with digital weights", Proc. SPIE 3517, Intelligent Systems in Design and Manufacturing, (9 October 1998); https://doi.org/10.1117/12.326913

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available