CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 12717 > Article
Paper
21 July 2023 Improved differentiable architecture search algorithm
Yuan Gao, Xiaohui Li, Changbao Li, Licai Wang, He Jia
Author Affiliations +
Proceedings Volume 12717, 3rd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2023); 127172F (2023) https://doi.org/10.1117/12.2684758
Event: 3rd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2023), 2023, Wuhan, China
Abstract
As a gradient-guided search method, differentiable architecture search greatly reduces computational costs and improves search speed compared with traditional reinforcement learning methods and evolutionary methods that search for network structures in discrete spaces. However, when the number of search epochs is too large, the searched architecture will contain a lot of skip connections, resulting in a sharp decline in network performance. Aiming at this phenomenon, this paper designs a phased search process. With the deepening of the search stage, different early stopping rules are designed, so that the units located in different positions of the network can present different structures, effectively solving the performance crash problem caused by skip connections. At the same time, the design of edge normalization is introduced on the connection between nodes, and the difference between the weight parameters of different operations is enlarged by improving the loss function, which effectively improves the stability of the architecture search. The experimental results show that this method trades off a small amount of parameters and search time in exchange for an improvement in accuracy, and the verification accuracy on the cifar10 and cifar100 datasets has increased by 0.15% and 1.36%, respectively.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Yuan Gao, Xiaohui Li, Changbao Li, Licai Wang, and He Jia "Improved differentiable architecture search algorithm", Proc. SPIE 12717, 3rd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2023), 127172F (21 July 2023); https://doi.org/10.1117/12.2684758
ACCESS THE FULL ARTICLE
ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
SELECT YOUR INSTITUTION
PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
PERSONAL SIGN IN
No SPIE Account? Create one
PURCHASE THIS CONTENT
SUBSCRIBE TO DIGITAL LIBRARY
50 downloads per 1-year subscription
Members: $195
Non-members: $335 ADD TO CART
25 downloads per 1 - year subscription
Members: $145
Non-members: $250 ADD TO CART
PURCHASE SINGLE ARTICLE
Includes PDF, HTML & Video, when available
Members: $17.00
Non-members: $21.00 ADD TO CART
PROCEEDINGS
 8 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Machine learning
Neural networks
Network architectures
Evolutionary algorithms
Mathematical optimization
Convolution
Deep learning
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top