4.7 Article

Efficient Self-learning Evolutionary Neural Architecture Search

期刊

APPLIED SOFT COMPUTING
卷 146, 期 -, 页码 -

出版社

ELSEVIER
DOI: 10.1016/j.asoc.2023.110671

关键词

Evolutionary algorithm; Neural architecture search; Probability distribution; Model size control

向作者/读者索取更多资源

This article presents a method called Efficient Self-learning Evolutionary Neural Architecture Search (ESE-NAS) that overcomes the challenges of traditional evolutionary algorithms. It uses an adaptive learning strategy and a performance predictor to guide the search process and improve efficiency.
The evolutionary algorithm has become a major method for neural architecture search recently. However, the fixed probability distribution employed by the traditional evolutionary algorithm may lead to structural complexity and redundancy due to its inability to control the size of individual architectures, and it cannot learn from empirical information gathered during the search process to guide the subsequent search more effectively and efficiently. Moreover, evaluating the performance of all the searched architectures requires significant computing resources and time overhead. To overcome these challenges, we present the Efficient Self-learning Evolutionary Neural Architecture Search (ESE-NAS) method. Firstly, we propose an Adaptive Learning Strategy for Mutation Sampling, composed of a Model Size Control module and a Credit Assignment method for Mutation Candidates, to guide the search process by learning from the model size information and evaluation results of the architectures and adjusting the probability distributions for evolution sampling accordingly. Additionally, we developed a neural architecture performance predictor to further improve the efficiency of NAS. Experiments on CIFAR-10 and CIFAR-100 datasets show that ESE-NAS significantly brings forward the first hitting time of the optimal architectures and reaches a competitive performance level with classic manual-designed and NAS models while maintaining structural simplicity and efficiency.& COPY; 2023 Published by Elsevier B.V.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据