期刊
GENETIC PROGRAMMING AND EVOLVABLE MACHINES
卷 20, 期 1, 页码 5-35出版社
SPRINGER
DOI: 10.1007/s10710-018-9339-y
关键词
Automated machine learning; NeuroEvolution; Deep neural networks; Convolutional neural networks; Dynamic structured grammatical evolution
资金
- FundacAo para a Ciencia e Tecnologia (FCT), Portugal [SFRH/BD/114865/2016]
- Fundação para a Ciência e a Tecnologia [SFRH/BD/114865/2016] Funding Source: FCT
Deep evolutionary network structured representation (DENSER) is a novel evolutionary approach for the automatic generation of deep neural networks (DNNs) which combines the principles of genetic algorithms (GAs) with those of dynamic structured grammatical evolution (DSGE). The GA-level encodes the macro structure of evolution, i.e., the layers, learning, and/or data augmentation methods (among others); the DSGE-level specifies the parameters of each GA evolutionary unit and the valid range of the parameters. The use of a grammar makes DENSER a general purpose framework for generating DNNs: one just needs to adapt the grammar to be able to deal with different network and layer types, problems, or even to change the range of the parameters. DENSER is tested on the automatic generation of convolutional neural networks (CNNs) for the CIFAR-10 dataset, with the best performing networks reaching accuracies of up to 95.22%. Furthermore, we take the fittest networks evolved on the CIFAR-10, and apply them to classify MNIST, Fashion-MNIST, SVHN, Rectangles, and CIFAR-100. The results show that the DNNs discovered by DENSER during evolution generalise, are robust, and scale. The most impressive result is the 78.75% classification accuracy on the CIFAR-100 dataset, which, to the best of our knowledge, sets a new state-of-the-art on methods that seek to automatically design CNNs.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据