Journal
PATTERN RECOGNITION
Volume 109, Issue -, Pages -Publisher
ELSEVIER SCI LTD
DOI: 10.1016/j.patcog.2020.107608
Keywords
Deep convolutional neural networks; Genetic algorithms; Parameter reduction; Structure optimization; DenseNet
Funding
- Dazhi Scholarship of Guangdong Polytechnic University [991620475]
- Education Dept. of Guangdong Province [2017KCXTD021, 2019KSYS009]
- Guangdong Provincial Key Laboratory Project [2018B030322016]
- Scholarship and Teaching Space Utilization System project from University of Strathclyde
Ask authors/readers for more resources
This paper optimizes the topology of DenseNet using a genetic algorithm to reduce unnecessary convolutional kernels, and also introduces a pretrained weight inheritance method to significantly reduce the time consumption of the genetic process. Experimental results show that the proposed model achieves comparable accuracy to state-of-the-art models while reducing the number of parameters.
Convolutional neural networks (CNNs) have been successfully applied in many computer vision applications [1] , especially in image classification tasks, where most of the structures have been designed manually. With the aid of skip connection and dense connection, the depths of the models are becoming deeper and the filters of layers are getting wider in order to tackle the challenge of large-scale datasets. However, large-scale models in convolutional layers become inefficient due to the redundant channels from input feature maps. In this paper, we aim to automatically optimize the topology of the DenseNet, in which unnecessary convolutional kernels are reduced. To achieve this, we present a training pipeline that generates the network structure using a genetic algorithm. We first propose two encoding methods that can represent the structure of the model using a fixed-length binary string. A three-step based evolutionary process consisting of selection, crossover, and mutation is proposed to optimize the structure. We also present a pretrained weight inheritance method which can largely reduce the total time consumption of the genetic process. Experimental results have demonstrated that our proposed model can achieve comparable accuracy to the state-of-the-art models, across a wide range of image recognition and classification datasets, whilst significantly reducing the number of parameters. (C) 2020 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available