An Improved Cuckoo Search Algorithm for Optimization of Artificial Neural Network Training

Artificial neural networks are widely used for solving engineering design problems of various disciplines due to its simplicity, efficiency, and adaptability. It predicts promising and accurate results. Artificial neural network solves these problems with weights and biases obtained in the training process. In training, the weights and biases have to be updated such that the difference between predicted and actual values has to be minimized. The artificial neural network uses stochastic gradient steepest descent methods to update the weights and biases for optimizing it. These methods are good at finding the optimum solution. However, they suffer from the drawbacks of vanishing gradient at local minima and critical points and are sensitive to initial weights and biases. As a result, it falls into local minima, the training time becomes high, and accuracy becomes low. One of the best solutions to overcome these problems is to use metaheuristics algorithms instead of stochastic gradient descent methods. Among metaheuristics, the cuckoo search algorithm is widely used in many applications due to its simplicity and efficiency. In this work, we proposed an improved Cuckoo search algorithm by incorporating Voronoi diagram with Cuckoo search to strengthen the weak areas of Cuckoo search and to overcome the addressed problems of the artificial neural network. The proposed Cuckoo search algorithm performance is tested on higher dimensional benchmark functions and on benchmark data sets. Moreover, its performance is compared with variants of Cuckoo search and other metaheuristic algorithms. The proposed algorithm has shown better results in terms of the number of generations, accuracy, cross-entropy, and root mean square error (RMSE).

Automated summary

Artificial neural networks are widely used for solving engineering design problems due to their simplicity, efficiency, and adaptability. However, stochastic gradient descent methods suffer from issues such as vanishing gradient and sensitivity to initial weights and biases. The cuckoo search algorithm, a simple and efficient metaheuristic algorithm, can be used to overcome these problems.