期刊
SWARM AND EVOLUTIONARY COMPUTATION
卷 74, 期 -, 页码 -出版社
ELSEVIER
DOI: 10.1016/j.swevo.2022.101130
关键词
Hyperparameter optimization; Evolutionary algorithms; Global sensitivity analysis; Algorithm design; Algorithm stability analysis
This study conducts a comprehensive sensitivity analysis on the hyperparameters of different optimization algorithms, revealing their influence patterns and interaction effects on algorithm performance, providing guidance for algorithm configuration.
We present a comprehensive global sensitivity analysis of two single-objective and two multi-objective state-of-the-art global optimization evolutionary algorithms as an algorithm configuration problem. That is, we investigate the quality of influence hyperparameters have on the performance of algorithms in terms of their direct effect and interaction effect with other hyperparameters. Using three sensitivity analysis methods, Morris LHS, Morris, and Sobol, to systematically analyze tunable hyperparameters of covariance matrix adaptation evolutionary strategy, differential evolution, non-dominated sorting genetic algorithm III, and multi-objective evolutionary algorithm based on decomposition, the framework reveals the behaviors of hyperparameters to sampling methods and performance metrics. That is, it answers questions like what are hyperparameters influence patterns, how they interact, how much they interact, and how much their direct influence is. Consequently, the ranking of hyper -parameters suggests their order of tuning, and the pattern of influence reveals the stability of the algorithms.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据