An Exploratory Landscape Analysis-Based Benchmark Suite

The choice of which objective functions, or benchmark problems, should be used to test an optimization algorithm is a crucial part of the algorithm selection framework. Benchmark suites that are often used in the literature have been shown to exhibit poor coverage of the problem space. Exploratory landscape analysis can be used to quantify characteristics of objective functions. However, exploratory landscape analysis measures are based on samples of the objective function, and there is a lack of work on the appropriate choice of sample size needed to produce reliable measures. This study presents an approach to determine the minimum sample size needed to obtain robust exploratory landscape analysis measures. Based on reliable exploratory landscape analysis measures, a self-organizing feature map is used to cluster a comprehensive set of benchmark functions. From this, a benchmark suite that has better coverage of the single-objective, boundary-constrained problem space is proposed.

Automated summary

This study introduces a method to determine the minimum sample size required for robust exploratory landscape analysis measures, and utilizes self-organizing feature map to cluster a comprehensive set of benchmark functions, proposing a benchmark suite with improved coverage in single-objective, boundary-constrained problem spaces.