4.7 Article

A prescription of methodological guidelines for comparing bio-inspired optimization algorithms

Journal

SWARM AND EVOLUTIONARY COMPUTATION
Volume 67, Issue -, Pages -

Publisher

ELSEVIER
DOI: 10.1016/j.swevo.2021.100973

Keywords

Bio-inspired optimization; Benchmarking; Parameter tuning; Comparison methodologies; Statistical analysis; Recommendations review; Guidelines

Funding

  1. Spanish Ministry of Science [TIN2016-8113-R, TIN2017-89517-P, TIN2017-83132-C2-2-R]
  2. Universidad Politecnica de Madrid [PINV-18-XEOGHQ-19-4QTEBP]
  3. Basque Government [IT1294-19]
  4. Department of Education of the Basque Government

Ask authors/readers for more resources

Bio-inspired optimization is a growing research field where proposing a new algorithm with significant advancement over previous ones is challenging. Selecting appropriate benchmarks for comparison and conducting rigorous validation processes are crucial for ensuring the significance of the results presented in studies. This work reviews recommendations and proposes methodological guidelines to help authors, reviewers, and editors in evaluating new contributions to the field.
Bio-inspired optimization (including Evolutionary Computation and Swarm Intelligence) is a growing research topic with many competitive bio-inspired algorithms being proposed every year. In such an active area, preparing a successful proposal of a new bio-inspired algorithm is not an easy task. Given the maturity of this research field, proposing a new optimization technique with innovative elements is no longer enough. Apart from the novelty, results reported by the authors should be proven to achieve a significant advance over previous outcomes from the state of the art. Unfortunately, not all new proposals deal with this requirement properly. Some of them fail to select appropriate benchmarks or reference algorithms to compare with. In other cases, the validation process carried out is not defined in a principled way (or is even not done at all). Consequently, the significance of the results presented in such studies cannot be guaranteed. In this work we review several recommendations in the literature and propose methodological guidelines to prepare a successful proposal, taking all these issues into account. We expect these guidelines to be useful not only for authors, but also for reviewers and editors along their assessment of new contributions to the field.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available