Beyond Standardization: Improving External Validity and Reproducibility in Experimental Evolution

Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution.

Automated summary

Discussions on reproducibility in the life sciences are raising doubts about the credibility of experimental outcomes. Experimental evolution, often excluded from these discussions, also faces issues with reproducibility due to contingencies affecting the evolutionary process. While standardization is commonly seen as a solution for internal validity in experimental studies, it may reduce external validity and reproducibility. Alternative approaches, such as systematic heterogenization of experimental factors, are proposed as promising solutions, drawing insights from animal research and ecology.