Bias and precision of some classical ANOVA effect sizes when assumptions are violated

Previous simulation research has focused on evaluating the impact of analytic assumption violations on statistics related to the F test and associated p(CALCULATED) values. The present article evaluated the bias of classical estimates of practical significance (i.e., effect size sample estimators (eta) over cap (2), (epsilon) over cap (2), and (omega) over cap (2)) in a one-way between-subjects univariate ANOVA when assumptions are violated. The simulation conditions modeled were selected on the basis of prior empirical research. Estimated (1) sampling error bias and (2) precision computed for each of the three effect size estimates for the 5,000 samples drawn for each of the 270 (5 parameter Cohen's d values x 3 group size ratios x 3 population distribution shapes x 3 variance ratios x 2 total ns) conditions were modeled for each of the k = 2, 3, and 4 group analyses. Our results corroborate the limited previous related research and suggest that (eta) over cap2 should not be used as an ANOVA effect size estimator, even though (eta) over cap (2) is the only available choice in the menus in most commonly available software.