Journal
BEHAVIOR RESEARCH METHODS
Volume 48, Issue 4, Pages 1560-1574Publisher
SPRINGER
DOI: 10.3758/s13428-015-0667-z
Keywords
Common-language effect size; Nonnormal data; Unequal variances; Simulation
Categories
Ask authors/readers for more resources
In psychological science, the new statistics refer to the new statistical practices that focus on effect size (ES) evaluation instead of conventional null-hypothesis significance testing (Cumming, Psychological Science, 25, 7-29, 2014). In a two-independent-samples scenario, Cohen's (1988) standardized mean difference (d) is the most popular ES, but its accuracy relies on two assumptions: normality and homogeneity of variances. Five other ESs-the unscaled robust d (dr*; Hogarty & Kromrey, 2001), scaled robust d (dr; Algina, Keselman, & Penfield, Psychological Methods, 10, 317-328, 2005), point-biserial correlation (r(pb); McGrath & Meyer, Psychological Methods, 11, 386-401, 2006), common-language ES (CL; Cliff, Psychological Bulletin, 114, 494-509, 1993), and nonparametric estimator for CL (A(w); Ruscio, Psychological Methods, 13, 19-30, 2008)may be robust to violations of these assumptions, but no study has systematically evaluated their performance. Thus, in this simulation study the performance of these six ESs was examined across five factors: data distribution, sample, base rate, variance ratio, and sample size. The results showed that A(w) and dr were generally robust to these violations, and A(w) slightly outperformed dr. Implications for the use of A(w) and dr in real-world research are discussed.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available