Journal
PSYCHOLOGICAL METHODS
Volume 24, Issue 2, Pages 217-235Publisher
AMER PSYCHOLOGICAL ASSOC
DOI: 10.1037/met0000179
Keywords
effect sizes; meta-analysis; single-case research; behavioral observation; alternating renewal process
Categories
Funding
- Institute of Educational Sciences, U.S. Department of Education [R305D160002]
Ask authors/readers for more resources
A wide variety of effect size indices have been proposed for quantifying the magnitude of treatment effects in single-case designs. Commonly used measures include parametric indices such as the standardized mean difference as well as nonoverlap measures such as the percentage of nonoverlapping data, improvement rate difference, and nonoverlap of all pairs. Currently, little is known about the properties of these indices when applied to behavioral data collected by systematic direct observation, even though systematic direct observation is the mast common method for outcome measurement in single-case research. This study uses Monte Carlo simulation to investigate the properties of several widely used single-case effect size measures when applied to systematic direct observation data. Results indicate that the magnitude of the nonoverlap measures and of the standardized mean difference can be strongly influenced by procedural details of the study's design, which is a significant limitation to using these indices as effect sizes for meta-analysis of single-case designs. A less widely used parametric index, the log response ratio. has the advantage of being insensitive to sample size and observation session length, although its magnitude is influenced by the use of partial interval recording.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available