期刊
AMERICAN JOURNAL OF EVALUATION
卷 35, 期 3, 页码 311-327出版社
SAGE PUBLICATIONS INC
DOI: 10.1177/1098214014527337
关键词
interrupted time series; educational evaluation; within-study comparison; randomized clinical trial
资金
- Direct For Education and Human Resources
- Division Of Graduate Education [1228866] Funding Source: National Science Foundation
Although evaluators often use an interrupted time series (ITS) design to test hypotheses about program effects, there are few empirical tests of the design's validity. We take a randomized experiment on an educational topic and compare its effects to those from a comparative ITS (CITS) design that uses the same treatment group as the experiment but a nonequivalent comparison group that is assessed at six time points before treatment. We estimate program effects with and without matching of the comparison schools, and we also systematically vary the number of pretest time points in the analysis. CITS designs produce impact estimates that are extremely close to the experimental benchmarks and, as implemented here, do so equally well with and without matching. Adding time points provides an advantage so long as the pretest trend differences in the treatment and comparison groups are correctly modeled. Otherwise, more time points can increase bias.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据