4.0 Article

Impact evaluation in field settings: experience from a complex NGO programme in Ethiopia

期刊

JOURNAL OF DEVELOPMENT EFFECTIVENESS
卷 4, 期 4, 页码 566-577

出版社

ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD
DOI: 10.1080/19439342.2012.725085

关键词

impact evaluation; operational settings; lessons learnt; Ethiopia

向作者/读者索取更多资源

Evidence from impact evaluations of community-based nutrition interventions addressing the question of what works to reduce linear growth retardation (stunting) is growing but consensus is mixed. Whilst the number of such impact evaluations is increasing, especially by non-governmental organisations, many studies fail to be publicised due to unclear and/or limited positive outcomes, denying experiences of lessons learnt. Those that are published need to be scrutinised to understand the methods used in deciding the validity of the reported outcomes, since impact evaluations in operation settings can suffer a number of limitations. The author uses as an example an integrated community-based non-randomised controlled impact evaluation to highlight some of the problems and issues encountered in carrying out impact evaluations in operational settings and how results need careful interpretation. In this Save the Children UK study, the only intervention to show a positive significant impact in reducing linear growth retardation (stunting) in children 636 months was water, sanitation and hygiene. A comprehensive analysis of the nature, reliability and robustness of the study was necessary to determine the validity of the results. This article looks at the important factors that may have been influential in these outcomes, including key issues generally faced in impact evaluations that threaten both the external and internal validity through bias, confounding, contamination and spillover effects as well as implementation problems encountered. The main issues in this evaluation were lack of randomisation and power, alongside implementation issues, resulting in potential confounding and bias possibly producing spurious results. Agencies involved in community-based impact evaluations should engage in robust methods and systematic reporting to create a stronger evidence base and as such be prepared to increase the transparency of their work.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.0
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据