期刊
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL
卷 146, 期 9, 页码 1223-1233出版社
AMER PSYCHOLOGICAL ASSOC
DOI: 10.1037/xge0000324
关键词
publication bias; p-hacking; p-curve; Bayesian mixture model
资金
- Netherlands Organization for Scientific Research (NWO) grant [406.16.528]
- European Research Council (ERC) grant [283876]
Publication bias and questionable research practices have long been known to corrupt the published record. One method to assess the extent of this corruption is to examine the meta-analytic collection of significant p values, the so-called p-curve (Simonsohn, Nelson, & Simmons, 2014a). Inspired by statistical research on false-discovery rates, we propose a Bayesian mixture model analysis of the p-curve. Our mixture model assumes that significant p values arise either from the null-hypothesis H-0 (when their distribution is uniform) or from the alternative hypothesis H-1 (when their distribution is accounted for by a simple parametric model). The mixture model estimates the proportion of significant results that originate from H-0, but it also estimates the probability that each specific p value originates from H-0. We apply our model to 2 examples. The first concerns the set of 587 significant p values for all t tests published in the 2007 volumes of Psychonomic Bulletin & Review and the Journal of Experimental Psychology: Learning, Memory, and Cognition; the mixture model reveals that p values higher than about. 005 are more likely to stem from H-0 than from H-1. The second example concerns 159 significant p values from studies on social priming and 130 from yoked control studies. The results from the yoked controls confirm the findings from the first example, whereas the results from the social priming studies are difficult to interpret because they are sensitive to the prior specification. To maximize accessibility, we provide a web application that allows researchers to apply the mixture model to any set of significant p values.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据