期刊
PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN
卷 44, 期 1, 页码 16-23出版社
SAGE PUBLICATIONS INC
DOI: 10.1177/0146167217729162
关键词
economics; null hypothesis significance testing; replication crisis; statistics
资金
- U.S. National Science Foundation
- Institute of Education Sciences
- Office of Naval Research
- Defense Advanced Research Projects Agency
A standard mode of inference in social and behavioral science is to establish stylized facts using statistical significance in quantitative studies. However, in a world in which measurements are noisy and effects are small, this will not work: selection on statistical significance leads to effect sizes which are overestimated and often in the wrong direction. After a brief discussion of two examples, one in economics and one in social psychology, we consider the procedural solution of open postpublication review, the design solution of devoting more effort to accurate measurements and within-person comparisons, and the statistical analysis solution of multilevel modeling and reporting all results rather than selection on significance. We argue that the current replication crisis in science arises in part from the ill effects of null hypothesis significance testing being used to study small effects with noisy data. In such settings, apparent success comes easy but truly replicable results require a more serious connection between theory, measurement, and data.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据