4.4 Article

Small Effects: The Indispensable Foundation for a Cumulative Psychological Science

Journal

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE
Volume 17, Issue 1, Pages 205-215

Publisher

SAGE PUBLICATIONS LTD
DOI: 10.1177/1745691620984483

Keywords

small effects; research culture; questionable research practices; scientific community

Funding

  1. Economic and Social Research Council PhD Scholarship
  2. Cambridge Commonwealth, European and International Trust

Ask authors/readers for more resources

Research indicates that complex psychological phenomena are influenced by multiple causes, each having a small effect. However, the current publication culture values large effects while overlooking small yet real effects. These small effects can have significant consequences when considered at scale and over time. Utilizing big data, machine learning, and changing cultural norms can help advance psychology research and practices.
We draw on genetics research to argue that complex psychological phenomena are most likely determined by a multitude of causes and that any individual cause is likely to have only a small effect. Building on this, we highlight the dangers of a publication culture that continues to demand large effects. First, it rewards inflated effects that are unlikely to be real and encourages practices likely to yield such effects. Second, it overlooks the small effects that are most likely to be real, hindering attempts to identify and understand the actual determinants of complex psychological phenomena. We then explain the theoretical and practical relevance of small effects, which can have substantial consequences, especially when considered at scale and over time. Finally, we suggest ways in which scholars can harness these insights to advance research and practices in psychology (i.e., leveraging the power of big data, machine learning, and crowdsourcing science; promoting rigorous preregistration, including prespecifying the smallest effect size of interest; contextualizing effects; changing cultural norms to reward accurate and meaningful effects rather than exaggerated and unreliable effects). Only once small effects are accepted as the norm, rather than the exception, can a reliable and reproducible cumulative psychological science be built.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.4
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available