4.6 Review

Replicability, Robustness, and Reproducibility in Psychological Science

Journal

ANNUAL REVIEW OF PSYCHOLOGY
Volume 73, Issue -, Pages 719-748

Publisher

ANNUAL REVIEWS
DOI: 10.1146/annurev-psych-020821-114157

Keywords

replication; reproducibility; robustness; generalizability; research methods; statistical inference; validity; theory; metascience

Funding

  1. Arnold Ventures
  2. John Templeton Foundation
  3. Templeton World Charity Foundation
  4. Templeton Religion Trust
  5. European Union [841188]
  6. Australian Research Council Future Fellowship [FT150100297]
  7. Dutch Research Council (NWO) on Increasing the Reliability and Efficiency of Psychological Science
  8. National Institutes of Health
  9. Agency for Healthcare Research and Quality
  10. Patient-Centered Outcomes Research Institute
  11. Marie Curie Actions (MSCA) [841188] Funding Source: Marie Curie Actions (MSCA)
  12. Australian Research Council [FT150100297] Funding Source: Australian Research Council

Ask authors/readers for more resources

Replication is an important and often misunderstood practice in psychology, which is gaining more recognition. It is crucial for research progress as it allows for the validation and development of theories. Assessing replicability is productive for generating and testing hypotheses, identifying weaknesses, and promoting innovation. In recent years, replication projects have revealed failures to replicate many published findings and highlighted sociocultural challenges, ultimately prompting improvements in research practices.
Replication-an important, uncommon, and misunderstood practice-is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available