4.6 Article

The process of replication target selection in psychology: what to consider?

Related references

Note: Only part of the references are listed.
Article Psychology, Multidisciplinary

Deciding What to Replicate: A Decision Model for Replication Study Selection Under Resource and Knowledge Constraints

Peder Mortvedt Isager et al.

Summary: This article emphasizes the importance of replication in scientific knowledge and proposes a general rule for selecting replication studies based on their replication value. It discusses the concept of replication value and its relationship with the importance and uncertainty of the study. The article aims to provide theoretical foundations for concrete guidelines on study selection in replication research.

PSYCHOLOGICAL METHODS (2023)

Article Sport Sciences

Proposal of a Selection Protocol for Replication of Studies in Sports and Exercise Science

Jennifer Murphy et al.

Summary: To improve the rigor of science, a collaborative effort is proposed to replicate studies in sports and exercise science, as a large replication project in this field has not been undertaken before. The proposed selection protocol includes multiple criteria for study selection and will assess replication outcomes using a multiple inferential strategy.

SPORTS MEDICINE (2023)

Article Psychology, Multidisciplinary

The Tone Debate: Knowledge, Self, and Social Order

Maarten Derksen et al.

Summary: The replication crisis in psychology has sparked a debate on how to conduct scientific debate effectively and ethically, especially with the increasing use of social technologies like Facebook and Twitter. Psychologists are trying to address this issue with codes of conduct, appeals to virtues like humility, and practices of self-transformation. The polemical style of debate popular in scientific communities is also being questioned by psychologists.

REVIEW OF GENERAL PSYCHOLOGY (2022)

Article Psychology, Clinical

Replication Target Selection in Clinical Psychology: A Bayesian and Qualitative Reevaluation

Merle-Marie Pittelkow et al.

Summary: The study suggests a two-step process for evaluating clinical studies, involving quantitative assessment followed by qualitative evaluation. Analysis of 75 studies found that 45% of effects had ambiguous evidence or no effect, which were then qualitatively assessed by two raters.

CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE (2021)

Article Multidisciplinary Sciences

How best to quantify replication success? A simulation study on the comparison of replication success metrics

Jasmine Muradchanian et al.

Summary: This study is one of the first attempts to compare various quantitative measures of replication success, finding that Bayesian metrics slightly outperform frequentist metrics overall. Generally, meta-analytic approaches seem to slightly outperform single study evaluation metrics, with the exception of cases of extreme publication bias where this pattern reverses.

ROYAL SOCIETY OPEN SCIENCE (2021)

Article Psychology

How Do We Choose Our Giants? Perceptions of Replicability in Psychological Science

Manikya Alister et al.

Summary: Assessing the replicability of research findings is crucial for scientific progress. This study investigated the factors influencing psychological scientists' confidence in replicability and identified six distinct underlying factors. Research practices can impact researchers' perceptions of robustness and it is important to promote practices that enhance replicability for cumulative progress in psychological science.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Editorial Material Psychology, Biological

A consensus-based transparency checklist

Balazs Aczel et al.

NATURE HUMAN BEHAVIOUR (2020)

Article Multidisciplinary Sciences

The effect of preregistration on trust in empirical research findings: results of a registered report

Sarahanne M. Field et al.

ROYAL SOCIETY OPEN SCIENCE (2020)

Article Health Care Sciences & Services

Higher number of items associated with significantly lower response rates in COS Delphi surveys

Elizabeth Gorgon et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2019)

Article Psychology, Multidisciplinary

When and Why to Replicate: As Easy as 1, 2, 3?

Sarahanne M. Field et al.

COLLABRA-PSYCHOLOGY (2019)

Editorial Material Psychology, Biological

Selecting target papers for replication

Anton Kuehberger et al.

BEHAVIORAL AND BRAIN SCIENCES (2018)

Article Psychology, Biological

Improving social and behavioral science by making replication mainstream: A response to commentaries Responses

Rolf A. Zwaan et al.

BEHAVIORAL AND BRAIN SCIENCES (2018)

Editorial Material Psychology, Biological

The costs and benefits of replication studies

Nicholas A. Coles et al.

BEHAVIORAL AND BRAIN SCIENCES (2018)

Editorial Material Psychology, Biological

A Bayesian decision-making framework for replication

Tom E. Hardwicke et al.

BEHAVIORAL AND BRAIN SCIENCES (2018)

Article Psychology

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Richard A. Klein et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2018)

Article Psychology

A Unified Framework to Quantify the Credibility of Scientific Findings

Etienne P. LeBel et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2018)

Review Clinical Neurology

Evidence-Based Psychotherapy: Advantages and Challenges

Sarah C. Cook et al.

NEUROTHERAPEUTICS (2017)

Article Psychology, Multidisciplinary

Registered Replication Report: Rand, Greene, and Nowak (2012)

S. Bouwmeester et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2017)

Review Economics

THE MEANING OF FAILED REPLICATIONS: A REVIEW AND PROPOSAL

Michael A. Clemens

JOURNAL OF ECONOMIC SURVEYS (2017)

Article Education, Scientific Disciplines

Is There a Consensus on Consensus Methodology? Descriptions and Recommendations for Future Consensus Research

Jane Waggoner et al.

ACADEMIC MEDICINE (2016)

Article Psychology, Experimental

Two Bayesian Tests of the GLOMOsys Model

Sarahanne M. Field et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL (2016)

Article Psychology, Social

Reconceptualizing replication as a sequence of different studies: A replication typology

Joachim Hueffmeier et al.

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2016)

Review Psychiatry

Using the Delphi expert consensus method in mental health research

Anthony F. Jorm

AUSTRALIAN AND NEW ZEALAND JOURNAL OF PSYCHIATRY (2015)

Article Multidisciplinary Sciences

Estimating the reproducibility of psychological science

Alexander A. Aarts et al.

SCIENCE (2015)

Article Family Studies

Guidelines for Establishing Reliability When Coding Narrative Data

Moin Syed et al.

EMERGING ADULTHOOD (2015)

Article Criminology & Penology

Replication in criminology: A necessary practice

Susan McNeeley et al.

EUROPEAN JOURNAL OF CRIMINOLOGY (2015)

Article Computer Science, Information Systems

Understanding replication of experiments in software engineering: A classification

Omar S. Gomez et al.

INFORMATION AND SOFTWARE TECHNOLOGY (2014)

Article Psychology, Experimental

Action Video Games Do Not Improve the Speed of Information Processing in Simple Perceptual Tasks

Don van Ravenzwaaij et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL (2014)

Article Psychology, Social

The Replication Recipe: What makes for a convincing replication?

Mark J. Brandt et al.

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2014)

Article Psychology, Multidisciplinary

An Agenda for Purely Confirmatory Research

Eric-Jan Wagenmakers et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Replications in Psychology Research: How Often Do They Really Occur?

Matthew C. Makel et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

Anita Alexander et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Voodoo Correlations Are Everywhere-Not Only in Neuroscience

Klaus Fiedler

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2011)

Article Psychology, Multidisciplinary

Shall We Really Do It Again? The Powerful Concept of Replication Is Neglected in the Social Sciences

Stefan Schmidt

REVIEW OF GENERAL PSYCHOLOGY (2009)

Article Social Sciences, Interdisciplinary

Sampling Knowledge: The Hermeneutics of Snowball Sampling in Qualitative Research

Chaim Noy

INTERNATIONAL JOURNAL OF SOCIAL RESEARCH METHODOLOGY (2008)

Article Medicine, General & Internal

Why most published research findings are false

JPA Ioannidis

PLOS MEDICINE (2005)