4.7 Article

Reducing bias, increasing transparency and calibrating confidence with preregistration

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Editorial Material Psychology, Biological

Lessons learnt from registration of biomedical research

Stylianos Serghiou et al.

Summary: Registration has been suggested as a potential solution to address the reproducibility crisis in scientific research. Despite its valuable role in biomedical research for over 20 years, registration is mostly limited to clinical trials and lacks consistent implementation.

NATURE HUMAN BEHAVIOUR (2023)

Article Political Science

Pre-Analysis Plans: An Early Stocktaking

George K. Ofosu et al.

Summary: This study examines a sample of 195 PAPs and finds significant variation in their ability to achieve pre-registered goals. It highlights the need for strengthening norms and institutions to enhance the credibility of research.

PERSPECTIVES ON POLITICS (2023)

Article Psychology, Experimental

Outlier Exclusion Procedures Must Be Blind to the Researcher's Hypothesis

Quentin Andre

Summary: Researchers should be cautious when choosing to exclude outliers, as condition-level exclusions may lead to inflated false-positive rates. The study highlights the importance of blind outlier exclusion procedures to avoid Type I errors.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL (2022)

Review Psychology

Replicability, Robustness, and Reproducibility in Psychological Science

Brian A. Nosek et al.

Summary: Replication is an important and often misunderstood practice in psychology, which is gaining more recognition. It is crucial for research progress as it allows for the validation and development of theories. Assessing replicability is productive for generating and testing hypotheses, identifying weaknesses, and promoting innovation. In recent years, replication projects have revealed failures to replicate many published findings and highlighted sociocultural challenges, ultimately prompting improvements in research practices.

ANNUAL REVIEW OF PSYCHOLOGY (2022)

Article Public, Environmental & Occupational Health

Protecting against researcher bias in secondary data analysis: challenges and potential solutions

Jessie R. Baldwin et al.

Summary: This article discusses the problems that researcher biases can cause in secondary data analysis and proposes solutions and alternative approaches. These solutions include addressing biases related to prior knowledge of the data, enabling pre-registration of non-hypothesis-driven research, ensuring that pre-registered analyses are appropriate for the data, and addressing difficulties arising from reduced analytical flexibility. Implementing these practices can protect against researcher biases in secondary data analysis and improve the robustness of research based on existing data.

EUROPEAN JOURNAL OF EPIDEMIOLOGY (2022)

Review Psychology, Biological

The past, present and future of Registered Reports

Christopher D. Chambers et al.

Summary: Registered Reports were introduced a decade ago to improve the rigour and credibility of confirmatory research by peer reviewing study proposals before research is undertaken. While they are not a universal solution for irreproducibility, early evidence suggests that Registered Reports are working as intended and are promoting reproducibility, transparency, and self-correction across disciplines. The policies and practices surrounding Registered Reports are evolving to address limitations and adapt to new challenges.

NATURE HUMAN BEHAVIOUR (2022)

Article Psychology, Multidisciplinary

Understanding the Exploratory/Confirmatory Data Analysis Continuum: Moving Beyond the Replication Crisis

Dustin A. Fife et al.

Summary: Researchers argue that the appropriate data analytic approach depends on the intentions and transparency of the research. Many believe that exploratory data analysis can provide more flexibility and creativity, but potential risks should be considered as well.

AMERICAN PSYCHOLOGIST (2022)

Article Psychology, Multidisciplinary

A Template for Preregistration of Quantitative Research in Psychology: Report of the Joint Psychological Societies Preregistration Task Force

Michael Bosnjak et al.

Summary: This article introduces the PRP-QUANT template for preregistration of quantitative research in psychology, developed by a joint Task Force of the American Psychological Association, the British Psychological Society, and the German Psychological Society. The use of this template will benefit researchers, authors, funders, and other stakeholders, promoting preregistration practices and knowledge-sharing in the field of psychology.

AMERICAN PSYCHOLOGIST (2022)

Article Multidisciplinary Sciences

A survey on how preregistration affects the research workflow: better science but more work

Alexandra Sarafoglou et al.

Summary: The pre-registration of research protocols and analysis plans is a significant reform innovation in the social and behavioral sciences to address confirmation bias. This exploratory study surveyed 355 researchers, 299 of whom had utilized pre-registration in their work. The results showed that the majority of researchers perceived pre-registration as improving the quality of their projects, although some expressed concerns about increased work-related stress and project duration.

ROYAL SOCIETY OPEN SCIENCE (2022)

Review Multidisciplinary Sciences

Discrepancy review: a feasibility study of a novel peer review intervention to reduce undisclosed discrepancies between registrations and publications

Robert T. Thibault et al.

Summary: Undisclosed discrepancies between study registrations and publications can increase bias risk and deceive readers. To address this issue, an intervention called discrepancy review was developed and implemented in two journals, showing its feasibility as a regular practice.

ROYAL SOCIETY OPEN SCIENCE (2022)

Article Psychology, Multidisciplinary

Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014-2017)

Tom E. Hardwicke et al.

Summary: A manual examination of 250 psychology articles published between 2014 and 2017 found that while over half of the articles were publicly available, sharing of research materials, preregistration, and other transparency and reproducibility-related research practices were rare. This suggests that these practices are far from routine in psychology research, highlighting the need for further efforts to increase credibility and utility.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2022)

Editorial Material Obstetrics & Gynecology

Multiple comparisons: a tutorial. Part 1. Understanding hypothesis testing

Michael T. Lawson et al.

BJOG-AN INTERNATIONAL JOURNAL OF OBSTETRICS AND GYNAECOLOGY (2021)

Article History & Philosophy Of Science

Flexible yet fair: blinding analyses in experimental psychology

Gilles Dutilh et al.

Summary: Distinguishing between hypothesis-generating research and hypothesis-testing research can help improve the replicability of findings in experimental psychology. While preregistration is a fair method to prevent biases, it may hinder researchers' flexibility in data analysis. Blinded analyses offer a solution by maintaining flexibility while preventing bias.

SYNTHESE (2021)

Article Public, Environmental & Occupational Health

Analysis goals, error-cost sensitivity, and analysis hacking: Essential considerations in hypothesis testing and multiple comparisons

Sander Greenland

Summary: The replication crisis is attributed to misleading incentives leading to selective reporting and misinterpretation of statistics. To address this issue, it is important to define analysis goals precisely and recognize the sensitivity of decision costs in adjusting hypothesis testing scenarios. Pre-analysis statements and hierarchical regression methods provide preferable alternatives to conventional adjustments.

PAEDIATRIC AND PERINATAL EPIDEMIOLOGY (2021)

Article Multidisciplinary Sciences

Preregistration in diverse contexts: a preregistration template for the application of cognitive models

Sophia Cruwell et al.

Summary: Open science practices have gained popularity in psychology and related fields as a response to challenges like the replication crisis. However, the current discussion and templates for preregistration may not be fully suitable for research areas with diverse hypotheses and complex analysis methods. This article aims to bridge open science and mathematical psychology, providing a preregistration template and example for model application in cognitive modeling research.

ROYAL SOCIETY OPEN SCIENCE (2021)

Article Multidisciplinary Sciences

Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies

Aline Claesen et al.

Summary: The study found that while some preregistered studies in psychology followed the plan completely, many studies did not disclose deviations. Main deviations observed included sample size, exclusion criteria, and statistical analysis.

ROYAL SOCIETY OPEN SCIENCE (2021)

Article Psychology, Biological

Aspiring to greater intellectual humility in science

Rink Hoekstra et al.

Summary: Intellectual humility, though essential for credible science, is often overlooked in current research practices. Recommendations have been made to increase intellectual humility in research articles, emphasizing the important role peer reviewers can play in promoting this value.

NATURE HUMAN BEHAVIOUR (2021)

Article Multidisciplinary Sciences

The case for formal methodology in scientific reform

Berna Devezer et al.

Summary: Current attempts at methodological reform in response to a lack of rigor in experimental sciences tend to make similar mistakes and over-generalizations. It is argued that formal statistical rigor and scientific nuance are necessary, with a proposed five-step formal approach for solving methodological problems. A formal statistical analysis of popular claims in the metascientific literature is used to demonstrate how this formal approach can inform debates on methodological claims.

ROYAL SOCIETY OPEN SCIENCE (2021)

Article Psychology, Biological

Making ERP research more transparent: Guidelines for preregistration

Mariella Paul et al.

Summary: A combination of confirmation bias, hindsight bias, and pressure to publish can lead to undisclosed analytic flexibility in research, particularly in EEG studies. Pre-registration is proposed as a solution to limit bias and increase transparency in research practices, benefiting EEG researchers in improving the rigor of their studies.

INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY (2021)

Article Psychology, Multidisciplinary

Opening the Door to Registered Reports: Census of Journals Publishing Registered Reports (2013-2020)

Amanda Kay Montoya et al.

Summary: Registered reports, a new publication workflow, see the decision to publish made before data collection and analysis without dependency on study outcomes. Majority of journals adopting registered reports are in psychology, with about a year taken to publish the first one. Varied impact exist among journals, with many lacking concrete policies addressing concerns about registered reports. Open data and materials, along with other open science practices, are commonly encouraged as part of the registered report process.

COLLABRA-PSYCHOLOGY (2021)

Article Public, Environmental & Occupational Health

Examining the robustness of observational associations to model, measurement and sampling uncertainty with the vibration of effects framework

Simon Klau et al.

Summary: The study highlights the significant impact of sampling, model, and measurement uncertainty on the stability of observational associations, potentially leading to large variability in results. Measurement error in observational studies can attenuate the true effect in most cases, but may also occasionally result in overestimation.

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2021)

Article Psychology

An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports

Anne M. Scheel et al.

Summary: Selective publishing of positive results may distort the evidence for scientific claims. A comparison between Registered Reports (RRs) and standard literature in psychology reveals a significant difference in the proportion of positive results, suggesting a reduction in publication bias and/or Type I error inflation in RR literature.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Article Business

Pre-registration: Why and How

P. Joseph Simmons et al.

Summary: Pre-registration can solve false positives caused by p-hacking, but it does not guarantee that every published finding will be true. It's time for our field to embrace pre-registration and ensure it is done right.

JOURNAL OF CONSUMER PSYCHOLOGY (2021)

Article Psychology, Multidisciplinary

Arrested Theory Development: The Misguided Distinction Between Exploratory and Confirmatory Research

Aba Szollosi et al.

Summary: Science progresses by identifying and correcting problems in theories. Good theories are characterized by being difficult to change, explaining the intended phenomena, aligning with other good theories, and not easily adaptable to explain broader concepts. The current replicability issues in psychology are not due to a lack of distinction between exploratory and confirmatory research, but rather an abundance of flexible theories. Criticizing theories through argumentation may be a more effective approach to improving replicability than popular method-oriented solutions.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Multidisciplinary

Why Hypothesis Testers Should Spend Less Time Testing Hypotheses

Anne M. Scheel et al.

Summary: Before testing hypotheses, researchers should focus on developing concepts, establishing valid measures, identifying causal relationships and functional forms, as well as determining boundary conditions and auxiliary assumptions. Providing these inputs should be recognized as a crucial goal.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Article Business

Study Preregistration: An Evaluation of a Method for Transparent Reporting

Allison A. Toth et al.

Summary: Study finds that preregistration promotes transparent reporting but results in fewer statistically significant findings. Participants generally have positive attitudes towards preregistration but express concerns about the process.

JOURNAL OF BUSINESS AND PSYCHOLOGY (2021)

Article Psychology

A Traveler's Guide to the Multiverse: Promises, Pitfalls, and a Framework for the Evaluation of Analytic Decisions

Marco Del Giudice et al.

Summary: Decisions made by researchers during data analysis can sometimes lack objective justification, leading to potentially misleading results. Multiverse-style methods aim to expose hidden effects and obtain robust estimates, but their effectiveness depends on the subjective nature of alternative specifications. A framework is proposed to help researchers determine the arbitrariness of alternatives, leading to different decision scenarios and suggesting exploratory use of multiverse-style analysis in uncertain situations.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Letter Behavioral Sciences

Is Preregistration Worthwhile?

Aba Szollosi et al.

TRENDS IN COGNITIVE SCIENCES (2020)

Article Multidisciplinary Sciences

An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017)

Tom E. Hardwicke et al.

ROYAL SOCIETY OPEN SCIENCE (2020)

Article Multidisciplinary Sciences

Variability in the analysis of a single neuroimaging dataset by many teams

Rotem Botvinik-Nezer et al.

NATURE (2020)

Article Psychology, Biological

Specification curve analysis

Uri Simonsohn et al.

NATURE HUMAN BEHAVIOUR (2020)

Editorial Material Psychology, Biological

Use caution when applying behavioural science to policy

Hans IJzerman et al.

NATURE HUMAN BEHAVIOUR (2020)

Article Biochemistry & Molecular Biology

Ensuring the quality and specificity of preregistrations

Marjan Bakker et al.

PLOS BIOLOGY (2020)

Article Social Sciences, Interdisciplinary

Preregistering Qualitative Research: A Delphi Study

Tamarinde L. Haven et al.

INTERNATIONAL JOURNAL OF QUALITATIVE METHODS (2020)

Article Social Sciences, Interdisciplinary

Does preregistration improve the credibility of research findings?

Mark Rubin

QUANTITATIVE METHODS FOR PSYCHOLOGY (2020)

Review Health Care Sciences & Services

Prevalence of trial registration varies by study characteristics and risk of bias

Aidan Christopher Tan et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2019)

Article Biochemistry & Molecular Biology

Open science challenges, benefits and tips in early career and beyond

Christopher Allen et al.

PLOS BIOLOGY (2019)

Article Medicine, General & Internal

RoB 2: a revised tool for assessing risk of bias in randomised trials

Jonathan A. C. Sterne et al.

BMJ-BRITISH MEDICAL JOURNAL (2019)

Article Health Care Sciences & Services

Result dissemination from clinical trials conducted at German university medical centers was delayed and incomplete

Susanne Wieschowski et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2019)

Editorial Material Behavioral Sciences

Preregistration Is Hard, And Worthwhile

Brian A. Nosek et al.

TRENDS IN COGNITIVE SCIENCES (2019)

Article Mathematics, Interdisciplinary Applications

Calibrating the Scientific Ecosystem Through Meta-Research

Tom E. Hardwicke et al.

Annual Review of Statistics and Its Application (2019)

Article Multidisciplinary Sciences

Registered reports: an early example an analysis

Richard Wiseman et al.

Article Medical Ethics

Preregistering qualitative research

Tamarinde L. Haven et al.

ACCOUNTABILITY IN RESEARCH-ETHICS INTEGRITY AND POLICY (2019)

Article Statistics & Probability

Multiple Perspectives on Inference for Two Simple Statistical Scenarios

Noah N. N. van Dongen et al.

AMERICAN STATISTICIAN (2019)

Review Psychology, Biological

A problem in theory

Michael Muthukrishna et al.

NATURE HUMAN BEHAVIOUR (2019)

Article Psychology, Biological

The association between adolescent well-being and digital technology use

Amy Orben et al.

NATURE HUMAN BEHAVIOUR (2019)

Review Psychology, Mathematical

Addressing the theory crisis in psychology

Klaus Oberauer et al.

PSYCHONOMIC BULLETIN & REVIEW (2019)

Article Psychology

Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods

Evan C. Carter et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2019)

Article Health Care Sciences & Services

Pre-specification of statistical analysis approaches in published clinical trial protocols was inadequate

Lauren Greenberg et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2018)

Review Health Care Sciences & Services

Registered trials report less beneficial treatment effects than unregistered ones: a meta-epidemiological study in orthodontics

Spyridon N. Papageorgiou et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2018)

Article Multidisciplinary Sciences

Questionable research practices in ecology and evolution

Hannah Fraser et al.

PLOS ONE (2018)

Article Multidisciplinary Sciences

The preregistration revolution

Brian A. Nosek et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2018)

Article Medicine, General & Internal

Researcher Requests for Inappropriate Analysis and Reporting: A US Survey of Consulting Biostatisticians

Min Qi Wang et al.

ANNALS OF INTERNAL MEDICINE (2018)

Article Biochemistry & Molecular Biology

Reproducible research practices, transparency, and open access data in the biomedical literature, 2015-2017

Oshua D. Wallach et al.

PLOS BIOLOGY (2018)

Editorial Material Psychology, Biological

Mapping the universe of registered reports

Tom E. Hardwicke et al.

NATURE HUMAN BEHAVIOUR (2018)

Article Economics

Transparency, Reproducibility, and the Credibility of Economics Research

Garret Christensen et al.

JOURNAL OF ECONOMIC LITERATURE (2018)

Article Psychology, Biological

Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

Colin F. Camerer et al.

NATURE HUMAN BEHAVIOUR (2018)

Article Psychology

Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results

R. Silberzahn et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2018)

Article Psychology, Multidisciplinary

The Creativity-Verification Cycle in Psychological Science: New Methods to Combat Old Idols

Eric-Jan Wagenmakers et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2018)

Article Psychology, Multidisciplinary

Replication, Registration, and Scientific Creativity

C. J. Brainerd et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2018)

Article Economics

Imputation in US Manufacturing Data and Its Implications for Productivity Dispersion

T. Kirk White et al.

REVIEW OF ECONOMICS AND STATISTICS (2018)

Article Medical Ethics

Who Believes in the Storybook Image of the Scientist?

Coosje L. S. Veldkamp et al.

ACCOUNTABILITY IN RESEARCH-POLICIES AND QUALITY ASSURANCE (2017)

Review Biology

Detecting and avoiding likely false-positive findings - a practical guide

Wolfgang Forstmeier et al.

BIOLOGICAL REVIEWS (2017)

Article Medicine, General & Internal

Update on Trial Registration 11 Years after the ICMJE Policy Was Established

Deborah A. Zarin et al.

NEW ENGLAND JOURNAL OF MEDICINE (2017)

Review Medicine, Research & Experimental

Association of the FDA Amendment Act with trial registration, publication, and outcome reporting

Adam T. Phillips et al.

TRIALS (2017)

Article Medicine, General & Internal

Evaluation of Evidence of Statistical Support and Corroboration of Subgroup Claims in Randomized Clinical Trials

Joshua D. Wallach et al.

JAMA INTERNAL MEDICINE (2017)

Article Medicine, General & Internal

Evolution of Reporting P Values in the Biomedical Literature, 1990-2015

David Chavalarias et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2016)

Article Health Care Sciences & Services

Registration practices for observational studies on ClinicalTrials.gov indicated low adherence

Stefania Boccia et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2016)

Article Mathematics, Interdisciplinary Applications

How Bayes factors change scientific practice

Zoltan Dienes

JOURNAL OF MATHEMATICAL PSYCHOLOGY (2016)

Editorial Material Multidisciplinary Sciences

IS THERE A REPRODUCIBILITY CRISIS?

Monya Baker

NATURE (2016)

Article Multidisciplinary Sciences

Evaluating replicability of laboratory experiments in economics

Colin F. Camerer et al.

SCIENCE (2016)

Article Biology

Publication bias and the canonization of false facts

Silas Boye Nissen et al.

Article Multidisciplinary Sciences

The natural selection of bad science

Paul E. Smaldino et al.

ROYAL SOCIETY OPEN SCIENCE (2016)

Article Psychology, Social

Underreporting in Psychology Experiments: Evidence From a Study Registry

Annie Franco et al.

SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE (2016)

Article Medicine, General & Internal

Rethinking the assessment of risk of bias due to selective reporting: a cross-sectional study

Matthew J. Page et al.

SYSTEMATIC REVIEWS (2016)

Article Psychology, Mathematical

Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies

Angelique O. J. Cramer et al.

PSYCHONOMIC BULLETIN & REVIEW (2016)

Article Political Science

Standard Operating Procedures: A Safety Net for Pre-Analysis Plans

Winston Lin et al.

PS-POLITICAL SCIENCE & POLITICS (2016)

Article Psychology, Multidisciplinary

Increasing Transparency Through a Multiverse Analysis

Sara Steegen et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2016)

Article Health Care Sciences & Services

Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations

Chirag J. Patel et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2015)

Editorial Material Multidisciplinary Sciences

Hide results to seek the truth

Robert MacCoun et al.

NATURE (2015)

Article Multidisciplinary Sciences

Estimating the reproducibility of psychological science

Alexander A. Aarts et al.

SCIENCE (2015)

Editorial Material Multidisciplinary Sciences

Promoting an open research culture

B. A. Nosek et al.

SCIENCE (2015)

Editorial Material Medicine, General & Internal

Trial registration 10 years on

Wim E. J. Weber et al.

BMJ-BRITISH MEDICAL JOURNAL (2015)

Editorial Material Medicine, General & Internal

Trial registration 10 years on

Wim E. J. Weber et al.

BMJ-BRITISH MEDICAL JOURNAL (2015)

Editorial Material Substance Abuse

HANDLING THE FRAGILE VASE OF SCIENTIFIC PRACTICES

John P. A. Ioannidis

ADDICTION (2015)

Article Multidisciplinary Sciences

Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time

Robert M. Kaplan et al.

PLOS ONE (2015)

Article Psychology, Multidisciplinary

A Short (Personal) Future History of Revolution 2.0

Barbara A. Spellman

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2015)

Article Psychology, Multidisciplinary

Opportunistic Biases Their Origins, Effects, and an Integrated Solution

Jamie DeCoster et al.

AMERICAN PSYCHOLOGIST (2015)

Article Economics

Promises and Perils of Pre-Analysis Plans

Benjamin A. Olken

JOURNAL OF ECONOMIC PERSPECTIVES (2015)

Article Economics

Pre-Analysis Plans Have Limited Upside, Especially Where Replications Are Feasible

Lucas C. Coffman et al.

JOURNAL OF ECONOMIC PERSPECTIVES (2015)

Article Political Science

Research Preregistration in Political Science: The Case, Counterarguments, and a Response to Critiques

James E. Monogan

PS-POLITICAL SCIENCE & POLITICS (2015)

Article Multidisciplinary Sciences

The Statistical Crisis in Science

Andrew Gelman et al.

AMERICAN SCIENTIST (2014)

Article Medicine, General & Internal

Reporting Discrepancies Between the ClinicalTrials.gov Results Database and Peer-Reviewed Publications

Daniel M. Hartung et al.

ANNALS OF INTERNAL MEDICINE (2014)

Letter Medicine, General & Internal

Reporting of Results in ClinicalTrials.gov and High-Impact Journals

Jessica E. Becker et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2014)

Article Medicine, General & Internal

Reducing waste from incomplete or unusable reports of biomedical research

Paul Glasziou et al.

LANCET (2014)

Article Multidisciplinary Sciences

Publication bias in the social sciences: Unlocking the file drawer

Annie Franco et al.

SCIENCE (2014)

Article Cell Biology

Making Prospective Registration of Observational Research a Reality

Rafael Dal-Re et al.

SCIENCE TRANSLATIONAL MEDICINE (2014)

Article History & Philosophy Of Science

Prediction and accommodation revisited

John Worrall

STUDIES IN HISTORY AND PHILOSOPHY OF SCIENCE (2014)

Article Biochemistry & Molecular Biology

Distinguishing between Exploratory and Confirmatory Preclinical Research Will Improve Translation

Jonathan Kimmelman et al.

PLOS BIOLOGY (2014)

Editorial Material Health Care Sciences & Services

A tutorial on sensitivity analyses in clinical trials: the what, why, when and how

Lehana Thabane et al.

BMC MEDICAL RESEARCH METHODOLOGY (2013)

Review Health Care Sciences & Services

Many scenarios exist for selective inclusion and reporting of results in randomized trials and systematic reviews

Matthew J. Page et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2013)

Review Neurosciences

Power failure: why small sample size undermines the reliability of neuroscience

Katherine S. Button et al.

NATURE REVIEWS NEUROSCIENCE (2013)

Review Multidisciplinary Sciences

Use of Trial Register Information during the Peer Review Process

Sylvain Mathieu et al.

PLOS ONE (2013)

Article History & Philosophy Of Science

State of the Field: Why novel prediction matters

Heather Douglas et al.

STUDIES IN HISTORY AND PHILOSOPHY OF SCIENCE (2013)

Article Psychology, Applied

Forgetting What We Learned as Graduate Students: HARKing and Selective Outcome Reporting in I-O Journal Articles

Joseph J. Mazzola et al.

INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY-PERSPECTIVES ON SCIENCE AND PRACTICE (2013)

Editorial Material Medicine, General & Internal

The Evolution of Trial Registries and Their Use to Assess the Clinical Trial Enterprise

Kay Dickersin et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2012)

Article Computer Science, Interdisciplinary Applications

Negative results are disappearing from most disciplines and countries

Daniele Fanelli

SCIENTOMETRICS (2012)

Article Economics

Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan

Katherine Casey et al.

QUARTERLY JOURNAL OF ECONOMICS (2012)

Article Psychology, Multidisciplinary

An Agenda for Purely Confirmatory Research

Eric-Jan Wagenmakers et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability

Brian A. Nosek et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

The Rules of the Game Called Psychological Science

Marjan Bakker et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science

Roger Giner-Sorolla

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Economics

On the Use of Holdout Samples for Model Selection

Frank Schorfheide et al.

AMERICAN ECONOMIC REVIEW (2012)

Article Psychology, Multidisciplinary

Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

Leslie K. John et al.

PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Bayesian Versus Orthodox Statistics: Which Side Are You On?

Zoltan Dienes

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2011)

Article Medicine, General & Internal

Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials

Jonathan A. C. Sterne et al.

BMJ-BRITISH MEDICAL JOURNAL (2011)

Article Statistics & Probability

BAYES AND EMPIRICAL-BAYES MULTIPLICITY ADJUSTMENT IN THE VARIABLE-SELECTION PROBLEM

James G. Scott et al.

ANNALS OF STATISTICS (2010)

Editorial Material Public, Environmental & Occupational Health

Preregistration of Study Protocols Is Unlikely to Improve the Yield From Our Science, But Other Strategies Might

Timothy L. Lash

EPIDEMIOLOGY (2010)

Review Medicine, General & Internal

A catalogue of reporting guidelines for health research

I. Simera et al.

EUROPEAN JOURNAL OF CLINICAL INVESTIGATION (2010)

Article Medicine, General & Internal

Selective publication of antidepressant trials and its influence on apparent efficacy

Erick H. Turner et al.

NEW ENGLAND JOURNAL OF MEDICINE (2008)

Editorial Material Medicine, General & Internal

Why Current Publication Practices May Distort Science

Neal S. Young et al.

PLOS MEDICINE (2008)

Review Behavioral Sciences

Perception and misperception of bias in human judgment

Emily Pronin

TRENDS IN COGNITIVE SCIENCES (2007)

Article Health Care Sciences & Services

Testing multiple statistical hypotheses resulted in spurious associations: A study of astrological signs and health

Peter C. Austin et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2006)

Review Health Care Sciences & Services

Outcome selection bias in meta-analysis

PR Williamson et al.

STATISTICAL METHODS IN MEDICAL RESEARCH (2005)

Article Medicine, General & Internal

Why most published research findings are false

JPA Ioannidis

PLOS MEDICINE (2005)

Review Multidisciplinary Sciences

Testing hypotheses: Prediction and prejudice

P Lipton

SCIENCE (2005)

Article History & Philosophy Of Science

Prediction versus accommodation and the risk of overfitting

C Hitchcock et al.

BRITISH JOURNAL FOR THE PHILOSOPHY OF SCIENCE (2004)

Article Medicine, General & Internal

Empirical evidence for selective reporting of outcomes in randomized trials -: Comparison of Protocols to published articles

AW Chan et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2004)