4.4 Article

Making ERP research more transparent: Guidelines for preregistration

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Psychology, Biological

The generalizability crisis

Tal Yarkoni

Summary: Most theories and hypotheses in psychology are verbal in nature, yet their evaluation overwhelmingly relies on inferential statistical procedures. However, many applications of statistical inference in psychology fail to meet the basic condition of closely aligning verbal and statistical expressions, which results in limited generalizability of results, increased false-positive rates, and researchers drawing sweeping verbal generalizations without meaningful connection to statistical quantities.

BEHAVIORAL AND BRAIN SCIENCES (2022)

Editorial Material Obstetrics & Gynecology

Multiple comparisons: a tutorial. Part 1. Understanding hypothesis testing

Michael T. Lawson et al.

BJOG-AN INTERNATIONAL JOURNAL OF OBSTETRICS AND GYNAECOLOGY (2021)

Article Psychology, Multidisciplinary

Arrested Theory Development: The Misguided Distinction Between Exploratory and Confirmatory Research

Aba Szollosi et al.

Summary: Science progresses by identifying and correcting problems in theories. Good theories are characterized by being difficult to change, explaining the intended phenomena, aligning with other good theories, and not easily adaptable to explain broader concepts. The current replicability issues in psychology are not due to a lack of distinction between exploratory and confirmatory research, but rather an abundance of flexible theories. Criticizing theories through argumentation may be a more effective approach to improving replicability than popular method-oriented solutions.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Multidisciplinary

Theory Before the Test: How to Build High-Verisimilitude Explanatory Theories in Psychological Science

Iris van Rooij et al.

Summary: Drawing on the philosophy of psychological explanation, it is suggested that psychological science should focus more on psychological capacities rather than just effects. By extending Marr's framework to other areas of psychology, such as social, developmental, and evolutionary psychology, new benefits can be brought to these fields. Theoretical analyses can endow a theory with minimal plausibility even before contact with empirical data, contributing to addressing critical issues in psychological science.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Multidisciplinary

The Theory Crisis in Psychology: How to Move Forward

Markus Eronen et al.

Summary: Theories in psychology often come and go, with little cumulative progress; developing good psychological theories is extremely difficult; understanding the reasons behind this difficulty is crucial for moving forward in the theory crisis.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Multidisciplinary

How Computational Modeling Can Force Theory Building in Psychological Science

Olivia Guest et al.

Summary: The use of computational modeling in psychological research is a divisive factor, but holds promise for advancing the field. By constraining the inference process, modeling helps build explanatory and predictive theories. Without formal modeling, psychology may continue to face replicability crises and struggles in theory building.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Review Psychology, Mathematical

Why optional stopping can be a problem for Bayesians

Rianne de Heide et al.

Summary: This article addresses the impact of optional stopping on Bayesian methods, specifying the potential issues under certain circumstances. By extending Rouder's experiments, the authors demonstrate that when parameters are equipped with default or pragmatic priors in practical applications, resilience to optional stopping can be compromised. The article distinguishes between three types of default priors, each with specific issues related to optional stopping.

PSYCHONOMIC BULLETIN & REVIEW (2021)

Review Psychology, Mathematical

The JASP guidelines for conducting and reporting a Bayesian analysis

Johnny van Doorn et al.

Summary: Although there is a lack of practical guidelines on how to apply Bayesian procedures and interpret results in empirical research, this study offers specific guidance for four stages of Bayesian statistical reasoning in a research setting: planning the analysis, executing the analysis, interpreting the results, and reporting the results. Each stage's guidelines are illustrated with a running example, primarily focusing on analyses performed with the open-source statistical software JASP, but with applicability to Bayesian inference in general.

PSYCHONOMIC BULLETIN & REVIEW (2021)

Article Business

Study Preregistration: An Evaluation of a Method for Transparent Reporting

Allison A. Toth et al.

Summary: Study finds that preregistration promotes transparent reporting but results in fewer statistically significant findings. Participants generally have positive attitudes towards preregistration but express concerns about the process.

JOURNAL OF BUSINESS AND PSYCHOLOGY (2021)

Article Neurosciences

Automated EEG mega-analysis II: Cognitive aspects of event related features

Nima Bigdely-Shamlo et al.

NEUROIMAGE (2020)

Letter Behavioral Sciences

Is Preregistration Worthwhile?

Aba Szollosi et al.

TRENDS IN COGNITIVE SCIENCES (2020)

Article Engineering, Biomedical

Evaluation of Artifact Subspace Reconstruction for Automatic Artifact Components Removal in Multi-Channel EEG Recordings

Chi-Yuan Chang et al.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2020)

Article Engineering, Biomedical

How Sensitive Are EEG Results to Preprocessing Methods: A Benchmarking Study

Kay A. Robbins et al.

IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING (2020)

Article Biochemistry & Molecular Biology

Preregistration of exploratory research: Learning from the golden age of discovery

Ulrich Dirnagl

PLOS BIOLOGY (2020)

Article Multidisciplinary Sciences

The effect of preregistration on trust in empirical research findings: results of a registered report

Sarahanne M. Field et al.

ROYAL SOCIETY OPEN SCIENCE (2020)

Review Neurosciences

Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence

Christian Keysers et al.

NATURE NEUROSCIENCE (2020)

Article Multidisciplinary Sciences

P-hacking in clinical trials and how incentives shape the distribution of results across phases

Jerome Adda et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2020)

Editorial Material Psychology, Biological

A registered report format for Psychophysiology

Andreas Keil et al.

PSYCHOPHYSIOLOGY (2020)

Article Biochemistry & Molecular Biology

Ensuring the quality and specificity of preregistrations

Marjan Bakker et al.

PLOS BIOLOGY (2020)

Article Social Sciences, Interdisciplinary

Does preregistration improve the credibility of research findings?

Mark Rubin

QUANTITATIVE METHODS FOR PSYCHOLOGY (2020)

Article Psychology, Experimental

Definitely saw it coming? The dual nature of the pre-nominal prediction effect

Damien S. Fleur et al.

COGNITION (2020)

Article Ethics

Quantifying professionalism in peer review

Travis G. Gerwing et al.

RESEARCH INTEGRITY AND PEER REVIEW (2020)

Review Chemistry, Analytical

Removal of Artifacts from EEG Signals: A Review

Xiao Jiang et al.

SENSORS (2019)

Article Psychology

The Utility of Event-Related Potentials in Clinical Psychology

Greg Hajcak et al.

Annual Review of Clinical Psychology (2019)

Article Neurosciences

Exploring the impact of analysis software on task fMRI results

Alexander Bowring et al.

HUMAN BRAIN MAPPING (2019)

Article Multidisciplinary Sciences

Signaling the trustworthiness of science

Kathleen Hall Jamieson et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2019)

Editorial Material Behavioral Sciences

Preregistration Is Hard, And Worthwhile

Brian A. Nosek et al.

TRENDS IN COGNITIVE SCIENCES (2019)

Review Behavioral Sciences

Do 'early' brain responses reveal word form prediction during language comprehension? A critical review

Mante S. Nieuwland

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS (2019)

Article Multidisciplinary Sciences

Registered reports: an early example an analysis

Richard Wiseman et al.

Article Medical Ethics

Preregistering qualitative research

Tamarinde L. Haven et al.

ACCOUNTABILITY IN RESEARCH-ETHICS INTEGRITY AND POLICY (2019)

Review Psychology, Biological

A problem in theory

Michael Muthukrishna et al.

NATURE HUMAN BEHAVIOUR (2019)

Review Psychology, Mathematical

Addressing the theory crisis in psychology

Klaus Oberauer et al.

PSYCHONOMIC BULLETIN & REVIEW (2019)

Review Psychology, Multidisciplinary

Preregistration of Analyses of Preexisting Data

Gaetan Mertens et al.

PSYCHOLOGICA BELGICA (2019)

Article Psychology, Biological

How many trials does it take to get a significant ERP effect? It depends

Megan A. Boudewyn et al.

PSYCHOPHYSIOLOGY (2018)

Review Health Care Sciences & Services

Registered trials report less beneficial treatment effects than unregistered ones: a meta-epidemiological study in orthodontics

Spyridon N. Papageorgiou et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2018)

Editorial Material Multidisciplinary Sciences

Industrial strength

Kendall Powell

NATURE (2018)

Article Multidisciplinary Sciences

The preregistration revolution

Brian A. Nosek et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2018)

Review Medicine, General & Internal

Registration of published randomized trials: a systematic review and meta-analysis

Ludovic Trinquart et al.

BMC MEDICINE (2018)

Article Computer Science, Interdisciplinary Applications

Day of the week submission effect for accepted papers in Physica A, PLOS ONE, Nature and Cell

Catalin Emilian Boja et al.

SCIENTOMETRICS (2018)

Letter Psychology, Biological

Protocol transparency is vital for registered reports

Christopher D. Chambers et al.

NATURE HUMAN BEHAVIOUR (2018)

Editorial Material Psychology, Biological

Mapping the universe of registered reports

Tom E. Hardwicke et al.

NATURE HUMAN BEHAVIOUR (2018)

Article Psychology, Mathematical

The Bayesian New Statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective

John K. Kruschke et al.

PSYCHONOMIC BULLETIN & REVIEW (2018)

Article Psychology, Social

When power analyses based on pilot data are biased: Inaccurate effect size estimators and follow-up bias

Casper Albers et al.

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2018)

Article Psychology, Mathematical

Introduction to Bayesian Inference for Psychology

Alexander Etz et al.

PSYCHONOMIC BULLETIN & REVIEW (2018)

Article Psychology, Biological

How to get statistically significant effects in any ERP experiment (and why you shouldn't)

Steven J. Luck et al.

PSYCHOPHYSIOLOGY (2017)

Review Psychology, Biological

Sample size calculations in human electrophysiology (EEG and ERP) studies: A systematic review and recommendations for increased rigor

Michael J. Larson et al.

INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY (2017)

Article Psychology, Biological

Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting

Peter E. Clayson et al.

INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY (2017)

Article Psychology, Biological

Improving the rigor of psychophysiology research

Scott A. Baldwin

INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY (2017)

Editorial Material Multidisciplinary Sciences

Nurture negatives

[Anonymous]

NATURE (2017)

Editorial Material Multidisciplinary Sciences

Faculty promotion must assess reproducibility

Jeffrey Flier

NATURE (2017)

Article Biochemical Research Methods

Good enough practices in scientific computing

Greg Wilson et al.

PLOS COMPUTATIONAL BIOLOGY (2017)

Article Multidisciplinary Sciences

The reproducibility of research and the misinterpretation of p-values

David Colquhoun

ROYAL SOCIETY OPEN SCIENCE (2017)

Article Engineering, Environmental

Academic Research in the 21st Century: Maintaining Scientific Integrity in a Climate of Perverse Incentives and Hypercompetition

Marc A. Edwards et al.

ENVIRONMENTAL ENGINEERING SCIENCE (2017)

Article Psychology, Multidisciplinary

Sequential Hypothesis Testing With Bayes Factors: Efficiently Testing Mean Differences

Felix D. Schoenbrodt et al.

PSYCHOLOGICAL METHODS (2017)

Article Psychology, Multidisciplinary

Improving Transparency and Replication in Bayesian Statistics: The WAMBS-Checklist

Sarah Depaoli et al.

PSYCHOLOGICAL METHODS (2017)

Review Psychology

Experiments with More Than One Random Factor: Designs, Analytic Models, and Statistical Power

Charles M. Judd et al.

ANNUAL REVIEW OF PSYCHOLOGY, VOL 68 (2017)

Article Behavioral Sciences

Mu suppression - A good measure of the human mirror neuron system?

Hannah M. Hobson et al.

CORTEX (2016)

Editorial Material Psychology, Biological

Commitment to Cutting-Edge Research with Rigor and Replication in Psychophysiological Science

Michael J. Larson

INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY (2016)

Editorial Material Clinical Neurology

Null is beautiful: On the importance of publishing null results

Marcus Munafo et al.

JOURNAL OF PSYCHOPHARMACOLOGY (2016)

Article Multidisciplinary Sciences

Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates

Anders Eklund et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2016)

Article Multidisciplinary Sciences

Evaluating replicability of laboratory experiments in economics

Colin F. Camerer et al.

SCIENCE (2016)

Article Biochemistry & Molecular Biology

Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency

Mallory C. Kidwell et al.

PLOS BIOLOGY (2016)

Article Biology

Publication bias and the canonization of false facts

Silas Boye Nissen et al.

Article Biology

How open science helps researchers succeed

Erin C. McKiernan et al.

Review Multidisciplinary Sciences

The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review

Richard D. Morey et al.

ROYAL SOCIETY OPEN SCIENCE (2016)

Article Psychology, Social

Underreporting in Psychology Experiments: Evidence From a Study Registry

Annie Franco et al.

SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE (2016)

Review Neurosciences

A Tutorial Review of Functional Connectivity Analysis Methods and Their Interpretational Pitfalls

Andre M. Bastos et al.

FRONTIERS IN SYSTEMS NEUROSCIENCE (2016)

Article Psychology, Social

Pre-registration in social psychology-A discussion and suggested template

Anna Elisabeth van 't Veer et al.

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2016)

Review Psychology, Multidisciplinary

Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking

Jelte M. Wicherts et al.

FRONTIERS IN PSYCHOLOGY (2016)

Article Psychology, Multidisciplinary

Increasing Transparency Through a Multiverse Analysis

Sara Steegen et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2016)

Article Biochemical Research Methods

Digital filter design for electrophysiological data - a practical approach

Andreas Widmann et al.

JOURNAL OF NEUROSCIENCE METHODS (2015)

Article Medicine, General & Internal

How to increase value and reduce waste when research priorities are set

Iain Chalmers et al.

LANCET (2014)

Review Behavioral Sciences

Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention

John P. A. Ioannidis et al.

TRENDS IN COGNITIVE SCIENCES (2014)

Article Political Science

Openness in Political Science: Data Access and Research Transparency

Arthur Lupia et al.

PS-POLITICAL SCIENCE & POLITICS (2014)

Article Psychology, Mathematical

Optional stopping: No problem for Bayesians

Jeffrey N. Rouder

PSYCHONOMIC BULLETIN & REVIEW (2014)

Article Psychology, Multidisciplinary

The New Statistics: Why and How

Geoff Cumming

PSYCHOLOGICAL SCIENCE (2014)

Article Neurosciences

Good practice for conducting and reporting MEG research

Joachim Gross et al.

NEUROIMAGE (2013)

Article Psychology, Multidisciplinary

Just Post It: The Lesson From Two Cases of Fabricated Data Detected by Statistics Alone

Uri Simonsohn

PSYCHOLOGICAL SCIENCE (2013)

Article Computer Science, Interdisciplinary Applications

Publication Bias in Neuroimaging Research: Implications for Meta-Analyses

Robin G. Jennings et al.

NEUROINFORMATICS (2012)

Article Computer Science, Interdisciplinary Applications

Negative results are disappearing from most disciplines and countries

Daniele Fanelli

SCIENTOMETRICS (2012)

Article Psychology, Multidisciplinary

Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability

Brian A. Nosek et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Scientific Utopia: I. Opening Scientific Communication

Brian A. Nosek et al.

PSYCHOLOGICAL INQUIRY (2012)

Article Psychology, Multidisciplinary

Hindsight Bias

Neal J. Roese et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Psychology, Multidisciplinary

Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

Leslie K. John et al.

PSYCHOLOGICAL SCIENCE (2012)

Article Behavioral Sciences

Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals

Irene Winkler et al.

BEHAVIORAL AND BRAIN FUNCTIONS (2011)

Article Psychiatry

The role and interpretation of pilot studies in clinical research

Andrew C. Leon et al.

JOURNAL OF PSYCHIATRIC RESEARCH (2011)

Review Psychology, Biological

Mass univariate analysis of event-related brain potentials/fields I: A critical tutorial review

David M. Groppe et al.

PSYCHOPHYSIOLOGY (2011)

Article Mathematical & Computational Biology

FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data

Robert Oostenveld et al.

COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE (2011)

Article Psychology, Social

Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect

Daryl J. Bem

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2011)

Article Medicine, General & Internal

Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov

Florence T. Bourgeois et al.

ANNALS OF INTERNAL MEDICINE (2010)

Article Biochemical Research Methods

FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection

H. Nolan et al.

JOURNAL OF NEUROSCIENCE METHODS (2010)

Article Multidisciplinary Sciences

Positive Results Increase Down the Hierarchy of the Sciences

Daniele Fanelli

PLOS ONE (2010)

Article Clinical Neurology

Semi-automatic identification of independent components representing EEG artifact

Filipa Campos Viola et al.

CLINICAL NEUROPHYSIOLOGY (2009)

Article Psychology, Mathematical

Bayesian t tests for accepting and rejecting the null hypothesis

Jeffrey N. Rouder et al.

PSYCHONOMIC BULLETIN & REVIEW (2009)

Review Public, Environmental & Occupational Health

Why most discovered true associations are inflated

John P. A. Ioannidis

EPIDEMIOLOGY (2008)

Review Psychology, Mathematical

A practical solution to the pervasive problems of p values

Eric-Jan Wagenmakers

PSYCHONOMIC BULLETIN & REVIEW (2007)

Article Biochemical Research Methods

Nonparametric statistical testing of EEG- and MEG-data

Eric Maris et al.

JOURNAL OF NEUROSCIENCE METHODS (2007)

Article Psychiatry

Caution regarding the use of pilot studies to guide power calculations for study proposals

HC Kraemer et al.

ARCHIVES OF GENERAL PSYCHIATRY (2006)

Article Medicine, General & Internal

Why most published research findings are false

JPA Ioannidis

PLOS MEDICINE (2005)