One data set, many analysts: Implications for practicing scientists

Article Multidisciplinary Sciences

Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

Nate Breznau et al.

Summary: This study explores how researchers' analytical choices affect the reliability of scientific findings. The researchers coordinated 161 researchers in 73 research teams to independently test the same social science hypothesis using the same data. The results showed widely diverging numerical findings and conclusions, with researchers' expertise, prior beliefs, and expectations barely predicting the variation in outcomes. This study highlights the idiosyncrasy of researchers' decisions and calls for greater clarity and humility in reporting scientific findings.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2022)

添加到收藏夹

Article Biology

Science Forum: Consensus-based guidance for conducting and reporting multi-analyst studies

Balazs Aczel et al.

Summary: This article discusses how employing multiple analysts can improve the robustness of data analysis results and conclusions, and presents consensus-based guidance for conducting such studies.

ELIFE (2021)

添加到收藏夹

Article Multidisciplinary Sciences

The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplines

Sabine Hoffmann et al.

Summary: This paper presents a general framework on sources of uncertainty in computational analyses that lead to multiplicity of analysis strategies, and applies it to various approaches proposed in different disciplines to address this issue.

ROYAL SOCIETY OPEN SCIENCE (2021)

添加到收藏夹

Article Education, Scientific Disciplines

What Makes a Good Statistical Question?

Pip Arnold et al.

Summary: The statistical problem-solving process involves formulating questions, collecting data, analyzing data, and interpreting results. Understanding the types of statistical questions and how they are used across the process is crucial for effective statistical practice.

JOURNAL OF STATISTICS AND DATA SCIENCE EDUCATION (2021)

添加到收藏夹

Article Psychology