☆ 4.6 Article

On the scope of scientific hypotheses

ROYAL SOCIETY OPEN SCIENCE (2023)

Related references

Note: Only part of the references are listed.

Article Psychology, Multidisciplinary

Misspecification and Unreliable Interpretations in Psychology and Social Science

Matthew J. Vowels

Summary: This article discusses the weaknesses in psychology and social science research practice that the replicability crisis has brought attention to. It highlights three issues that cannot be addressed through replication alone, and provides recommendations for improvement in research practice.

PSYCHOLOGICAL METHODS (2023)

Add to Collection

Review Psychology, Mathematical

A Bayesian perspective on severity: risky predictions and specific hypotheses

Noah van Dongen et al.

Summary: This paper examines the value of severity in error statistics and Bayesian inference, highlighting the limitations of the error-statistical explication of severity. It argues that severity is important in Bayesian inference due to the value of specific, risky predictions, and illustrates its application in Bayesian statistics through a practical example.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Add to Collection

Article Political Science

Pre-Analysis Plans: An Early Stocktaking

George K. Ofosu et al.

Summary: This study examines a sample of 195 PAPs and finds significant variation in their ability to achieve pre-registered goals. It highlights the need for strengthening norms and institutions to enhance the credibility of research.

PERSPECTIVES ON POLITICS (2023)

Add to Collection

Article History & Philosophy Of Science

The Costs of HARKing

Mark Rubin

Summary: This article discusses and evaluates the concept of HARKing, arguing that the existing potential costs of HARKing are misunderstood and insufficient, and it is premature to conclude that HARKing has led to low replication rates.

BRITISH JOURNAL FOR THE PHILOSOPHY OF SCIENCE (2022)

Add to Collection

Article Psychology, Social

Generalizing across auxiliary, statistical, and inferential assumptions

David Trafimow

Summary: Researchers can attempt to generalize not only their findings, but also theories, empirical hypotheses, and statistical hypotheses. Before proposing generalization, it is important to distinguish between these entities and specify the scope of generalization. The practice of using p-values to draw conclusions about hypotheses is challenged in this discussion about generalization.

JOURNAL FOR THE THEORY OF SOCIAL BEHAVIOUR (2022)

Add to Collection

Article Psychology, Biological

The generalizability crisis

Tal Yarkoni

Summary: Most theories and hypotheses in psychology are verbal in nature, yet their evaluation overwhelmingly relies on inferential statistical procedures. However, many applications of statistical inference in psychology fail to meet the basic condition of closely aligning verbal and statistical expressions, which results in limited generalizability of results, increased false-positive rates, and researchers drawing sweeping verbal generalizations without meaningful connection to statistical quantities.

BEHAVIORAL AND BRAIN SCIENCES (2022)

Add to Collection

Article Psychology, Multidisciplinary

The unappreciated relevance of auxiliary assumptions for evaluating theory-based interventions in health psychology

Tom St Quinton et al.

Summary: The use of theory in health behavior change interventions has been questioned, and it is found that intervention failures are often due to flaws in auxiliary assumptions rather than theoretical assumptions. The importance of auxiliary assumptions in assessing the effectiveness of interventions informed by theory is illustrated using the theory of planned behavior.

THEORY & PSYCHOLOGY (2022)

Add to Collection

Article Multidisciplinary Sciences

Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

Nate Breznau et al.

Summary: This study explores how researchers' analytical choices affect the reliability of scientific findings. The researchers coordinated 161 researchers in 73 research teams to independently test the same social science hypothesis using the same data. The results showed widely diverging numerical findings and conclusions, with researchers' expertise, prior beliefs, and expectations barely predicting the variation in outcomes. This study highlights the idiosyncrasy of researchers' decisions and calls for greater clarity and humility in reporting scientific findings.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2022)

Add to Collection

Article Ethics

Exploratory hypothesis tests can be more compelling than confirmatory hypothesis tests

Mark Rubin et al.

Summary: This article challenges the claim that confirmatory hypothesis tests provide more compelling results and argues for the advantages of exploratory hypothesis tests. Exploratory hypothesis tests avoid biases, reduce data fraud, and facilitate inference to the best explanation, while also allowing peer reviewers to contribute at the data analysis stage. In contrast, confirmatory hypothesis tests may lead to inappropriate confidence, less suitable analyses in unplanned deviations, and greater bias and errors in theoretical inferences.

PHILOSOPHICAL PSYCHOLOGY (2022)

Add to Collection

Article Multidisciplinary Sciences

Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies

Aline Claesen et al.

Summary: The study found that while some preregistered studies in psychology followed the plan completely, many studies did not disclose deviations. Main deviations observed included sample size, exclusion criteria, and statistical analysis.

ROYAL SOCIETY OPEN SCIENCE (2021)

Add to Collection

Article Ecology

When are hypotheses useful in ecology and evolution?

Matthew G. Betts et al.

Summary: The use of research hypotheses in ecology and evolution is low, stable, and not correlated with grant success or citation rates, potentially disincentivizing hypothesis formulation.

ECOLOGY AND EVOLUTION (2021)

Add to Collection

Article History & Philosophy Of Science

When to adjust alpha during multiple testing: a consideration of disjunction, conjunction, and individual testing

Mark Rubin

Summary: This article examines the conditions under which adjusting the significance threshold in multiple testing is appropriate or inappropriate, distinguishing between three types of multiple testing. It argues that alpha adjustment is suitable for disjunction testing but not for conjunction testing or individual testing. Researchers should not assume blindly that alpha adjustment is necessary for all types of multiple testing.

SYNTHESE (2021)

Add to Collection

Article Psychology, Multidisciplinary

Theory Construction Methodology: A Practical Framework for Building Theories in Psychology

Denny Borsboom et al.

Summary: This article introduces a practical methodology called Theory Construction Methodology (TCM) to improve theory formation in psychology, consisting of five steps to construct explanatory theories. The emphasis is on the importance of the integrity, simplicity, and substantive credibility of the model, as well as the incorporation of TCM into the larger framework of scientific research. Additionally, a systematic university curriculum outline is proposed to educate psychologists in the process of theory formation.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Add to Collection

Article Psychology, Multidisciplinary

Invisible Hands and Fine Calipers: A Call to Use Formal Theory as a Toolkit for Theory Construction

Donald J. Robinaugh et al.

Summary: In recent years, there has been a growing concern among researchers about the crisis in psychological theory, with theories lacking an accumulation of knowledge. Despite Paul Meehl's proposed solution over 40 years ago, little improvement has been seen. To advance psychological theory, researchers must be provided with better tools to generate, evaluate, and develop theories.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Add to Collection

Article Psychology, Multidisciplinary

Why Hypothesis Testers Should Spend Less Time Testing Hypotheses

Anne M. Scheel et al.

Summary: Before testing hypotheses, researchers should focus on developing concepts, establishing valid measures, identifying causal relationships and functional forms, as well as determining boundary conditions and auxiliary assumptions. Providing these inputs should be recognized as a crucial goal.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Add to Collection

Editorial Material Biodiversity Conservation

Exploratory and confirmatory research in the open science era

Erlend B. Nilsen et al.

JOURNAL OF APPLIED ECOLOGY (2020)

Add to Collection

Article Psychology

Strong Theory Testing Using the Prior Predictive and the Data Prior

Wolf Vanpaemel

PSYCHOLOGICAL REVIEW (2020)

Add to Collection

Editorial Material Biology

Open exploration

William Hedley Thompson et al.

ELIFE (2020)

Add to Collection

Article Biology

Dataset decay and the problem of sequential analyses on open datasets

William Hedley Thompson et al.

ELIFE (2020)

Add to Collection

Article Multidisciplinary Sciences

Variability in the analysis of a single neuroimaging dataset by many teams

Rotem Botvinik-Nezer et al.

NATURE (2020)

Add to Collection

Article Psychology, Multidisciplinary

Lack of Theory Building and Testing Impedes Progress in The Factor and Network Literature

Eiko I. Fried

PSYCHOLOGICAL INQUIRY (2020)

Add to Collection

Editorial Material Behavioral Sciences

Preregistration Is Hard, And Worthwhile

Brian A. Nosek et al.

TRENDS IN COGNITIVE SCIENCES (2019)

Add to Collection

Review Psychology, Biological

A problem in theory

Michael Muthukrishna et al.

NATURE HUMAN BEHAVIOUR (2019)

Add to Collection

Article Social Sciences, Interdisciplinary

A taxonomy of model assumptions on which P is based and implications for added benefit in the sciences

David Trafimow

INTERNATIONAL JOURNAL OF SOCIAL RESEARCH METHODOLOGY (2019)

Add to Collection

Article Education & Educational Research

Objectivity as standardization in data-scientific education policy, technology and governance

Ben Williamson et al.

LEARNING MEDIA AND TECHNOLOGY (2019)

Add to Collection

Article Multidisciplinary Sciences

The preregistration revolution

Brian A. Nosek et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2018)

Add to Collection

Article Psychology, Mathematical

The Bayesian New Statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective

John K. Kruschke et al.

PSYCHONOMIC BULLETIN & REVIEW (2018)

Add to Collection

Article Biology

Point of View: How should novelty be valued in science?

Barak A. Cohen

ELIFE (2017)

Add to Collection

Article History & Philosophy Of Science

On the proper domain of psychological predicates

Carrie Figdor

SYNTHESE (2017)

Add to Collection

Article Psychology, Multidisciplinary

When Does HARKing Hurt? Identifying When Different Types of Undisclosed Post Hoc Hypothesizing Harm Scientific Progress

Mark Rubin

REVIEW OF GENERAL PSYCHOLOGY (2017)

Add to Collection

Article Psychology, Multidisciplinary

Increasing Transparency Through a Multiverse Analysis

Sara Steegen et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2016)

Add to Collection

Article Communication

Linguistic Obfuscation in Fraudulent Science

David M. Markowitz et al.

JOURNAL OF LANGUAGE AND SOCIAL PSYCHOLOGY (2016)

Add to Collection

Editorial Material Behavioral Sciences

Registered Reports: Realigning incentives in scientific publishing

Christopher D. Chambers et al.

CORTEX (2015)

Add to Collection

Review Neurosciences

Computational models in the age of large datasets

Timothy O'Leary et al.

CURRENT OPINION IN NEUROBIOLOGY (2015)

Add to Collection

Article Multidisciplinary Sciences

The Statistical Crisis in Science

Andrew Gelman et al.

AMERICAN SCIENTIST (2014)

Add to Collection

Article Psychology, Multidisciplinary

Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

Leslie K. John et al.

PSYCHOLOGICAL SCIENCE (2012)

Add to Collection

Editorial Material Biochemistry & Molecular Biology

A brief history of the hypothesis

David J. Glass et al.

CELL (2008)

Add to Collection

© Peeref 2019-2024. All rights reserved.