4.4 Article

Are Small Effects the Indispensable Foundation for a Cumulative Psychological Science? A Reply to Gotz et al. (2022)

Related references

Note: Only part of the references are listed.
Article Psychology, Multidisciplinary

Not All Effects Are Indispensable: Psychological Science Requires Verifiable Lines of Reasoning for Whether an Effect Matters

Farid Anvari et al.

Summary: Recent articles have revisited the importance of seemingly small effect sizes in psychological science to discourage researchers from heuristically dismissing them as unimportant. The field is now in danger of accepting all effects as potentially important, and this study aims to encourage researchers to thoroughly consider the mechanisms that amplify or counteract the importance of an observed effect size. By transparently providing verifiable lines of reasoning, researchers can promote a more rigorous assessment of psychological findings and their generalizability.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2023)

Article Psychology, Multidisciplinary

Small Effects: The Indispensable Foundation for a Cumulative Psychological Science

Friedrich M. Goetz et al.

Summary: Research indicates that complex psychological phenomena are influenced by multiple causes, each having a small effect. However, the current publication culture values large effects while overlooking small yet real effects. These small effects can have significant consequences when considered at scale and over time. Utilizing big data, machine learning, and changing cultural norms can help advance psychology research and practices.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2022)

Article Psychology, Social

Universals and Variations in Musical Preferences: A Study of Preferential Reactions to Western Music in 53 Countries

David M. Greenberg et al.

Summary: Universal patterns in preferences for Western music were found across countries, as well as consistent correlations between personality traits and musical preferences. These findings provide a foundation for further research on the interactions between music, psychology, biology, and culture.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2022)

Article Psychology, Applied

Daily autonomy and job performance: Does person-organization fit act as a key resource?

Henrik O. Sorlie et al.

Summary: This study integrates Person-Organization fit and Job Demands-Resources theories to examine the influence of P-O fit on the relationship between job autonomy and performance. Results show that individuals high in P-O fit demonstrate a stronger positive relationship between autonomy and performance, with effects noticeable several days later.

JOURNAL OF VOCATIONAL BEHAVIOR (2022)

Article Psychology, Social

Urban-Rural Residential Mobility Associated With Political Party Affiliation: The US National Longitudinal Surveys of Youth and Young Adults

Markus Jokela

Summary: The study found that stronger Republican affiliation was associated with a lower probability of moving from rural regions to major cities, and a higher probability of moving away from major cities to urban or rural regions. There was an empirical correlation between party affiliation and urban-rural residence, with selective residential mobility potentially accounting for almost half of this association.

SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE (2022)

Article Psychology, Social

Using anchor-based methods to determine the smallest effect size of interest

Farid Anvari et al.

Summary: This article introduces a method to quantify the smallest subjective experience difference using an anchor-based approach, aiming to assist researchers in determining the subjective significance of empirical results and interpreting observed outcomes with theoretical and practical implications.

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2021)

Article Psychology, Multidisciplinary

Providing a Lower-Bound Estimate for Psychology's Crud Factor: The Case of Aggression

Christopher J. Ferguson et al.

Summary: This study found that statistically significant but trivial effects may emerge in large datasets, but these effects may lack interpretive value, cautioning against over-interpretation.Variables with little theoretical relevance achieved significance, suggesting that effect sizes below r = .10 should not be interpreted as hypothesis supportive.

PROFESSIONAL PSYCHOLOGY-RESEARCH AND PRACTICE (2021)

Article Neurosciences

Neurophysiological Responses to Interpersonal Emotional Images Prospectively Predict the Impact of COVID-19 Pandemic-Related Stress on Internalizing Symptoms

Lindsay Dickey et al.

Summary: This study found that emerging adults experienced numerous stressful events related to the COVID-19 pandemic, leading to overall increases in depression symptoms and traumatic intrusions during the pandemic. Neurophysiological reactivity to emotional stimuli plays an important role in predicting internalizing symptoms after exposure to stressors, highlighting the impact of individual differences in neurophysiological responses to emotional stimuli on vulnerability to depression and traumatic intrusions following stress exposure.

BIOLOGICAL PSYCHIATRY-COGNITIVE NEUROSCIENCE AND NEUROIMAGING (2021)

Article Psychology

Putting Psychology to the Test: Rethinking Model Evaluation Through Benchmarking and Prediction

Roberta Rocca et al.

Summary: Consensus on common evaluation benchmarks is lacking in the field of psychology, leading to idiosyncratic evaluation practices and difficulty in discerning between good and bad models. Introducing common benchmarks is advocated as a means to drive cumulative progress in psychology, emphasizing the practical utility of scientific models.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Article Psychology

An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports

Anne M. Scheel et al.

Summary: Selective publishing of positive results may distort the evidence for scientific claims. A comparison between Registered Reports (RRs) and standard literature in psychology reveals a significant difference in the proportion of positive results, suggesting a reduction in publication bias and/or Type I error inflation in RR literature.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Social

Maximal positive controls: A method for estimating the largest plausible effect size

Joseph Hilgard

Summary: Effect sizes in social psychology are generally small, and maximal positive controls can help identify implausible study results compared to direct replication, particularly in the context of aggressive cognition measures.

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2021)

Article Psychology, Multidisciplinary

The Bias of Individuals (in Crowds): Why Implicit Bias Is Probably a Noisily Measured Individual-Level Construct

Paul Connor et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2020)

Article Psychology

Crud (Re)Defined

Amy Orben et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2020)

Correction Psychology

Evaluating effect size in psychological research: Sense and nonsense (vol 2, pg 156, 2019)

D. C. Funder et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2019)

Article Clinical Neurology

The 52 symptoms of major depression: Lack of content overlap among seven common depression scales

Eiko I. Fried

JOURNAL OF AFFECTIVE DISORDERS (2017)

Article Multidisciplinary Sciences

Meta-assessment of bias in science

Daniele Fanelli et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2017)

Article Psychology, Social

Construct Validation in Social and Personality Research: Current Practice and Recommendations

Jessica K. Flake et al.

SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE (2017)

Article Psychology, Social

The State of Social and Personality Science: Rotten to the Core, Not So Bad, Getting Better, or Getting Worse?

Matt Motyl et al.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2017)

Article Psychology, Social

Statistically Small Effects of the Implicit Association Test Can Have Societally Large Effects

Anthony G. Greenwald et al.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2015)

Article Psychology, Multidisciplinary

Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors

Andrew Gelman et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2014)

Review Neurosciences

Power failure: why small sample size undermines the reliability of neuroscience

Katherine S. Button et al.

NATURE REVIEWS NEUROSCIENCE (2013)

Article Psychology, Multidisciplinary

A comprehensive review of reporting practices in psychological journals: Are effect sizes really enough?

Astrid Fritz et al.

THEORY & PSYCHOLOGY (2013)

Article Psychology, Multidisciplinary

On Effect Size

Ken Kelley et al.

PSYCHOLOGICAL METHODS (2012)

Article Multidisciplinary Sciences

Positive Results Increase Down the Hierarchy of the Sciences

Daniele Fanelli

PLOS ONE (2010)

Article Psychology, Multidisciplinary

An Effect Size Primer: A Guide for Clinicians and Researchers

Christopher J. Ferguson

PROFESSIONAL PSYCHOLOGY-RESEARCH AND PRACTICE (2009)

Article Psychology, Multidisciplinary

Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition

Edward Vul et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2009)

Article Multidisciplinary Sciences

Quality assessment of the human genome sequency

J Schmutz et al.

NATURE (2004)