3.8 Article

Limitations of the Sum-and-Alpha Approach to Measurement in Behavioral Research

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Psychology, Multidisciplinary

Regression Discontinuity Designs in a Latent Variable Framework

James Soland et al.

Summary: When randomized control trials are not available, regression discontinuity (RD) designs are a viable way to produce causal estimates of how a program or intervention affects an outcome. In this tutorial, a straightforward way to implement an RD model as a structural equation model (SEM) is presented, aiming to introduce RD to a broader audience in psychology and show researchers the benefits of employing an SEM framework.

PSYCHOLOGICAL METHODS (2023)

Article Psychology, Biological

The generalizability crisis

Tal Yarkoni

Summary: Most theories and hypotheses in psychology are verbal in nature, yet their evaluation overwhelmingly relies on inferential statistical procedures. However, many applications of statistical inference in psychology fail to meet the basic condition of closely aligning verbal and statistical expressions, which results in limited generalizability of results, increased false-positive rates, and researchers drawing sweeping verbal generalizations without meaningful connection to statistical quantities.

BEHAVIORAL AND BRAIN SCIENCES (2022)

Article Psychology, Multidisciplinary

Construct Validity and the Validity of Replication Studies: A Systematic Review

Jessica Kay Flake et al.

Summary: This study highlights the lack of guidance in addressing measurement challenges that threaten construct validity in replication research. By conducting a systematic review of measures used in original and replication studies, it revealed that scales used in original studies often lacked validity evidence. The research identifies four common measurement challenges for replicators and provides solutions to improve measurement practices.

AMERICAN PSYCHOLOGIST (2022)

Article Psychology, Multidisciplinary

Avoiding Bias From Sum Scores in Growth Estimates: An Examination of IRT-Based Approaches to Scoring Longitudinal Survey Responses

Megan Kuhfeld et al.

Summary: A large amount of our knowledge about human development, learning, behavior, and interaction is derived from survey data. Researchers utilize longitudinal growth modeling to study the development of students in terms of psychological and social-emotional learning constructs during elementary and middle school. Through simulations and empirical studies, it has been found that using multidimensional item response theory (IRT) approaches that take into account latent variable covariances over time leads to better estimation of growth parameters in longitudinal growth models.

PSYCHOLOGICAL METHODS (2022)

Article Mathematical & Computational Biology

A multilevel structural equation model for assessing a drug effect on a patient-reported outcome measure in on-demand medication data

Rob Kessels et al.

Summary: In this paper, data from a clinical trial studying the impact of an on-demand drug on women with low sexual desire were analyzed. The traditional approach of aggregating data before analysis was found to have drawbacks, such as varying standard errors and implicit assumptions about item weights. A multilevel structural equation model was proposed as an alternative analysis method to address these issues.

BIOMETRICAL JOURNAL (2021)

Article Mathematics, Interdisciplinary Applications

Measurement in Intensive Longitudinal Data

Daniel McNeish et al.

Summary: The paper demonstrates how to incorporate measurement models into DSEM for more rigorous measurement and to assess the invariance of scales across time and individuals. An example from a study on self-regulation is provided to show how to fit the model in Mplus and interpret the results.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2021)

Article Education & Educational Research

Strengthening the foundation of educational psychology by integrating construct validation into open science reform

Jessica Kay Flake

Summary: The increasing focus on transparency and replication in science has led to reforms in research practices and dissemination. Methodological reform movements are now addressing the lack of transparency and rigor in measurement development and usage, with a particular emphasis on the potential challenges in replication research. Educational psychology is seen as well-positioned to contribute to these efforts.

EDUCATIONAL PSYCHOLOGIST (2021)

Article Psychology

Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them

Jessica Kay Flake et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2020)

Article Psychology, Multidisciplinary

Measurement Practices in Large-Scale Replications: Insights From Many Labs 2

Mairead Shaw et al.

CANADIAN PSYCHOLOGY-PSYCHOLOGIE CANADIENNE (2020)

Article Psychology

Hidden Invalidity Among 15 Commonly Used Measures in Social and Personality Psychology

Ian Hussey et al.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2020)

Article Psychology, Multidisciplinary

Machine Learning and Psychological Research: The Unexplored Effect of Measurement

Ross Jacobucci et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2020)

Article Psychology, Mathematical

Thinking twice about sum scores

Daniel McNeish et al.

BEHAVIOR RESEARCH METHODS (2020)

Article Psychology

Psychology's Replication Crisis and Clinical Psychological Science

Jennifer L. Tackett et al.

Annual Review of Clinical Psychology (2019)

Review Psychology

Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis

Patrick E. Shrout et al.

ANNUAL REVIEW OF PSYCHOLOGY, VOL 69 (2018)

Article Psychology, Multidisciplinary

Thanks Coefficient Alpha, We'll Take It From Here

Daniel McNeish

PSYCHOLOGICAL METHODS (2018)

Editorial Material Multidisciplinary Sciences

Measurement error and the replication crisis

Eric Loken et al.

SCIENCE (2017)

Article Psychology, Social

Construct Validation in Social and Personality Research: Current Practice and Recommendations

Jessica K. Flake et al.

SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE (2017)

Article Psychology, Clinical

Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all

Rik Crutzen et al.

HEALTH PSYCHOLOGY REVIEW (2017)

Review Medicine, General & Internal

Depression sum-scores don't add up: why analyzing specific depression symptoms is essential

Eiko I. Fried et al.

BMC MEDICINE (2015)

Article Multidisciplinary Sciences

Estimating the reproducibility of psychological science

Alexander A. Aarts et al.

SCIENCE (2015)

Article Psychology, Multidisciplinary

A cautionary note on testing latent variable models

Ivan Ropovik

FRONTIERS IN PSYCHOLOGY (2015)

Review Public, Environmental & Occupational Health

Validity and Reliability Reporting Practices in the Field of Health Education and Behavior: A Review of Seven Journals

Adam E. Barry et al.

HEALTH EDUCATION & BEHAVIOR (2014)

Article Psychology, Social

Structural equation modelling: Adjudging model fit

Paul Barrett

PERSONALITY AND INDIVIDUAL DIFFERENCES (2007)

Article Psychology, Educational

An empirical study of reporting practices concerning measurement validity

TP Hogan et al.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2004)

Article Mathematics, Interdisciplinary Applications

In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings

HW Marsh et al.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2004)

Article Psychology, Educational

Reliability methods: A note on the frequency of use of various types

TP Hogan et al.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2000)