4.5 Review

Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation

期刊

出版社

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.paid.2020.110205

关键词

Measurement; Assessment; Psychometrics; Replicability; Test interpretation; Test scores; Validity; Instrument development

资金

  1. European Commission (EC) [629430]

向作者/读者索取更多资源

This article examines various critiques of quantitative psychology, highlighting the importance of language and concepts while revealing the confusion and erroneous equations between phenomena and properties in construct research. It clarifies the conceptual relationships between nomological networks, representation theorems, and psychometric modeling, shedding light on biased inferences and potential replicability problems in the field.
Various lines of critique of quantitative psychology, well-established and new, are used to trace along the field's typical steps of research a complex network of misconceptions and fallacies codified in psychological jargon. The article explores what constructs actually are, why they are needed in psychology, fallacies and challenges in construct research, and the crucial role of language. It shows how common misconceptions of language and concepts mislead psychologists to conflate phenomena, qualities, quantities and constructs with one another and with their semiotic encodings in terms, variables and scores. The article clarifies the conceptual relations between nomological networks, representation theorems and psychometric modelling. It reveals conflations of disparate notions of causality and unobservability, and erroneous equations of nomological networks with semantic networks, description with explanation, and measurement theories with explanatory theories. Instead of establishing causal measurand-result relations, common practices match data generation to the results rather than the phenomena and properties studied. Mathematical meaning for scores is often created from differences between individuals and between different phenomena and properties, which constitute mere conceptual entities and cannot reflect magnitudes attributable to individuals. This entails biased inferences on the actual study phenomena and shows that replicability problems may be even larger than assumed.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据