4.5 Article

The effects of careless responding on the fit of confirmatory factor analysis and item response theory models

期刊

BEHAVIOR RESEARCH METHODS
卷 -, 期 -, 页码 -

出版社

SPRINGER
DOI: 10.3758/s13428-023-02074-9

关键词

Careless responding; Model fit; Confirmatory factor analysis; Item response theory; Surveys

向作者/读者索取更多资源

It has been found that careless responding in online surveys can negatively impact model fit within latent variable frameworks. Two studies were conducted to investigate the relationship between careless responding and model fit, and the results showed that the effects are nuanced and contingent on various factors.
It is common to model responses to surveys within latent variable frameworks (e.g., item response theory [IRT], confirmatory factor analysis [CFA]) and use model fit indices to evaluate model-data congruence. Unfortunately, research shows that people occasionally engage in careless responding (CR) when completing online surveys. While CR has the potential to negatively impact model fit, this issue has not been systematically explored. To better understand the CR-fit linkage, two studies were conducted. In study 1, participants' response behaviors were experimentally shaped and used to embed aspects of a comprehensive simulation (study 2) with empirically informed data. For this simulation, 144 unique conditions (which varied the sample size, number of items, CR prevalence, CR severity, and CR type), two latent variable models (IRT, CFA), and six model fit indices (chi(2), RMSEA, SRMSR [CFA] and M2, RMSEA, SRMSR [IRT]), were examined. The results indicated that CR deteriorates model fit under most circumstances, though these effects are nuanced, variable, and contingent on many factors. These findings can be leveraged by researchers and practitioners to improve survey methods, obtain more accurate survey results, develop more precise theories, and enable more justifiable data-driven decisions.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据