期刊
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY
卷 61, 期 -, 页码 29-48出版社
BRITISH PSYCHOLOGICAL SOC
DOI: 10.1348/000711006X126600
关键词
-
Pi (pi) and kappa (kappa) statistics are widely used in the areas of psychiatry and psychological testing to compute the extent of agreement between raters on nominally scaled data. It is a fact that these coefficients occasionally yield unexpected results in situations known as the paradoxes of kappa. This paper explores the origin of these limitations, and introduces an alternative and more stable agreement coefficient referred to as the AC(1) coefficient. Also proposed are new variance estimators for the multiple-rater generalized pi and AC(1) statistics, whose validity does not depend upon the hypothesis of independence between raters. This is an improvement over existing alternative variances, which depend on the independence assumption. A Monte-Carlo simulation study demonstrates the validity of these variance estimators for confidence interval construction, and confirms the value of AC(1) as an improved alternative to existing inter-rater reliability statistics.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据