Journal
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION
Volume 15, Issue 1, Pages 193-208Publisher
SPRINGER HEIDELBERG
DOI: 10.1007/s11634-020-00394-8
Keywords
Cohen's unweighted kappa; Weighted kappa; Unordered classifications; Agreement studies; Inter-rater agreement; Inter-rater reliability
Categories
Ask authors/readers for more resources
This study distinguishes between regular nominal classifications and dichotomous-nominal classifications, introducing different coefficients for evaluating the latter. Kappa coefficients for dichotomous-nominal classifications with identical categories are defined and all coefficients belong to a one-parameter family. The values of the new kappa coefficients can be strictly ordered in precisely two ways, suggesting they measure the same thing to varying extents.
Two types of nominal classifications are distinguished, namely regular nominal classifications and dichotomous-nominal classifications. The first type does not include an 'absence' category (for example, no disorder), whereas the second type does include an 'absence' category. Cohen's unweighted kappa can be used to quantify agreement between two regular nominal classifications with the same categories, but there are no coefficients for assessing agreement between two dichotomous-nominal classifications. Kappa coefficients for dichotomous-nominal classifications with identical categories are defined. All coefficients proposed belong to a one-parameter family. It is studied how the coefficients for dichotomous-nominal classifications are related and if the values of the coefficients depend on the number of categories. It turns out that the values of the new kappa coefficients can be strictly ordered in precisely two ways. The orderings suggest that the new coefficients are measuring the same thing, but to a different extent. If one accepts the use of magnitude guidelines, it is recommended to use stricter criteria for the new coefficients that tend to produce higher values.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available