Journal
FIELD METHODS
Volume 20, Issue 3, Pages 272-282Publisher
SAGE PUBLICATIONS INC
DOI: 10.1177/1525822X08317166
Keywords
qualitative analysis; interviews; reliability; simulations
Categories
Ask authors/readers for more resources
We propose the pooled estimator of kappa, an efficient estimator when summarizing the interrater agreement for qualitative data with many items but few subjects. We evaluate this estimator through a simulation of proposed and alternative (average kappa) estimators and subsequently apply our method to calculate pooled and average kappas over 2,176 rated items from six semistructured interviews with sponsors of the CAHPS. The proposed pooled kappa estimator efficiently summarizes interrater agreement by domain. It is more widely applicable and makes better use of scarce subjects than simply averaging item-level kappas.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available