Weighted Kappas for 3×3 Tables. (16th June 2013)

• Record Type: Journal Article
• Authors: Warrens, Matthijs J.
• Other Names: Zitikis Ricardas Academic Editor.
• Is Part Of: Journal of probability and statistics. Volume 2013(2013)
• Publication Date: 2013-06-16
• Subjects: Probabilities -- Periodicals; Mathematical statistics -- Periodicals; Mathematical statistics; Probabilities; Periodicals; 519
• DOI: 10.1155/2013/325831
• Languages: English
• ISSNs: 1687-952X

Abstract

Abstract : Weighted kappa is a widely used statistic for summarizing inter-rater agreement on a categorical scale. For rating scales with three categories, there are seven versions of weighted kappa. It is shown analytically how these weighted kappas are related. Several conditional equalities and inequalities between the weighted kappas are derived. The analytical analysis indicates that the weighted kappas are measuring the same thing but to a different extent. One cannot, therefore, use the same magnitude guidelines for all weighted kappas.