A measure of association for ordered categorical data in population-based studies. (March 2018)

• Record Type: Journal Article
• Authors: Nelson, Kerrie P; Edwards, Don
• Other Names: Nakas Christos T guest-editor.; Reiser Benjamin guest-editor.
• Is Part Of: Statistical methods in medical research. Volume 27:Number 3(2018)
• Page Start: 812
• Page End: 831
• Publication Date: 2018-03
• Subjects: Agreement -- association -- crossed random effects -- generalized linear mixed model -- ordinal classifications -- weighted kappa; Medicine -- Research -- Statistical methods -- Periodicals; Research -- Periodicals; Review Literature -- Periodicals; Statistics -- methods -- Periodicals; Médecine -- Recherche -- Méthodes statistiques -- Périodiques; 610.727
• DOI: 10.1177/0962280216643347
• Languages: English
• ISSNs: 0962-2802

Abstract

Ordinal classification scales are commonly used to define a patient's disease status in screening and diagnostic tests such as mammography. Challenges arise in agreement studies when evaluating the association between many raters' classifications of patients' disease or health status when an ordered categorical scale is used. In this paper, we describe a population-based approach and chance-corrected measure of association to evaluate the strength of relationship between multiple raters' ordinal classifications where any number of raters can be accommodated. In contrast to Shrout and Fleiss' intraclass correlation coefficient, the proposed measure of association is invariant with respect to changes in disease prevalence. We demonstrate how unique characteristics of individual raters can be explored using random effects. Simulation studies are conducted to demonstrate the properties of the proposed method under varying assumptions. The methods are applied to two large-scale agreement studies of breast cancer screening and prostate cancer severity.