Determining agreement using rater characteristics. Issue 4 (3rd July 2016)

• Record Type: Journal Article
• Authors: Davis, Mat D.; Joseph, Jeffrey
• Is Part Of: Journal of biopharmaceutical statistics. Volume 26:Issue 4(2016)
• Page Start: 619
• Page End: 630
• Publication Date: 2016-07-03
• Subjects: Agreement -- intraclass correlation -- reliability -- sensitivity -- specificity; Pharmacy -- Statistical methods -- Periodicals; Drugs -- Testing -- Statistical methods -- Periodicals; Biometry -- Periodicals; Biopharmaceutics -- Periodicals; Pharmacokinetics -- Periodicals; 615.19
• DOI: 10.1080/10543406.2015.1052490
• Languages: English
• ISSNs: 1054-3406

Abstract

ABSTRACT: When evaluating the usefulness of clinical information for the diagnosis of disease, multiple raters provide a diagnosis for the same set of data. These ratings provide important insights into the performance of the diagnosis, determining the accuracy of each rater's diagnosis compared to the truth standard and the level of agreement among the raters. We demonstrate that the intraclass correlation coefficient (ICC) is dependent on the sensitivities and specificities of the raters involved in the study. Given the sensitivity and specificity of any number of raters, along with the prevalence of disease, the expected ICC can be determined.