Assessing the Calibration of Actuarial Risk Scales: A Primer on the E/O Index. (January 2017)

• Record Type: Journal Article
• Authors: Hanson, R. Karl
• Other Names: Helmus L. Maaike guest-editor.; Babchishin Kelly M. guest-editor.
• Is Part Of: Criminal justice and behavior. Volume 44:Number 1(2017:Jan.)
• Page Start: 26
• Page End: 39
• Publication Date: 2017-01
• Subjects: calibration -- predictive accuracy -- risk assessment -- recidivism; Correctional psychology -- Periodicals; 364.6
• DOI: 10.1177/0093854816683956
• Languages: English
• ISSNs: 0093-8548

Abstract

Assessing the predictive accuracy of actuarial risk assessment tools requires consideration of discrimination (the differences between recidivists and nonrecidivists) and calibration (the credibility of the recidivism rates associated with test scores or categories). Currently, there are no conventions for reporting calibration effect sizes for offender risk tools. This article explains one promising calibration effect size statistic (the Expected/Observed [E/O] index) and provides an illustrative example of how it can be calculated and interpreted. Briefly, the E/O index is the ratio of the expected number of recidivists to the observed number of recidivists. Guidance is provided for calculating the E/O index with fixed follow-up data as well as from survival data. This article also discusses alternative approaches to examining calibration and provides references to other studies using the E/O index to assess the calibration of offender risk scales.