Sensitivity of Error: An Examination of the Impact of Human Mistakes on Offender Risk Classification Validity. (3rd April 2018)

• Record Type: Journal Article
• Authors: Ho, Aaron; Shlosberg, Amy; Lesneskie, Eric
• Is Part Of: Justice system journal. Volume 39:Number 2(2018)
• Page Start: 171
• Page End: 188
• Publication Date: 2018-04-03
• Subjects: Sensitivity of error -- judicial decision making -- human mistakes -- offender risk classification -- offender risk assessment -- validity; Justice, Administration of -- United States -- Periodicals; Court administration -- United States -- Periodicals; Court administration; Justice, Administration of; United States; Periodicals; 347.7313
• DOI: 10.1080/0098261X.2018.1430632
• Languages: English
• ISSNs: 0098-261X

Abstract

ABSTRACT: Human error in offender risk assessment can take many forms, including assessment staff bias and mistakes in official records. The effect of these human mistakes on outcomes depends on the "sensitivity of error" of the risk assessment instruments. Yet how these human errors influence risk classification outcomes has remained speculative. To disentangle this relationship and fill the research gap, simulated human error was injected into two risk datasets to determine how unreliability and invalidity affects classification validity. Two main conclusions are drawn. First, risk devices are highly sensitive to human errors, and their use should be met with caution. Second, new techniques are needed to measure and convey model validity. The findings and the conclusions of this study are critical given that more accurate risk assessments give rise to higher levels of public safety. Methods of reducing the sensitivity of error in risk instruments are offered.