Adherence to Structured Risk Assessment Guidelines: Development and Preliminary Evaluation of an Adherence Scale for the START:AV. Issue 5 (19th October 2020)

• Record Type: Journal Article
• Authors: De Beuf, Tamara L. F.; de Vogel, Vivienne; de Ruiter, Corine
• Is Part Of: Journal of Forensic Psychology Research and Practice. Volume 20:Issue 5(2020)
• Page Start: 413
• Page End: 435
• Publication Date: 2020-10-19
• Subjects: Implementation -- adherence -- fidelity -- structured risk assessment -- START:AV; Forensic psychology -- Research -- Periodicals; 614.15
• DOI: 10.1080/24732850.2020.1756676
• Languages: English
• ISSNs: 2473-2850

Abstract

ABSTRACT: Risk assessment instruments are widely used to predict risk of adverse outcomes, such as violence or victimization, and to allocate resources for managing these risks among individuals involved in criminal justice and forensic mental health services. For risk assessment instruments to reach their full potential, they must be implemented with fidelity. A lack of information on administration fidelity hinders transparency about the implementation quality, as well as the interpretation of negative or inconclusive findings from predictive validity studies. The present study focuses on adherence, a dimension of fidelity. Adherence denotes the extent to which the risk assessment is completed according to the instrument's guidelines. We developed an adherence measure, tailored to the Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV), an evidence-based risk assessment instrument for adolescents. With the START:AV Adherence Rating Scale, we explored the degree to which 11 key features of the instrument were adhered to in 306 START:AVs forms, completed by 17 different evaluators in a Dutch residential youth care facility over a two-year period. Good to excellent interrater reliability was found for all adherence items. We identified differences in adherence scores on the various START:AV features, as well as significant improvement in adherence for those who attended a START:AV refresher workshop. Outcomes of risk assessment instruments potentially impact decision-making, for example, whether a youth's secure placement should be extended. Therefore, we recommend fidelity monitoring to ensure the risk assessment practice was delivered as intended.