A Machine Learning Approach to Reclassifying Miscellaneous Patient Safety Event Reports. Issue 8 (December 2021)

• Record Type: Journal Article
• Authors: Fong, Allan; Behzad, Shabnam; Pruitt, Zoe; Ratwani, Raj M.
• Is Part Of: Journal of patient safety. Volume 17:Issue 8(2021)
• Publication Date: 2021-12
• Subjects: patient safety reports -- incident reports -- miscellaneous -- natural language processing -- patient safety analysts; Patients -- Safety measures -- Periodicals; Medicine -- Practice -- Safety measures -- Periodicals; Medical errors -- Prevention -- Periodicals; 610.289
• DOI: 10.1097/PTS.0000000000000731
• Languages: English
• ISSNs: 1549-8417

Abstract

Abstract : Background and Objectives: Medical errors are a leading cause of death in the United States. Despite widespread adoption of patient safety reporting systems to address medical errors, making sense of the reports collected in these systems is challenging in practice. Event classification taxonomies used in many reporting systems can be complex and difficult to understand by frontline reporters, leading reporters to classify reports as "miscellaneous" as opposed to assigning a specific event-type category, which may facilitate analysis. Methods: To assist patient safety analysts in their analysis of "miscellaneous" reports, we developed an ensemble machine learning natural language processing model to reclassify these reports. We integrated the model into a clinical workflow dashboard, evaluated user feedback, and compared differences in user thresholds for model performance. Results and Conclusions: Integrating an ensemble model to classify "miscellaneous" event reports with an interactive visualization was helpful to patient safety analysts review "miscellaneous" reports. However, patient safety analysts have different thresholds for model reclassification depending on their role and experience with "miscellaneous" event reports.