Leveraging electronic health records for data science: common pitfalls and how to avoid them. Issue 12 (December 2022)

• Record Type: Journal Article
• Authors: Sauer, Christopher M; Chen, Li-Ching; Hyland, Stephanie L; Girbes, Armand; Elbers, Paul; Celi, Leo A
• Is Part Of: Lancet. Volume 4:Issue 12(2022)
• Page Start: e893
• Page End: e898
• Publication Date: 2022-12
• Subjects: Medical care -- Data processing -- Periodicals; Medical care -- Information technology -- Periodicals; Medical informatics -- Periodicals; 610.285
• DOI: 10.1016/S2589-7500(22)00154-6
• Languages: English
• ISSNs: 2589-7500

Abstract

Summary: Analysis of electronic health records (EHRs) is an increasingly common approach for studying real-world patient data. Use of routinely collected data offers several advantages compared with other study designs, including reduced administrative costs, the ability to update analysis as practice patterns evolve, and larger sample sizes. Methodologically, EHR analysis is subject to distinct challenges because data are not collected for research purposes. In this Viewpoint, we elaborate on the importance of in-depth knowledge of clinical workflows and describe six potential pitfalls to be avoided when working with EHR data, drawing on examples from the literature and our experience. We propose solutions for prevention or mitigation of factors associated with each of these six pitfalls—sample selection bias, imprecise variable definitions, limitations to deployment, variable measurement frequency, subjective treatment allocation, and model overfitting. Ultimately, we hope that this Viewpoint will guide researchers to further improve the methodological robustness of EHR analysis.