Challenges in adapting existing clinical natural language processing systems to multiple, diverse health care settings. (17th April 2017)

• Record Type: Journal Article
• Authors: Carrell, David S; Schoen, Robert E; Leffler, Daniel A; Morris, Michele; Rose, Sherri; Baer, Andrew; Crockett, Seth D; Gourevitch, Rebecca A; Dean, Katie M; Mehrotra, Ateev
• Is Part Of: Journal of the American Medical Informatics Association. Volume 24:Number 5(2017:Sep.)
• Page Start: 986
• Page End: 991
• Publication Date: 2017-04-17
• Subjects: natural language processing -- information dissemination -- electronic health records -- cancer screening -- data collection; Medical informatics -- Periodicals; Information Services -- Periodicals; Medical Informatics -- Periodicals; Médecine -- Informatique -- Périodiques; Informatica; Geneeskunde; Informatique médicale; Computer network resources; Electronic journals; 610.285
• DOI: 10.1093/jamia/ocx039
• Languages: English
• ISSNs: 1067-5027

Abstract

Abstract: Objective: Widespread application of clinical natural language processing (NLP) systems requires taking existing NLP systems and adapting them to diverse and heterogeneous settings. We describe the challenges faced and lessons learned in adapting an existing NLP system for measuring colonoscopy quality. Materials and Methods: Colonoscopy and pathology reports from 4 settings during 2013–2015, varying by geographic location, practice type, compensation structure, and electronic health record. Results: Though successful, adaptation required considerably more time and effort than anticipated. Typical NLP challenges in assembling corpora, diverse report structures, and idiosyncratic linguistic content were greatly magnified. Discussion: Strategies for addressing adaptation challenges include assessing site-specific diversity, setting realistic timelines, leveraging local electronic health record expertise, and undertaking extensive iterative development. More research is needed on how to make it easier to adapt NLP systems to new clinical settings. Conclusions: A key challenge in widespread application of NLP is adapting existing systems to new clinical settings.