NLPReViz: an interactive tool for natural language processing on clinical text. (22nd July 2017)

• Record Type: Journal Article
• Authors: Trivedi, Gaurav; Pham, Phuong; Chapman, Wendy W; Hwa, Rebecca; Wiebe, Janyce; Hochheiser, Harry
• Is Part Of: Journal of the American Medical Informatics Association. Volume 25:Number 1(2018)
• Page Start: 81
• Page End: 87
• Publication Date: 2017-07-22
• Subjects: natural language processing (NLP) -- electronic health records -- machine learning -- user-computer interface -- medical informatics; Medical informatics -- Periodicals; Information Services -- Periodicals; Medical Informatics -- Periodicals; Médecine -- Informatique -- Périodiques; Informatica; Geneeskunde; Informatique médicale; Computer network resources; Electronic journals; 610.285
• DOI: 10.1093/jamia/ocx070
• Languages: English
• ISSNs: 1067-5027

Abstract

Abstract: The gap between domain experts and natural language processing expertise is a barrier to extracting understanding from clinical text. We describe a prototype tool for interactive review and revision of natural language processing models of binary concepts extracted from clinical notes. We evaluated our prototype in a user study involving 9 physicians, who used our tool to build and revise models for 2 colonoscopy quality variables. We report changes in performance relative to the quantity of feedback. Using initial training sets as small as 10 documents, expert review led to final F 1 scores for the "appendiceal-orifice" variable between 0.78 and 0.91 (with improvements ranging from 13.26% to 29.90%). F 1 for "biopsy" ranged between 0.88 and 0.94 (−1.52% to 11.74% improvements). The average System Usability Scale score was 70.56. Subjective feedback also suggests possible design improvements.