LARNet-STC: Spatio-temporal orthogonal region selection network for laryngeal closure detection in endoscopy videos. (May 2022)

• Record Type: Journal Article
• Authors: Wang, Yang Yang; Hamad, Ali S.; Palaniappan, Kannappan; Lever, Teresa E.; Bunyak, Filiz
• Is Part Of: Computers in biology and medicine. Volume 144(2022)
• Publication Date: 2022-05
• Subjects: Deep learning -- Vocal folds -- Laryngeal endoscopy -- Laryngeal closure detection -- Laryngeal adductor reflex; Medicine -- Data processing -- Periodicals; Biology -- Data processing -- Periodicals; 610.285
• DOI: 10.1016/j.compbiomed.2022.105339
• Languages: English
• ISSNs: 0010-4825

Abstract

Abstract: The vocal folds (VFs) are a pair of muscles in the larynx that play a critical role in breathing, swallowing, and speaking. VF function can be adversely affected by various medical conditions including head or neck injuries, stroke, tumor, and neurological disorders. In this paper, we propose a deep learning system for automated detection of laryngeal adductor reflex (LAR) events in laryngeal endoscopy videos to enable objective, quantitative analysis of VF function. The proposed deep learning system incorporates our novel orthogonal region selection network and temporal context. This network learns to directly map its input to a VF open/close state without first segmenting or tracking the VF region. This one-step approach drastically reduces manual annotation needs from labor-intensive segmentation masks or VF motion tracks to frame-level class labels. The proposed spatio-temporal network with an orthogonal region selection subnetwork allows integration of local image features, global image features, and VF state information in time for robust LAR event detection. The proposed network is evaluated against several network variations that incorporate temporal context and is shown to lead to better performance. The experimental results show promising performance for automated, objective, and quantitative analysis of LAR events from laryngeal endoscopy videos with over 90% and 99% F1 scores for LAR and non-LAR frames respectively. Highlights: Automated detection of laryngeal adductor reflex events in laryngeal endoscopy videos. Vocal folds (VFs) play critical role in breathing, swallowing, and speaking. VF function can be affected by injuries, stroke, tumor and neurological disorders. Deep learning-based system proposed for automated analysis of VF function. Proposed system integrates spatial and temporal visual cues for robust analysis.