Comparison metrics for multi-step prediction of rare events in vital sign signals. (February 2023)

• Record Type: Journal Article
• Authors: Kandhare, Pravinkumar G.; Ambalavanan, Namasivayam; Travers, Colm P.; Carlo, Waldemar A.; Sirakov, Nikolay M.; Nakhmani, Arie
• Is Part Of: Biomedical signal processing and control. Volume 80:Part 2(2023)
• Publication Date: 2023-02
• Subjects: Deep learning -- Predictor evaluation -- Time series forecasting; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.104371
• Languages: English
• ISSNs: 1746-8094

Abstract

Abstract: Prediction of changes in biomedical signals, such as vital signs, is useful for many clinical applications. Several signal prediction (forecasting) tools were developed, but their evaluation and applicability to a specific clinical use is context dependent. In this work, we propose a novel method to tackle the problem of evaluation and comparison of vital sign predictors for intervention based clinical studies. The proposed prediction quality measures are particularly well-suited for forecasting rare events scenarios. Specifically, using the novel metrics, we measure the prediction statistics and compare nine deep learning and autoregressive forecasting models for multi-step prediction of rare bradycardia events in preterm infants, however the new concepts allow applications to other biomedical signals. We validated the novel metrics with experimental results on testing sets with several days of vital sign recordings. Our results show that simple statistical predictors could outperform state-of-the-art deep learning architectures for low-dimensional signals. Highlights: Novel metrics for evaluation of multi-step predictors of rare events Nine predictors of bradycardia events were compared using the new metrics Simple predictors outperform deep learning based predictors for vital sign datasets