A deep learning approach for remote heart rate estimation. (April 2022)

• Record Type: Journal Article
• Authors: Przybyło, Jaromir
• Is Part Of: Biomedical signal processing and control. Volume 74(2022)
• Publication Date: 2022-04
• Subjects: Deep learning -- Imaging photoplethysmography -- Videoplethysmography -- Telemedicine -- Image processing -- Heart rate estimation; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2021.103457
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: Heart rate (HR) measurement method based on videoplethysmography (VPG) and LSTM deep neural network. A method that replaces several existing algorithms and thus improves the accuracy of HR estimation. The solution works with color and grayscale/infrared images, which allows it to be used when the RGB camera is not available. The algorithm that can continuously monitor the user's heart rate in real-world applications (telemedicine, sport). Abstract: Remote monitoring of elderly people or patients in home isolation is an essential part of modern telemedicine. Videoplethysmography (VPG) is a method of noncontact assessment of heart rate and other cardiovascular parameters. Many algorithms have been developed to extract and improve the quality of the VPG signal. The main objective of this study is to design a method that replaces existing multistage algorithms and provides continuous monitoring of the user's pulse. The article presents a method of heart rate measurement based on the Long Short Term Memory (LSTM) Deep Neural Network. The proposed method outperforms the algorithm based on the analysis of the green component (G) and provides comparable results to the state-of-the-art methods such as Independent Component Analysis (ICA) and Plane Orthogonal to the Skin (POS). The best result for G was 6.49 bpm (beats per minute), ICA = 3.02 bpm, POS = 2.61 bpm, and for the proposed method was 3.26 bpm. While maintaining the accuracy comparable to ICA and POS algorithms, the LSTM network works well also beyond the visible spectrum, e.g., with infrared lighting when the color signal is not available and is easily adaptable to telemedicine applications.