AI-enabled remote and objective quantification of stress at scale. (May 2020)

• Record Type: Journal Article
• Authors: Al-Jebrni, Abdulrhman H.; Chwyl, Brendan; Wang, Xiao Yu; Wong, Alexander; Saab, Bechara J.
• Is Part Of: Biomedical signal processing and control. Volume 59(2020)
• Publication Date: 2020-05
• Subjects: Artificial intelligence -- Digital therapeutics -- Photophlethysmography -- Heart rate variability -- Stress; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2020.101929
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: We have developed deep neural networks that quantify stress from 30 s selfie videos. We interrogate the networks and find they demonstrate strong generalization. We show the networks are much more accurate than contemporary algorithms. We conclude the networks provide a meaningful and objective assessment of stress. We reason the networks can be used to measure the efficacy of digital psychotherapy. Abstract: Background: Accurate measurement of human stress at scale is a major mHealth challenge. Here we explore the potential for deep neural networks (DNNs) to improve remote and objective quantification of stress from voluntary selfie videos captured through mobile device front-facing cameras. Methods: Two DNNs were trained with heart rate (HR) and heart rate variability (HRV) data obtained through photophlethysmographic imaging (PPGI) of 11, 823 mobile device selfie videos captured in tandem with self-assessments of stress, and compared to contemporary algorithms used to estimate stress from HR and HRV data. Results: A classification DNN and predictive DNN determined self-reported stress with 86 % accuracy and a mean absolute error of 0.001, respectively. Both DNNs performed far better than other recently described approaches when applied to the identical dataset. Conclusions: Well-trained DNNs can objectively and remotely quantify stress at scale. Future efforts may concentrate on the measurement of additional enigmatic cognitive states.