Automatic sleep scoring using patient-specific ensemble models and knowledge distillation for ear-EEG data. (March 2023)

• Record Type: Journal Article
• Authors: Borup, Kenneth; Kidmose, Preben; Phan, Huy; Mikkelsen, Kaare
• Is Part Of: Biomedical signal processing and control. Volume 81(2023)
• Publication Date: 2023-03
• Subjects: Automatic sleep scoring -- Ensemble models -- Knowledge distillation -- Light-weight sleep scoring -- Semi-supervised learning -- Personalized models; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.104496
• Languages: English
• ISSNs: 1746-8094

Abstract

Abstract: Human sleep can be described as a series of transitions between distinct states. This makes automatic sleep analysis ( scoring ) suitable for an automatic implementation using machine learning. However, the task becomes harder when data is sampled using more light-weight or mobile equipment, often chosen due to greater comfort for the patient. In this study we investigate the improvement in sleep scoring when multiple state-of-the-art neural networks are joined into an ensemble, and subsequently distilled into a single model of identical network architecture, but with improved predictive performance. In this study we investigate ensembles of up to 10 networks, and show that, on the same data, ensembles of neural networks perform better than each single subject model (improvement: 2.4%) and that this improvement can be transferred back into a single network using a combination of patient specific data and knowledge distillation . The study demonstrates both a way to further improve automatic sleep scoring from mobile devices, which in itself is interesting, but also highlights the great potential of the vast amounts of unlabeled personal data which will become available from personal recording devices. Highlights: Using unlabeled personal data improve subject-specific models. Ensembles of neural networks improve automatic sleep scoring. Knowledge distillation can retain performance improvements of ensemble models.