Patch-level contrastive embedding learning for respiratory sound classification. (February 2023)

• Record Type: Journal Article
• Authors: Song, Wenjie; Han, Jiqing
• Is Part Of: Biomedical signal processing and control. Volume 80:Part 2(2023)
• Publication Date: 2023-02
• Subjects: Respiratory sound classification -- Adventitious sound -- Contrastive learning -- Patch-level method; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.104338
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: An effective approach for the automatic identification of respiratory sounds is presented in this paper, which is helpful to assist in the preliminary diagnosis for respiratory diseases. Differently from most methods that focus on the distribution of entire samples, our proposed method models the distance between finer-grained patches in an embedding space, and is capable of learning additional detailed information from the limited training samples. Since patch-level labels are require and are usually not provided in most cases, a Multi-Instance Learning based approach is designed to estimate the labels. Contrastive Learning theory is utilized in our method, which explicitly encourages the learned embeddings to be more discriminative. Abstract: Nowadays, due to the difficulty of data acquisition and expensive manual annotation, respiratory sound classification suffers from limited training samples, which restrains the performance improvement of existing methods. To learn more information from the limited samples, we previously proposed a method of contrastive embedding learning to incorporate additional out-of-class information into the model. However, since the method mapped each entire sample to a deep embedding vector and modelled the distribution of the embeddings, it hardly learned the detailed information within the samples. In fact, a sample is a finite combination of various components, and the classification task essentially is to detect the presence of components that contain adventitious sounds, where detailed component-wise information is crucial. To this end, a method of patch-level contrastive embedding learning based on finer-grained patches is further proposed in this paper. It divides each sample into multiple patches and maps the patches to the embedding space. The patches are split into different subclasses, according to the type of adventitious sounds contained in each patch. Considering that there might be no patch-level labels provided in most cases, a Multi-Instance Learning (MIL) based approach is designed to estimate the labels. Then by modelling intra- and inter-subclass distance between the patch-level embeddings, the method learns the detailed information about the difference between patches, which benefits the identification task. The results following random and official splitting on the ICBHI dataset show that our method achieves the performance of 79.99% and 52.95%, exceeding the previous one by 1.81% and 1.58%, respectively.