Tensor completion algorithms for estimating missing values in multi-channel audio signals. (January 2022)

• Record Type: Journal Article
• Authors: Ding, Wenjian; Sun, Zhe; Wu, Xingxing; Yang, Zhenglu; Solé-Casals, Jordi; Caiafa, Cesar F.
• Is Part Of: Computers & electrical engineering. Volume 97(2022)
• Publication Date: 2022-01
• Subjects: Audio inpainting -- Tensor completion -- Signal reconstruction -- Multi-channel signals; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2021.107561
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: Audio inpainting is a widely used technology in the real world since audio signals with missing data are pervasive in many scenarios. The majority of existing works address the time gaps in single-channel audio signals, while completing multi-channel audio signals is rarely investigated. In this work, we tackle this issue using four different tensor completion algorithms and we evaluate them on speech audio datasets with gaps in the time domain. Based on extensive quantitative and qualitative experiments, the tensor completion algorithms generally achieve a superior predictive performance, including when the gap duration of the signals reaches values of up to 200 ms. Specifically, the experimental results illustrate that all of the applied tensor completion algorithms yield at least 56% improvement in signal restoration performance compared with single-channel based methods. Therefore, the tensor based approaches can capture the underlying latent structure over different channels to reconstruct incomplete multi-channel data. Graphical abstract: Highlights: Tensor completion is applied to multi-channel audio signals restoration. Different completion methods are compared under three scenarios. Tensor completion approaches outperform methods based on matrix factorization.