Development of a computationally efficient voice conversion system on mobile phones. (4th January 2019)

• Record Type: Journal Article
• Authors: Gao, Shuhua; Wu, Xiaoling; Xiang, Cheng; Huang, Dongyan
• Is Part Of: APSIPA transactions on signal and information processing. Volume 8(2019)
• Publication Date: 2019-01-04
• Subjects: Voice conversion, -- GMM, -- Mobile application, -- Parallel computing, -- Weighted frequency warping; Signal processing -- Periodicals; 621.3822
• DOI: 10.1017/ATSIP.2018.23
• Languages: English
• ISSNs: 2048-7703

Abstract

Abstract : Voice conversion aims to change a source speaker's voice to make it sound like the one of a target speaker while preserving linguistic information. Despite the rapid advance of voice conversion algorithms in the last decade, most of them are still too complicated to be accessible to the public. With the popularity of mobile devices especially smart phones, mobile voice conversion applications are highly desirable such that everyone can enjoy the pleasure of high-quality voice mimicry and people with speech disorders can also potentially benefit from it. Due to the limited computing resources on mobile phones, the major concern is the time efficiency of such a mobile application to guarantee positive user experience. In this paper, we detail the development of a mobile voice conversion system based on the Gaussian mixture model (GMM) and the weighted frequency warping methods. We attempt to boost the computational efficiency by making the best of hardware characteristics of today's mobile phones, such as parallel computing on multiple cores and the advanced vectorization support. Experimental evaluation results indicate that our system can achieve acceptable voice conversion performance while the conversion time for a five-second sentence only takes slightly more than one second on iPhone 7.