A Novel DBN Feature Fusion Model for Cross-Corpus Speech Emotion Recognition. (28th December 2016)

• Record Type: Journal Article
• Authors: Cairong, Zou; Xinran, Zhang; Cheng, Zha; Li, Zhao
• Other Names: Karpov Alexey Academic Editor.
• Is Part Of: Journal of electrical and computer engineering. Volume 2016(2016)
• Publication Date: 2016-12-28
• Subjects: Computer engineering -- Periodicals; Electrical engineering -- Periodicals; 621.3905
• DOI: 10.1155/2016/7437860
• Languages: English
• ISSNs: 2090-0147

Abstract

Abstract : The feature fusion from separate source is the current technical difficulties of cross-corpus speech emotion recognition. The purpose of this paper is to, based on Deep Belief Nets (DBN) in Deep Learning, use the emotional information hiding in speech spectrum diagram (spectrogram) as image features and then implement feature fusion with the traditional emotion features. First, based on the spectrogram analysis by STB/Itti model, the new spectrogram features are extracted from the color, the brightness, and the orientation, respectively; then using two alternative DBN models they fuse the traditional and the spectrogram features, which increase the scale of the feature subset and the characterization ability of emotion. Through the experiment on ABC database and Chinese corpora, the new feature subset compared with traditional speech emotion features, the recognition result on cross-corpus, distinctly advances by 8.8%. The method proposed provides a new idea for feature fusion of emotion recognition.