The evaluation of automobile interior acceleration sound fused with physiological signal using a hybrid deep neural network. (1st February 2023)

• Record Type: Journal Article
• Authors: Xie, Liping; Lu, Chihua; Liu, Zhien; Chen, Wan; Zhu, Yawei; Xu, Tao
• Is Part Of: Mechanical systems and signal processing. Volume 184(2023)
• Publication Date: 2023-02-01
• Subjects: Automobile interior acceleration sound -- Physiological signals -- Feature extraction -- Deep learning -- Evaluation models; Structural dynamics -- Periodicals; Vibration -- Periodicals; Constructions -- Dynamique -- Périodiques; Vibration -- Périodiques; Structural dynamics; Vibration; Periodicals; 621
• DOI: 10.1016/j.ymssp.2022.109675
• Languages: English
• ISSNs: 0888-3270

Abstract

Highlights: This study provides new insights into the evaluation of automobile sound quality from the perspective of physiological acoustics and artificial intelligence. An EEG test paradigm designed here provides the experimental guidance for evaluating specific sound quality with physiological signals; The advantages of CNN in spatial characteristics and the LSTM in temporal characteristics are combined here to construct an HDNN to adaptively extract EEG features, which is 14.6% more accurate than the manual extraction of EEG feature. The score prediction of sportiness sound quality fused with EEG signals is achieved by using the HDNN, which outperforms the traditional CNN and LSTM. Abstract: The evaluation of automobile sound quality is not only related to the inherent properties of the sound, but also to the psychological and physiological state of the evaluator, which makes the evaluation of sound quality become an interdisciplinary research. However, there are some deficiencies regarding the existing studies as follows: (1) it is imprecise enough to visualize the preference of evaluators for sound on the scale; (2) the evaluators without acoustic experience are prone to deviations in their evaluations, resulting in the universally and unapplicable results; (3) the automobile sound quality cannot be fully reflected only by physical and psychological parameters, and most of the existing evaluation models of sound quality are only characterized by shallow architectures. To alleviate the above flaws, a hybrid deep neural network (HDNN) is constructed to achieve the evaluation of automobile interior acceleration sound fused with physiological signals in this paper. An EEG test paradigm under the stimulation of automobile sound is meanwhile designed for a feasibility confirmation of the proposed method. In addition, the acquired EEG datum are respectively analyzed from two perspectives: the manual extraction of typical EEG features and the adaptive extraction of EEG features based on HDNN model. Furthermore, the performance of the proposed HDNN is also validated by comparing with conventional convolutional neural network (CNN) and long short time memory (LSTM). The results indicate that the adaptively extracted EEG features are superior to the manually extracted EEG features, and the proposed HDNN outperforms the CNN and LSTM in terms of accuracy, sensitivity as well as precision, and the optimal accuracy of HDNN is up to 88.1%. Thus, the constructed HDNN contributes to achieving accurate evaluation of automobile sound quality with EEG signal.