A randomized deep neural network for emotion recognition with landmarks detection. (March 2023)

• Record Type: Journal Article
• Authors: Di Luzio, Francesco; Rosato, Antonello; Panella, Massimo
• Is Part Of: Biomedical signal processing and control. Volume 81(2023)
• Publication Date: 2023-03
• Subjects: Emotion recognition -- Randomized neural networks -- Facial landmarks -- Deep learning -- Video sequences; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.104418
• Languages: English
• ISSNs: 1746-8094

Abstract

Abstract: In this paper, we present an innovative deep neural architecture employing parameter randomization in a complex classification model for emotion recognition. Actually, randomized deep neural networks represent an interesting alternative to exploring the efficiency-to-accuracy balance in real-life applications. Moreover, we also introduce the use of input frames composed of 468 facial landmarks coordinates and an innovative sampling procedure avoiding padding. The proposed randomized classifier is trained for emotion recognition on video sequences and the related accuracy is compared with a non-randomized version of the same model and with well-known benchmark architectures, demonstrating the robustness of the proposed approach in terms of classification accuracy and training time. Highlights: Deep learning technique in the biomedical context. 468 facial landmarks to solve emotion recognition through videos. Parameter randomization in a complex classification model. Trade-off between accuracy and computational cost for social diffusion.