Communication skills training exploiting multimodal emotion recognition. Issue 8 (17th November 2017)

• Record Type: Journal Article
• Authors: Bahreini, Kiavash; Nadolski, Rob; Westera, Wim
• Is Part Of: Interactive learning environments. Volume 25:Issue 8(2017)
• Page Start: 1065
• Page End: 1082
• Publication Date: 2017-11-17
• Subjects: Assessment of learners -- communication skills -- emotion recognition -- serious gaming -- feedback; Educational technology -- United States -- Periodicals; 371.33
• DOI: 10.1080/10494820.2016.1247286
• Languages: English
• ISSNs: 1049-4820

Abstract

ABSTRACT: The teaching of communication skills is a labour-intensive task because of the detailed feedback that should be given to learners during their prolonged practice. This study investigates to what extent our FILTWAM facial and vocal emotion recognition software can be used for improving a serious game (the Communication Advisor) that delivers a web-based training of communication skills. A test group of 25 participants played the game wherein they were requested to mimic specific facial and vocal emotions. Half of the assignments included direct feedback and the other half included no feedback. It was investigated whether feedback on the mimicked emotions would lead to better learning. The results suggest the facial performance growth was found to be positive, particularly significant in the feedback condition. The vocal performance growth was significant in both conditions. The results are a significant indication that the automated feedback from the software improves learners' communication performances.