Affect Detection from Text-Based Virtual Improvisation and Emotional Gesture Recognition. (10th December 2012)

• Record Type: Journal Article
• Authors: Zhang, Li; Yap, Bryan
• Other Names: Fernando Owen Noel Newton Academic Editor.
• Is Part Of: Advances in human-computer interaction. Volume 2012(2012)
• Publication Date: 2012-12-10
• Subjects: Human-computer interaction -- Periodicals; Human-computer interaction; Periodicals; Electronic journals; 004.019
• DOI: 10.1155/2012/461247
• Languages: English
• ISSNs: 1687-5893

Abstract

Abstract : We have developed an intelligent agent to engage with users in virtual drama improvisation previously. The intelligent agent was able to perform sentence-level affect detection from user inputs with strong emotional indicators. However, we noticed that many inputs with weak or no affect indicators also contain emotional implication but were regarded as neutral expressions by the previous interpretation. In this paper, we employ latent semantic analysis to perform topic theme detection and identify target audiences for such inputs. We also discuss how such semantic interpretation of the dialog contexts is used to interpret affect more appropriately during virtual improvisation. Also, in order to build a reliable affect analyser, it is important to detect and combine weak affect indicators from other channels such as body language. Such emotional body language detection also provides a nonintrusive channel to detect users' experience without interfering with the primary task. Thus, we also make initial exploration on affect detection from several universally accepted emotional gestures.