Using feature points and angles between them to recognise facial expression by a neural network approach. Issue 11 (1st November 2018)

• Record Type: Journal Article
• Authors: Li, Taihao; Du, Cuifen; Naren, Tuya; Chen, Zhiqiang; Liu, Shupeng; Zhou, Jianshe; Xu, Xiaoyin
• Is Part Of: IET image processing. Volume 12:Issue 11(2018)
• Page Start: 1951
• Page End: 1955
• Publication Date: 2018-11-01
• Subjects: face recognition -- emotion recognition -- neural nets; CK + database -- no‐decision class -- affective computing -- facial expression recognition -- NN‐based approaches -- basic expressions -- facial recognition accuracy -- neural network method -- neural network approach -- feature points; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2018.0009
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : In this study, the authors propose a neural network (NN) method that uses feature points and the angles formed between the points to recognise facial expressions. Accurate facial expression recognition is an important part of affective computing with many practical applications. Yet, achieving acceptable levels of facial recognition accuracy has proven difficult. Feature points and the distances between the points are used to model basic expressions in NN‐based approaches, but, in some cases, they cannot generate satisfactory performance. They expand on the characterisation of facial expression by considering the angles formed between feature points to augment the amount of information that is sent to the NNs. Furthermore, to circumvent a common challenge in facial expressions recognition, which is the difficulty of differentiating among several expressions, they designed a post‐processing step to assess the output of the NN against a threshold. The whole method makes a decision only when the output of the NN exceeds the threshold. Otherwise, the frame under consideration is assigned to a 'no decision' class. They tested our method on the widely used facial expression CK + database and found that it can achieve good accuracy.