The Compositionality of Facial Expressions. (March 2022)

• Record Type: Journal Article
• Authors: Sofer, Carmel; Dotsch, Ron; Vilenchik, Dan; Avidan, Galia
• Is Part Of: Perception. Volume 51:Number 3(2022)
• Page Start: 172
• Page End: 186
• Publication Date: 2022-03
• Subjects: emotions -- facial expressions -- semantic compositionality -- vector representation -- word embedding; Perception -- Periodicals; Perception -- Periodicals; Perception; Periodicals; 153.705
• DOI: 10.1177/03010066221077573
• Languages: English
• ISSNs: 0301-0066

Abstract

The principle of compositionality, an important postulation in language and cognition research, posits that the meaning of a complex expression is determined by the meaning of its constituting parts and the operation performed on those parts. Here, we provide strong evidence that this principle plays a significant role also in interpreting facial expressions. In three studies in which perceivers interpreted sequences of two emotional facial expression images, we show that the composite meaning of facial expressions results from the meaning of its constituting expressions and an algebraic operation performed on those expressions. Our study offers a systematic account as to how the meaning of facial expressions (single and sequences) are being formed and perceived. In a broader context, our results raise the possibility that the principle of compositionality may apply to human communication modalities beyond spoken language, whereby a minimal number of components are expanded to a much greater number of meanings.