Meaning above the head: combinatorial constraints on the visual vocabulary of comics. Issue 5 (3rd July 2016)

• Record Type: Journal Article
• Authors: Cohn, Neil; Murthy, Beena; Foulsham, Tom
• Is Part Of: Journal of cognitive psychology. Volume 28:Issue 5(2016)
• Page Start: 559
• Page End: 574
• Publication Date: 2016-07-03
• Subjects: Visual language -- visual morphology -- visual metaphor -- emotion -- comics; Cognitive psychology -- Periodicals; 153.05
• DOI: 10.1080/20445911.2016.1179314
• Languages: English
• ISSNs: 2044-5911

Abstract

ABSTRACT: "Upfixes" are "visual morphemes" originating in comics where an element floats above a character's head (ex. lightbulbs or gears). We posited that, similar to constructional lexical schemas in language, upfixes use an abstract schema stored in memory, which constrains upfixes to locations above the head and requires them to "agree" with their accompanying facial expressions. We asked participants to rate and interpret both conventional and unconventional upfixes that either matched or mismatched their facial expression (Experiment 1) and/or were placed either above or beside the head (Experiment 2). Interpretations and ratings of conventionality and face–upfix matching (Experiment 1) along with overall comprehensibility (Experiment 2) suggested that both constraints operated on upfix understanding. Because these constraints modulated both conventional and unconventional upfixes, these findings support that an abstract schema stored in long-term memory allows for generalisations beyond memorised individual items.