Words speak louder than pictures for action concepts: an eyetracking investigation of the picture superiority effect in semantic categorisation. Issue 9 (20th October 2016)

• Record Type: Journal Article
• Authors: Hung, Jinyi; Edmonds, Lisa A.; Reilly, Jamie
• Is Part Of: Language, cognition and neuroscience. Volume 31:Issue 9(2016)
• Page Start: 1150
• Page End: 1166
• Publication Date: 2016-10-20
• Subjects: Semantic memory -- verb processing -- eyetracking -- semantic access -- action concept; Psycholinguistics -- Periodicals; Linguistics -- Periodicals; Neurosciences -- Periodicals; Psycholinguïstiek; Cognitieve processen; Linguistics; Neurosciences; Psycholinguistics; Periodicals; 401.9
• DOI: 10.1080/23273798.2016.1198818
• Languages: English
• ISSNs: 2327-3798

Abstract

ABSTRACT: An evolving consensus holds that actions and objects are supported by at least partially distinct neurocognitive substrates. In addition, representational modality (e.g. pictures vs. words) moderates the speed and accuracy of semantic access for both word classes. The picture superiority effect refers to the advantage that pictures manifest relative to words across a range of object recognition and memory recall tasks. While the effect has been investigated exclusively in the context of static objects, it is unclear whether this modality advantage extends to the processing of actions and/or verbs. We report two eyetracking experiments examining the dynamics of modality-specific access to actions via associative semantic judgement tasks for actions depicted as pictures or words. A range of eyetracking and behavioural measures revealed that participants consistently showed a reversal of the picture superiority effect for action semantic categorisation. These results challenge the privileged access hypothesis and demonstrate further distinctiveness of the action-object processing dichotomy. We discuss implications for action semantic processing.