How are icons processed by the brain? Neuroimaging measures of four types of visual stimuli used in information systems. (15th May 2014)

• Record Type: Journal Article
• Authors: Huang, Sheng‐Cheng; Bias, Randolph G.; Schnyer, David
• Is Part Of: Journal of the Association for Information Science and Technology. Volume 66:Number 4(2015:Apr.)
• Page Start: 702
• Page End: 720
• Publication Date: 2014-05-15
• Subjects: Information science -- Periodicals; Information technology -- Periodicals; 020.5
• DOI: 10.1002/asi.23210
• Languages: English
• ISSNs: 2330-1635

Abstract

<abstract abstract-type="main"> <title> <x xml:space="preserve">Abstract</x> </title> <p>We sought to understand how users interpret meanings of symbols commonly used in information systems, especially how icons are processed by the brain. We investigated Chinese and English speakers' processing of 4 types of visual stimuli: icons, pictures, Chinese characters, and English words. The goal was to examine, via functional magnetic resonance imaging (fMRI) data, the hypothesis that people cognitively process icons as logographic words and to provide neurological evidence related to human−computer interaction (HCI), which has been rare in traditional information system studies. According to the neuroimaging data of 19 participants, we conclude that icons are not cognitively processed as logographical words like Chinese characters, although they both stimulate the semantic system in the brain that is needed for language processing. Instead, more similar to images and pictures, icons are not as efficient as words in conveying meanings, and brains (people) make more effort to process icons than words. We use this study to demonstrate that it is practicable to test information system constructs such as elements of graphical user interfaces (GUIs) with neuroscience data and that, with such data, we can better understand individual or group differences related to system usage and user−computer interactions.</p> </abstract>