Electrophysiological correlates and psychoacoustic characteristics of hearing-motion synaesthesia. (November 2017)

• Record Type: Journal Article
• Authors: Rothen, Nicolas; Bartl, Gergely; Franklin, Anna; Ward, Jamie
• Is Part Of: Neuropsychologia. Volume 106(2017)
• Page Start: 280
• Page End: 288
• Publication Date: 2017-11
• Subjects: Hearing -- Visual motion -- EEG -- Synaesthesia/synaesthesia -- Multisensory; Neuropsychology -- Periodicals; Neurology -- Periodicals; Psychophysiology -- Periodicals; Neuropsychologie -- Périodiques; Neuropsychology; Periodicals; Electronic journals; 616.8
• DOI: 10.1016/j.neuropsychologia.2017.08.031
• Languages: English
• ISSNs: 0028-3932

Abstract

Abstract: People with hearing-motion synaesthesia experience sounds from moving or changing (e.g. flickering) visual stimuli. This phenomenon may be one of the most common forms of synaesthesia but it has rarely been studied and there are no studies of its neural basis. We screened for this in a sample of 200+ individuals, and estimated a prevalence of 4.2%. We also document its characteristics: it tends to be induced by physically moving stimuli (more so than static stimuli which imply motion or trigger illusory motion); and the psychoacoustic features are simple (e.g. "whooshing") with some systematic correspondences to vision (e.g. faster movement is higher pitch). We demonstrate using event-related potentials that it emerges from early perceptual processing of vision. The synaesthetes have a higher amplitude motion-evoked N2 (165–185 ms), with some evidence of group differences as early as 55–75 ms. We discuss similarities between hearing-motion synaesthesia and previous observations that visual motion triggers auditory activity in the congenitally deaf. It is possible that both conditions reflect the maintenance of multisensory pathways found in early development that most people lose but can be retained in certain people in response to sensory deprivation (in the deaf) or, in people with normal hearing, as a result of other differences (e.g. genes predisposing to synaesthesia). Highlights: Hearing-motion synaesthesia is induced by simple physically moving/changing visual stimuli. It is linked to EEG differences to visual stimuli at 165–185 ms. It resembles auditory activity by visual motion in congenitally deaf.