Formal models and quantitative measures of multisensory integration: a selective overview. (23rd January 2018)

• Record Type: Journal Article
• Authors: Colonius, Hans; Diederich, Adele
• Is Part Of: European journal of neuroscience. Volume 51:Number 5(2020)
• Page Start: 1161
• Page End: 1178
• Publication Date: 2018-01-23
• Subjects: Bayesian causal inference -- crossmodal recalibration -- diffusion model -- probability summation -- race model -- time window of integration; Nervous system -- Periodicals; 612.8
• DOI: 10.1111/ejn.13813
• Languages: English
• ISSNs: 0953-816X

Abstract

Abstract: Multisensory integration (MI) is defined as the neural process by which unisensory signals are combined to form a new product that is significantly different from the responses evoked by the modality‐specific component stimuli. In recent years, MI research has seen exponential growth in the number of empirical and theoretical studies. This study presents a selective overview of formal modeling approaches to MI. Emphasis is on models and measures for behavioral paradigms, such as localization, judgment of temporal order or simultaneity, and reaction times, but some concepts for the modeling of single‐cell spike rates are treated as well. We identify a number of essential concepts underlying most model classes, such as Bayesian causal inference, probability summation, coactivation, and time window of integration. Quantitative indexes for measuring and comparing the strength of MI across different paradigms are also discussed. Whereas progress over the last years is remarkable, we point out some strengths and weaknesses of the modeling approaches and discuss some obstacles toward a unified theory of MI. Abstract : Schematic of time‐window‐of‐integration (TWIN) model: A peripheral stage of parallel processing is followed by a second stage of multisensory integration.