Modality shift effects mimic multisensory interactions: an event-related potential study

Gondan, Matthias and Vorberg, Dirk and Greenlee, Mark W. (2007) Modality shift effects mimic multisensory interactions: an event-related potential study. EXPERIMENTAL BRAIN RESEARCH, 182 (2). pp. 199-214. ISSN 0014-4819, 1432-1106

Full text not available from this repository. (Request a copy)

Abstract

A frequent approach to study interactions of the auditory and the visual system is to measure event-related potentials (ERPs) to auditory, visual, and auditory-visual stimuli (A, V, AV). A nonzero result of the AV -(A + V) comparison indicates that the sensory systems interact at a specific processing stage. Two possible biases weaken the conclusions drawn by this approach: first, subtracting two ERPs from one requires that A, V, and AV do not share any common activity. We have shown before (Gondan and Roder in Brain Res 1073-1074:389-397, 2006) that the problem of common activity can be avoided using an additional tactile stimulus (T) and evaluating the ERP difference (T + TAV) - (TA + TV). A second possible confound is the modality shift effect (MSE): for example, the auditory N1 is increased if an auditory stimulus follows a visual stimulus, whereas it is smaller if the modality is unchanged (ipsimodal stimulus). Bimodal stimuli might be affected less by MSEs because at least one component always matches the preceding trial. Consequently, an apparent amplitude modulation of the N1 would be observed in AV. We tested the influence of MSEs on auditory-visual interactions by comparing the results of AV - (A + V) using (a) all stimuli and using (b) only ipsimodal stimuli. (a) and (b) differed around 150 ms, this indicates that AV - (A + V) is indeed affected by the MSE. We then formally and empirically demonstrate that (T + TAV) - (TA + TV) is robust against possible biases due to the MSE.

Item Type: Article
Uncontrolled Keywords: SUPERIOR TEMPORAL SULCUS; SIMPLE REACTION-TIME; EVOKED-POTENTIALS; STATISTICAL FACILITATION; AUDIOTACTILE INTERACTION; AUDIOVISUAL INTEGRATION; OBJECT RECOGNITION; DIVIDED ATTENTION; AUDITORY-CORTEX; HUMANS; multisensory processes; event-related potentials; divided attention; modality shift effect
Subjects: 100 Philosophy & psychology > 150 Psychology
Divisions: Human Sciences > Institut für Psychologie > Lehrstuhl für Psychologie I (Allgemeine Psychologie I und Methodenlehre) - Prof. Dr. Mark W. Greenlee
Depositing User: Dr. Gernot Deinzer
Date Deposited: 01 Dec 2020 12:03
Last Modified: 01 Dec 2020 12:03
URI: https://pred.uni-regensburg.de/id/eprint/32277

Actions (login required)

View Item View Item