期刊
NEUROIMAGE
卷 255, 期 -, 页码 -出版社
ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.neuroimage.2022.119182
关键词
Cross-modal interaction; Audiovisual congruency; Arousal; TRF; Naturalistic stimuli
资金
- National Key Research and De-velopment Program of China [2021ZD0201501]
- Major Scientific Research Project of Zhejiang Lab [2019KB0AC02]
- Exploratory Re-search Project of Zhejiang Lab [2022RC0AN01]
- National Natural Science Foundation of China [31771248]
- Municipal Postdoc-toral Research Fund from Hangzhou
Natural scenes contain multi-modal information that can modulate neural encoding of low-level sensory features. Our study shows asymmetrical cross-modal interactions during the processing of natural scenes lacking rhythmicity, with congruent visual information enhancing low-level auditory processing, while congruent auditory information does not significantly modulate low-level visual processing.
Natural scenes contain multi-modal information, which is integrated to form a coherent perception. Previous studies have demonstrated that cross-modal information can modulate neural encoding of low-level sensory features. These studies, however, mostly focus on the processing of single sensory events or rhythmic sensory sequences. Here, we investigate how the neural encoding of basic auditory and visual features is modulated by cross-modal information when the participants watch movie clips primarily composed of non-rhythmic events. We presented audiovisual congruent and audiovisual incongruent movie clips, and since attention can modulate cross-modal interactions, we separately analyzed high-and low-arousal movie clips. We recorded neural responses using electroencephalography (EEG), and employed the temporal response function (TRF) to quantify the neural encoding of auditory and visual features. The neural encoding of sound envelope is enhanced in the audiovisual congruent condition than the incongruent condition, but this effect is only significant for high-arousal movie clips. In contrast, audiovisual congruency does not significantly modulate the neural encoding of visual features, e.g., luminance or visual motion. In summary, our findings demonstrate asymmetrical cross-modal interactions during the processing of natural scenes that lack rhythmicity: Congruent visual information enhances low-level auditory processing, while congruent auditory information does not significantly modulate low-level visual processing.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据