期刊
FRONTIERS IN PSYCHOLOGY
卷 13, 期 -, 页码 -出版社
FRONTIERS MEDIA SA
DOI: 10.3389/fpsyg.2022.971979
关键词
incongruence effect; lexical tone; Mandarin; audiovisual speech; visual timing; lip movement; vowel
This study investigates the impact of audiovisual information on the perception of lexical tones for Chinese and English speakers. It finds that visual form information significantly affects the identification accuracy of vowels, while visual timing information does not interfere with the perception of auditory lexical tone.
Over the recent few decades, a large number of audiovisual speech studies have been focusing on the visual cues of consonants and vowels but neglecting those relating to lexical tones. In this study, we investigate whether incongruent audiovisual information interfered with the perception of lexical tones. We found that, for both Chinese and English speakers, incongruence between auditory and visemic mouth shape (i.e., visual form information) significantly interfered with reaction time and reduced the identification accuracy of vowels. However, incongruent lip movements (i.e., visual timing information) did not interfere with the perception of auditory lexical tone. We conclude that, in contrast to vowel perception, auditory tone perception seems relatively impervious to visual congruence cues, at least under these restricted laboratory conditions. The salience of visual form and timing information is discussed based on this finding.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据