期刊
出版社
NATL ACAD SCIENCES
DOI: 10.1073/pnas.2117000119
关键词
audiotactile integration; speech-in-noise comprehension; multisensory processing; EEG
资金
- Engineering and Physical Sciences Research Council (EPSRC) [EP/R032602/1]
- EPSRC Centre for Doctoral Training in Neurotechnology for Life and Health
When listening to continuous speech, vibrotactile feedback presented at the rate of syllables can enhance speech comprehension. The enhancement occurs when vibrotactile pulses occur at the perceptual center of the syllables, while a temporal delay between the vibrotactile signals and the speech stream can lower speech comprehension. Electroencephalographic recordings show that audiotactile integration modulates the neural response to the speech rhythm and vibrotactile pulses, and these neural activities reflect the behavioral effects on speech comprehension.
Speech unfolds over distinct temporal scales, in particular, those related to the rhythm of phonemes, syllables, and words. When a person listens to continuous speech, the syllabic rhythm is tracked by neural activity in the theta frequency range. The tracking plays a functional role in speech processing: Influencing the theta activity through transcranial current stimulation, for instance, can impact speech perception. The theta-band activity in the auditory cortex can also be modulated through the somatosensory system, but the effect on speech processing has remained unclear. Here, we show that vibrotactile feedback presented at the rate of syllables can modulate and, in fact, enhance the comprehension of a speech signal in background noise. The enhancement occurs when vibrotactile pulses occur at the perceptual center of the syllables, whereas a temporal delay between the vibrotactile signals and the speech stream can lead to a lower level of speech comprehension. We further investigate the neural mechanisms underlying the audiotactile integration through electroencephalographic (EEG) recordings. We find that the audiotactile stimulation modulates the neural response to the speech rhythm, as well as the neural response to the vibrotactile pulses. The modulations of these neural activities reflect the behavioral effects on speech comprehension. Moreover, we demonstrate that speech comprehension can be predicted by particular aspects of the neural responses. Our results evidence a role of vibrotactile information for speech processing and may have applications in future auditory prosthesis.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据