3.8 Proceedings Paper

Speech Acquisition and Recovery Based on Piezoelectric Effect in the mmWave Band

Publisher

IEEE
DOI: 10.1109/IMBIOC52515.2022.9790291

Keywords

mmWave sensing; speech recovery; piezoelectric effect

Ask authors/readers for more resources

This paper proposes a novel speech acquisition method that directly senses sound waves through the air instead of relying on sound-induced vibrations. The study finds that mmWave signals can penetrate soundproofing materials, allowing for speech recovery through obstacles. To combat the loss of mmWave signals, a speech enhancement method based on deep neural networks is developed.
This paper proposes a novel speech acquisition method to directly sense the sound waves travelling through the air rather than leveraging the sound-induced vibration. The rationale is that the piezoelectric film can cause changes to the incident mmWave signals due to the piezoelectric effect when sound waves hit the film. Moreover, we find that the mmWave signals can penetrate common soundproofing materials, which pave the way for through-obstacle speech recovery. Based on this, we propose a new mechanism to decode the phase-demodulated audio signals from the reflected mmWave signals. To combat the penetrating and propagation loss of mmWave signals, we further developed a speech enhancement method based on the deep neural network. The network can filter the raw recovered speech and reconstruct clean speech with higher speech quality and intelligibility. We evaluate the proposed system on a public dataset. The results indicate that the system can recover high-quality and intelligible speech from a distance of 5m in the case of occlusion.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

3.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available