Journal
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING
Volume -, Issue -, Pages 3502-3506Publisher
IEEE
DOI: 10.1109/icassp40776.2020.9054579
Keywords
adversarial networks; data augmentation; end-to-end affective computing; emotional speech synthesis
Categories
Funding
- UK Economic & Social Research Council (UK-ESRC) [HJ-253479]
- Engineering and Physical Sciences Research Council (EPSRC) [2021037]
- Bavarian State Ministry of Education, Science and the Arts in the framework of the Centre Digitisation.Bavaria
Ask authors/readers for more resources
In this paper, we propose an adversarial network implementation for speech emotion conversion as a data augmentation method, validated by a multi-class speech affect recognition task. In our setting, we do not assume the availability of parallel data, and we additionally make it a priority to exploit as much as possible the available training data by adopting a cycle-consistent, class-conditional generative adversarial network with an auxiliary domain classifier. Our generated samples are valuable for data augmentation, achieving a corresponding 2% and 6% absolute increase in Micro- and Macro-F1 compared to the baseline in a 3-class classification paradigm using a deep, end-to-end network. We finally perform a human perception evaluation of the samples, through which we conclude that our samples are indicative of their target emotion, albeit showing a tendency for confusion in cases where the emotional attribute of valence and arousal are inconsistent.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available