期刊
APPLIED SCIENCES-BASEL
卷 11, 期 17, 页码 -出版社
MDPI
DOI: 10.3390/app11177967
关键词
speech emotion recognition; emotion recognition; multi-modal emotion recognition
类别
资金
- Sangmyung University
This paper proposes a method of emotion recognition using speech and text data to improve accuracy, feeding acoustic feature vectors and embedding vectors into deep learning models to calculate probabilities for predicted output classes, demonstrating more accurate performance than previous research.
Recently, intelligent personal assistants, chat-bots and AI speakers are being utilized more broadly as communication interfaces and the demands for more natural interaction measures have increased as well. Humans can express emotions in various ways, such as using voice tones or facial expressions; therefore, multimodal approaches to recognize human emotions have been studied. In this paper, we propose an emotion recognition method to deliver more accuracy by using speech and text data. The strengths of the data are also utilized in this method. We conducted 43 feature vectors such as spectral features, harmonic features and MFCC from speech datasets. In addition, 256 embedding vectors from transcripts using pre-trained Tacotron encoder were extracted. The acoustic feature vectors and embedding vectors were fed into each deep learning model which produced a probability for the predicted output classes. The results show that the proposed model exhibited more accurate performance than in previous research.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据