Journal
IEEE TRANSACTIONS ON MULTIMEDIA
Volume 21, Issue 7, Pages 1853-1866Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2018.2887016
Keywords
Emotion; Internet voice data; deep sparse neural network; long short-term memory
Categories
Funding
- National Key Research and Development Plan [2016YFB1001200]
- Innovation Method Fund of China [2016IM010200]
- National Natural and Science Foundation of China [61521002]
- Tiangong Institute for Intelligent Computing, Tsinghua University, Beijing, China
Ask authors/readers for more resources
As voice dialog applications (VDAs, e.g., Siri,(1) Cortana,(2) Google Now(3)) are increasing in popularity, inferring emotions from the large-scale internet voice data generated from VDAs can help give a more reasonable and humane response. However, the tremendous amounts of users in large-scale internet voice data lead to a great diversity of users accents and expression patterns. Therefore, the traditional speech emotion recognition methods, which mainly target acted corpora, cannot effectively handle the massive and diverse amount of internet voice data. To address this issue, we carry out a series of observations, find suitable emotion categories for large-scale internet voice data, and verify the indicators of the social attributes (query time, query topic, and users location) and emotion inferring. Based on our observations, two different strategies are employed to solve the problem. First, a deep sparse neural network model that uses acoustic information, textual information, and three indicators (a temporal indicator, descriptive indicator, and geo-social indicator) as the input is proposed. Then, to capture the contextual information, we propose a hybrid emotion inference model that includes long short-term memory to capture the acoustic features and a latent dirichlet allocation to extract text features. Experiments on 93 000 utterances collected from the Sogou Voice Assistant(4) (Chinese Siri) validate the effectiveness of the proposed methodologies. Furthermore, we compare the two methodologies and give their advantages and disadvantages.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available