Journal
INFORMATION SCIENCES
Volume 571, Issue -, Pages 459-474Publisher
ELSEVIER SCIENCE INC
DOI: 10.1016/j.ins.2021.05.044
Keywords
Sentiment analysis; Text classification; Multiview attention; Sentence representation
Categories
Funding
- National Natural Science Foundation of China (NSFC) [61702443, 61966038, 61762091]
Ask authors/readers for more resources
A multiview attention model was proposed for learning sentence representation, using multiple view vectors to map attentions from different perspectives and a fusion gate to combine them, improving the performance of previously proposed attention models.
Self-attention mechanisms in deep neural networks, such as CNN, GRU and LSTM, have been proven to be effective for sentiment analysis. However, existing attention models tend to focus on individual tokens or aspect meanings in an expression. If a text contains information on multiple sentiments from different perspectives, the existing models will fail to extract the most critical and comprehensive features of the whole text. In the present study, a multiview attention model was proposed for learning sentence representation. Instead of using a single attention, multiple view vectors were used to map the attentions from different perspectives. Then, a fusion gate was adopted to combine these multiview attentions to draw a conclusion. To ensure the differences between multiview attentions, a regularization item was introduced to add a penalty to the loss function. In addition, the proposed model can be extended to other text tasks, such as questions and topics, to provide a comprehensive representation for the classification. Comparative experiments were conducted on both multiclass and multilabel classification datasets. The results revealed that the proposed method improves the performance of several previously proposed attention models. (c) 2021 Elsevier Inc. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available