Journal
IEEE ACCESS
Volume 8, Issue -, Pages 152183-152192Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2020.3017382
Keywords
Multi-label text classification; label embedding; BERT; attention mechanism
Categories
Funding
- Major Program of the National Social Science Foundation of China [18ZDA315]
- Science and Technique Program of Henan Province [172102410065, 192102210260]
- Medical Science and Technique Program
- Key Scientific Research Program of Higher Education of Henan Province [19A520003, 20A52003]
- [SB201901021]
Ask authors/readers for more resources
The multi-label text classification task aims to tag a document with a series of labels. Previous studies usually treated labels as symbols without semantics and ignored the relation among labels, which caused information loss. In this paper, we show that explicitly modeling label semantics can improve multi-label text classification. We propose a hybrid neural network model to simultaneously take advantage of both label semantics and fine-grained text information. Specifically, we utilize the pre-trained BERT model to compute context-aware representation of documents. Furthermore, we incorporate the label semantics in two stages. First, a novel label graph construction approach is proposed to capture the label structures and correlations. Second, we propose a neoteric attention mechanism-adjustive attention to establish the semantic connections between labels and words and to obtain the label-specific word representation. The hybrid representation that combines context-aware feature and label-special word feature is fed into a document encoder to classify. Experimental results on two publicly available datasets show that our model is superior to other state-of-the-art classification methods.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available