Journal
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
Volume 33, Issue 3, Pages 973-982Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TNNLS.2020.3036192
Keywords
Road transportation; Logic gates; Computer architecture; Convolution; Training; Standards; Electronic mail; Convolutional neural network (CNN); dynamic embedding projection gate; multi-class and multi-label text classification; natural language processing (NLP)
Categories
Funding
- Natural Science Foundation of China [51775385, 61703279]
- Strategy Research Project of Artificial Intelligence Algorithms of Ministry of Education of China
- Fundamental Research Funds for the Central Universities
- Deanship of Scientific Research (DSR) at King Abdulaziz University, Jeddah, Saudi Arabia [RG-48-13540]
Ask authors/readers for more resources
The study proposes a dynamic embedding projection-gated convolutional neural network (DEP-CNN) for multi-class and multi-label text classification. Using the dynamic embedding projection gate (DEPG) allows better capture of word information and control over the integration of context information.
Text classification is a fundamental and important area of natural language processing for assigning a text into at least one predefined tag or category according to its content. Most of the advanced systems are either too simple to get high accuracy or centered on using complex structures to capture the genuinely required category information, which requires long time to converge during their training stage. In order to address such challenging issues, we propose a dynamic embedding projection-gated convolutional neural network (DEP-CNN) for multi-class and multi-label text classification. Its dynamic embedding projection gate (DEPG) transforms and carries word information by using gating units and shortcut connections to control how much context information is incorporated into each specific position of a word-embedding matrix in a text. To our knowledge, we are the first to apply DEPG over a word-embedding matrix. The experimental results on four known benchmark datasets display that DEP-CNN outperforms its recent peers.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available