4.6 Article

ADCM: attention dropout convolutional module

期刊

NEUROCOMPUTING
卷 394, 期 -, 页码 95-104

出版社

ELSEVIER
DOI: 10.1016/j.neucom.2020.02.007

关键词

Attention; Dropout-channel; Dropout-region; Network architecture; Convolutional module

资金

  1. National Natural Science Foundation of China [61502094, 51774090, 51104030]
  2. Heilongjiang Province Natural Science Foundation of China [F2016002, LH2019F042]
  3. Youth Science Foundation of Northeast Petroleum University [2017PYZL-06, 2018YDL-22, KYCXTD201903]
  4. Daqing Science and Technology Project [ZD-2019-08]

向作者/读者索取更多资源

Network architecture design plays an important role in boosting the performance of models in various applications. In this work, we design a general and lightweight module named the attention dropout convolutional module (ADCM). It consists of two submodules, channel attention dropout (CAD) and position attention dropout (PAD), and each submodule integrates both attention and dropout mechanisms. The attention mechanism emphasizes the meaningful information and suppresses unnecessary noise. The dropout-channel in the CAD submodule filters the channel based on its channel attention, while the dropout-region in the PAD submodule filters the region consisting of the spatially correlated features according to its position attention. The two dropout methods we designed allow the baseline network to learn more robust features and further boost its performance. Finally, we deploy the ADCM in consecutive layers of classical convolutional neural networks and evaluate its performance on multiple benchmark datasets. The experimental results demonstrate that the ADCM brings significant improvements to the performance of the baseline models at negligible computational cost and with less complexity. (C) 2020 Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据