期刊
SCIENTIFIC REPORTS
卷 12, 期 1, 页码 -出版社
NATURE PORTFOLIO
DOI: 10.1038/s41598-022-21149-9
关键词
-
资金
- NSFC [62076200, 2020JM-468]
- Shaanxi Natural Science Foundation
This paper proposes a dynamic memory network model (DMN-MA) based on the multiple attention mechanism, which combines channel attention and spatial attention. By applying the multiple attention mechanism in the situational memory module, the model achieves accurate answers to complex questions and effectively utilizes contextual information for answer inference.
Since the existing visual question answering model lacks long-term memory modules for answering complex questions, it is easy to cause the loss of effective information. In order to further improve the accuracy of the visual question answering model, this paper applies the multiple attention mechanism combining channel attention and spatial attention to memory networks for the first time and proposes a dynamic memory network model (DMN-MA) based on the multiple attention mechanism. The model uses the multiple attention mechanism in the situational memory module to obtain the most relevant visual vectors for answering questions based on continuous memory updating, storage and iterative inference of the questions, and effectively uses contextual information for answer inference. The experimental results show that the accuracy of the model in this paper reaches 64.57% and 67.18% on the large-scale public datasets COCO-QA and VQA2.0, respectively.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据