期刊
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19)
卷 -, 期 -, 页码 1089-1097出版社
ASSOC COMPUTING MACHINERY
DOI: 10.1145/3343031.3351033
关键词
multi-modal knowledge graph representation; medical question answering; interpretability
资金
- National Key Research and Development Program of China [2017YFB1002804]
- National Natural Science Foundation of China [61432019, 61702509, 61802405, 61832002, 61572503, 61872424, 61720106006]
- Key Research Program of Frontier Sciences, CAS [QYZDJ-SSW-JSC039]
- Beijing Municipal Science & Technology Commission [Z181100008918012]
- K.C.Wong Education Foundation
Online healthcare services can offer public ubiquitous access to the medical knowledge, especially with the emergence of medical question answering websites, where patients can get in touch with doctors without going to hospital. Explainability and accuracy are two main concerns for medical question answering. However, existing methods mainly focus on accuracy and cannot provide a good explanation for retrieved medical answers. This paper proposes a novel Multi-Modal Knowledge-aware Hierarchical Attention Network (MKHAN) to effectively exploit multi-modal knowledge graph (MKG) for explainable medical question answering. MKHAN can generate path representation by composing the structural, linguistics, and visual information of entities, and infer the underlying rationale of question-answer interactions by leveraging the sequential dependencies within a path from MKG. Furthermore, a novel hierarchical attention network is proposed to discriminate the salience of paths endowing our model with explainability. We build a large-scale multi-modal medical knowledge graph and two real-world medical question answering datasets, the experimental results demonstrate the superior performance on our approach compared with the state-of-the-art methods.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据