Journal
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19)
Volume -, Issue -, Pages 1089-1097Publisher
ASSOC COMPUTING MACHINERY
DOI: 10.1145/3343031.3351033
Keywords
multi-modal knowledge graph representation; medical question answering; interpretability
Funding
- National Key Research and Development Program of China [2017YFB1002804]
- National Natural Science Foundation of China [61432019, 61702509, 61802405, 61832002, 61572503, 61872424, 61720106006]
- Key Research Program of Frontier Sciences, CAS [QYZDJ-SSW-JSC039]
- Beijing Municipal Science & Technology Commission [Z181100008918012]
- K.C.Wong Education Foundation
Ask authors/readers for more resources
Online healthcare services can offer public ubiquitous access to the medical knowledge, especially with the emergence of medical question answering websites, where patients can get in touch with doctors without going to hospital. Explainability and accuracy are two main concerns for medical question answering. However, existing methods mainly focus on accuracy and cannot provide a good explanation for retrieved medical answers. This paper proposes a novel Multi-Modal Knowledge-aware Hierarchical Attention Network (MKHAN) to effectively exploit multi-modal knowledge graph (MKG) for explainable medical question answering. MKHAN can generate path representation by composing the structural, linguistics, and visual information of entities, and infer the underlying rationale of question-answer interactions by leveraging the sequential dependencies within a path from MKG. Furthermore, a novel hierarchical attention network is proposed to discriminate the salience of paths endowing our model with explainability. We build a large-scale multi-modal medical knowledge graph and two real-world medical question answering datasets, the experimental results demonstrate the superior performance on our approach compared with the state-of-the-art methods.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available