期刊
INFORMATION PROCESSING & MANAGEMENT
卷 61, 期 2, 页码 -出版社
ELSEVIER SCI LTD
DOI: 10.1016/j.ipm.2023.103584
关键词
Machine reading comprehension; Semantic textual similarity; Explainable artificial intelligence; Pre-trained language models
This paper aims to improve the interpretability of machine reading comprehension models by utilizing the pre-trained T5 model for evidence inference. They propose an interpretable reading comprehension model based on T5, which is trained on a more accurate evidence corpus and can infer precise interpretations for answers. Experimental results show that their model outperforms the baseline BERT model on the SQuAD1.1 task.
Pre-trained language models (PLMs) have achieved outstanding performance on Machine Reading Comprehension (MRC) tasks, but these models' interpretability remains uncertain. In this paper, we exploit the strengths of the pre-trained T5 (Text-to-Text Transfer Transformer) model on evidence inference to improve the interpretability of the MRC model and propose an interpretable reading comprehension model based on T5, which is trained on a more accurate evidence corpus and can infer precise interpretations for the generated answers. First, we propose a novel T5-based Semantic Textual Similarity (STS) model to label training evidences more precisely, including label reconstruction and data augmentation. Then, we propose a T5-based interpretable reading comprehension model with more accurate evidence training, including a threshold-based method to filter out erroneous evidence during model training. Experiments show that our model significantly outperforms the baseline BERT (Pseudo-data Training) model by 8.7 and 8.0 points for the evidence F1-score of SQuAD1.1 respectively in the base and large levels. Our code is available at https://github.com/MN-Guan/T5-InterMRC.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据