期刊
INTERNATIONAL JOURNAL OF EPIDEMIOLOGY
卷 45, 期 1, 页码 266-277出版社
OXFORD UNIV PRESS
DOI: 10.1093/ije/dyv306
关键词
Risk of bias; systematic review; text mining; machine learning
资金
- UK Medical Research Council
- Medical Research Council [MC_UU_12013/1-9]
- Medical Research Council [MR/K025643/1, MC_UU_12013/8, MC_UU_12013/9, 1170982] Funding Source: researchfish
- National Institute for Health Research [NF-SI-0514-10114] Funding Source: researchfish
- MRC [MC_UU_12013/8, MR/K025643/1, MC_UU_12013/9] Funding Source: UKRI
Background: Risk-of-bias assessments are now a standard component of systematic reviews. At present, reviewers need to manually identify relevant parts of research articles for a set of methodological elements that affect the risk of bias, in order to make a riskof-bias judgement for each of these elements. We investigate the use of text mining methods to automate risk-of-bias assessments in systematic reviews. We aim to identify relevant sentences within the text of included articles, to rank articles by risk of bias and to reduce the number of risk-of-bias assessments that the reviewers need to perform by hand. Methods: We use supervised machine learning to train two types of models, for each of the three risk-of-bias properties of sequence generation, allocation concealment and blinding. The first model predicts whether a sentence in a research article contains relevant information. The second model predicts a risk-of-bias value for each research article. We use logistic regression, where each independent variable is the frequency of a word in a sentence or article, respectively. Results: We found that sentences can be successfully ranked by relevance with area under the receiver operating characteristic (ROC) curve (AUC) > 0.98. Articles can be ranked by risk of bias with AUC > 0.72. We estimate that more than 33% of articles can be assessed by just one reviewer, where two reviewers are normally required. Conclusions: We show that text mining can be used to assist risk-of-bias assessments.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据