期刊
STATISTICS IN MEDICINE
卷 42, 期 6, 页码 761-780出版社
WILEY
DOI: 10.1002/sim.9642
关键词
electronic health records; interpretable machine learning; predictive modeling; variable importance
This study investigates the interpretability and variable importance of machine learning models. A novel and computationally efficient evaluation framework called VIPOR is proposed. VIPOR is a model-agnostic method that can evaluate variable importance locally and globally using the concept of personalized odds ratio. The method groups predictors into different categories and ranks their importance based on different statistics. The proposed method is demonstrated using real-world electronic health records data and compared with other interpretation methods.
The interpretability of machine learning models, even though with an excellent prediction performance, remains a challenge in practical applications. The model interpretability and variable importance for well-performed supervised machine learning models are investigated in this study. With the commonly accepted concept of odds ratio (OR), we propose a novel and computationally efficient Variable Importance evaluation framework based on the Personalized Odds Ratio (VIPOR). It is a model-agnostic interpretation method that can be used to evaluate variable importance both locally and globally. Locally, the variable importance is quantified by the personalized odds ratio (POR), which can account for subject heterogeneity in machine learning. Globally, we utilize a hierarchical tree to group the predictors into five groups: completely positive, completely negative, positive dominated, negative dominated, and neutral groups. The relative importance of predictors within each group is ranked based on different statistics of PORs across subjects for different application purposes. For illustration, we apply the proposed VIPOR method to interpreting a multilayer perceptron (MLP) model, which aims to predict the mortality of subarachnoid hemorrhage (SAH) patients using real-world electronic health records (EHR) data. We compare the important variables derived from MLP with other machine learning models, including tree-based models and the L1-regularized logistic regression model. The top importance variables are consistently identified by VIPOR across different prediction models. Comparisons with existing interpretation methods are also conducted and discussed based on publicly available data sets.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据