期刊
AIES '19: PROCEEDINGS OF THE 2019 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY
卷 -, 期 -, 页码 131-138出版社
ASSOC COMPUTING MACHINERY
DOI: 10.1145/3306618.3314229
关键词
Interpretable machine learning; Decision making; Black box models
资金
- NSF [IIS-1149837]
- Ford
- SAP
- Lightspeed
- Stanford Data Science Initiative
- Chan Zuckerberg Biohub
- Robert Bosch Stanford Graduate Fellowship
- Microsoft Dissertation Grant
- Google Anitaborg Scholarship
- Office of the Director of National Intelligence (ODNI)
- Intelligence Advanced Research Projects Activity (IARPA) [2017-17071900005]
As predictive models increasingly assist human experts (e.g., doctors) in day-to-day decision making, it is crucial for experts to be able to explore and understand how such models behave in different feature subspaces in order to know if and when to trust them. To this end, we propose Model Understanding through Subspace Explanations (MUSE), a novel model agnostic framework which facilitates understanding of a given black box model by explaining how it behaves in subspaces characterized by certain features of interest. Our framework provides end users (e.g., doctors) with the flexibility of customizing the model explanations by allowing them to input the features of interest. The construction of explanations is guided by a novel objective function that we propose to simultaneously optimize for fidelity to the original model, unambiguity and interpretability of the explanation. More specifically, our objective allows us to learn, with optimality guarantees, a small number of compact decision sets each of which captures the behavior of a given black box model in unambiguous, well-defined regions of the feature space. Experimental evaluation with real-world datasets and user studies demonstrate that our approach can generate customizable, highly compact, easy-to-understand, yet accurate explanations of various kinds of predictive models compared to state-of-the-art baselines.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据