Journal
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
Volume 45, Issue 4, Pages 4494-4503Publisher
IEEE COMPUTER SOC
DOI: 10.1109/TPAMI.2022.3189849
Keywords
Games; Computational modeling; Neural networks; Tumors; Task analysis; Supervised learning; Standards; Interpretable machine learning; Shapley coefficients; image explanations
Ask authors/readers for more resources
As complex neural networks become more powerful, their predictions become less interpretable, which hinders their deployment in sensitive settings. In this study, we propose h-Shap, a hierarchical extension of Shapley coefficients, as a model-agnostic explanation method for image classification. Compared to other Shapley-based methods, h-Shap is scalable and can compute precise Shapley coefficients without approximation. Experimental results show that h-Shap outperforms state-of-the-art methods in terms of accuracy and runtime in various scenarios.
As modern complex neural networks keep breaking records and solving harder problems, their predictions also become less and less intelligible. The current lack of interpretability often undermines the deployment of accurate machine learning tools in sensitive settings. In this work, we present a model-agnostic explanation method for image classification based on a hierarchical extension of Shapley coefficients-Hierarchical Shap (h-Shap)-that resolves some of the limitations of current approaches. Unlike other Shapley-based explanation methods, h-Shap is scalable and can be computed without the need of approximation. Under certain distributional assumptions, such as those common in multiple instance learning, h-Shap retrieves the exact Shapley coefficients with an exponential improvement in computational complexity. We compare our hierarchical approach with popular Shapley-based and non-Shapley-based methods on a synthetic dataset, a medical imaging scenario, and a general computer vision problem, showing that h-Shap outperforms the state-of-the-art in both accuracy and runtime. Code and experiments are made publicly available.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available