Interpretability-Driven Sample Selection Using Self Supervised Learning for Disease Classification and Segmentation

In supervised learning for medical image analysis, sample selection methodologies are fundamental to attain optimum system performance promptly and with minimal expert interactions (e.g. label querying in an active learning setup). In this article we propose a novel sample selection methodology based on deep features leveraging information contained in interpretability saliency maps. In the absence of ground truth labels for informative samples, we use a novel self supervised learning based approach for training a classifier that learns to identify the most informative sample in a given batch of images. We demonstrate the benefits of the proposed approach, termed Interpretability-Driven Sample Selection (IDEAL), in an active learning setup aimed at lung disease classification and histopathology image segmentation. We analyze three different approaches to determine sample informativeness from interpretability saliency maps: (i) an observational model stemming from findings on previous uncertainty-based sample selection approaches, (ii) a radiomics-based model, and (iii) a novel data-driven self-supervised approach. We compare IDEAL to other baselines using the publicly available NIH chest X-ray dataset for lung disease classification, and a public histopathology segmentation dataset (GLaS), demonstrating the potential of using interpretability information for sample selection in active learning systems. Results show our proposed self supervised approach outperforms other approaches in selecting informative samples leading to state of the art performance with fewer samples.

Automated summary

In this article, we propose a novel sample selection methodology called IDEAL based on deep features for medical image analysis, which can improve system performance and reduce expert interactions. By leveraging information from interpretability saliency maps, a self-supervised learning approach is used to train a classifier to identify the most informative samples in a given batch of images. Experimental results demonstrate that the proposed approach outperforms other methods in lung disease classification and histopathology image segmentation tasks, showing the potential of using interpretability information for sample selection in active learning systems.