Interpretable classification of pathology whole-slide images using attention based context-aware graph convolutional neural network

Background and Objective: Whole slide image (WSI) classification and lesion localization within giga-pixel slide are challenging tasks in computational pathology that requires context-aware representations of his-tological features to adequately infer nidus. The existing weakly supervised learning methods mainly treat different locations in the slide as independent regions and cannot learn potential nonlinear interactions between instances based on i.i.d assumption, resulting in the model unable to effectively utilize context -ware information to predict the labels of WSIs and locate the region of interest (ROI).Methods: Here, we propose an interpretable classification model named bidirectional Attention-based Multiple Instance Learning Graph Convolutional Network (ABMIL-GCN), which hierarchically aggregates context-aware features of instances into a global representation in a topology fashion to predict the slide labels and localize the region of lymph node metastasis in WSIs.Results: We verified the superiority of this method on the Camelyon16 dataset, and the results show that the average predicted ACC and AUC of the proposed model after flooding optimization can reach 90.89% and 0.9149, respectively. The average accuracy and ACC score are improved by more than 7% and 4% compared with the existing state-of-the-art algorithms.Conclusions: The results demonstrate that context-aware GCN outperforms existing weakly supervised learning methods by introducing spatial correlations between the neighbor image patches, which also addresses the 'accuracy-interpretability trade-off' problem. The framework provides a novel paradigm for the clinical application of computer-aided diagnosis and intelligent systems.(c) 2022 Elsevier B.V. All rights reserved.

Automated summary

In this study, we propose an interpretable classification model named ABMIL-GCN, which hierarchically aggregates context-aware features using graph convolutional networks to predict the labels of WSI and locate the region of lymph node metastasis. The results demonstrate the superiority of this method on the Camelyon16 dataset, with improved accuracy and AUC scores compared to existing algorithms.