Journal
FRONTIERS IN PUBLIC HEALTH
Volume 10, Issue -, Pages -Publisher
FRONTIERS MEDIA SA
DOI: 10.3389/fpubh.2022.892658
Keywords
digital pathology; deep learning; multi-scale analysis; multi-label classification; multiple instance learning; representation learning
Categories
Ask authors/readers for more resources
Whole slide images (WSIs) are digitized histopathology images stored in a pyramidal data structure with different magnification levels, revealing relevant properties. With high resolution, WSIs are broken down into tiles for processing, and multiple scale analysis using multiple instance learning and barcode approach improves performance.
Whole slide images (WSIs) are digitized histopathology images. WSIs are stored in a pyramidal data structure that contains the same images at multiple magnification levels. In digital pathology, most algorithmic approaches to analyze WSIs use a single magnification level. However, images at different magnification levels may reveal relevant and distinct properties in the image, such as global context or detailed spatial arrangement. Given their high resolution, WSIs cannot be processed as a whole and are broken down into smaller pieces called tiles. Then, a prediction at the tile-level is made for each tile in the larger image. As many classification problems require a prediction at a slide-level, there exist common strategies to integrate the tile-level insights into a slide-level prediction. We explore two approaches to tackle this problem, namely a multiple instance learning framework and a representation learning algorithm (the so-called barcode approach) based on clustering. In this work, we apply both approaches in a single- and multi-scale setting and compare the results in a multi-label histopathology classification task to show the promises and pitfalls of multi-scale analysis. Our work shows a consistent improvement in performance of the multi-scale models over single-scale ones. Using multiple instance learning and the barcode approach we achieved a 0.06 and 0.06 improvement in F1 score, respectively, highlighting the importance of combining multiple scales to integrate contextual and detailed information.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available