期刊
MEDICAL IMAGE ANALYSIS
卷 81, 期 -, 页码 -出版社
ELSEVIER
DOI: 10.1016/j.media.2022.102539
关键词
Self-supervised learning; Contrastive representation learning; Histopathological images; Computational histopathology
类别
资金
- National Key Research and Development Program of China [2021YFF1200902]
- National Natural Science Foundation of China [61873141, 61721003, 61573207, U1736210, 42050101]
- Tsinghua-Fuzhou Institute for Data Technology
- Guoqiang Institute, Tsinghua University
This paper proposes a hybrid self-supervised learning method CS-CO tailored for histopathological images. It makes good use of domain-specific knowledge and requires no side information, showing good rationality and versatility. Experimental results demonstrate the effectiveness and robustness of CS-CO on common computational histopathology tasks, and ablation studies prove the complementarity and enhancement of cross-staining prediction and contrastive learning in CS-CO.
Visual representation extraction is a fundamental problem in the field of computational histopathology. Considering the powerful representation capacity of deep learning and the scarcity of annotations, self-supervised learning has emerged as a promising approach to extract effective visual representations from unlabeled histopathological images. Although a few self-supervised learning methods have been specifically proposed for histopathological images, most of them suffer from certain defects that may hurt the versatility or representation capacity. In this work, we propose CS-CO, a hybrid self-supervised visual representation learning method tailored for H&E-stained histopathological images, which integrates advantages of both generative and discriminative approaches. The proposed method consists of two self-supervised learning stages: cross-stain prediction (CS) and contrastive learning (CO). In addition, a novel data augmentation approach named stain vector perturbation is specifically proposed to facilitate contrastive learning. Our CS-CO makes good use of domain-specific knowledge and requires no side information, which means good rationality and versatility. We evaluate and analyze the proposed CS-CO on three H&E-stained histopathological image datasets with downstream tasks of patch-level tissue classification and slide-level cancer prognosis and subtyping. Experimental results demonstrate the effectiveness and robustness of the proposed CS-CO on common computational histopathology tasks. Furthermore, we also conduct ablation studies and prove that cross-staining prediction and contrastive learning in our CS-CO can complement and enhance each other. Our code is made available at https://github.com/easonyang1996/CS-CO.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据