4.6 Article

Fast and scalable search of whole-slide images via self-supervised deep learning

Related references

Note: Only part of the references are listed.
Article Computer Science, Interdisciplinary Applications

Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosis

Richard J. Chen et al.

Summary: This study proposes an interpretable strategy for multimodal fusion of histology image and genomic features for survival outcome prediction. The results on glioma and clear cell renal cell carcinoma datasets demonstrate that this approach improves the prognostic determinations.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2022)

Article Computer Science, Artificial Intelligence

Multi-layer pseudo-supervision for histopathology tissue semantic segmentation using patch-level classification labels

Chu Han et al.

Summary: This paper proposes a method for tissue semantic segmentation in histopathology images using patch-level classification labels to reduce annotation efforts. The model consists of two steps, generating pseudo masks and achieving tissue semantic segmentation with multi-layer pseudo-supervision. The proposed model outperforms state-of-the-art weakly-supervised semantic segmentation approaches and achieves comparable results to fully-supervised models. Patch-level labeling significantly reduces annotation time compared to manual labeling.

MEDICAL IMAGE ANALYSIS (2022)

Article Biochemistry & Molecular Biology

Deep learning-enabled assessment of cardiac allograft rejection from endomyocardial biopsies

Jana Lipkova et al.

Summary: A deep learning-based AI system has been developed for automated assessment of gigapixel whole-slide images obtained from endomyocardial biopsy, addressing the detection, subtyping and grading of allograft rejection. The system showed non-inferior performance to conventional assessment, reducing interobserver variability and assessment time.

NATURE MEDICINE (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

Richard J. Chen et al.

Summary: A new ViT architecture called HIPT is introduced to leverage the hierarchical structure inherent in gigapixel WSIs, with impressive performance on 9 slide-level tasks.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Review Pathology

Diagnostic concordance and discordance in digital pathology: a systematic review and meta-analysis

Ayesha S. Azam et al.

Summary: Digital pathology (DP) has the potential to revolutionize histopathology practice by improving efficiency and diagnostic accuracy. However, limited evidence of reliability has been a barrier to wider adoption. This meta-analysis showed equivalent performance of DP compared to light microscopy for routine diagnosis, with specific areas of diagnostic discrepancy identified.

JOURNAL OF CLINICAL PATHOLOGY (2021)

Review Pathology

MINI-REVIEW Searching Images for Consensus Can AI Remove Observer Variability in Pathology?

Hamid R. Tizhoosh et al.

Summary: Observer variability is a major obstacle in achieving diagnostic consensus. With the recent success of artificial intelligence, especially deep neural networks, it is possible to overcome the fundamental challenge of diagnostic imaging.

AMERICAN JOURNAL OF PATHOLOGY (2021)

Article Computer Science, Artificial Intelligence

Fine-Tuning and training of densenet for histopathology image representation using TCGA diagnostic slides

Abtin Riasatian et al.

Summary: Pre-trained deep artificial neural networks are a dominant source for image representation and their performance in image analysis can be improved through fine-tuning. This study introduces a new network, KimiaNet, which outperforms the original DenseNet and other networks in representing histopathology images. By utilizing a large dataset and training with different configurations, KimiaNet shows superior results in image analysis.

MEDICAL IMAGE ANALYSIS (2021)

Article Engineering, Biomedical

Data-efficient and weakly supervised computational pathology on whole-slide images

Ming Y. Lu et al.

Summary: The CLAM method utilizes attention-based learning to identify subregions with high diagnostic value for accurate classification of whole-slide images. It can localize well-known morphological features without the need for spatial labels, outperforming standard weakly supervised classification algorithms, and adapt to independent test cohorts, smartphone microscopy, and varying tissue content.

NATURE BIOMEDICAL ENGINEERING (2021)

Article Multidisciplinary Sciences

AI-based pathology predicts origins for cancers of unknown primary

Ming Y. Lu et al.

Summary: Cancer of unknown primary (CUP) is a difficult diagnosis as the primary site of tumor origin cannot be determined. The deep-learning-based algorithm TOAD provides a differential diagnosis for the origin of the primary tumor, achieving high accuracy on test sets and reducing the occurrence of CUP by assisting in assigning differential diagnoses for complicated cases.

NATURE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images

Richard J. Chen et al.

Summary: This paper introduces a Multimodal Co-Attention Transformer (MCAT) framework that learns a dense co-attention mapping between WSIs and genomic features in an embedding space. By reducing the space complexity of WSI bags, this method demonstrates superior performance in multiple instance learning.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

Proceedings Paper Engineering, Biomedical

A Similarity Measure of Histopathology Images by Deep Embeddings

Mehdi Afshari et al.

Summary: A content-based similarity measure for high-resolution gigapixel histopathology images was proposed, using patch-level deep embeddings extracted from a pre-trained deep model at different magnification levels. Results showed that the similarity measure achieved a maximum accuracy of 93.18% for top-5 search at 5x magnification.

2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC) (2021)

Proceedings Paper Acoustics

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction Using Patch-Based Graph Convolutional Networks

Richard J. Chen et al.

Summary: The study introduces a context-aware, patch-based graph convolutional network model that hierarchically aggregates histology features to model structures in the tumor microenvironment. Validation shows that the model outperforms previous methods in predicting patient survival.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VIII (2021)

Article Computer Science, Artificial Intelligence

Yottixel - An Image Search Engine for Large Archives of Histopathology Whole Slide Images

Shivam Kalra et al.

MEDICAL IMAGE ANALYSIS (2020)

Article Health Care Sciences & Services

Pan-cancer diagnostic consensus through searching archival histopathology images using artificial intelligence

Shivam Kalra et al.

NPJ DIGITAL MEDICINE (2020)

Article Biochemical Research Methods

Structured crowdsourcing enables convolutional segmentation of histology images

Mohamed Amgad et al.

BIOINFORMATICS (2019)

Article Oncology

Digital pathology and artificial intelligence

Muhammad Khalid Khan Niazi et al.

LANCET ONCOLOGY (2019)

Article Biochemistry & Molecular Biology

Clinical-grade computational pathology using weakly supervised deep learning on whole slide images

Gabriele Campanella et al.

NATURE MEDICINE (2019)

Article Oncology

Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology

Kaustav Bera et al.

NATURE REVIEWS CLINICAL ONCOLOGY (2019)

Article Biochemistry & Molecular Biology

A guide to deep learning in healthcare

Andre Esteva et al.

NATURE MEDICINE (2019)

Article Health Care Sciences & Services

Similar image search for histopathology: SMILY

Narayan Hegde et al.

NPJ DIGITAL MEDICINE (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Encoding Histopathological WSIs Using GNN for Scalable Diagnostically Relevant Regions Retrieval

Yushan Zheng et al.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT I (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Atlas of Digital Pathology: A Generalized Hierarchical Histological Tissue Type-Annotated Database for Deep Learning

Mahdi S. Hosseini et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Article Computer Science, Interdisciplinary Applications

Histopathological Whole Slide Image Analysis Using Context-Based CBIR

Yushan Zheng et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2018)

Article Biochemistry & Molecular Biology

Machine Learning Methods for Histopathological Image Analysis

Daisuke Komura et al.

COMPUTATIONAL AND STRUCTURAL BIOTECHNOLOGY JOURNAL (2018)

Article Biochemistry & Molecular Biology

Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning

Nicolas Coudray et al.

NATURE MEDICINE (2018)

Article Computer Science, Artificial Intelligence

Supervised graph hashing for histopathology image retrieval and classification

Xiaoshuang Shi et al.

MEDICAL IMAGE ANALYSIS (2017)

Article Multidisciplinary Sciences

Dermatologist-level classification of skin cancer with deep neural networks

Andre Esteva et al.

NATURE (2017)

Article Computer Science, Information Systems

Breast Histopathological Image Retrieval Based on Latent Dirichlet Allocation

Yibing Ma et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Densely Connected Convolutional Networks

Gao Huang et al.

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)

Article Cell Biology

Validation of digital pathology imaging for primary histopathological diagnosis

David R. J. Snead et al.

HISTOPATHOLOGY (2016)

Article Biochemical Research Methods

Automated prostate tissue referencing for cancer detection and diagnosis

Jin Tae Kwak et al.

BMC BIOINFORMATICS (2016)

Article Computer Science, Artificial Intelligence

Scalable histopathological image analysis via supervised hashing with multiple features

Menglin Jiang et al.

MEDICAL IMAGE ANALYSIS (2016)

Article Computer Science, Interdisciplinary Applications

Towards Large-Scale Histopathological Image Analysis: Hashing-Based Image Retrieval

Xiaofan Zhang et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2015)

Article Biochemical Research Methods

The CPTAC Data Portal: A Resource for Cancer Proteomics Research

Nathan J. Edwards et al.

JOURNAL OF PROTEOME RESEARCH (2015)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Article Biochemical Research Methods

Content-based histopathology image retrieval using CometCloud

Xin Qi et al.

BMC BIOINFORMATICS (2014)

Editorial Material Genetics & Heredity

The Cancer Genome Atlas Pan-Cancer analysis project

John N. Weinstein et al.

NATURE GENETICS (2013)

Article Computer Science, Information Systems

Content-Based Microscopic Image Retrieval System for Multi-Image Queries

Hatice Cinar Akakin et al.

IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE (2012)

Book Review Computer Science, Artificial Intelligence

Introduction to Information Retrieval

Mark Sanderson

NATURAL LANGUAGE ENGINEERING (2010)