Journal
MEDICAL IMAGE ANALYSIS
Volume 69, Issue -, Pages -Publisher
ELSEVIER
DOI: 10.1016/j.media.2021.101957
Keywords
Radiology pathology fusion; Super-resolution registration; Generative adversarial networks; Mapping cancer from histopathology& nbsp; images onto MRI
Categories
Funding
- Department of Radiology, Stanford University
- Mark and Mary Stevens Interdisciplinary Graduate Fellowship, Wu Tsai Neuroscience Institute
- National Institutes of Health, National Cancer Institute [U01CA196387]
- Radiology Science Laboratory (Neuro) from the Department of Radiology at Stanford University, GE Blue Sky Award, National Institutes of Health, Training in Biomedical Imaging Instrumentation at Stanford [5T32 EB009653]
- Department of Urology, Stanford University
- GE Blue Sky Award
Ask authors/readers for more resources
The use of MRI for prostate cancer diagnosis and treatment is increasing rapidly, but accurately detecting cancer on MRI remains a challenge. By aligning 3D histopathology images with pre-surgical MRI, more accurate cancer labels can be projected onto MRI.
The use of MRI for prostate cancer diagnosis and treatment is increasing rapidly. However, identifying the presence and extent of cancer on MRI remains challenging, leading to high variability in detection even among expert radiologists. Improvement in cancer detection on MRI is essential to reducing this variability and maximizing the clinical utility of MRI. To date, such improvement has been limited by the lack of accurately labeled MRI datasets. Data from patients who underwent radical prostatectomy enables the spatial alignment of digitized histopathology images of the resected prostate with corresponding presurgical MRI. This alignment facilitates the delineation of detailed cancer labels on MRI via the projection of cancer from histopathology images onto MRI. We introduce a framework that performs 3D registration of whole-mount histopathology images to pre-surgical MRI in three steps. First, we developed a novel multi-image super-resolution generative adversarial network (miSRGAN), which learns information useful for 3D registration by producing a reconstructed 3D MRI. Second, we trained the network to learn information between histopathology slices to facilitate the application of 3D registration methods. Third, we registered the reconstructed 3D histopathology volumes to the reconstructed 3D MRI, mapping the extent of cancer from histopathology images onto MRI without the need for slice-to-slice correspondence. When compared to interpolation methods, our super-resolution reconstruction resulted in the highest PSNR relative to clinical 3D MRI (32.15 dB vs 30.16 dB for BSpline interpolation). Moreover, the registration of 3D volumes reconstructed via super-resolution for both MRI and histopathology images showed the best alignment of cancer regions when compared to (1) the state-of-the-art RAPSODI approach, (2) volumes that were not reconstructed, or (3) volumes that were reconstructed using nearest neighbor, linear, or BSpline interpolations. The improved 3D alignment of histopathology images and MRI facilitates the projection of accurate cancer labels on MRI, allowing for the development of improved MRI interpretation schemes and machine learning models to automatically detect cancer on MRI. (c) 2021 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ( http://creativecommons.org/licenses/by-nc-nd/4.0/ )
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available