An Augmented Reality-Assisted Visualization System for Potential Applications in Prostate Biopsy

Ultrasound-guided biopsy is widely used for disease detection and diagnosis. We plan to register preoperative imaging, such as positron emission tomography / computed tomography ( PET/CT) and/or magnetic resonance imaging (MRI), with real-time intraoperative ultrasound imaging for improved localization of suspicious lesions that may not be seen on ultrasound but visible on other imaging modalities. Once the image registration is completed, we will combine the images from two or more imaging modalities and use Microsoft HoloLens 2 augmented reality (AR) headset to display three-dimensional (3D) segmented lesions and organs from previously acquired images and real-time ultrasound images. In this work, we are developing a multi-modal, 3D augmented reality system for the potential use in ultrasound-guided prostate biopsy. Preliminary results demonstrate the feasibility of combining images from multiple modalities into an AR-guided system.

Automated summary

Ultrasound-guided biopsy is commonly used for disease detection and diagnosis. This study aims to improve the localization of suspicious lesions by registering preoperative imaging with real-time ultrasound imaging and using augmented reality technology. The preliminary results show the feasibility of using multiple imaging modalities in an augmented reality-guided system for ultrasound-guided prostate biopsy.