Real-World Validation of a Computer-Aided Diagnosis System for Prediction of Polyp Histology in Colonoscopy: A Prospective Multicenter Study

INTRODUCTION: Computer-aided diagnosis (CADx) of polyp histology could support endoscopists in clinical decision making. However, this has not been validated in a real-world setting.METHODS: We performed a prospective, multicenter study comparing CADx and endoscopist predictions of polyp histology in real-time colonoscopy. Optical diagnosis based on visual inspection of polyps was made by experienced endoscopists. After this, the automated output from the CADx support tool was recorded. All imaged polyps were resected for histological assessment. Primary outcome was difference in diagnostic performance between CADx and endoscopist prediction of polyp histology. Subgroup analysis was performed for polyp size, bowel preparation, difficulty of location of the polyps, and endoscopist experience.RESULTS: A total of 661 eligible polyps were resected in 320 patients aged =40 years between March 2021 and July 2022. CADx had an overall accuracy of 71.6% (95% confidence interval [CI] 68.0-75.0), compared with 75.2% (95% CI 71.7-78.4) for endoscopists (P 5 0.023). The sensitivity of CADx for neoplastic polyps was 61.8% (95% CI 56.9-66.5), compared with 70.3% (95% CI 65.7-74.7) for endoscopists (P < 0.001). The interobserver agreement between CADx and endoscopist predictions of polyp histology was moderate (83.1% agreement, K 0.661). When there was concordance between CADx and endoscopist predictions, the accuracy increased to 78.1%.DISCUSSION: The overall diagnostic accuracy and sensitivity for neoplastic polyps was higher in experienced endoscopists compared with CADx predictions, with moderate interobserver agreement. Concordance in predictions increased this diagnostic accuracy. Further research is required to improve the performance of CADx and to establish its role in clinical practice.

Automated summary

Computer-aided diagnosis (CADx) has the potential to support endoscopists in clinical decision making, but its performance in a real-world setting has not been validated. In this prospective, multicenter study, CADx predictions were compared with endoscopist predictions of polyp histology during colonoscopy. The results showed that endoscopists had higher accuracy and sensitivity compared to CADx, with moderate agreement between the two. Concordance between CADx and endoscopist predictions improved diagnostic accuracy. Further research is needed to improve the performance of CADx in clinical practice.