Journal
COMPUTATIONAL INTELLIGENCE
Volume 37, Issue 2, Pages 701-734Publisher
WILEY
DOI: 10.1111/coin.12411
Keywords
bias-corrected uncertainty estimation; classification; deep learning; dropweights; ensembles; medical image segmentation
Categories
Ask authors/readers for more resources
Deep learning has made remarkable progress in medical image analysis, but current methods focus solely on accuracy of point predictions without considering the quality of outputs. This article proposes an uncertainty estimation framework, MC-DropWeights, to approximate Bayesian inference in DL by applying a Bernoulli distribution to model weights. By decomposing predictive probabilities into two main types of uncertainty and addressing mode collapse in variational inference, the MC-DropWeights method demonstrates improved estimation of uncertainty quality in image classification.
Deep learning (DL), which involves powerful black box predictors, has achieved a remarkable performance in medical image analysis, such as segmentation and classification for diagnosis. However, in spite of these successes, these methods focus exclusively on improving the accuracy of point predictions without assessing the quality of their outputs. Knowing how much confidence there is in a prediction is essential for gaining clinicians' trust in the technology. In this article, we propose an uncertainty estimation framework, called MC-DropWeights, to approximate Bayesian inference in DL by imposing a Bernoulli distribution on the incoming or outgoing weights of the model, including neurones. We demonstrate that by decomposing predictive probabilities into two main types of uncertainty, aleatoric and epistemic, using the Bayesian Residual U-Net (BRUNet) in image segmentation. Approximation methods in Bayesian DL suffer from the mode collapse phenomenon in variational inference. To address this problem, we propose a model which Ensembles of Monte-Carlo DropWeights by varying the DropWeights rate. In segmentation, we introduce a predictive uncertainty estimator, which takes the mean of the standard deviations of the class probabilities associated with every class. However, in classification, we need an alternative approach since the predictive probabilities from a forward pass through the model does not capture uncertainty. The entropy of the predictive distribution is a measure of uncertainty, but its exponential depends on sample size. The plug-in estimate in mutual information is subject to sampling bias. We propose Jackknife resampling, to correct for sample bias, which improves estimating uncertainty quality in image classification. We demonstrate that our deep ensemble MC-DropWeights method, using the bias-corrected estimator produces an equally good or better result in both quantified uncertainty estimation and quality of uncertainty estimates than approximate Bayesian neural networks in practice.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available