Bayesian Deep Basis Fitting for Depth Completion with Uncertainty

In this work we investigate the problem of uncertainty estimation for image-guided depth completion. We extend Deep Basis Fitting (DBF) [54] for depth completion within a Bayesian evidence framework to provide calibrated perpixel variance. The DBF approach frames the depth completion problem in terms of a network that produces a set of low-dimensional depth bases and a differentiable least squares fitting module that computes the basis weights using the sparse depths. By adopting a Bayesian treatment, our Bayesian Deep Basis Fitting (BDBF) approach is able to 1) predict high-quality uncertainty estimates and 2) enable depth completion with few or no sparse measurements. We conduct controlled experiments to compare BDBF against commonly used techniques for uncertainty estimation under various scenarios. Results show that our method produces better uncertainty estimates with accurate depth prediction.

Automated summary

This study investigates uncertainty estimation for image-guided depth completion using Bayesian evidence framework. The Bayesian Deep Basis Fitting (BDBF) approach can predict high-quality uncertainty estimates and enable depth completion with few or no sparse measurements. Controlled experiments show that BDBF produces better uncertainty estimates with accurate depth prediction.