Differentiable Time-Gated Rendering

The continued advancements of time-of-flight imaging devices have enabled new imaging pipelines with numerous applications. Consequently, several forward rendering techniques capable of accurately and efficiently simulating these devices have been introduced. However, general-purpose differentiable rendering techniques that estimate derivatives of time-of-flight images are still lacking. In this paper, we introduce a new theory of differentiable time-gated rendering that enjoys the generality of differentiating with respect to arbitrary scene parameters. Our theory also allows the design of advanced Monte Carlo estimators capable of handling cameras with near-delta or discontinuous time gates. We validate our theory by comparing derivatives generated with our technique and finite differences. Further, we demonstrate the usefulness of our technique using a few proof-of-concept inverse-rendering examples that simulate several time-of-flight imaging scenarios.

Automated summary

This paper introduces a new theory of differentiable time-gated rendering that allows differentiation with respect to arbitrary scene parameters and the design of advanced Monte Carlo estimators. The authors validate their theory by comparing derivatives generated with their technique and finite differences, and demonstrate the usefulness of the technique through a few proof-of-concept inverse-rendering examples simulating various time-of-flight imaging scenarios.