Neural Modeling of Portrait Bas-Relief From a Single Photograph

In this paper, we present an end-to-end neural solution to model portrait bas-relief from a single photograph, which is cast as a problem of image-to-depth translation. The main challenge is the lack of bas-relief data for network training. To solve this problem, we propose a semi-automatic pipeline to synthesize bas-relief samples. The main idea is to first construct normal maps from photos, and then generate bas-relief samples by reconstructing pixel-wise depths. In total, our synthetic dataset contains 23 k pixel-wise photo/bas-relief pairs. Since the process of bas-relief synthesis requires a certain amount of user interactions, we propose end-to-end solutions with various network architectures, and train them on the synthetic data. We select the one that gave the best results through qualitative and quantitative comparisons. Experiments on numerous portrait photos, comparisons with state-of-the-art methods and evaluations by artists have proven the effectiveness and efficiency of the selected network.

Automated summary

This paper presents an end-to-end neural solution for modeling portrait bas-relief from a single photograph. The authors address the challenge of lacking bas-relief data by proposing a semi-automatic pipeline to synthesize bas-relief samples. They train different network architectures on synthetic data and select the best-performing one through qualitative and quantitative comparisons. Experiments, comparisons, and evaluations by artists demonstrate the effectiveness and efficiency of the selected network.