期刊
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
卷 29, 期 11, 页码 4644-4654出版社
IEEE COMPUTER SOC
DOI: 10.1109/TVCG.2023.3320220
关键词
Rendering (computer graphics); Three-dimensional displays; Head; Photography; Image color analysis; Virtual reality; Cameras; Multi-layer images; inpainting; virtual reality; image-based rendering
Multi-layer images are widely used for viewing natural scenes in virtual reality, but removing obstructive objects or editing the content is challenging. Researchers propose a multi-layer inpainting approach that addresses this issue in two stages.
Multi-layer images are currently the most prominent scene representation for viewing natural scenes under full-motion parallax in virtual reality. Layers ordered in diopter space contain color and transparency so that a complete image is formed when the layers are composited in a view-dependent manner. Once baked, the same limitations apply to multi-layer images as to conventional single-layer photography, making it challenging to remove obstructive objects or otherwise edit the content. Object removal before baking can benefit from filling disoccluded layers with pixels from background layers. However, if no such background pixels have been observed, an inpainting algorithm must fill the empty spots with fitting synthetic content. We present and study a multi-layer inpainting approach that addresses this problem in two stages: First, a volumetric area of interest specified by the user is classified with respect to whether the background pixels have been observed or not. Second, the unobserved pixels are filled with multi-layer inpainting. We report on experiments using multiple variants of multi-layer inpainting and compare our solution to conventional inpainting methods that consider each layer individually.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据