期刊
ACM TRANSACTIONS ON GRAPHICS
卷 33, 期 4, 页码 -出版社
ASSOC COMPUTING MACHINERY
DOI: 10.1145/2601097.2601135
关键词
intrinsic decomposition; temporal coherence; video editing
资金
- NSFC [61327902, 61035002, 61120106003]
- 863 Program [2013AA01A604]
- Beijing Key Laboratory of Multi-dimensional AMP
- Multi-scale Computational Photography (MMCP)
- European Commission (7FP [GOLEM, VERVE]
- Spanish Ministry of Science and Technology [TIN2010-21543]
- Gobierno de Aragon
We present a method to decompose a video into its intrinsic components of reflectance and shading, plus a number of related example applications in video editing such as segmentation, stylization, material editing, recolorization and color transfer. Intrinsic decomposition is an ill-posed problem, which becomes even more challenging in the case of video due to the need for temporal coherence and the potentially large memory requirements of a global approach. Additionally, user interaction should be kept to a minimum in order to ensure efficiency. We propose a probabilistic approach, formulating a Bayesian Maximum a Posteriori problem to drive the propagation of clustered reflectance values from the first frame, and defining additional constraints as priors on the reflectance and shading. We explicitly leverage temporal information in the video by building a causal-anticausal, coarse-to-fine iterative scheme, and by relying on optical flow information. We impose no restrictions on the input video, and show examples representing a varied range of difficult cases. Our method is the first one designed explicitly for video; moreover, it naturally ensures temporal consistency, and compares favorably against the state of the art in this regard.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据