Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

Plenoptic images and videos bearing rich information demand a tremendous amount of data storage and high transmission cost. While there has been much study on plenoptic image coding, investigations into plenoptic video coding have been very limited. We investigate the motion compensation (or so-called temporal prediction) for plenoptic video coding from a slightly different perspective by looking at the problem in the ray-space domain instead of in the conventional pixel domain. Here, we develop a novel motion compensation scheme for lenslet video under two sub-cases of ray-space motion, that is, integer ray-space motion and fractional ray-space motion. The proposed new scheme of light field motion-compensated prediction is designed such that it can be easily integrated into well-known video coding techniques such as HEVC. Experimental results compared to relevant existing methods have shown remarkable compression efficiency with an average gain of 20.03% and 21.76% respectively under Low delayed B and Random Access configurations of HEVC.

Automated summary

Plenoptic images and videos require a large amount of data storage and high transmission cost. This paper investigates motion compensation for plenoptic video coding in the ray-space domain. A novel motion compensation scheme is proposed and integrated into well-known video coding techniques such as HEVC. Experimental results show significant compression efficiency improvement compared to existing methods under different configurations of HEVC.