4.7 Article

Learned Video Compression With Efficient Temporal Context Learning

期刊

IEEE TRANSACTIONS ON IMAGE PROCESSING
卷 32, 期 -, 页码 3188-3198

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2023.3276333

关键词

Image coding; Video compression; Transforms; Codecs; Quantization (signal); Video coding; Motion compensation; Learned video compression; inter-frame prediction; long-term correspondence; temporal context learning; TCVC-Net

向作者/读者索取更多资源

This paper proposes a novel temporal context-based video compression network (TCVC-Net) to improve the performance of learned video compression by exploiting long-term temporal context and utilizing multi-frequency components in temporal context. It introduces a global temporal reference aggregation (GTRA) module to obtain accurate temporal reference and a temporal conditional codec (TCC) to efficiently compress motion vector and residue. Experimental results demonstrate that the proposed TCVC-Net outperforms state-of-the-art methods in terms of both PSNR and MS-SSIM metrics.
In contrast to image compression, the key of video compression is to efficiently exploit the temporal context for reducing the inter-frame redundancy. Existing learned video compression methods generally rely on utilizing short-term temporal correlations or image-oriented codecs, which prevents further improvement of the coding performance. This paper proposed a novel temporal context-based video compression network (TCVC-Net) for improving the performance of learned video compression. Specifically, a global temporal reference aggregation (GTRA) module is proposed to obtain an accurate temporal reference for motion-compensated prediction by aggregating long-term temporal context. Furthermore, in order to efficiently compress the motion vector and residue, a temporal conditional codec (TCC) is proposed to preserve structural and detailed information by exploiting the multi-frequency components in temporal context. Experimental results show that the proposed TCVC-Net outperforms public state-of-the-art methods in terms of both PSNR and MS-SSIM metrics.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据