4.7 Article

Video Denoising for Scenes With Challenging Motion: A Comprehensive Analysis and a New Framework

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Information Systems

Deep SR-HDR: Joint Learning of Super-Resolution and High Dynamic Range Imaging for Dynamic Scenes

Xiao Tan et al.

Summary: This paper proposes a deep neural network called Deep SR-HDR for the joint task of super-resolution and high dynamic range imaging. The network reconstructs high-resolution HDR images from a set of differently exposed low-resolution LDR images of a dynamic scene. By merging the shared processing steps and designing a multi-scale deformable module, the proposed network achieves high-quality image reconstruction efficiently.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Information Systems

Video Frame Interpolation via Generalized Deformable Convolution

Zhihao Shi et al.

Summary: Video frame interpolation aims to synthesize intermediate frames while maintaining spatial and temporal consistencies. Existing methods can be categorized into flow-based and kernel-based. Flow-based methods suffer from inaccuracies in flow map estimation, while kernel-based methods are constrained by rigid kernel shapes. To address these limitations, a novel mechanism called generalized deformable convolution is proposed, which enables data-driven motion learning and flexible sampling in space-time. Experimental results demonstrate the superiority of the new method, particularly for complex motions.

IEEE TRANSACTIONS ON MULTIMEDIA (2022)

Article Computer Science, Artificial Intelligence

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Huaian Chen et al.

Summary: This study introduces a semi-supervised semantic segmentation method that reduces the need for a large number of pixel-level annotated images by improving the confidence of the predicted class probability map. The method includes adversarial learning and information entropy calculation, resulting in more confident predictions focused on misclassified regions, particularly boundary areas, and achieving competitive segmentation performance.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Information Systems

Contrastive Attention for Video Anomaly Detection

Shuning Chang et al.

Summary: In this work, we propose a novel lightweight anomaly detection model for weakly-supervised video anomaly detection. The model fully utilizes normal videos to train a classifier with discriminative ability for normal videos, and employs a contrastive attention module to improve the selection of anomalous segments. Experimental results demonstrate that our model significantly improves the frame-level AUC compared to state-of-the-art methods.

IEEE TRANSACTIONS ON MULTIMEDIA (2022)

Article Computer Science, Information Systems

Multiframe-to-Multiframe Network for Video Denoising

Huaian Chen et al.

Summary: This paper proposes a multiframe-to-multiframe (MM) denoising scheme that simultaneously recovers multiple clean frames from consecutive noisy frames, aiming to achieve better temporal consistency. Furthermore, an MM network (MMNet) is presented, which combines interframe similarity and single-frame characteristics to achieve competitive denoising performance.

IEEE TRANSACTIONS ON MULTIMEDIA (2022)

Article Computer Science, Artificial Intelligence

MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancement

Wenbo Bao et al.

Summary: The study introduces a motion estimation and compensation driven neural network for video frame interpolation, which integrates optical flow and interpolation kernels using an adaptive warping layer. It achieves visually appealing results without the need for hand-crafted features, showing improved computational efficiency compared to existing methods. The proposed MEMC-Net architecture can be seamlessly adapted to various video enhancement tasks and outperforms state-of-the-art algorithms on a wide range of datasets in quantitative and qualitative evaluations.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Article Automation & Control Systems

DOF: A Demand-Oriented Framework for Image Denoising

Huaian Chen et al.

Summary: The study proposes a demand-oriented framework for image denoising, which can balance denoising quality, number of parameters, and computational complexity. By designing a scale encoder, split-flow module, and scale decoder, the framework achieves competitive denoising performance in terms of parameters and complexity, as demonstrated by extensive experiments.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2021)

Article Computer Science, Artificial Intelligence

Deep Maximum a Posterior Estimator for Video Denoising

Lu Sun et al.

Summary: This paper presents a novel deep learning-based video denoising method, MAP-VDNet, which efficiently removes noise by exploiting temporal redundancy in video frames using the MAP estimation framework. The algorithm allows for effective separation of motion estimation and image restoration, and outperforms current state-of-the-art techniques on popular video datasets.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Patch Craft: Video Denoising by Deep Modeling and Patch Matching

Gregory Vaksman et al.

Summary: The paper introduces a new method for utilizing self-similarity in video denoising, while still relying on a regular convolutional architecture. By introducing the concept of "patch-craft frames" to enhance video sequences with artificial frames, significant improvements in denoising performance were achieved.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

Article Computer Science, Artificial Intelligence

Video Denoising by Combining Patch Search and CNNs

Axel Davy et al.

Summary: Recent research has shown that non-local patch-based methods were once state of the art for image denoising, but are now surpassed by CNNs. However, in video denoising, non-local methods are still competitive due to their ability to exploit video temporal redundancy. The proposed method in this study incorporates non-locality into a CNN to improve image and video denoising results.

JOURNAL OF MATHEMATICAL IMAGING AND VISION (2021)

Article Computer Science, Artificial Intelligence

Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising

Xiangyu Xu et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Video Enhancement with Task-Oriented Flow

Tianfan Xue et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2019)

Article Computer Science, Artificial Intelligence

Video Denoising via Empirical Bayesian Estimation of Space-Time Patches

Pablo Arias et al.

JOURNAL OF MATHEMATICAL IMAGING AND VISION (2018)

Article Computer Science, Artificial Intelligence

FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising

Kai Zhang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2018)

Article Computer Science, Information Systems

F-DES: Fast and Deep Event Summarization

Krishan Kumar et al.

IEEE TRANSACTIONS ON MULTIMEDIA (2018)

Article Computer Science, Artificial Intelligence

Trunk-Branch Ensemble Convolutional Neural Networks for Video-Based Face Recognition

Changxing Ding et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2018)

Article Computer Science, Artificial Intelligence

Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising

Kai Zhang et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2017)

Article Computer Science, Software Engineering

Deep High Dynamic Range Imaging of Dynamic Scenes

Nima Khademi Kalantari et al.

ACM TRANSACTIONS ON GRAPHICS (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Deformable Convolutional Networks

Jifeng Dai et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Article Computer Science, Artificial Intelligence

Patch-Based Video Denoising With Optical Flow Estimation

Antoni Buades et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2016)

Proceedings Paper Computer Science, Artificial Intelligence

FlowNet: Learning Optical Flow with Convolutional Networks

Alexey Dosovitskiy et al.

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2015)

Article Computer Science, Artificial Intelligence

Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction

Matteo Maggioni et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2013)

Article Computer Science, Artificial Intelligence

3D Convolutional Neural Networks for Human Action Recognition

Shuiwang Ji et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2013)

Article Computer Science, Artificial Intelligence

Fast Cost-Volume Filtering for Visual Correspondence and Beyond

Asmaa Hosni et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2013)

Article Computer Science, Artificial Intelligence

Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms

Matteo Maggioni et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2012)