Journal
PATTERN RECOGNITION
Volume 65, Issue -, Pages 11-25Publisher
ELSEVIER SCI LTD
DOI: 10.1016/j.patcog.2016.10.027
Keywords
Optical flow; Image sequence restoration; Edge preserving; Efficient numerical solver
Funding
- National Science Foundation (NSF) [1135616]
- National Natural Science Foundation of China [61501198]
- Wuhan Youth Science and Technology Chenguang program [2014072704011248]
- Direct For Computer & Info Scie & Enginr
- Division Of Computer and Network Systems [1135616] Funding Source: National Science Foundation
Ask authors/readers for more resources
The most popular optical flow algorithms rely on optimizing the energy function that integrates a data term and a smoothness term. In contrast to this traditional framework, we derive a new objective function that couples optical flow estimation and image restoration. Our method is inspired by the recent successes of edge-aware constraints (EAC) in preserving edges in general gradient domain image filtering. By incorporating an EAC image fidelity term (IFT) in the conventional variational model, the new energy function can simultaneously estimate optical flow and restore images with preserved edges, in a bidirectional manner. For the energy minimization, we rewrite the EAC into gradient form and optimize the IFT with Euler Lagrange equations. We can thus apply the image restoration by analytically solving a system of linear equations. Our EAC-combined IFT is easy to implement and can be seamlessly integrated into various optical flow functions suggested in literature. Extensive experiments on public optical flow benchmarks demonstrate that our method outperforms the current state-of-the-art in optical flow estimation and image restoration.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available