Journal
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022)
Volume -, Issue -, Pages 3172-3182Publisher
IEEE COMPUTER SOC
DOI: 10.1109/WACV51458.2022.00323
Keywords
-
Ask authors/readers for more resources
Modern image inpainting systems often struggle with large missing areas, complex geometric structures, and high-resolution images. This study proposes a new method called large mask inpainting (LaMa), which improves the inpainting network architecture using fast Fourier convolutions (FFCs) with wide receptive fields and a high receptive field perceptual loss. The experiments show that the proposed method achieves excellent performance and can handle challenging scenarios effectively.
Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that one of the main reasons for that is the lack of an effective receptive field in both the inpainting network and the loss function. To alleviate this issue, we propose a new method called large mask inpainting (LaMa). LaMa is based on i) a new inpainting network architecture that uses fast Fourier convolutions (FFCs), which have the imagewide receptive field; ii) a high receptive field perceptual loss; iii) large training masks, which unlocks the potential of the first two components. Our inpainting network improves the state-of-the-art across a range of datasets and achieves excellent performance even in challenging scenarios, e.g. completion of periodic structures. Our model generalizes surprisingly well to resolutions that are higher than those seen at train time, and achieves this at lower parameter&time costs than the competitive baselines. The code is available at https://github.com/saic-mdal/lama.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available