Journal
IEEE TRANSACTIONS ON IMAGE PROCESSING
Volume 29, Issue -, Pages 8652-8667Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2020.3017352
Keywords
Task analysis; Feature extraction; Skeleton; Image edge detection; Object segmentation; Logic gates; Mobile handsets; Salient object segmentation; edge detection; skeleton extraction; joint learning
Funding
- Major Project for New Generation of AI [2018AAA0100400]
- NSFC [61922046]
- National Youth Talent Support Program
- Tianjin Natural Science Foundation [18ZXZNGX00110]
Ask authors/readers for more resources
Salient object segmentation, edge detection, and skeleton extraction are three contrasting low-level pixel-wise vision problems, where existing works mostly focused on designing tailored methods for each individual task. However, it is inconvenient and inefficient to store a pre-trained model for each task and perform multiple different tasks in sequence. There are methods that solve specific related tasks jointly but require datasets with different types of annotations supported at the same time. In this article, we first show some similarities shared by these tasks and then demonstrate how they can be leveraged for developing a unified framework that can be trained end-to-end. In particular, we introduce a selective integration module that allows each task to dynamically choose features at different levels from the shared backbone based on its own characteristics. Furthermore, we design a task-adaptive attention module, aiming at intelligently allocating information for different tasks according to the image content priors. To evaluate the performance of our proposed network on these tasks, we conduct exhaustive experiments on multiple representative datasets. We will show that though these tasks are naturally quite different, our network can work well on all of them and even perform better than current single-purpose state-of-the-art methods. In addition, we also conduct adequate ablation analyses that provide a full understanding of the design principles of the proposed framework.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available