Journal
IEEE TRANSACTIONS ON MULTIMEDIA
Volume 25, Issue -, Pages 1148-1160Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2021.3139459
Keywords
Prototypes; Training; Semantics; Image segmentation; Task analysis; Robustness; Annotations; Cross-image; weakly-supervised; segmentation
Ask authors/readers for more resources
Weakly supervised image segmentation trained with image-level labels usually suffer from inaccurate coverage of object areas during pseudo groundtruth generation. To enhance the generality of object activation maps, we propose a region prototypical network (RPNet) to explore cross-image object diversity. Similar object parts are identified through region feature comparison, with object confidence propagated to discover new object areas and suppress background regions. Experiments demonstrate that our approach generates more complete and accurate pseudo object masks and achieves state-of-the-art performance on PASCAL VOC 2012 and MS COCO. We also investigate the robustness of our method on reduced training sets. The code can be accessed at https://github.com/liuweide01/RPNet-Weakly-Supervised-Segmentation.
Weakly supervised image segmentation trained with image-level labels usually suffers from inaccurate coverage of object areas during the generation of the pseudo groundtruth. This is because the object activation maps are trained with the classification objective and lack the ability to generalize. To improve the generality of the object activation maps, we propose a region prototypical network (RPNet) to explore the cross-image object diversity of the training set. Similar object parts across images are identified via region feature comparison. Object confidence is propagated between regions to discover new object areas while background regions are suppressed. Experiments show that the proposed method generates more complete and accurate pseudo object masks while achieving state-of-the-art performance on PASCAL VOC 2012 and MS COCO. In addition, we investigate the robustness of the proposed method on reduced training sets. The code is available at https://github.com/liuweide01/RPNet-Weakly-Supervised-Segmentation.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available