期刊
IEEE TRANSACTIONS ON MULTIMEDIA
卷 25, 期 -, 页码 1148-1160出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2021.3139459
关键词
Prototypes; Training; Semantics; Image segmentation; Task analysis; Robustness; Annotations; Cross-image; weakly-supervised; segmentation
Weakly supervised image segmentation trained with image-level labels usually suffer from inaccurate coverage of object areas during pseudo groundtruth generation. To enhance the generality of object activation maps, we propose a region prototypical network (RPNet) to explore cross-image object diversity. Similar object parts are identified through region feature comparison, with object confidence propagated to discover new object areas and suppress background regions. Experiments demonstrate that our approach generates more complete and accurate pseudo object masks and achieves state-of-the-art performance on PASCAL VOC 2012 and MS COCO. We also investigate the robustness of our method on reduced training sets. The code can be accessed at https://github.com/liuweide01/RPNet-Weakly-Supervised-Segmentation.
Weakly supervised image segmentation trained with image-level labels usually suffers from inaccurate coverage of object areas during the generation of the pseudo groundtruth. This is because the object activation maps are trained with the classification objective and lack the ability to generalize. To improve the generality of the object activation maps, we propose a region prototypical network (RPNet) to explore the cross-image object diversity of the training set. Similar object parts across images are identified via region feature comparison. Object confidence is propagated between regions to discover new object areas while background regions are suppressed. Experiments show that the proposed method generates more complete and accurate pseudo object masks while achieving state-of-the-art performance on PASCAL VOC 2012 and MS COCO. In addition, we investigate the robustness of the proposed method on reduced training sets. The code is available at https://github.com/liuweide01/RPNet-Weakly-Supervised-Segmentation.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据