4.7 Article

Weakly-Supervised Saliency Detection via Salient Object Subitizing

Journal

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCSVT.2021.3049408

Keywords

Saliency detection; Task analysis; Object detection; Feature extraction; Training; Image segmentation; Annotations; Weak supervision; saliency detection; object subitizing

Funding

  1. National Natural Science Foundation of China [61972157, 61902129]
  2. Shanghai Pujiang Talent Program [19PJ1403100]
  3. Economy and Information Commission of Shanghai [XX-RGZN-01-19-6348]
  4. National Key Research and Development Program of China [2019YFC1521104]
  5. Science and Technology Commission of Shanghai Municipality Program [18D1205903]
  6. City University of Hong Kong

Ask authors/readers for more resources

This paper introduces the use of saliency subitizing as weak supervision for salient object detection, with two modules generating and refining saliency masks. Experimental results demonstrate its superiority over other weakly-supervised methods and comparable performance to some fully-supervised methods.
Salient object detection aims at detecting the most visually distinct objects and producing the corresponding masks. As the cost of pixel-level annotations is high, image tags are usually used as weak supervisions. However, an image tag can only be used to annotate one class of objects. In this paper, we introduce saliency subitizing as the weak supervision since it is class-agnostic. This allows the supervision to be aligned with the property of saliency detection, where the salient objects of an image could be from more than one class. To this end, we propose a model with two modules, Saliency Subitizing Module (SSM) and Saliency Updating Module (SUM). While SSM learns to generate the initial saliency masks using the subitizing information, without the need for any unsupervised methods or some random seeds, SUM helps iteratively refine the generated saliency masks. We conduct extensive experiments on five benchmark datasets. The experimental results show that our method outperforms other weakly-supervised methods and even performs comparable to some fully-supervised methods.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available