4.7 Article

Self-Supervised Learning With Data-Efficient Supervised Fine-Tuning for Crowd Counting

期刊

IEEE TRANSACTIONS ON MULTIMEDIA
卷 25, 期 -, 页码 1538-1546

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2023.3251106

关键词

Data models; Head; Self-supervised learning; Annotations; Training; Task analysis; Computational modeling; Crowd counting; augmentation transformation; self-supervised learning; self-supervised loss

向作者/读者索取更多资源

To reduce the burden of labeling, this paper proposes a self-supervised learning framework (SSL-FT) that utilizes unlabeled and limited labeled data for crowd counting. The framework consists of an online network and a target network, which are trained using consistent spatial transformations. Results show that SSL-FT outperforms state-of-the-art semi-supervised methods on four public datasets.
Due to the expensive and laborious annotations of labeled data required by fully-supervised learning in the crowd counting task, it is desirable to explore a method to reduce the labeling burden. There exists a large number of unlabeled images in the wild that can be easily obtained compared to labeled datasets. Based on the characteristics of consistent spatial transformation with the annotations of heads and image, this paper proposes a self-supervised learning framework with unlabeled and limited labeled data for pre-training and fine-tuning crowd counting model (SSL-FT). It includes an online network and a target network that receive the same images but are randomly processed by two defined augmentation transformations. We leverage unlabeled data to pre-train the online network based on a self-supervised loss and small-scale labeled data to transfer the model to a specific domain based on a fully-supervised loss. We demonstrate the effectiveness of the SSL-FT on four public datasets including ShanghaiTech PartA, PartB, UCF-QNRF and WorldExpo'10 utilizing a classical counting model. Experimental results show that our approach performs better than state-of-art semi-supervised methods.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据