Journal
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021)
Volume -, Issue -, Pages 10161-10170Publisher
IEEE
DOI: 10.1109/ICCV48922.2021.01002
Keywords
-
Funding
- Stanford Data for Development Initiative
- IARPA SMART
- ONR [N0001419-1-2145]
- NSF [1651565, 1733686]
- HAI
Ask authors/readers for more resources
This paper explores the application of contrastive learning methods to geo-located datasets, proposing novel training methods that leverage the spatio-temporal structure of remote sensing data to close the gap between contrastive and supervised learning. By constructing temporal positive pairs in contrastive learning and designing pre-text tasks based on geo-location, the proposed method shows improvements in various tasks related to image classification, object detection, and semantic segmentation for remote sensing, as well as geo-tagged ImageNet images.
Contrastive learning methods have significantly narrowed the gap between supervised and unsupervised learning on computer vision tasks. In this paper, we explore their application to geo-located datasets, e.g. remote sensing, where unlabeled data is often abundant but labeled data is scarce. We first show that due to their different characteristics, a non-trivial gap persists between contrastive and supervised learning on standard benchmarks. To close the gap, we propose novel training methods that exploit the spatio-temporal structure of remote sensing data. We leverage spatially aligned images over time to construct temporal positive pairs in contrastive learning and geo-location to design pre-text tasks. Our experiments show that our proposed method closes the gap between contrastive and supervised learning on image classification, object detection and semantic segmentation for remote sensing. Moreover, we demonstrate that the proposed method can also be applied to geo-tagged ImageNet images, improving downstream performance on various tasks.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available