期刊
IEEE TRANSACTIONS ON IMAGE PROCESSING
卷 30, 期 -, 页码 1623-1638出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2019.2914575
关键词
Person re-identification (Re-ID); graph matching; correspondence transfer; pose context descriptor; correspondence template ensemble
资金
- National Natural Science Foundation of China (NSFC) [61671289, 61221001, 61528204, 61771303, 61521062, 61571261]
- Shanghai Science and Technology Committee (STCSM) [18DZ2270700]
- U.S. National Science Foundation (NSF) [1618398, 1350521]
This paper presents a robust and efficient graph correspondence transfer (REGCT) approach for explicit spatial alignment in Re-ID, which achieves local feature distance calculation in both training and testing stages through offline correspondence learning and online correspondence transfer frameworks. Extensive experiments on five challenging benchmarks demonstrate the superior performance of REGCT over other state-of-the-art approaches.
Spatial misalignment caused by variations in poses and viewpoints is one of the most critical issues that hinder the performance improvement in existing person re-identification (Re-ID) algorithms. Although it is straightforward to explore correspondence learning algorithms for alignment, online learning is intractable for negative pairs due to the intrinsic visual difference between negative pairs and efficiency concern. To address this problem, in this paper, we present a robust and efficient graph correspondence transfer (REGCT) approach for explicit spatial alignment in Re-ID. Specifically, we propose the off-line correspondence learning and on-line correspondence transfer framework. During training, patch-wise correspondences between positive training pairs are established via graph matching. By exploiting both spatial and visual contexts of human appearance in graph matching, meaningful semantic correspondences can be obtained. During testing, the off-line learned patch-wise correspondence templates are transferred to test pairs with similar pose-pair configurations for local feature distance calculation. To enhance the robustness of correspondence transfer, we design a novel pose context descriptor to accurately model human body configurations, and present an approach to measure the similarity between a pair of pose context descriptors. Meanwhile, to improve testing efficiency, we propose a correspondence template ensemble method using the voting mechanism, which significantly reduces the amount of patch-wise matchings involved in distance calculation. With the aforementioned strategies, the REGCT model can effectively and efficiently handle the spatial misalignment problem in Re-ID. Extensive experiments on five challenging benchmarks, including VIPeR, Road, PRID450S, 3DPES, and CUHK01, evidence the superior performance of REGCT over other state-of-the-art approaches.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据