期刊
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
卷 71, 期 -, 页码 -出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIM.2022.3168892
关键词
Visualization; Cameras; Feature extraction; Robots; Training; Robot kinematics; Streaming media; Deep residual network; event camera; event spike tensor (EST); triplet ranking loss; visual place recognition (VPR)
资金
- National Natural Science Foundation of China [62073066, U20A20197]
- Science and Technology on Near-Surface Detection Laboratory [6142414200208]
- Fundamental Research Funds for the Central Universities [N2226001]
- Aeronautical Science Foundation of China [201941050001]
In this study, an end-to-end VPR network using event cameras is proposed, which achieves good recognition performance in challenging driving scenes. By characterizing and aggregating event streams, the algorithm demonstrates stronger advantages in handling challenging environments.
Traditional visual place recognition (VPR) methods generally use frame-based cameras, which will easily fail due to rapid illumination changes or fast motion. To overcome this, we propose an end-to-end VPR network using event cameras, which can achieve good recognition performance in challenging environments (e.g., large-scale driving scenes). The key idea of the proposed algorithm is first to characterize the event streams with the EST voxel grid representation, then extract features using a deep residual network, and, finally, aggregate features using an improved VLAD network to realize end-to-end VPR using event streams. To verify the effectiveness of the proposed algorithm, on the event-based driving datasets (MVSEC, DDD17, and Brisbane-Event-VPR) and the synthetic event datasets (Oxford RobotCar and CARLA), we analyze the performance of our proposed method on large-scale driving sequences, including cross-weather, cross-season, and illumination changing scenes, and then, we compare the proposed method with the state-of-the-art event-based VPR method (Ensemble-Event-VPR) to prove its advantages. Experimental results show that the performance of the proposed method is better than that of the event-based ensemble scheme in challenging scenarios. To the best of our knowledge, for the VPR task, this is the first end-to-end weakly supervised deep network architecture that directly processes event stream data.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据