期刊
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
卷 70, 期 -, 页码 -出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIM.2021.3105243
关键词
Deep learning for visual perception; saliency prediction; simultaneous localization and mapping (SLAM)
资金
- National Natural Science Foundation of China [51605054]
- Natural Science Foundation of Chongqing [cstc2020jcyj-msxmX0575]
- Chongqing Technology Innovation and Application Development Project [cstc2020jscx-dxwtBX0029, cstc2020jscxmsxmX0109]
- Fundamental Research Funds for the Central Universities [2020CDJ-LHZZ-042]
This article proposes to mimic the mechanism of visual saliency or visual attention in the visual SLAM framework by using the saliency prediction model. By re-computing the saliency map to solve the center bias of the generic salient dataset, the salient bundle adjustment (SBA) algorithm is introduced. Experimental results demonstrate that the proposed SBA algorithm outperforms existing algorithms such as DSO and ORB-SLAM3 in both indoor and outdoor environments.
Most visual simultaneous localization and mapping (SLAM) algorithms rely on geometric features, such as points, lines, and planes, and these algorithms treated all features as equally important in the optimization process, ignoring the semantic information of these features. However, the robust and rich semantic features should play a more important role, which is similar to the mechanism of visual saliency or visual attention. Therefore, this article aims to mimic this mechanism in the visual SLAM framework by using the saliency prediction model. To solve the center bias of the generic salient dataset, we proposed a method for recomputing saliency map by considering both geometric and semantic information. Then, we proposed the salient bundle adjustment (SBA) algorithm by using the value of saliency prediction map as the weight of the feature points in the traditional bundle adjustment (BA) approach. Finally, exhaustive experiments conducted with the state-of-the-art algorithm show that our proposed algorithm outperforms existing algorithms such as direct sparse odometry (DSO) and oriented brief (ORB)SLAM3 in both indoor and outdoor environments.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据