期刊
IEEE ROBOTICS AND AUTOMATION LETTERS
卷 7, 期 2, 页码 2613-2620出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/LRA.2022.3141751
关键词
Vision-based navigation; computer vision for transportation; sensor fusion; RGB-D perception
类别
资金
- National Research Foundation of Korea (NRF) - Korea government (MSIT) [NRF-2021R1F1A1061397, NRF-2021R1C1C1005723]
- Institute of Information & Communications Technology Planning & Evaluation (IITP) - Korea government (MSIT) [2020-001336]
- Artificial Intelligence Graduate School Program (UNIST)
We propose a drift-free visual compass that estimates the rotational motion of a camera by recognizing structural regularities in a Manhattan world. Our approach hybridizes data sampling and parameter search strategies to achieve quasi-global optimality and high efficiency. Experimental results on real-world datasets demonstrate that our method outperforms other state-of-the-art approaches in terms of accuracy, efficiency, and stability.
We present a drift-free visual compass for estimating the three degrees of freedom (DoF) rotational motion of a camera by recognizing structural regularities in a Manhattan world (MW), which posits that the major structures conform to three orthogonal principal directions. Existing Manhattan frame estimation approaches are based on either data sampling or a parameter search, and fail to guarantee accuracy and efficiency simultaneously. To overcome these limitations, we propose a novel approach to hybridize these two strategies, achieving quasi-global optimality and high efficiency. We first compute the two DoF of the camera orientation by detecting and tracking a vertical dominant direction from a depth camera or an IMU, and then search for the optimal third DoF with the image lines through the proposed Manhattan Mine-and-Stab (MnS) approach. Once we find the initial rotation estimate of the camera, we refine the absolute camera orientation by minimizing the average orthogonal distance from the endpoints of the lines to the MW axes. We compare the proposed algorithm with other state-of-the-art approaches on a variety of real-world datasets including data from a drone flying in an urban environment, and demonstrate that the proposed method outperforms them in terms of accuracy, efficiency, and stability. The code is available on the project page: https://github.com/PyojinKim/MWMS
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据