4.6 Article

Quasi-Globally Optimal and Real-Time Visual Compass in Manhattan Structured Environments

Journal

IEEE ROBOTICS AND AUTOMATION LETTERS
Volume 7, Issue 2, Pages 2613-2620

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/LRA.2022.3141751

Keywords

Vision-based navigation; computer vision for transportation; sensor fusion; RGB-D perception

Categories

Funding

  1. National Research Foundation of Korea (NRF) - Korea government (MSIT) [NRF-2021R1F1A1061397, NRF-2021R1C1C1005723]
  2. Institute of Information & Communications Technology Planning & Evaluation (IITP) - Korea government (MSIT) [2020-001336]
  3. Artificial Intelligence Graduate School Program (UNIST)

Ask authors/readers for more resources

We propose a drift-free visual compass that estimates the rotational motion of a camera by recognizing structural regularities in a Manhattan world. Our approach hybridizes data sampling and parameter search strategies to achieve quasi-global optimality and high efficiency. Experimental results on real-world datasets demonstrate that our method outperforms other state-of-the-art approaches in terms of accuracy, efficiency, and stability.
We present a drift-free visual compass for estimating the three degrees of freedom (DoF) rotational motion of a camera by recognizing structural regularities in a Manhattan world (MW), which posits that the major structures conform to three orthogonal principal directions. Existing Manhattan frame estimation approaches are based on either data sampling or a parameter search, and fail to guarantee accuracy and efficiency simultaneously. To overcome these limitations, we propose a novel approach to hybridize these two strategies, achieving quasi-global optimality and high efficiency. We first compute the two DoF of the camera orientation by detecting and tracking a vertical dominant direction from a depth camera or an IMU, and then search for the optimal third DoF with the image lines through the proposed Manhattan Mine-and-Stab (MnS) approach. Once we find the initial rotation estimate of the camera, we refine the absolute camera orientation by minimizing the average orthogonal distance from the endpoints of the lines to the MW axes. We compare the proposed algorithm with other state-of-the-art approaches on a variety of real-world datasets including data from a drone flying in an urban environment, and demonstrate that the proposed method outperforms them in terms of accuracy, efficiency, and stability. The code is available on the project page: https://github.com/PyojinKim/MWMS

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available