期刊
IEEE ROBOTICS AND AUTOMATION LETTERS
卷 8, 期 1, 页码 416-423出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/LRA.2022.3223020
关键词
Computer vision for automation
类别
Event cameras perform better than frame cameras in challenging scenarios, but cannot completely replace frame cameras in normal situations. To leverage the advantages of both cameras, we propose a heterogeneous stereo camera system that combines an event and a frame camera to estimate real-time semi-dense disparity by matching heterogeneous data.
Event cameras can show better performance than frame cameras in challenging scenarios, such as fast-moving environments or high-dynamic-range scenes. However, it is still difficult for event cameras to replace frame cameras in non-challenging normal scenarios. In order to leverage the advantages of both cameras, we conduct a study for the heterogeneous stereo camera system which employs both an event and a frame camera. The proposed system estimates the semi-dense disparity in real-time by matching heterogeneous data of an event and a frame camera in stereo. We propose an accurate, intuitive and efficient way to align events with 6-DOF camera motion, by suggesting the maximum shift distance method. The aligned event image shows high similarity to the edge image of the frame camera. The proposed method can estimate poses of an event camera and depth of events in a few frames, which can speed up the initialization of the event camera system. We verified our algorithm in the DSEC dataset. The proposed hetero-stereo matching outperformed other methods. For real-time operation, we implemented our code using parallel computation with CUDA and release our code open source:
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据