Journal
COMPUTERS & GRAPHICS-UK
Volume 115, Issue -, Pages 254-262Publisher
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.cag.2023.07.023
Keywords
Real-time scene reconstruction; Single-view 3D reconstruction
Categories
Ask authors/readers for more resources
Traditional urban reconstruction methods can only output incomplete 3D models, while learning-based shape reconstruction techniques are designed for single objects. This paper proposes a novel learning-based approach for real-time complete 3D mesh reconstruction of large-scale urban scenes. The approach segments objects and determines their positions, and reconstructs them under local coordinates to approximate training datasets.
Traditional urban reconstruction methods can only output incomplete 3D models, which depict the scene regions that are visible to the moving camera. While learning-based shape reconstruction techniques make single-view 3D reconstruction possible, they are designed to handle single objects that are well-presented in the training datasets. This paper presents a novel learning-based approach for reconstructing complete 3D meshes for large-scale urban scenes in real-time. The input video sequences are fed into a localization module, which segments different objects and determines their relative positions. Each object is then reconstructed under their local coordinates to better approximate models in the training datasets. The reconstruction module is adopted from BSP-Net (Chen et al., 2020), which is capable of producing compact polygon meshes. However, major changes have been made so that unoriented objects in large-scale scenes can be reconstructed efficiently using only a small number of planes. Experimental results demonstrate that our approach can reconstruct urban scenes with buildings and vehicles using 400 similar to 800 convex parts in 0.1 similar to 0.5 s. (c) 2023 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available