4.7 Article

DPPS: A deep-learning based point-light photometric stereo method for 3D reconstruction of metallic surfaces

期刊

MEASUREMENT
卷 210, 期 -, 页码 -

出版社

ELSEVIER SCI LTD
DOI: 10.1016/j.measurement.2023.112543

关键词

3D reconstruction; Photometric stereo; Convolutional neural network; Deep learning; Point light

向作者/读者索取更多资源

This paper presents a new deep learning method, DPPS, for recovering surface normal and height maps under varying illumination conditions. The method combines physics-based and data-driven approaches to handle reflective metal surfaces with unknown surface roughness. Experimental results show that DPPS outperforms commercial 3D scanners in accuracy and provides guidance for the application of deep learning in manufacturing.
(3D) provides geometric quality process monitoring in many manufacturing applications. Photometric stereo is one of the potential solutions for in -process metrology and active geometry compensation, which takes multiple images of an object under different illuminations as inputs and recovers its surface normal map based on a reflectance model. Deep learning approaches have shown their potential in solving the highly nonlinear problem for photometric stereo, but the main challenge preventing their practical application in process metrology lies in the difficulties in the generation of a comprehensive dataset for training the deep learning model. This paper presents a new Deep -learning based Point-light Photometric Stereo method, DPPS, which utilizes a multi-channel deep convolutional neural network (CNN) to achieve end-to-end prediction for both the surface normal and height maps in a semi -calibrated fashion. The key contribution is a new dataset generation method combining both physics-based and data-driven approaches, which minimizes the training cost and enables DPPS to handle reflective metal surfaces with unknown surface roughness. Even trained only with fully synthetic and high-fidelity dataset, our DPPS surpasses the state-of-the-art with an accuracy better than 0.15 cm over a 10 cm x 10 cm area and its real-life experimental results are on par with commercial 3D scanners. The demonstrated results provide guidance on improving the generalizability and robustness of deep-learning based computer vision metrology with minimized training cost as well as show the potential for in-process 3D metrology in advanced manufacturing processes.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据