Model-Based 3D Contact Geometry Perception for Visual Tactile Sensor

Tactile sensing plays an important role for robots' perception, but the existing tactile technologies have multiple limitations. Visual-tactile sensor (VTS) is a newly developed tactile detector; it perceives the contacting surface shape, or even more refined texture, by way of the contact deformation image captured by a camera. A conventional visual perception is usually formulated as a data processing. It suffers issues of cumbersome training set and complicated calibration procedures. A novel model-based depth perceptual scheme is proposed where a mapping from the image intensity to the contact geometry is mathematically formulated with an associated tailored fast solver. The hardware calibration requires single image only, leading to an outstanding algorithmic robustness. The non-uniformity of the illumination condition is embodied by the stereo model, resulting in a robust depth perception precision. Compression tests on a prototype VTS showed the method's capability in high-quality geometry reconstruction. Both contacting shape and texture were captured at a root-mean-square error down to a sub-millimeter level. The feasibility of the proposed in a pose estimation application is further experimentally validated. The associated tests yielded estimation errors that were all less than 3 degrees in terms of spatial orientation and all less than 1mm in terms of translation.

Automated summary

This research presents a new visual-tactile sensor that can perceive the shape and texture of a contacting surface by capturing the deformation image. With model-based depth perceptual scheme and tailored fast solver, it achieves high-quality geometry reconstruction and pose estimation. The experimental results validate the effectiveness and robustness of this method.