Pixel-Wise Grasp Detection via Twin Deconvolution and Multi-Dimensional Attention

The grasp detection is crucial to high-quality robotic grasping. Typically, the mainstream encoder-decoder regression solution is attractive due to its high accuracy and efficiency, however, it is still challenging to solve the checkerboard artifacts from the uneven overlap of convolution results in decoder, and features from the encoder also need to be further refined. In this paper, a novel pixel-wise grasp detection network is proposed, which is composed of an encoder, a multi-dimensional attention bottleneck, and a decoder based on twin deconvolution. The proposed decoder introduces a twin branch upon the original transposed convolution branch. Through the overlap degree matrix provided by the twin branch, the original branch is re-weighted and then the checkerboard artifacts of the original branch are eliminated. Besides, to deeply explore the intrinsic relationship of features and strengthen feature discrimination, residual multi-head self-attention, cross-amplitude attention, and channel attention are integrated together. As a result, adaptive feature refinement is achieved. The effectiveness of the proposed method is verified by experiments.

Automated summary

In this paper, a novel pixel-wise grasp detection network is proposed, which addresses the checkerboard artifacts issue in the decoder caused by uneven overlap of convolution results. The network consists of an encoder, a multi-dimensional attention bottleneck, and a decoder based on twin deconvolution. Additionally, various attention mechanisms are integrated to enhance feature discrimination and achieve adaptive feature refinement.