4.7 Article

3D hand mesh recovery through inverse kinematics from a monocular RGB image☆

期刊

DISPLAYS
卷 80, 期 -, 页码 -

出版社

ELSEVIER
DOI: 10.1016/j.displa.2023.102535

关键词

3D hand mesh recovery; MANO model; Inverse kinematics; Monocular RGB image; Computer vision

向作者/读者索取更多资源

This article introduces a method for recovering 3D hand mesh from a monocular RGB image. By integrating an analytical method into a neural network, an end-to-end learnable model named IKHand is proposed, which can generate impressive and robust 3D hand meshes under various challenging conditions.
Recovering 3D hand mesh from a monocular RGB image has a wide range of application scenarios such as VR/AR. The parametric hand model provides a good geometric prior to the shape of hand, and is commonly used to recover the 3D hand mesh. However, the rotation parameters of hand model are not easy to learn, which influences the accuracy of model-based methods. To address this problem, we take advantage of the inverse kinematic chains of hand to derive an analytical method, which can convert hand joint locations into rotation parameters. By integrating such analytical method into the neural network, we propose an end-to end learnable model named IKHand to recover the 3D hand mesh. IKHand comprises detection module and mesh generation module. Detection module predicts the 3D hand keypoints while mesh generation module takes these keypoints to generate the 3D hand mesh. Experimental results show that our proposed method can generate impressive and robust 3D hand meshes under several challenging conditions, and can achieve competitive results on FreiHAND dataset as well as RHD.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据