Journal
SENSORS
Volume 21, Issue 2, Pages -Publisher
MDPI
DOI: 10.3390/s21020649
Keywords
hierarchical thinking; 3D hand pose estimation; RGB image; hand topology
Funding
- National Natural Science Foundation of China [61462038, 61562039, 61502213, 62062041]
- Science and Technology Planning Project of Jiangxi Provincial Department of Education [GJJ190217]
- Open Project Program of the State Key Lab of CAD & CG of Zhejiang University [A2029]
Ask authors/readers for more resources
The paper introduces a novel Five-Layer Ensemble CNN model based on hierarchical thinking to decompose the hand pose estimation task into five single-finger pose estimation sub-tasks, improving the estimation accuracy of 3D hand pose through sub-task fusion. Additionally, a more sophisticated hand model based on the topological structure of the hand is built to further enhance the estimation performance.
Estimating accurate 3D hand pose from a single RGB image is a highly challenging problem in pose estimation due to self-geometric ambiguities, self-occlusions, and the absence of depth information. To this end, a novel Five-Layer Ensemble CNN (5LENet) is proposed based on hierarchical thinking, which is designed to decompose the hand pose estimation task into five single-finger pose estimation sub-tasks. Then, the sub-task estimation results are fused to estimate full 3D hand pose. The hierarchical method is of great benefit to extract deeper and better finger feature information, which can effectively improve the estimation accuracy of 3D hand pose. In addition, we also build a hand model with the center of the palm (represented as Palm) connected to the middle finger according to the topological structure of hand, which can further boost the performance of 3D hand pose estimation. Additionally, extensive quantitative and qualitative results on two public datasets demonstrate the effectiveness of 5LENet, yielding new state-of-the-art 3D estimation accuracy, which is superior to most advanced estimation methods.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available