Journal
ACM TRANSACTIONS ON GRAPHICS
Volume 32, Issue 4, Pages -Publisher
ASSOC COMPUTING MACHINERY
DOI: 10.1145/2461912.2462000
Keywords
Hand grasping and manipulation; motion capture; motion control; hand tracking; physics-based simulation
Categories
Funding
- National Science Foundation [IIS-1065384, IIS-1055046]
- NSFC [61035002, 60932007, 61073072, 61021063]
- Direct For Computer & Info Scie & Enginr
- Div Of Information & Intelligent Systems [1055046, 1065384] Funding Source: National Science Foundation
Ask authors/readers for more resources
This paper describes a new method for acquiring physically realistic hand manipulation data from multiple video streams. The key idea of our approach is to introduce a composite motion control to simultaneously model hand articulation, object movement, and subtle interaction between the hand and object. We formulate video-based hand manipulation capture in an optimization framework by maximizing the consistency between the simulated motion and the observed image data. We search an optimal motion control that drives the simulation to best match the observed image data. We demonstrate the effectiveness of our approach by capturing a wide range of high-fidelity dexterous manipulation data. We show the power of our recovered motion controllers by adapting the captured motion data to new objects with different properties. The system achieves superior performance against alternative methods such as marker-based motion capture and kinematic hand motion tracking.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available