Journal
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
Volume 27, Issue 1, Pages 68-82Publisher
IEEE COMPUTER SOC
DOI: 10.1109/TVCG.2019.2930691
Keywords
Cameras; Image reconstruction; Dynamics; Geometry; Real-time systems; Topology; Measurement; Non-rigid; real-time; 4D reconstruction; markerless motion capture; flying camera
Categories
Funding
- Natural Science Foundation of China (NSFC) [61722209, 6181001011, 61531014, 61861166002]
- Shenzhen Science and Technology Research and Development Funds [JCYJ20180507183706645]
Ask authors/readers for more resources
This paper presents a novel dynamic fusion scheme called FlyFusion, using a single flying depth camera, which successfully enables intelligent viewpoint selection and produces fused and denoised 3D geometry and motions.
While dynamic scene reconstruction has made revolutionary progress from the earliest setup using a mass of static cameras in studio environment to the latest egocentric or hand-held moving camera based schemes, it is still restricted by the recording volume, user comfortability, human labor and expertise. In this paper, a novel solution is proposed through a real-time and robust dynamic fusion scheme using a single flying depth camera, denoted as FlyFusion. By proposing a novel topology compactness strategy for effectively regularizing the complex topology changes, and the Geometry And Motion Energy (GAME) metric for guiding the viewpoint optimization in the volumetric space, FlyFusion succeeds to enable intelligent viewpoint selection based on the immediate dynamic reconstruction result. The merit of FlyFusion lies in its concurrent robustness, efficiency, and adaptation in producing fused and denoised 3D geometry and motions of a moving target interacting with different non-rigid objects in a large space.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available