4.7 Article

Data-Driven 3D Neck Modeling and Animation

Journal

Publisher

IEEE COMPUTER SOC
DOI: 10.1109/TVCG.2020.2967036

Keywords

Neck; Larynx; Facial animation; Strain; Solid modeling; Three-dimensional displays; Neck modeling; neck animation; speech-driven animation

Funding

  1. National Key R&D Program of China [2018YFA0704000]
  2. NSFC [61822111, 61727808, 61671268]
  3. Beijing Natural Science Foundation [JQ19015, L182052]

Ask authors/readers for more resources

This article introduces a data-driven approach for modeling and animating 3D necks, which decomposes neck animation into local and global deformations, and utilizes a dataset to learn a neck model and regressor for driving the animation.
In this article, we present a data-driven approach for modeling and animation of 3D necks. Our method is based on a new neck animation model that decomposes the neck animation into local deformation caused by larynx motion and global deformation driven by head poses, facial expressions, and speech. A skinning model is introduced for modeling local deformation and underlying larynx motions, while the global neck deformation caused by each factor is modeled by its corrective blendshape set, respectively. Based on this neck model, we introduce a regression method to drive the larynx motion and neck deformation from speech. Both the neck model and the speech regressor are learned from a dataset of 3D neck animation sequences captured from different identities. Our neck model significantly improves the realism of facial animation and allows users to easily create plausible neck animations from speech and facial expressions. We verify our neck model and demonstrate its advantages in 3D neck tracking and animation.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available