期刊
COMPUTER VISION AND IMAGE UNDERSTANDING
卷 117, 期 3, 页码 250-268出版社
ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.cviu.2012.11.010
关键词
2.5D Models; Active appearance models; AAM; 2.5D AAM; Image alignment; Lucas-Kanade; Simultaneous forwards additive; Normalization forwards additive; Robust fitting
资金
- Portuguese Science Foundation (FCT) [PTDC/EIA-CCO/108791/2008]
- FCT [SFRH/BD/45178/2008, SFRH/BD74152/2010]
- Fundação para a Ciência e a Tecnologia [PTDC/EIA-CCO/108791/2008, SFRH/BD/45178/2008] Funding Source: FCT
This work addresses the matching of a 3D deformable face model to 2D images through a 2.5D Active Appearance Models (AAM). We propose a 2.5D AAM that combines a 3D metric Point Distribution Model (PDM) and a 2D appearance model whose control points are defined by a full perspective projection of the PDM. The advantage is that, assuming a calibrated camera, 3D metric shapes can be retrieved from single view images. Two model fitting algorithms and their computational efficient approximations are proposed: the Simultaneous Forwards Additive (SFA) and the Normalization Forwards Additive (NFA), both based on the Lucas-Kanade framework. The SFA algorithm searches for shape and appearance parameters simultaneously whereas the NFA projects out the appearance from the error image and searches only for the shape parameters. SFA is therefore more accurate. Robust solutions for the SFA and NFA are also proposed in order to take into account the self-occlusion or partial occlusion of the face. Several performance evaluations for the SFA, NFA and theirs efficient approximations were performed. The experiments include evaluating the frequency of converge, the fitting performance in unseen data and the tracking performance in the FGNET Talking Face sequence. All results show that the 2.5D AAM can outperform both the 2D + 3D combined models and the 2D standard methods. The robust extensions to occlusion were tested on a synthetic sequence showing that the model can deal efficiently with large head rotation. (C) 2012 Elsevier Inc. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据