Journal
IET IMAGE PROCESSING
Volume 17, Issue 8, Pages 2489-2502Publisher
WILEY
DOI: 10.1049/ipr2.12812
Keywords
computer vision; convolutional neural nets; face recognition
Ask authors/readers for more resources
This paper proposes a probability-guided hourglass network to enhance the shape constraints for robust facial landmark detection in unconstrained environments. The method involves a multi-scale pre-processing module for feature extraction, generating coarse localizations and probability maps based on heatmaps, and a probability-based boundary regression method with modified hausdorff distance as the loss function. The experimental results demonstrate that this method outperforms state-of-the-arts on unconstrained conditions.
The absence of local features and global shape constraints severely limits the performance of the hourglass network for facial landmark detection in unconstrained environments. Moreover, diverse feature types and scales may result in low accuracy. This paper proposes a probability-guided hourglass network to enhance the shape constraints for robust facial landmark detection. Firstly, a multi-scale pre-processing module is designed to extract features at different scales. Secondly, based on the heatmaps generated by the stacked hourglass network, the coarse localizations are obtained, while the probability maps are generated with local features. Finally, a probability-based boundary regression method is proposed and the hausdorff distance is modified as the loss function to constrain the feature shape. Adaptive weights are also added to the loss function, which can help relieve the data imbalance problem. Subjective and objective experimental results on the challenging datasets show that this method outperforms the state-of-the-arts on unconstrained conditions.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available