期刊
NEUROCOMPUTING
卷 175, 期 -, 页码 564-578出版社
ELSEVIER
DOI: 10.1016/j.neucom.2015.10.096
关键词
Micro-expression; LOP-TOP; Vector quantization; Discriminative
资金
- Academy of Finland [277395, 251286, 283125]
- Infotech Oulu [24001161]
- National Basic Research Program of China [20150351704]
- National Natural Science Foundation of China (NSFC) [61231002, 61201444]
- Natural Science Foundation of Jiangsu Province [BK20130020]
- Ph.D. Program Foundation of Ministry Education of China [20120092110054]
- Academy of Finland (AKA) [277395, 277395, 251286, 283125, 251286, 283125] Funding Source: Academy of Finland (AKA)
Spontaneous facial micro-expression analysis has become an active task for recognizing suppressed and involuntary facial expressions shown on the face of humans. Recently, Local Binary Pattern from Three Orthogonal Planes (LBP-TOP) has been employed for micro-expression analysis. However, LBP-TOP suffers from two critical problems, causing a decrease in the performance of micro-expression analysis. It generally extracts appearance and motion features from the sign-based difference between two pixels but not yet considers other useful information. As well, LBP-TOP commonly uses classical pattern types which maybe not optimal for local structure in some applications. This paper proposes SpatioTemporal Completed Local Quantization Patterns (STCLQP) for facial micro-expression analysis. Firstly, STCLQP extracts three interesting information containing sign, magnitude and orientation components. Secondly, an efficient vector quantization and codebook selection are developed for each component in appearance and temporal domains to learn compact and discriminative codebooks for generalizing classical pattern types. Finally, based on discriminative codebooks, spatiotemporal features of sign, magnitude and orientation components are extracted and fused. Experiments are conducted on three publicly available facial micro-expression databases. Some interesting findings about the neighboring patterns and the component analysis are concluded. Comparing with the state of the art, experimental results demonstrate that STCLQP achieves a substantial improvement for analyzing facial micro-expressions. (C) 2015 Elsevier B.V. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据