期刊
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING
卷 14, 期 1, 页码 811-822出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TAFFC.2020.3023821
关键词
Feature extraction; Databases; Training; Machine learning; Machine learning algorithms; Magnetic heads; Data mining; Micro-expression; spotting; local temporal pattern; data augmentation; Hammerstein model
Micro-expressions are important nonverbal communication clues that are difficult to spot due to their local and short nature. This article proposes a dedicated local and temporal pattern (LTP) of facial movement, called the S-pattern, to distinguish micro-expressions from other facial movements using a classic classification algorithm. The article also suggests using a global final fusion analysis and data augmentation with Hammerstein models (HMs) to improve the spotting performance of micro-expressions.
Micro-expressions (MEs) are very important nonverbal communication clues. However, due to their local and short nature, spotting them is challenging. In this article, we address this problem by using a dedicated local and temporal pattern (LTP) of facial movement. This pattern has a specific shape (an S-pattern) when MEs are displayed. Thus, by using a classic classification algorithm (SVM), MEs can be distinguished from other facial movements. We also propose a global final fusion analysis covering the whole face to improve the distinction between ME (local) and head (global) movements. However, the learning of S-patterns is limited by the small number of ME databases and the low volume of ME samples. Hammerstein models (HMs) are known to effectively approximate muscle movements. By approximating each S-pattern with an HM, we can both filter out outliers and generate new similar S-patterns. In this way, we augment the dataset for S-pattern training and improve the ability to differentiate MEs from other movements. The spotting results, performed in the CASMEI and CASMEII databases, show that our proposed LTP outperforms the most popular spotting method in terms of the F1-score. Adding a fusion process and data augmentation improves the spotting performance even further.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据