Journal
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING
Volume 9, Issue 2, Pages 271-284Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TAFFC.2016.2623718
Keywords
Depth sequences; linear subspaces; Grassmann manifold; spontaneous expression; pain detection
Funding
- Futur & Ruptures Institut Mines-Telecom Ph.D Grant
- FUI project MAGNUM 2
- Programme d'Investissements d'Avenir (PIA)
- Agence Nationale pour la Recherche [ANR-11-EQPX-0023]
- European Founds for the Regional Development [FEDER-Presage 41779]
- PHC Utique program for the CMCU DEFI project [N 34882WK]
Ask authors/readers for more resources
In this paper, we propose a framework for online spontaneous emotion detection, such as happiness or physical pain, from depth videos. Our approach consists on mapping the video streams onto a Grassmann manifold (i.e., space of k-dimensional linear subspaces) to form time-parameterized trajectories. To this end, depth videos are decomposed into short-time subsequences, each approximated by a k-dimensional linear subspace, which is in turn a point on the Grassmann manifold. Then, the temporal evolution of subspaces gives rise to a precise mathematical representation of trajectories on the underlying manifold. In the final step, extracted spatio-temporal features based on computing the velocity vectors along the trajectories, termed Geometric Motion History (GMH), are fed to an early event detector based on Structured Output SVM, which enables online emotion detection from partially-observed data. Experimental results obtained on the publicly available Cam3D Kinect and BP4D-spontaneous databases validate the proposed solution. The first database has served to exemplify the proposed framework using depth sequences of the upper part of the body collected using depth-consumer cameras, while the second database allowed the application of the same framework to physical pain detection from high-resolution and long 3D-face sequences.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available