期刊
IEEE ACCESS
卷 10, 期 -, 页码 96053-96065出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2022.3205018
关键词
Emotion recognition; Training data; Labeling; Convolutional neural networks; Face recognition; Support vector machines; Streaming media; Deep learning; Predictive models; Facial expression quantification; continuous affect prediction; valence-arousal space; deep learning
资金
- University of Malaya [GPF095A-2020]
- Malaysia France Bilateral Research Grant [MATCH 2021, IF040-2021]
Facial emotion recognition has attracted extensive attention in the affective computing community. This paper proposes a new deep learning-based approach for continuous affect recognition and prediction by mapping discrete emotion labels and facial expression representation to a continuous valence-arousal dimensional space.
Facial emotion recognition has attracted extensive attention from the affective computing community and several approaches have been proposed, mainly providing classification of facial expressions images using a set of discrete emotional labels. The quantification of human emotions from faces has been studied in a continuous 2D emotional space of valence and arousal, that describes the level of pleasantness and the intensity of excitement, respectively. Emotion assessment using valence-arousal computation is a challenging topic with several possible applications in health monitoring, e-learning, mental health diagnosis and monitoring of customer interest. Supervised learning of emotional valence-arousal for continuous affect prediction requires labeled data. However, annotation of facial images with the values for valence and arousal requires training human experts. In this paper, we propose a new and robust approach based on deep learning for continuous affect recognition and prediction. The novelty of our approach is that it maps the discrete labels and a learned facial expression representation to the continuous valence-arousal dimensional space. Given a discrete class of emotion and a facial image, our deep learning-based approach can predict the valence and arousal values accurately. Our proposed approach outperforms existing approaches for arousal and valence prediction on AffectNet dataset and it shows an impressive generalization ability on an unseen dataset for valence prediction.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据