期刊
SENSORS
卷 21, 期 16, 页码 -出版社
MDPI
DOI: 10.3390/s21165317
关键词
affective computing; classification; communication; deep neural networks; emotion recognition; interpersonal features; multimodal
资金
- JST-COI from Japan Science and Technology Agency [JPMJCE1309]
- KAKENHI from JSPS/MEXT, Japan [JP20H03553]
This study investigated the impact of interpersonal features on the performance of automatic emotion recognition techniques, by comparing individual framework and interpersonal framework in main and supplementary experiments. The results demonstrated that interpersonal framework outperformed individual framework in all modalities, indicating the usefulness of interpersonal features in enhancing automatic emotion recognition tasks.
During social interaction, humans recognize others' emotions via individual features and interpersonal features. However, most previous automatic emotion recognition techniques only used individual features-they have not tested the importance of interpersonal features. In the present study, we asked whether interpersonal features, especially time-lagged synchronization features, are beneficial to the performance of automatic emotion recognition techniques. We explored this question in the main experiment (speaker-dependent emotion recognition) and supplementary experiment (speaker-independent emotion recognition) by building an individual framework and interpersonal framework in visual, audio, and cross-modality, respectively. Our main experiment results showed that the interpersonal framework outperformed the individual framework in every modality. Our supplementary experiment showed-even for unknown communication pairs-that the interpersonal framework led to a better performance. Therefore, we concluded that interpersonal features are useful to boost the performance of automatic emotion recognition tasks. We hope to raise attention to interpersonal features in this study.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据