A recurrence quantification analysis-based channel-frequency convolutional neural network for emotion recognition from EEG

Constructing a reliable and stable emotion recognition system is a critical but challenging issue for realizing an intelligent human-machine interaction. In this study, we contribute a novel channel-frequency convolutional neural network (CFCNN), combined with recurrence quantification analysis (RQA), for the robust recognition of electroencephalogram (EEG) signals collected from different emotion states. We employ movie clips as the stimuli to induce happiness, sadness, and fear emotions and simultaneously measure the corresponding EEG signals. Then the entropy measures, obtained from the RQA operation on EEG signals of different frequency bands, are fed into the novel CFCNN. The results indicate that our system can provide a high emotion recognition accuracy of 92.24% and a relatively excellent stability as well as a satisfactory Kappa value of 0.884, rendering our system particularly useful for the emotion recognition task. Meanwhile, we compare the performance of the entropy measures, extracted from each frequency band, in distinguishing the three emotion states. We mainly find that emotional features extracted from the gamma band present a considerably higher classification accuracy of 90.51% and a Kappa value of 0.858, proving the high relation between emotional process and gamma frequency band. Published by AIP Publishing.