A Bayesian Deep Learning Framework for End-To-End Prediction of Emotion From Heartbeat

Automatic prediction of emotion promises to revolutionise human-computer interaction. Recent trends involve fusion of multiple data modalities audio, visual, and physiological to classify emotional state. However, in practice, collection of physiological data 'in the wild' is currently limited to heartbeat time series of the kind generated by affordable wearable heart monitors. Furthermore, real-world applications of emotion prediction often require some measure of uncertainty over model output, in order to inform downstream decision-making. We present here an end-to-end deep learning model for classifying emotional valence from unimodal heartbeat time series. We further propose a Bayesian framework for modelling uncertainty over these valence predictions, and describe a probabilistic procedure for choosing to accept or reject model output according to the intended application. We benchmarked our framework against two established datasets and achieved peak classification accuracy of 90 percent. These results lay the foundation for applications of affective computing in real-world domains such as healthcare, where a high premium is placed on non-invasive collection of data, and predictive certainty.

Automated summary

Automatic prediction of emotion has the potential to revolutionize human-computer interaction. This study presents an end-to-end deep learning model for classifying emotional valence from unimodal heartbeat time series. The proposed Bayesian framework models uncertainty over these predictions and provides a probabilistic procedure for decision-making. The benchmarking results show a peak classification accuracy of 90 percent, laying the foundation for real-world applications of affective computing.