A Model of Normality Inspired Deep Learning Framework for Depression Relapse Prediction Using Audiovisual Data

Background: Depression (Major Depressive Disorder) is one of the most common mental illnesses. According to the World Health Organization, more than 300 million people in the world are affected. A first depressive episode can be solved by a spontaneous remission within 6 to 12 months. It has been shown that depression affects speech production and facial expressions. Although numerous studies are proposed in the literature for depression recognition using audiovisual cues, depression relapse using audiovisual cues has not been studied in the literature. Method: In this paper, we propose a deep learningbased approach for depression recognition and depression relapse prediction using audiovisual data. For more versatility and reusability, the proposed approach is based on a Model of Normality inspired framework where we define depression relapse by the closeness of the audiovisual patterns of a subject after a symptom-free period to the audiovisual patterns of depressed subjects. A model of Normality is an anomaly detection distance-based approach that computes a distance of normality between the deep audiovisual encoding of a test sample and a learned representation from audiovisual encodings of anomalyfree data. Results: The proposed approach shows a very promising results with an accuracy of 87 . 4% and a F1-score of 82 . 3% for relapse/depression prediction using a Leave-One-Subject-Out training strategy on the DAIC-Woz dataset. Conclusion: The proposed model of normality-based framework is accurate in detecting depression and in predicting depression relapse. A prospective monitoring system is proposed for assisting depressed patients. The proposed framework is easily extensible and others modalities will be integrated in future works.

Automated summary

This paper proposes a deep learning-based approach for depression recognition and depression relapse prediction using audiovisual data. The proposed model of normality-based framework accurately detects depression and predicts depression relapse.