Journal
IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS
Volume 10, Issue 3, Pages 668-680Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCDS.2017.2721552
Keywords
Artificial system; Beck depression inventory (BDI); deep learning; depression; facial expression; regression; vocal expression
Funding
- Thomas Gerald Gray PGR Scholarship
- Royal Society of U.K. [IE160946]
- National Natural Science Foundation of China [IE160946]
- Majlis Amanah Rakyat Scholarship
- School of Engineering and Design
Ask authors/readers for more resources
A human being's cognitive system can be simulated by artificial intelligent systems. Machines and robots equipped with cognitive capability can automatically recognize a humans mental state through their gestures and facial expressions. In this paper, an artificial intelligent system is proposed to monitor depression. It can predict the scales of Beck depression inventory II (BDI-11) from vocal and visual expressions. First, different visual features are extracted from facial expression images. Deep learning method is utilized to extract key visual features from the facial expression frames. Second, spectral low-level descriptors and mel-frequency cepstral coefficients features arc extracted from short audio segments to capture the vocal expressions. Third, feature dynamic history histogram (FDHH) is proposed to capture the temporal movement on the feature space. Finally, these FDHH and audio features are fused using regression techniques for the prediction of the BDI-II scales. The proposed method has been tested on the public Audio/Visual Emotion Challenges 2014 dataset as it is tuned to be more focused on the study of depression. The results outperform all the other existing methods on the same dataset.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available