Journal
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
Volume 70, Issue -, Pages -Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIM.2020.3031835
Keywords
Deep convolution neural networks (DCNNs); facial expression recognition (FER); local gravitational force (GF) descriptor; score-level fusion; softmax classification
Funding
- project Prediction of Diseases Through Computer Assisted Diagnosis System Using Images Captured by Minimally Invasive and Noninvasive Modalities, Computer Science and Engineering, PDPM Indian Institute of Information Technology, Design and Manufacturing [SPARC-MHRD-231]
- project IT4Neuro(degeneration) [CZ.02.1.01/0.0/0.0/18 069/0010054]
- project Smart Solutions in Ubiquitous Computing Environments, Grant Agency of Excellence, University of Hradec Kralove, Faculty of Informatics and Management, Czech Republic [UHK-FIM-GE-2020]
- Universiti Teknologi Malaysia (UTM) [20H04]
- Malaysia Research University Network (MRUN) [4L876]
- Fundamental Research Grant Scheme (FRGS) under the Ministry of Education Malaysia [5F073]
Ask authors/readers for more resources
This work proposes a deep-learning-based scheme for identifying facial expressions, exploring both local and holistic features and using score-level fusion to compute the final classification score. The method outperformed all state-of-the-art methods on five benchmark databases.
An image is worth a thousand words; hence, a face image illustrates extensive details about the specification, gender, age, and emotional states of mind. Facial expressions play an important role in community-based interactions and are often used in the behavioral analysis of emotions. Recognition of automatic facial expressions from a facial image is a challenging task in the computer vision community and admits a large set of applications, such as driver safety, human-computer interactions, health care, behavioral science, video conferencing, cognitive science, and others. In this work, a deep-learning-based scheme is proposed for identifying the facial expression of a person. The proposed method consists of two parts. The former one finds out local features from face images using a local gravitational force descriptor, while, in the latter part, the descriptor is fed into a novel deep convolution neural network (DCNN) model. The proposed DCNN has two branches. The first branch explores geometric features, such as edges, curves, and lines, whereas holistic features are extracted by the second branch. Finally, the score-level fusion technique is adopted to compute the final classification score. The proposed method along with 25 state-of-the-art methods is implemented on five benchmark available databases, namely, Facial Expression Recognition 2013, Japanese Female Facial Expressions, Extended CohnKanade, Karolinska Directed Emotional Faces, and Real-world Affective Faces. The databases consist of seven basic emotions: neutral, happiness, anger, sadness, fear, disgust, and surprise. The proposed method is compared with existing approaches using four evaluation metrics, namely, accuracy, precision, recall, and f1-score. The obtained results demonstrate that the proposed method outperforms all state-of-the-art methods on all the databases.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available