4.7 Review

Deep learning for depression recognition with audiovisual cues: A review

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

Integrating Deep and Shallow Models for Multi-Modal Depression Analysis-Hybrid Architectures

Le Yang et al.

Summary: This paper emphasizes the importance of text-based features in addition to audio and video features for automatic depression assessment systems. It also proposes a hybrid framework that incorporates deep and shallow models to analyze depression-related textual indicators, and introduces new text and video features for depression estimation and classification. The experiments conducted on the AVEC2016 depression dataset demonstrate that the proposed framework effectively improves accuracy and outperforms existing features in terms of depression recognition performance.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2021)

Article Computer Science, Artificial Intelligence

Video-Based Depression Level Analysis by Encoding Deep Spatiotemporal Features

Mohamad Al Jazaery et al.

Summary: This study proposes a novel framework for estimating depression levels from video data, which shows promising results in experiments conducted on AVEC2013 and AVEC2014 depression datasets.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2021)

Article Computer Science, Artificial Intelligence

Automatic depression recognition using CNN with attention mechanism from videos

Lang He et al.

Summary: The study proposes an integrated framework DLGA-CNN for depression recognition, combining CNN with attention mechanism and weighted spatial pyramid pooling. By focusing on local and global attention, it effectively mines depression patterns from facial videos.

NEUROCOMPUTING (2021)

Article Computer Science, Artificial Intelligence

Sequential fusion of facial appearance and dynamics for depression recognition

Qian Chen et al.

Summary: The paper proposes a sequential fusion method for facial depression recognition, which aims to improve depression recognition by exploring the correlation and complementarity between different data modalities in multimodal learning. The results show the superiority of this method against several state-of-the-art alternatives.

PATTERN RECOGNITION LETTERS (2021)

Article Computer Science, Artificial Intelligence

A hierarchical depression detection model based on vocal and emotional cues

Yizhuo Dong et al.

Summary: This paper proposes a method to enhance the prediction performance of depression diagnosis using deep speaker recognition and speech emotion recognition features, and introduces a hierarchical depression detection model, achieving promising results on the AVEC 2013 and AVEC 2014 benchmark databases.

NEUROCOMPUTING (2021)

Article Computer Science, Artificial Intelligence

A time-frequency channel attention and vectorization network for automatic depression level prediction

Mingyue Niu et al.

Summary: This study proposes a new method for depression detection by combining time-frequency attention and squeeze-and-excitation components, emphasizing discriminative timestamps, frequency bands, and channels. Through attention and vectorization processing of the time-frequency attributes of data, a new network architecture is formed, improving the accuracy and efficiency of depression detection.

NEUROCOMPUTING (2021)

Article Computer Science, Artificial Intelligence

Deep Learning for Human Affect Recognition: Insights and New Developments

Philipp V. Rouast et al.

Summary: Human affect recognition research primarily focuses on the application of deep learning algorithms, covering feature representations of spatial, temporal, and multimodal sensor data. The findings suggest a trend towards the use of deep learning in this field, which will play a significant role in future research.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2021)

Article Computer Science, Artificial Intelligence

Visually Interpretable Representation Learning for Depression Recognition from Facial Images

Xiuzhuang Zhou et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2020)

Review Computer Science, Artificial Intelligence

A review on the long short-term memory model

Greg Van Houdt et al.

ARTIFICIAL INTELLIGENCE REVIEW (2020)

Article Engineering, Electrical & Electronic

Automatic Assessment of Depression From Speech via a Hierarchical Attention Transfer Network and Attention Autoencoders

Ziping Zhao et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2020)

Article Chemistry, Multidisciplinary

Towards Automatic Depression Detection: A BiLSTM/1D CNN-Based Model

Lin Lin et al.

APPLIED SCIENCES-BASEL (2020)

Article Computer Science, Information Systems

A Novel Approach for Classification of Speech Emotions Based on Deep and Acoustic Features

Mehmet Bilal Er

IEEE ACCESS (2020)

Article Computer Science, Information Systems

Feature Augmenting Networks for Improving Depression Severity Estimation From Speech Signals

Le Yang et al.

IEEE ACCESS (2020)

Article Computer Science, Information Systems

Automatic Depression Analysis Using Dynamic Facial Appearance Descriptor and Dirichlet Process Fisher Encoding

Lang He et al.

IEEE TRANSACTIONS ON MULTIMEDIA (2019)

Article Computer Science, Information Systems

Multimodal Depression Detection: Fusion of Electroencephalography and Paralinguistic Behaviors Using a Novel Strategy for Classifier Ensemble

Xiaowei Zhang et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2019)

Proceedings Paper Computer Science, Interdisciplinary Applications

Multi-instance Learning for Bipolar Disorder Diagnosis using Weakly Labelled Speech Data

Zhao Ren et al.

PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON DIGITAL PUBLIC HEALTH (DPH '19) (2019)

Article Computer Science, Artificial Intelligence

Multimodal Depression Detection: Fusion Analysis of Paralinguistic, Head Pose and Eye Gaze Behaviors

Sharifa Alghowinem et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2018)

Article Computer Science, Artificial Intelligence

Automated Depression Diagnosis Based on Deep Networks to Encode Facial Appearance and Dynamics

Yu Zhu et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2018)

Article Computer Science, Artificial Intelligence

Artificial Intelligent System for Automatic Depression Level Analysis Through Visual and Vocal Expressions

Asim Jan et al.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2018)

Article Computer Science, Interdisciplinary Applications

Automated EEG-based screening of depression using deep convolutional neural network

U. Rajendra Acharya et al.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2018)

Article Computer Science, Interdisciplinary Applications

Automated depression analysis using convolutional neural networks from speech

Lang He et al.

JOURNAL OF BIOMEDICAL INFORMATICS (2018)

Article Computer Science, Information Systems

Dynamic Multimodal Measurement of Depression Severity Using Deep Autoencoding

Hamdi Dibeklioglu et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Multi-modality Hierarchical Recall based on GBDTs for Bipolar Disorder Classification

Xiaofen Xing et al.

PROCEEDINGS OF THE 2018 AUDIO/VISUAL EMOTION CHALLENGE AND WORKSHOP (AVEC'18) (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Bipolar Disorder Recognition with Histogram Features of Arousal and Body Gestures

Le Yang et al.

PROCEEDINGS OF THE 2018 AUDIO/VISUAL EMOTION CHALLENGE AND WORKSHOP (AVEC'18) (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Automated Screening for Bipolar Disorder from Audio/Visual Modalities

Zafi Sherhan Syed et al.

PROCEEDINGS OF THE 2018 AUDIO/VISUAL EMOTION CHALLENGE AND WORKSHOP (AVEC'18) (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Bipolar Disorder Recognition via Multi-scale Discriminative Audio Temporal Representation

Zhengyin Du et al.

PROCEEDINGS OF THE 2018 AUDIO/VISUAL EMOTION CHALLENGE AND WORKSHOP (AVEC'18) (2018)

Article Computer Science, Artificial Intelligence

Coupled HMM-based multimodal fusion for mood disorder detection through elicited audio-visual signals

Tsung-Hsien Yang et al.

JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING (2017)

Article Computer Science, Artificial Intelligence

SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation

Vijay Badrinarayanan et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2017)

Article Biochemical Research Methods

Using thermographic cameras to investigate eye temperature and clinical severity in depression

Jerome J. Maller et al.

JOURNAL OF BIOMEDICAL OPTICS (2016)

Article Medicine, Research & Experimental

Alleviated negative rather than positive attentional bias in patients with depression in remission: an eye-tracking study

Mi Li et al.

JOURNAL OF INTERNATIONAL MEDICAL RESEARCH (2016)

Proceedings Paper Acoustics

Decision Tree Based Depression Classification from Audio Video and Language Information

Le Yang et al.

PROCEEDINGS OF THE 6TH INTERNATIONAL WORKSHOP ON AUDIO/VISUAL EMOTION CHALLENGE (AVEC'16) (2016)

Proceedings Paper Acoustics

DepAudioNet: An Efficient Deep Model for Audio based Depression Classification

Xingchen Ma et al.

PROCEEDINGS OF THE 6TH INTERNATIONAL WORKSHOP ON AUDIO/VISUAL EMOTION CHALLENGE (AVEC'16) (2016)

Article Computer Science, Theory & Methods

Automated Depression Diagnosis Based on Facial Dynamic Analysis and Sparse Coding

Lingyun Wen et al.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2015)

Article Acoustics

A review of depression and suicide risk assessment using speech analysis

Nicholas Cummins et al.

SPEECH COMMUNICATION (2015)

Article Behavioral Sciences

Motivational and emotional influences on cognitive control in depression: A pupillometry study

Neil P. Jones et al.

COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE (2015)

Article Computer Science, Artificial Intelligence

Automatic nonverbal behavior indicators of depression and PTSD: the effect of gender

Giota Stratou et al.

JOURNAL ON MULTIMODAL USER INTERFACES (2015)

Article Computer Science, Artificial Intelligence

Automatic audiovisual behavior descriptors for psychological disorder analysis

Stefan Scherer et al.

IMAGE AND VISION COMPUTING (2014)

Article Computer Science, Artificial Intelligence

Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses

Jeffrey M. Girard et al.

IMAGE AND VISION COMPUTING (2014)

Review Medicine, Legal

Neurobiology of suicide: do biomarkers exist?

Alessandra Costanza et al.

INTERNATIONAL JOURNAL OF LEGAL MEDICINE (2014)

Article Environmental Sciences

Pupillometry in Chinese Female Patients with Depression: A Pilot Study

Jikun Wang et al.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2014)

Review Public, Environmental & Occupational Health

The Epidemiology of Depression Across Cultures

Ronald C. Kessler et al.

ANNUAL REVIEW OF PUBLIC HEALTH, VOL 34 (2013)

Article Computer Science, Interdisciplinary Applications

Classifying depression patients and normal subjects using machine learning techniques and nonlinear features from EEG signal

Behshad Hosseinifard et al.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2013)

Review Clinical Neurology

Risk factors for suicide in individuals with depression: A systematic review

Keith Hawton et al.

JOURNAL OF AFFECTIVE DISORDERS (2013)

Article Computer Science, Artificial Intelligence

Multimodal assistive technologies for depression diagnosis and monitoring

Jyoti Joshi et al.

JOURNAL ON MULTIMODAL USER INTERFACES (2013)

Article Neurosciences

Vocal Acoustic Biomarkers of Depression Severity and Treatment Response

James C. Mundt et al.

BIOLOGICAL PSYCHIATRY (2012)

Review Psychiatry

Verbal and Nonverbal Correlates for Depression: A Review

Martin J. H. Balsters et al.

CURRENT PSYCHIATRY REVIEWS (2012)

Article Psychiatry

The heterogeneity of the depressive syndrome: when numbers get serious

S. D. Ostergaard et al.

ACTA PSYCHIATRICA SCANDINAVICA (2011)

Article Pharmacology & Pharmacy

5-HT and depression: is the glass half-full?

Trevor Sharp et al.

CURRENT OPINION IN PHARMACOLOGY (2011)

Review Biochemistry & Molecular Biology

The GABAergic deficit hypothesis of major depressive disorder

B. Luscher et al.

MOLECULAR PSYCHIATRY (2011)

Article Psychology, Clinical

Deconstructing major depression: a validation study of the DSM-IV symptomatic criteria

V. Lux et al.

PSYCHOLOGICAL MEDICINE (2010)

Editorial Material Psychology, Clinical

What is a mental/psychiatric disorder? From DSM-IV to DSM-V

D. J. Stein et al.

PSYCHOLOGICAL MEDICINE (2010)

Review Computer Science, Artificial Intelligence

Learning from Imbalanced Data

Haibo He et al.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2009)

Article Computer Science, Artificial Intelligence

Facial expression recognition based on Local Binary Patterns: A comprehensive study

Caifeng Shan et al.

IMAGE AND VISION COMPUTING (2009)

Article Medicine, General & Internal

Clinical diagnosis of depression in primary care: a meta-analysis

Alex J. Mitchell et al.

LANCET (2009)

Article Public, Environmental & Occupational Health

Usefulness of the Beck Depression Inventory as a screening method for depression among the general population of Finland

Roberto Nuevo et al.

SCANDINAVIAN JOURNAL OF PUBLIC HEALTH (2009)

Article Psychology, Clinical

On Categorical Diagnoses in DSM-V: Cutting Dimensions at Useful Points?

Jan H. Kamphuis et al.

PSYCHOLOGICAL ASSESSMENT (2009)

Article Medicine, General & Internal

Screening and case-finding instruments for depression: a meta-analysis

Simon Gilbody et al.

CANADIAN MEDICAL ASSOCIATION JOURNAL (2008)

Review Public, Environmental & Occupational Health

Suicide and Suicidal Behavior

Matthew K. Nock et al.

EPIDEMIOLOGIC REVIEWS (2008)

Article Engineering, Biomedical

Critical analysis of the impact of glottal features in the classification of clinical depression in speech

Elliot Moore et al.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2008)

Article Computer Science, Artificial Intelligence

Dynamic texture recognition using local binary patterns with an application to facial expressions

Guoying Zhao et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2007)

Article Medicine, General & Internal

Projections of global mortality and burden of disease from 2002 to 2030

Colin D. Mathers et al.

PLOS MEDICINE (2006)

Review Clinical Neurology

Functional imaging of mood and anxiety disorders

T Deckersbach et al.

JOURNAL OF NEUROIMAGING (2006)

Review Psychology, Clinical

Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V

D Watson

JOURNAL OF ABNORMAL PSYCHOLOGY (2005)

Article Neurosciences

Deep brain stimulation for treatment-resistant depression

HS Mayberg et al.

NEURON (2005)

Article Clinical Neurology

Performance of the PHQ-9 as a screening tool for depression after stroke

LS Williams et al.

STROKE (2005)

Article Neurosciences

Voice acoustical measurement of the severity of major depression

M Cannizzaro et al.

BRAIN AND COGNITION (2004)

Review Psychiatry

The Hamilton depression rating scale: Has the gold standard become a lead weight?

RM Bagby et al.

AMERICAN JOURNAL OF PSYCHIATRY (2004)

Article Computer Science, Artificial Intelligence

Robust real-time face detection

P Viola et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2004)

Article Medicine, General & Internal

The epidemiology of major depressive disorder - Results from the National Comorbidity Survey Replication (NCS-R).

RC Kessler et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2003)

Article Psychiatry

The PHQ-9: A new depression diagnostic and severity measure

K Kroenke et al.

PSYCHIATRIC ANNALS (2002)

Article Engineering, Biomedical

Acoustical properties of speech as indicators of depression and suicidal risk

DJ France et al.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2000)

Article Psychiatry

The responsiveness of the Hamilton Depression Rating Scale

D Faries et al.

JOURNAL OF PSYCHIATRIC RESEARCH (2000)