4.6 Article

Multimodal emotion recognition from facial expression and speech based on feature fusion

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Automation & Control Systems

Soft Person Reidentification Network Pruning via Blockwise Adjacent Filter Decaying

Xiaodong Wang et al.

Summary: The proposed blockwise adjacent filter decaying method aims to retain the original filter distribution in continuous features as much as possible for person reidentification models through blockwise filter pruning and a novel filter decaying policy. This method shows superior performance on three popular person reidentification datasets compared to existing state-of-the-art pruning methods, demonstrating its effectiveness in compacting person reidentification models.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Computer Science, Artificial Intelligence

Joint image clustering and feature selection with auto-adjoined learning for high-dimensional data

Xiaodong Wang et al.

Summary: Traditional K-means struggles with high-dimensional data due to irrelevant features or noise, prompting recent studies to combine it with subspace learning. This study proposes an auto-adjoined subspace clustering approach, enhancing clustering performance through efficient feature selection and clear adjacency exploration.

KNOWLEDGE-BASED SYSTEMS (2021)

Article Computer Science, Information Systems

ASL-3DCNN: American sign language recognition technique using 3-D convolutional neural networks

Shikhar Sharma et al.

Summary: Communication between those who understand sign language and those who do not is challenging. To address the challenge of dynamic ASL recognition, 3-D CNNs were employed, with training and testing on a dataset showing improved precision, recall, and f-measure compared to existing models. The proposed approach also shows potential for real-time applications with a computing time of 0.19 seconds per frame.

MULTIMEDIA TOOLS AND APPLICATIONS (2021)

Article Computer Science, Information Systems

Selective shallow models strength integration for emotion detection using GloVe and LSTM

Aditya Vijayvergia et al.

Summary: Text analysis is increasingly popular due to the internet and social media allowing access to public opinions. Real-time analysis of public emotions can help predict and prevent future issues. A novel emotion detection technique is proposed using multiple shallow models to outperform large models in terms of performance. These models can run independently in parallel, ensuring smaller execution time and higher accuracy.

MULTIMEDIA TOOLS AND APPLICATIONS (2021)

Article Chemistry, Analytical

Deep-Learning-Based Multimodal Emotion Classification for Music Videos

Yagya Raj Pandeya et al.

Summary: This study presents an affective computing system incorporating music, video, and facial expression cues, which efficiently captures emotional clues from both audio and visual sources. By regularizing the training process and reducing computational costs, the system achieved improved performance.

SENSORS (2021)

Article Biochemical Research Methods

Subject-Independent Emotion Recognition of EEG Signals Based on Dynamic Empirical Convolutional Neural Network

Shuaiqi Liu et al.

Summary: Affective computing is a key technology for advanced brain-machine interfaces, and subject-independent emotion recognition remains a challenge. This study proposes a subject-independent emotion recognition algorithm based on dynamic differential entropy, which enhances accuracy through optimized feature extraction and classification methods, and discusses the optimal electrode placement for reducing complexity.

IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS (2021)

Article Acoustics

Speech Emotion Recognition Considering Nonverbal Vocalization in Affective Conversations

Jia-Hao Hsu et al.

Summary: This study considers both verbal and nonverbal sounds within an utterance for emotion recognition in real-life conversations, utilizing support vector machine, deep residual networks, and other techniques. The research shows that nonverbal vocalization is helpful for speech emotion recognition, with the proposed decision-level fusion method outperforming traditional and other fusion approaches.

IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING (2021)

Article Computer Science, Artificial Intelligence

Realistic Transformation of Facial and Vocal Smiles in Real-Time Audiovisual Streams

Pablo Arias et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2020)

Article Engineering, Electrical & Electronic

Human emotion recognition by optimally fusing facial expression and speech feature

Xusheng Wang et al.

SIGNAL PROCESSING-IMAGE COMMUNICATION (2020)

Article Acoustics

Semi-Supervised Speech Emotion Recognition With Ladder Networks

Srinivas Parthasarathy et al.

IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Audiovisual emotion recognition in wild

Egils Avots et al.

MACHINE VISION AND APPLICATIONS (2019)

Proceedings Paper Computer Science, Theory & Methods

Bi-modality Fusion for Emotion Recognition in the Wild

Sunan Li et al.

ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (2019)

Article Engineering, Electrical & Electronic

Learning Affective Features With a Hybrid Deep Model for Audio-Visual Emotion Recognition

Shiqing Zhang et al.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2018)

Article Computer Science, Artificial Intelligence

Deep spatio-temporal feature fusion with compact bilinear pooling for multimodal emotion recognition

Dung Nguyen et al.

COMPUTER VISION AND IMAGE UNDERSTANDING (2018)

Proceedings Paper Computer Science, Artificial Intelligence

LEXER: LEXicon Based Emotion AnalyzeR

Shikhar Sharma et al.

PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2017 (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Deep spatio-temporal features for multimodal emotion recognition

Dung Nguyen et al.

2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017) (2017)

Article Computer Science, Artificial Intelligence

Audio-visual emotion recognition using multi-directional regression and Ridgelet transform

M. Shamim Hossain et al.

JOURNAL ON MULTIMODAL USER INTERFACES (2016)

Article Computer Science, Hardware & Architecture

Audio-Visual Emotion Recognition Using Big Data Towards 5G

M. Shamim Hossain et al.

MOBILE NETWORKS & APPLICATIONS (2016)

Article Computer Science, Artificial Intelligence

Towards an intelligent framework for multimodal affective data analysis

Soujanya Poria et al.

NEURAL NETWORKS (2015)

Article Computer Science, Information Systems

Integrating Facial Expression and Body Gesture in Videos for Emotion Recognition

Jingjie Yan et al.

IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS (2014)

Article Computer Science, Artificial Intelligence

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Soroosh Mariooryad et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2013)