4.6 Review

A Review of Emotion Recognition Methods From Keystroke, Mouse, and Touchscreen Dynamics

Related references

Note: Only part of the references are listed.
Review Computer Science, Cybernetics

Using the computer mouse for stress measurement - An empirical investigation and critical review

Paul Freihaut et al.

Summary: This study aimed to explore the potential of measuring an individual's stress level through their computer mouse usage, assuming that stress-related cognitive and physiological changes would manifest in measurable psycho-motor changes. While successful manipulation of stress levels was indicated by self-report and physiological data, clear differences in mouse usage as a function of stress level were not found. Theoretical and methodological challenges arising from the results were discussed.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2021)

Article Computer Science, Information Systems

Designing Online Platforms Supporting Emotions and Awareness

Cesar A. Collazos et al.

Summary: The global pandemic has led to the emergence of a new teaching-learning environment, presenting opportunities for technological advancements in e-learning platforms. While e-learning offers benefits like cost reduction and on-demand education, it may also pose challenges such as difficulties in communication. A report on Latin American teachers and students highlighted the importance of considering emotions and awareness when using e-learning platforms during lockdown situations.

ELECTRONICS (2021)

Article Computer Science, Artificial Intelligence

SEWA DB: A Rich Database for Audio-Visual Emotion and Sentiment Research in the Wild

Jean Kossaifi et al.

Summary: Natural human-computer interaction and audio-visual human behaviour sensing systems are more important than ever, as digital devices become increasingly integral to our lives. The SEWA database provides a valuable resource with over 2000 minutes of audio-visual data from 398 individuals representing six cultures, aiding research in affective computing and automatic human sensing.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Proceedings Paper Engineering, Biomedical

Estimation of Affective State based on Keystroke and Typing Vibration during Computer-Mediated Communication

Kei Hasegawa et al.

Summary: The use of computer-mediated communication (CMC) has increased in recent years. Understanding the message sender's affective state is crucial, but difficult during CMC due to the lack of nonverbal information. This paper proposes a method for estimating affective state using keyboard input and typing vibration information, achieving accuracies of 69.8% and 71.1% for valence and arousal, respectively, in experiments.

BIOSIGNALS: PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES - VOL 4: BIOSIGNALS (2021)

Article Computer Science, Artificial Intelligence

Survey on Emotional Body Gesture Recognition

Fatemeh Noroozi et al.

Summary: Automatic emotion recognition, particularly from body gestures, is a trending research topic that has received less exploration compared to facial expressions or speech-based recognition. Researchers introduced a framework for recognizing emotional body gestures and discussed limitations of current methods.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2021)

Review Psychology, Multidisciplinary

A Review on Five Recent and Near-Future Developments in Computational Processing of Emotion in the Human Voice

Dagmar M. Schuller et al.

Summary: Recent developments in computational processing of emotion in voice involve trends such as self-learning representations, coupling of analysis and synthesis, large-scale weakly supervised learning, transfer learning, and reinforced learning. These trends have important implications for fields such as psychological studies and digital health applications.

EMOTION REVIEW (2021)

Article Computer Science, Hardware & Architecture

Human Emotion Recognition Using an EEG Cloud Computing Platform

Huimin Lu et al.

MOBILE NETWORKS & APPLICATIONS (2020)

Article Engineering, Electrical & Electronic

Emotional state detection based on common spatial patterns of EEG

Merve Dogruyol Basar et al.

SIGNAL IMAGE AND VIDEO PROCESSING (2020)

Article Engineering, Industrial

Identification of trusted interactive behavior based on mouse behavior considering web User's emotions

Qian Yi et al.

INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS (2020)

Article Engineering, Electrical & Electronic

Federated Learning: Challenges, Methods, and Future Directions

Tian Li et al.

IEEE SIGNAL PROCESSING MAGAZINE (2020)

Review Chemistry, Analytical

Emotion Recognition Using Eye-Tracking: Taxonomy, Review and Current Challenges

Jia Zheng Lim et al.

SENSORS (2020)

Article Computer Science, Artificial Intelligence

Stress generation and non-intrusive measurement in virtual environments using eye tracking

Christian Hirt et al.

JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING (2020)

Review Computer Science, Artificial Intelligence

The current challenges of automatic recognition of facial expressions: A systematic review

Audrey Masson et al.

AI COMMUNICATIONS (2020)

Article Engineering, Biomedical

An On-Chip Processor for Chronic Neurological Disorders Assistance Using Negative Affectivity Classification

Abdul Rehman Aslam et al.

IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS (2020)

Proceedings Paper Computer Science, Cybernetics

Affective State Prediction Based on Semi-Supervised Learning from Smartphone Touch Data

Rafael Wampfler et al.

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) (2020)

Proceedings Paper Computer Science, Hardware & Architecture

A Real-time Emotion Recognition System Based on an AI System-On-Chip Design

Wei-Chih Li et al.

2020 17TH INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC 2020) (2020)

Proceedings Paper Computer Science, Artificial Intelligence

Does Keystroke Dynamics tell us about Emotions? A Systematic Literature Review and Dataset Construction

Aicha Maalej et al.

PROCEEDINGS OF THE 2020 16TH INTERNATIONAL CONFERENCE ON INTELLIGENT ENVIRONMENTS (IE) (2020)

Proceedings Paper Computer Science, Information Systems

Real Time Facial Expression and Emotion Recognition using Eigen faces, LBPH and Fisher Algorithms

Shrayan Mukhopadhyay et al.

PROCEEDINGS OF THE CONFLUENCE 2020: 10TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (2020)

Article Psychology, Experimental

Adaptation aftereffects influence the perception of specific emotions from walking gait

Shaun Halovic et al.

ACTA PSYCHOLOGICA (2020)

Article Computer Science, Cybernetics

Emotion detection from touch interactions during text entry on smartphones

Surjya Ghosh et al.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2019)

Article Computer Science, Information Systems

An intelligent recommendation system using gaze and emotion detection

Saurabh Jaiswal et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2019)

Article Engineering, Electrical & Electronic

Development and Validation of an EEG-Based Real-Time Emotion Recognition System Using Edge AI Computing Platform With Convolutional Neural Network System-on-Chip Design

Wai-Chi Fang et al.

IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS (2019)

Article Psychology, Experimental

EmoMadrid: An emotional pictures database for affect research

L. Carretie et al.

MOTIVATION AND EMOTION (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Sentiment Pen: Recognizing Emotional Context Based on Handwriting Features

Jiawen Han et al.

PROCEEDINGS OF THE 10TH AUGMENTED HUMAN INTERNATIONAL CONFERENCE 2019 (AH2019) (2019)

Article Education & Educational Research

Team learning and emotions during teamwork: a qualitative study

Verena Watzek et al.

RESEARCH PAPERS IN EDUCATION (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Recent Advances and Applications of Keystroke Dynamics

Kirty Shekhawat et al.

PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND KNOWLEDGE ECONOMY (ICCIKE' 2019) (2019)

Proceedings Paper Computer Science, Theory & Methods

Ambiance Signal Processing: A Study on Collaborative Affective Computing

Kaveh Bakhtiyari et al.

2019 5TH INTERNATIONAL CONFERENCE ON WEB RESEARCH (ICWR) (2019)

Proceedings Paper Computer Science, Theory & Methods

Emotion Recognition from Physiological Signal Analysis: A Review

Egger Maria et al.

ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Representation Learning for Emotion Recognition from Smartphone Keyboard Interactions

Surjya Ghosh et al.

2019 8TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII) (2019)

Review Computer Science, Information Systems

Speech Emotion Recognition Using Deep Learning Techniques: A Review

Ruhul Amin Khalil et al.

IEEE ACCESS (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Mining of Keystroke and Mouse Dynamics to Increase the Engagement of Students with Programming Assignments

Mario Garcia Valdez et al.

COMPUTATIONAL INTELLIGENCE, IJCCI 2017 (2019)

Article Multidisciplinary Sciences

Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors

Javier Marin-Morales et al.

SCIENTIFIC REPORTS (2018)

Article Psychology, Experimental

Reading Emotion From Mouse Cursor Motions: Affective Computing Approach

Takashi Yamauchi et al.

COGNITIVE SCIENCE (2018)

Article Computer Science, Information Systems

Emotion detection from text and speech: a survey

Kashfia Sailunaz et al.

SOCIAL NETWORK ANALYSIS AND MINING (2018)

Review Engineering, Electrical & Electronic

Databases, features and classifiers for speech emotion recognition: a review

Monorama Swain et al.

INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY (2018)

Article Computer Science, Hardware & Architecture

Emotion recognition using mobile phones

I. Zualkernan et al.

COMPUTERS & ELECTRICAL ENGINEERING (2017)

Proceedings Paper Computer Science, Information Systems

On Capturing Older Adults' Smartphone Keyboard Interaction as a Means for Behavioral Change Under Emotional Stimuli Within i-PROGNOSIS Framework

Stelios Hadjidimitriou et al.

UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION: DESIGN AND DEVELOPMENT APPROACHES AND METHODS, PT I (2017)

Editorial Material Computer Science, Artificial Intelligence

Affective Computing and Sentiment Analysis

Erik Cambria

IEEE INTELLIGENT SYSTEMS (2016)

Article Multidisciplinary Sciences

Computer keyboard interaction as an indicator of early Parkinson's disease

L. Giancardo et al.

SCIENTIFIC REPORTS (2016)

Article Computer Science, Information Systems

Multimodal Human Attention Detection for Reading from Facial Expression, Eye Gaze, and Mouse Dynamics

Jiajia Li et al.

APPLIED COMPUTING REVIEW (2016)

Article Computer Science, Artificial Intelligence

Hybrid affective computing-keyboard, mouse and touch screen: from review to experiment

Kaveh Bakhtiyari et al.

NEURAL COMPUTING & APPLICATIONS (2015)

Proceedings Paper Automation & Control Systems

Automatic Emotion Recognition through Handwriting Analysis: A Review

S. V. Kedar et al.

1ST INTERNATIONAL CONFERENCE ON COMPUTING COMMUNICATION CONTROL AND AUTOMATION ICCUBEA 2015 (2015)

Proceedings Paper Computer Science, Artificial Intelligence

A Multimodal Approach To Detect User's Emotion

Anil K. M. Kumar et al.

PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON ECO-FRIENDLY COMPUTING AND COMMUNICATION SYSTEMS (2015)

Article Computer Science, Cybernetics

Identifying emotion by keystroke dynamics and text pattern analysis

A. F. M. Nazmul Haque Nahin et al.

BEHAVIOUR & INFORMATION TECHNOLOGY (2014)

Article Engineering, Biomedical

The influence of emotion on keyboard typing: an experimental study using visual stimuli

Po-Ming Lee et al.

BIOMEDICAL ENGINEERING ONLINE (2014)

Proceedings Paper Computer Science, Artificial Intelligence

An evaluation of mouse and keyboard interaction indicators towards non-intrusive and low cost affective modeling in an educational context

Sergio Salmeron-Majadas et al.

KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS 18TH ANNUAL CONFERENCE, KES-2014 (2014)

Article Computer Science, Artificial Intelligence

YouTube Movie Reviews: Sentiment Analysis in an Audio-Visual Context

Martin Woellmer et al.

IEEE INTELLIGENT SYSTEMS (2013)

Proceedings Paper Computer Science, Artificial Intelligence

Mouse Trajectories and State Anxiety: Feature Selection with Random Forest

Takashi Yamauchi

2013 HUMAINE ASSOCIATION CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII) (2013)

Proceedings Paper Computer Science, Artificial Intelligence

A review of emotion recognition methods based on keystroke dynamics and mouse movements

A. Kolakowska

2013 6TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI) (2013)

Article Psychology, Educational

Academic self-efficacy in study-related skills and behaviours: Relations with learning-related emotions and academic success

Dave Putwain et al.

BRITISH JOURNAL OF EDUCATIONAL PSYCHOLOGY (2013)

Article Computer Science, Cybernetics

What Does Touch Tell Us about Emotions in Touchscreen-Based Gameplay?

Yuan Gao et al.

ACM TRANSACTIONS ON COMPUTER-HUMAN INTERACTION (2012)

Article Computer Science, Artificial Intelligence

The Belfast Induced Natural Emotion Database

Ian Sneddon et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2012)

Article Computer Science, Artificial Intelligence

The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

Gary McKeown et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2012)

Article Psychology, Clinical

The Emotional Movie Database (EMDB): A Self-Report and Psychophysiological Study

Sandra Carvalho et al.

APPLIED PSYCHOPHYSIOLOGY AND BIOFEEDBACK (2012)

Article Psychology, Mathematical

The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance

Elise S. Dan-Glauser et al.

BEHAVIOR RESEARCH METHODS (2011)

Review Computer Science, Artificial Intelligence

Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications

Rafael A. Calvo et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2010)

Article Computer Science, Cybernetics

Automated stress detection using keystroke and linguistic features: An exploratory study

Lisa M. Vizer et al.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2009)

Article Computer Science, Interdisciplinary Applications

IEMOCAP: interactive emotional dyadic motion capture database

Carlos Busso et al.

LANGUAGE RESOURCES AND EVALUATION (2008)

Article Engineering, Electrical & Electronic

Biologic verification based on pressure sensor keyboards and classifier fusion techniques

Hai-Rong Lv et al.

IEEE TRANSACTIONS ON CONSUMER ELECTRONICS (2006)

Article Information Science & Library Science

What are emotions? And how can they be measured?

KR Scherer

SOCIAL SCIENCE INFORMATION SUR LES SCIENCES SOCIALES (2005)

Article Computer Science, Theory & Methods

Keystroke dynamics as a biometric for authentication

F Monrose et al.

FUTURE GENERATION COMPUTER SYSTEMS (2000)