4.7 Review

A review of driver fatigue detection and its advances on the use of RGB-D camera and deep learning

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms

Xianye Ben et al.

Summary: This survey paper explores the importance of micro-expression analysis and its applications in different fields. The paper highlights the differences between micro-expressions and conventional expressions and provides a systematic research structure, covering various aspects of the field. Additionally, the paper introduces and releases a new dataset, performs a comprehensive evaluation of representative methods, and discusses potential future research directions.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Review Chemistry, Analytical

Driver Fatigue Detection Systems Using Multi-Sensors, Smartphone, and Cloud-Based Computing Platforms: A Comparative Analysis

Qaisar Abbas et al.

Summary: The paper reviews state-of-the-art approaches for predicting unsafe driving styles using IoT-based architectures, focusing on the major differences among multi-sensors, smartphone-based, and cloud-based systems. It discusses the challenges faced by machine learning techniques, particularly the deep learning model, in predicting driver hypovigilance. State-of-the-art comparisons using driving simulators are conducted to evaluate the performance of these architectures for detecting driver fatigue.

SENSORS (2021)

Article Computer Science, Artificial Intelligence

A Regression Method With Subnetwork Neurons for Vigilance Estimation Using EOG and EEG

Wei Wu et al.

Summary: This study uses a feature fusion strategy and a double-layer neural network model to predict drivers' vigilance state. Experimental results in single and multimodal fields show that the multimodal fusion method outperforms the single modality due to the complementary information between forehead-EOG and EEG signals.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2021)

Article Engineering, Civil

A Novel Machine Vision-Based 3D Facial Action Unit Identification for Fatigue Detection

Gulbadan Sikander et al.

Summary: This study presents an innovative driver fatigue detection method based on fatigue related facial action units, achieving better accuracy compared to 2D image based classification. The method offers a new approach for intelligent transportation and demonstrates significant improvement in accuracy when compared to established methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2021)

Article Engineering, Civil

Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features

Guanglong Du et al.

Summary: This paper proposes a method that uses a single RGB-D camera to extract three fatigue features and improves the accuracy of driver fatigue detection through a novel multimodal fusion recurrent neural network. By addressing the fuzziness and noise of the heart rate feature and identifying the relationship between features, the proposed method outperforms similar methods in both simulation and field experiments.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2021)

Review Engineering, Civil

Multimodal Features for Detection of Driver Stress and Fatigue: Review

Andrea Nemcova et al.

Summary: This paper reviews different approaches for driver fatigue and stress detection and evaluation, including the use of various signals and features, and discusses their relevance and advantages. In the era of automated driving, assessing the driver's mental state will be a crucial part of future cars.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2021)

Article Engineering, Electrical & Electronic

Can Steering Wheel Detect Your Driving Fatigue?

Jianchao Lu et al.

Summary: The study proposed a driver fatigue detection method by embedding surface electromyography sensors on a steering wheel to collect bio-signals and detect fatigue early. Experimental results indicated that the method outperforms existing ones in terms of performance.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Computer Science, Information Systems

Driver Yawning Detection Based on Subtle Facial Action Recognition

Hao Yang et al.

Summary: Driver fatigue is identified as the main cause of traffic accidents. This study proposes a novel approach for detecting yawning based on subtle facial action recognition, using a 3D deep learning network and a keyframe selection algorithm to improve detection accuracy.

IEEE TRANSACTIONS ON MULTIMEDIA (2021)

Article Engineering, Biomedical

Classification of pilots' mental states using a multimodal deep learning network

Soo-Yeon Han et al.

BIOCYBERNETICS AND BIOMEDICAL ENGINEERING (2020)

Article Engineering, Electrical & Electronic

Robust Lane Detection From Continuous Driving Scenes Using Deep Neural Networks

Qin Zou et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2020)

Article Engineering, Electrical & Electronic

Personalized Vehicle Trajectory Prediction Based on Joint Time-Series Modeling for Connected Vehicles

Yang Xing et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2020)

Article Computer Science, Artificial Intelligence

Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks

Yingying Jiao et al.

NEUROCOMPUTING (2020)

Article Computer Science, Artificial Intelligence

Driver behavior detection and classification using deep convolutional neural networks

Mohammad Shahverdy et al.

EXPERT SYSTEMS WITH APPLICATIONS (2020)

Article Instruments & Instrumentation

Partial directed coherence based graph convolutional neural networks for driving fatigue detection

Weiwei Zhang et al.

REVIEW OF SCIENTIFIC INSTRUMENTS (2020)

Article Engineering, Electrical & Electronic

Unsupervised Drowsy Driving Detection With RFID

Chao Yang et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2020)

Article Computer Science, Artificial Intelligence

Deep unsupervised multi-modal fusion network for detecting driver distraction

Yuxin Zhang et al.

NEUROCOMPUTING (2020)

Article Computer Science, Artificial Intelligence

Distracted driver detection by combining in-vehicle and image data using deep learning

Furkan Omerustaoglu et al.

APPLIED SOFT COMPUTING (2020)

Article Computer Science, Information Systems

Multimodal System to Detect Driver Fatigue Using EEG, Gyroscope, and Image Processing

Naveen Senniappan Karuppusamy et al.

IEEE ACCESS (2020)

Article Computer Science, Information Systems

Vision-Based Instant Measurement System for Driver Fatigue Monitoring

Yin-Cheng Tsai et al.

IEEE ACCESS (2020)

Article Computer Science, Information Systems

Driver drowsiness detection using hybrid convolutional neural network and long short-term memory

Jing-Ming Guo et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2019)

Article Computer Science, Artificial Intelligence

Smartphone based context-aware driver behavior classification using dynamic bayesian network

Rishu Chhabra et al.

JOURNAL OF INTELLIGENT & FUZZY SYSTEMS (2019)

Article Computer Science, Information Systems

Dynamic set point model for driver alert state using digital image processing

Cesar Isaza et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2019)

Article Engineering, Biomedical

Research on fatigue driving detection using forehead EEG based on adaptive multi-scale entropy

Haowen Luo et al.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2019)

Article Engineering, Electrical & Electronic

Fatigue driving recognition network: fatigue driving recognition via convolutional neural network and long short-term memory units

Zhitao Xiao et al.

IET INTELLIGENT TRANSPORT SYSTEMS (2019)

Article Engineering, Electrical & Electronic

Fatigue driving detection model based on multi-feature fusion and semi-supervised active learning

Xu Li et al.

IET INTELLIGENT TRANSPORT SYSTEMS (2019)

Article Computer Science, Artificial Intelligence

Driver's fatigue recognition based on yawn detection in thermal images

Mateusz Knapik et al.

NEUROCOMPUTING (2019)

Article Public, Environmental & Occupational Health

Deriving heart rate variability indices from cardiac monitoring-An indicator of driver sleepiness

Ruben Buendia et al.

TRAFFIC INJURY PREVENTION (2019)

Review Engineering, Civil

Driver Fatigue Detection Systems: A Review

Gulbadan Sikander et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2019)

Article Mathematical & Computational Biology

Driving Fatigue Detection from EEG Using a Modified PCANet Method

Yuliang Ma et al.

COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE (2019)

Article Engineering, Mechanical

An identification algorithm of driver steering characteristics based on backpropagation neural network

Shangyu Zhao et al.

PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING (2019)

Article Computer Science, Artificial Intelligence

EEG-Based Spatio-Temporal Convolutional Neural Network for Driver Fatigue Evaluation

Zhongke Gao et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2019)

Article Computer Science, Information Systems

A fuzzy recurrent neural network for driver fatigue detection based on steering-wheel angle sensor data

Zuojin Li et al.

INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS (2019)

Article Engineering, Electrical & Electronic

Pilots' Fatigue Status Recognition Using Deep Contractive Autoencoder Network

Edmond Q. Wu et al.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2019)

Article Computer Science, Artificial Intelligence

Multiplex Limited Penetrable Horizontal Visibility Graph from EEG Signals for Driver Fatigue Detection

Qing Cai et al.

INTERNATIONAL JOURNAL OF NEURAL SYSTEMS (2019)

Article Computer Science, Artificial Intelligence

A Low-Cost Prototype for Driver Fatigue Detection

Tiago Meireles et al.

MULTIMODAL TECHNOLOGIES AND INTERACTION (2019)

Article Computer Science, Information Systems

Convolutional Two-Stream Network Using Multi-Facial Feature Fusion for Driver Fatigue Detection

Weihuang Liu et al.

FUTURE INTERNET (2019)

Article Computer Science, Information Systems

A Survey on State-of-the-Art Drowsiness Detection Techniques

Muhammad Ramzan et al.

IEEE ACCESS (2019)

Article Computer Science, Information Systems

Fatigue State Detection Based on Multi-Index Fusion and State Recognition Network

Yingyu Ji et al.

IEEE ACCESS (2019)

Article Engineering, Multidisciplinary

An Analysis of EEG Changes during Prolonged Simulated Driving for the Assessment of Driver Fatigue

Rida Zuraida et al.

JOURNAL OF ENGINEERING AND TECHNOLOGICAL SCIENCES (2019)

Article Mathematics, Interdisciplinary Applications

An Innovative Deep Learning Algorithm for Drowsiness Detection from EEG Signal

Francesco Rundo et al.

COMPUTATION (2019)

Article Computer Science, Information Systems

Eye state recognition based on deep integrated neural network and transfer learning

Lei Zhao et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2018)

Article Engineering, Electrical & Electronic

Driver drowsiness detection using facial dynamic fusion information and a DBN

Lei Zhao et al.

IET INTELLIGENT TRANSPORT SYSTEMS (2018)

Article Computer Science, Artificial Intelligence

Deep visual domain adaptation: A survey

Mei Wang et al.

NEUROCOMPUTING (2018)

Article Computer Science, Information Systems

Deep Convolution Neural Network and Autoencoders-Based Unsupervised Feature Learning of eeg Signals

Tingxi Wen et al.

IEEE ACCESS (2018)

Article Engineering, Electrical & Electronic

Recent Trends in Driver Safety Monitoring Systems: State of the Art and Challenges

Arief Koesdwiady et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2017)

Article Engineering, Electrical & Electronic

Abnormal Driving Detection Based on Normalized Driving Behavior

Jie Hu et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2017)

Article Engineering, Multidisciplinary

A Method for Recognizing Fatigue Driving Based on Dempster-Shafer Theory and Fuzzy Neural Network

WenBo Zhu et al.

MATHEMATICAL PROBLEMS IN ENGINEERING (2017)

Article Computer Science, Artificial Intelligence

Assessment of driving fatigue based on intra/inter-region phase synchronization

Wanzeng Kong et al.

NEUROCOMPUTING (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Real-time Driver Drowsiness Detection for Embedded System Using Model Compression of Deep Neural Networks

Bhargava Reddy et al.

2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition

Seokju Lee et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Article Engineering, Electrical & Electronic

Driver state estimation by convolutional neural network using multimodal sensor data

Sejoon Lim et al.

ELECTRONICS LETTERS (2016)

Article Computer Science, Artificial Intelligence

Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network

Yu-Ting Liu et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2016)

Article Mathematical & Computational Biology

Preparing Laboratory and Real-World EEG Data for Large-Scale Analysis: A Containerized Approach

Nima Bigdely-Shamlo et al.

FRONTIERS IN NEUROINFORMATICS (2016)

Article Engineering, Civil

Driver Behavior Analysis for Safe Driving: A Survey

Sinan Kaplan et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2015)

Article Public, Environmental & Occupational Health

Driving Fatigue in Professional Drivers: A Survey of Truck and Taxi Drivers

Fanxing Meng et al.

TRAFFIC INJURY PREVENTION (2015)

Article Computer Science, Hardware & Architecture

Detecting Driver Drowsiness A survey of system designs and technology

Mario I. Chacon-Murguia et al.

IEEE CONSUMER ELECTRONICS MAGAZINE (2015)

Article Engineering, Civil

Driver Monitoring Based on Low-Cost 3-D Sensors

Gustavo A. Pelaez C et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2014)

Article Engineering, Civil

Automated Detection of Driver Fatigue Based on Entropy and Complexity Measures

Chi Zhang et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2014)

Article Computer Science, Artificial Intelligence

Hybrid computer vision system for drivers' eye recognition and fatigue monitoring

Boguslaw Cyganek et al.

NEUROCOMPUTING (2014)

Article Automation & Control Systems

Real-time driver drowsiness estimation by multi-source information fusion with Dempster-Shafer theory

Xuanpeng Li et al.

TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL (2014)

Article Engineering, Civil

Real-Time Detection System of Driver Distraction Using Machine Learning

Fabio Tango et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2013)

Article Engineering, Electrical & Electronic

Context-Aware Driver Behavior Detection System in Intelligent Transportation Systems

Saif Al-Sultan et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2013)

Article Computer Science, Artificial Intelligence

WLBP: Weber local binary pattern for local image description

Fan Liu et al.

NEUROCOMPUTING (2013)

Review Chemistry, Analytical

Detecting Driver Drowsiness Based on Sensors: A Review

Arun Sahayadhas et al.

SENSORS (2012)

Article Ergonomics

Prevalence of motor vehicle crashes involving drowsy drivers, United States, 1999-2008

Brian Christopher Tefft

ACCIDENT ANALYSIS AND PREVENTION (2012)

Article Computer Science, Artificial Intelligence

Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces

Hubert Cecotti et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2011)

Article Automation & Control Systems

On-line road boundary modeling with multiple sensory features, flexible road model, and particle filter

Y. Matsushita et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2011)

Article Computer Science, Artificial Intelligence

LIBSVM: A Library for Support Vector Machines

Chih-Chung Chang et al.

ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY (2011)

Article Engineering, Civil

Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness

Erik Murphy-Chutorian et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2010)

Article Computer Science, Artificial Intelligence

WLD: A Robust Local Image Descriptor

Jie Chen et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2010)

Article Computer Science, Information Systems

A driver fatigue recognition model based on information fusion and dynamic Bayesian network

Guosheng Yang et al.

INFORMATION SCIENCES (2010)

Article Engineering, Civil

Onboard measurement and warning module for irregular vehicle behavior

Tang-Hsien Chang et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2008)

Article Computer Science, Artificial Intelligence

A fast learning algorithm for deep belief nets

Geoffrey E. Hinton et al.

NEURAL COMPUTATION (2006)

Article Biochemical Research Methods

Techniques of EMG signal analysis: detection, processing, classification and applications

MBI Reaz et al.

BIOLOGICAL PROCEDURES ONLINE (2006)

Article Engineering, Civil

Real-time system for monitoring driver vigilance

LM Bergasa et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2006)

Article Neurosciences

Assessment of muscle fatigue in low level monotonous task performance during car driving

I Hostens et al.

JOURNAL OF ELECTROMYOGRAPHY AND KINESIOLOGY (2005)

Article Ergonomics

Development of an algorithm for an EEG-based driver fatigue countermeasure

SKL Lal et al.

JOURNAL OF SAFETY RESEARCH (2003)

Article Computer Science, Artificial Intelligence

Multiresolution gray-scale and rotation invariant texture classification with local binary patterns

T Ojala et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2002)

Article Computer Science, Artificial Intelligence

From few to many: Illumination cone models for face recognition under variable lighting and pose

AS Georghiades et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2001)

Review Psychology, Biological

A critical review of the psychophysiology of driver fatigue

SKL Lal et al.

BIOLOGICAL PSYCHOLOGY (2001)