Journal
SENSORS
Volume 22, Issue 19, Pages -Publisher
MDPI
DOI: 10.3390/s22197623
Keywords
sensor fusion; mental workload; n-back; artificial intelligence; feature engineering
Ask authors/readers for more resources
This paper proposes a new framework using hybrid EEG-fNIRS and machine learning features for multi-level mental workload classification. By utilizing bivariate functional brain connectivity features and fNIRS indicators, it significantly improves classification accuracy and identifies different regions of influence for different EEG and fNIRS mental workload tasks.
There is high demand for techniques to estimate human mental workload during some activities for productivity enhancement or accident prevention. Most studies focus on a single physiological sensing modality and use univariate methods to analyse multi-channel electroencephalography (EEG) data. This paper proposes a new framework that relies on the features of hybrid EEG-functional near-infrared spectroscopy (EEG-fNIRS), supported by machine-learning features to deal with multi-level mental workload classification. Furthermore, instead of the well-used univariate power spectral density (PSD) for EEG recording, we propose using bivariate functional brain connectivity (FBC) features in the time and frequency domains of three bands: delta (0.5-4 Hz), theta (4-7 Hz) and alpha (8-15 Hz). With the assistance of the fNIRS oxyhemoglobin and deoxyhemoglobin (HbO and HbR) indicators, the FBC technique significantly improved classification performance at a 77% accuracy for 0-back vs. 2-back and 83% for 0-back vs. 3-back using a public dataset. Moreover, topographic and heat-map visualisation indicated that the distinguishing regions for EEG and fNIRS showed a difference among the 0-back, 2-back and 3-back test results. It was determined that the best region to assist the discrimination of the mental workload for EEG and fNIRS is different. Specifically, the posterior area performed the best for the posterior midline occipital (POz) EEG in the alpha band and fNIRS had superiority in the right frontal region (AF8).
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available