An End-to-End Convolutional Recurrent Neural Network with Multi-Source Data Fusion for Sleep Stage Classification

Automatic sleep stage monitoring is an essential tool for the diagnosis and treatment of sleep-related disorders effectively. Although extensive studies focusing on single source data or information, such as single channel electroencephalogram (EEG), electrooculogram (EOG), and electromyogram (EMG), with machine learning (ML) and deep learning (DL) have been presented in this field of automatic sleep staging, there are very limited literature's that have investigated the impact of multisource information fusion on ML or DL based schemes for the sleep stage classification. In addition, exploiting recurrent neural network (RNN) to learn temporal information from the sequences of multi-source inputs can bring significant improvement in classifying the sleep stage. Therefore, we aim to develop an multi-source data fusion, more specifically two source's signal fusion, enabled end-to-end convolutional recurrent neural network (CRNN) in order to perform automatic sleep stage classification in this article. In the proposed scheme, no hand crafted features is used to train the model and hence the proposed model can be called an end-to-end approach. The proposed CRNN model can extract time-invariant features from raw data of two input sources and can fuse them to learn temporally correlated features. Sleep-EDF expanded benchmark dataset is used in this study and we have employed Fpz-Cz EEG channel signal and EOG signal as input with 3 variants of RNN layer in model architecture separately in order to evaluate and investigate the performance. The proposed CRNN model with standard RNN layers can classify the Sleep-EDF dataset with maximum average accuracy of 90.30% and maximum Cohen's kappa coefficient of 86.86 compared other two RNN variant's layer (e.g., gated recurrent unit and long short term memory) based models which is very promising in the studies on classification of sleep stages as well as can be regarded as an alternative to conventional sleep staging.

Automated summary

In this article, an end-to-end convolutional recurrent neural network (CRNN) is developed for automatic sleep stage classification, using multi-source data fusion. The proposed CRNN model can extract time-invariant features from raw data of two input sources and fuse them to learn temporally correlated features. The CRNN model achieves a maximum average accuracy of 90.30% and a maximum Cohen's kappa coefficient of 86.86 on the Sleep-EDF dataset, outperforming other RNN variant models and showing promising potential in the field of sleep stage classification as an alternative to conventional sleep staging.