Journal
IEEE ACCESS
Volume 8, Issue -, Pages 54789-54801Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2020.2979074
Keywords
Electroencephalography; Electromyography; Brain modeling; Signal processing; Muscles; Neural networks; Applied machine learning; biological signal processing; EEG; EMG; knowledge adaptation; neural networks; transfer learning
Categories
Funding
- U.K. ACADEMIES - RESEARCH MOBILITY
- CONFAP-Brazil
- Fundacao Araucaria Pr-Brazil [50715.538.33202.06072018]
- Aston University, U.K.
- Federal University of Parana, Brazil
Ask authors/readers for more resources
In this work, we show the success of unsupervised transfer learning between Electroencephalographic (brainwave) classification and Electromyographic (muscular wave) domains with both MLP and CNN methods. To achieve this, signals are measured from both the brain and forearm muscles and EMG data is gathered from a 4-class gesture classification experiment via the Myo Armband, and a 3-class mental state EEG dataset is acquired via the Muse EEG Headband. A hyperheuristic multi-objective evolutionary search method is used to find the best network hyperparameters. We then use this optimised topology of deep neural network to classify both EMG and EEG signals, attaining results of 84.76 & x0025; and 62.37 & x0025; accuracy, respectively. Next, when pre-trained weights from the EMG classification model are used for initial distribution rather than random weight initialisation for EEG classification, 93.82 & x0025;(& x002B;29.95) accuracy is reached. When EEG pre-trained weights are used for initial weight distribution for EMG, 85.12 & x0025; (& x002B;0.36) accuracy is achieved. When the EMG network attempts to classify EEG, it outperforms the EEG network even without any training (& x002B;30.25 & x0025; to 82.39 & x0025; at epoch 0), and similarly the EEG network attempting to classify EMG data outperforms the EMG network (& x002B;2.38 & x0025; at epoch 0). All transfer networks achieve higher pre-training abilities, curves, and asymptotes, indicating that knowledge transfer is possible between the two signal domains. In a second experiment with CNN transfer learning, the same datasets are projected as 2D images and the same learning process is carried out. In the CNN experiment, EMG to EEG transfer learning is found to be successful but not vice-versa, although EEG to EMG transfer learning did exhibit a higher starting classification accuracy. The significance of this work is due to the successful transfer of ability between models trained on two different biological signal domains, reducing the need for building more computationally complex models in future research.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available