A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
Motor imagery electroencephalography (MI-EEG), which is an important subfield of active brain-computer interface (BCI) systems, can be applied to help disabled people to consciously and directly control prosthesis or external devices, aiding them in certain daily activities. However, the low signal-...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9247162/ |
id |
doaj-43b4f6dcf67a494b8a601ccc26f5280f |
---|---|
record_format |
Article |
spelling |
doaj-43b4f6dcf67a494b8a601ccc26f5280f2021-03-30T03:39:52ZengIEEEIEEE Access2169-35362020-01-01820210020211010.1109/ACCESS.2020.30353479247162A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation FusionJun Yang0https://orcid.org/0000-0002-4230-8340Zhengmin Ma1https://orcid.org/0000-0001-9560-4218Jin Wang2Yunfa Fu3Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, ChinaFaculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, ChinaFaculty of Information, Yunnan University, Kunming, ChinaFaculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, ChinaMotor imagery electroencephalography (MI-EEG), which is an important subfield of active brain-computer interface (BCI) systems, can be applied to help disabled people to consciously and directly control prosthesis or external devices, aiding them in certain daily activities. However, the low signal-to-noise ratio and spatial resolution make MI-EEG decoding a challenging task. Recently, some deep neural approaches have shown good improvements over state-of-the-art BCI methods. In this study, an end-to-end scheme that includes a multi-layer convolution neural network is constructed for an accurate spatial representation of multi-channel grouped MI-EEG signals, which is employed to extract the useful information present in a multi-channel MI signal. Then the invariant spatial representations are captured from across-subjects training for enhancing the generalization capability through a stacked sparse autoencoder framework, which is inspired by representative deep learning models. Furthermore, a quantitative experimental analysis is conducted on our private dataset and on a public BCI competition dataset. The results show the effectiveness and significance of the proposed methodology.https://ieeexplore.ieee.org/document/9247162/Brain–computer interfacediscriminative and representative deep learningfeature fusionconvolution neural networkstacked sparse autoencoder |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jun Yang Zhengmin Ma Jin Wang Yunfa Fu |
spellingShingle |
Jun Yang Zhengmin Ma Jin Wang Yunfa Fu A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion IEEE Access Brain–computer interface discriminative and representative deep learning feature fusion convolution neural network stacked sparse autoencoder |
author_facet |
Jun Yang Zhengmin Ma Jin Wang Yunfa Fu |
author_sort |
Jun Yang |
title |
A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion |
title_short |
A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion |
title_full |
A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion |
title_fullStr |
A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion |
title_full_unstemmed |
A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion |
title_sort |
novel deep learning scheme for motor imagery eeg decoding based on spatial representation fusion |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
Motor imagery electroencephalography (MI-EEG), which is an important subfield of active brain-computer interface (BCI) systems, can be applied to help disabled people to consciously and directly control prosthesis or external devices, aiding them in certain daily activities. However, the low signal-to-noise ratio and spatial resolution make MI-EEG decoding a challenging task. Recently, some deep neural approaches have shown good improvements over state-of-the-art BCI methods. In this study, an end-to-end scheme that includes a multi-layer convolution neural network is constructed for an accurate spatial representation of multi-channel grouped MI-EEG signals, which is employed to extract the useful information present in a multi-channel MI signal. Then the invariant spatial representations are captured from across-subjects training for enhancing the generalization capability through a stacked sparse autoencoder framework, which is inspired by representative deep learning models. Furthermore, a quantitative experimental analysis is conducted on our private dataset and on a public BCI competition dataset. The results show the effectiveness and significance of the proposed methodology. |
topic |
Brain–computer interface discriminative and representative deep learning feature fusion convolution neural network stacked sparse autoencoder |
url |
https://ieeexplore.ieee.org/document/9247162/ |
work_keys_str_mv |
AT junyang anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT zhengminma anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT jinwang anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT yunfafu anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT junyang noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT zhengminma noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT jinwang noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion AT yunfafu noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion |
_version_ |
1724183055622471680 |