A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion

Motor imagery electroencephalography (MI-EEG), which is an important subfield of active brain-computer interface (BCI) systems, can be applied to help disabled people to consciously and directly control prosthesis or external devices, aiding them in certain daily activities. However, the low signal-...

Full description

Bibliographic Details
Main Authors: Jun Yang, Zhengmin Ma, Jin Wang, Yunfa Fu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9247162/
id doaj-43b4f6dcf67a494b8a601ccc26f5280f
record_format Article
spelling doaj-43b4f6dcf67a494b8a601ccc26f5280f2021-03-30T03:39:52ZengIEEEIEEE Access2169-35362020-01-01820210020211010.1109/ACCESS.2020.30353479247162A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation FusionJun Yang0https://orcid.org/0000-0002-4230-8340Zhengmin Ma1https://orcid.org/0000-0001-9560-4218Jin Wang2Yunfa Fu3Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, ChinaFaculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, ChinaFaculty of Information, Yunnan University, Kunming, ChinaFaculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, ChinaMotor imagery electroencephalography (MI-EEG), which is an important subfield of active brain-computer interface (BCI) systems, can be applied to help disabled people to consciously and directly control prosthesis or external devices, aiding them in certain daily activities. However, the low signal-to-noise ratio and spatial resolution make MI-EEG decoding a challenging task. Recently, some deep neural approaches have shown good improvements over state-of-the-art BCI methods. In this study, an end-to-end scheme that includes a multi-layer convolution neural network is constructed for an accurate spatial representation of multi-channel grouped MI-EEG signals, which is employed to extract the useful information present in a multi-channel MI signal. Then the invariant spatial representations are captured from across-subjects training for enhancing the generalization capability through a stacked sparse autoencoder framework, which is inspired by representative deep learning models. Furthermore, a quantitative experimental analysis is conducted on our private dataset and on a public BCI competition dataset. The results show the effectiveness and significance of the proposed methodology.https://ieeexplore.ieee.org/document/9247162/Brain–computer interfacediscriminative and representative deep learningfeature fusionconvolution neural networkstacked sparse autoencoder
collection DOAJ
language English
format Article
sources DOAJ
author Jun Yang
Zhengmin Ma
Jin Wang
Yunfa Fu
spellingShingle Jun Yang
Zhengmin Ma
Jin Wang
Yunfa Fu
A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
IEEE Access
Brain–computer interface
discriminative and representative deep learning
feature fusion
convolution neural network
stacked sparse autoencoder
author_facet Jun Yang
Zhengmin Ma
Jin Wang
Yunfa Fu
author_sort Jun Yang
title A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
title_short A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
title_full A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
title_fullStr A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
title_full_unstemmed A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
title_sort novel deep learning scheme for motor imagery eeg decoding based on spatial representation fusion
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Motor imagery electroencephalography (MI-EEG), which is an important subfield of active brain-computer interface (BCI) systems, can be applied to help disabled people to consciously and directly control prosthesis or external devices, aiding them in certain daily activities. However, the low signal-to-noise ratio and spatial resolution make MI-EEG decoding a challenging task. Recently, some deep neural approaches have shown good improvements over state-of-the-art BCI methods. In this study, an end-to-end scheme that includes a multi-layer convolution neural network is constructed for an accurate spatial representation of multi-channel grouped MI-EEG signals, which is employed to extract the useful information present in a multi-channel MI signal. Then the invariant spatial representations are captured from across-subjects training for enhancing the generalization capability through a stacked sparse autoencoder framework, which is inspired by representative deep learning models. Furthermore, a quantitative experimental analysis is conducted on our private dataset and on a public BCI competition dataset. The results show the effectiveness and significance of the proposed methodology.
topic Brain–computer interface
discriminative and representative deep learning
feature fusion
convolution neural network
stacked sparse autoencoder
url https://ieeexplore.ieee.org/document/9247162/
work_keys_str_mv AT junyang anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT zhengminma anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT jinwang anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT yunfafu anoveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT junyang noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT zhengminma noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT jinwang noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
AT yunfafu noveldeeplearningschemeformotorimageryeegdecodingbasedonspatialrepresentationfusion
_version_ 1724183055622471680