A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attentio...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2020-01-01
|
Series: | Neural Plasticity |
Online Access: | http://dx.doi.org/10.1155/2020/8863223 |
id |
doaj-e06b96e3944f4eaf8faed7e7efc51e78 |
---|---|
record_format |
Article |
spelling |
doaj-e06b96e3944f4eaf8faed7e7efc51e782021-01-18T00:00:45ZengHindawi LimitedNeural Plasticity1687-54432020-01-01202010.1155/2020/88632238863223A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery DecodingJuntao Xue0Feiyue Ren1Xinlin Sun2Miaomiao Yin3Jialing Wu4Chao Ma5Zhongke Gao6School of Electrical and Information EngineeringSchool of Electrical and Information EngineeringSchool of Electrical and Information EngineeringDepartment of Neurorehabilitation and NeurologyDepartment of Neurorehabilitation and NeurologySchool of Electrical and Information EngineeringSchool of Electrical and Information EngineeringMotor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients.http://dx.doi.org/10.1155/2020/8863223 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Juntao Xue Feiyue Ren Xinlin Sun Miaomiao Yin Jialing Wu Chao Ma Zhongke Gao |
spellingShingle |
Juntao Xue Feiyue Ren Xinlin Sun Miaomiao Yin Jialing Wu Chao Ma Zhongke Gao A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding Neural Plasticity |
author_facet |
Juntao Xue Feiyue Ren Xinlin Sun Miaomiao Yin Jialing Wu Chao Ma Zhongke Gao |
author_sort |
Juntao Xue |
title |
A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
title_short |
A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
title_full |
A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
title_fullStr |
A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
title_full_unstemmed |
A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
title_sort |
multifrequency brain network-based deep learning framework for motor imagery decoding |
publisher |
Hindawi Limited |
series |
Neural Plasticity |
issn |
1687-5443 |
publishDate |
2020-01-01 |
description |
Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients. |
url |
http://dx.doi.org/10.1155/2020/8863223 |
work_keys_str_mv |
AT juntaoxue amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT feiyueren amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT xinlinsun amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT miaomiaoyin amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT jialingwu amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT chaoma amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT zhongkegao amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT juntaoxue multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT feiyueren multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT xinlinsun multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT miaomiaoyin multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT jialingwu multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT chaoma multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT zhongkegao multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding |
_version_ |
1714941125595234304 |