A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding

Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attentio...

Full description

Bibliographic Details
Main Authors: Juntao Xue, Feiyue Ren, Xinlin Sun, Miaomiao Yin, Jialing Wu, Chao Ma, Zhongke Gao
Format: Article
Language:English
Published: Hindawi Limited 2020-01-01
Series:Neural Plasticity
Online Access:http://dx.doi.org/10.1155/2020/8863223
id doaj-e06b96e3944f4eaf8faed7e7efc51e78
record_format Article
spelling doaj-e06b96e3944f4eaf8faed7e7efc51e782021-01-18T00:00:45ZengHindawi LimitedNeural Plasticity1687-54432020-01-01202010.1155/2020/88632238863223A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery DecodingJuntao Xue0Feiyue Ren1Xinlin Sun2Miaomiao Yin3Jialing Wu4Chao Ma5Zhongke Gao6School of Electrical and Information EngineeringSchool of Electrical and Information EngineeringSchool of Electrical and Information EngineeringDepartment of Neurorehabilitation and NeurologyDepartment of Neurorehabilitation and NeurologySchool of Electrical and Information EngineeringSchool of Electrical and Information EngineeringMotor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients.http://dx.doi.org/10.1155/2020/8863223
collection DOAJ
language English
format Article
sources DOAJ
author Juntao Xue
Feiyue Ren
Xinlin Sun
Miaomiao Yin
Jialing Wu
Chao Ma
Zhongke Gao
spellingShingle Juntao Xue
Feiyue Ren
Xinlin Sun
Miaomiao Yin
Jialing Wu
Chao Ma
Zhongke Gao
A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
Neural Plasticity
author_facet Juntao Xue
Feiyue Ren
Xinlin Sun
Miaomiao Yin
Jialing Wu
Chao Ma
Zhongke Gao
author_sort Juntao Xue
title A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
title_short A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
title_full A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
title_fullStr A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
title_full_unstemmed A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
title_sort multifrequency brain network-based deep learning framework for motor imagery decoding
publisher Hindawi Limited
series Neural Plasticity
issn 1687-5443
publishDate 2020-01-01
description Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients.
url http://dx.doi.org/10.1155/2020/8863223
work_keys_str_mv AT juntaoxue amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT feiyueren amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT xinlinsun amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT miaomiaoyin amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT jialingwu amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT chaoma amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT zhongkegao amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT juntaoxue multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT feiyueren multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT xinlinsun multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT miaomiaoyin multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT jialingwu multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT chaoma multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
AT zhongkegao multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding
_version_ 1714941125595234304