An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm

One of the most exciting areas of rehabilitation research is brain-controlled prostheses, which translate electroencephalography (EEG) signals into control commands that operate prostheses. However, the existing brain-control methods have an obstacle between the selection of brain computer interface...

Full description

Bibliographic Details
Main Authors: Rui Li, Xiaodong Zhang, Zhufeng Lu, Chang Liu, Hanzhe Li, Weihua Sheng, Randolph Odekhe
Format: Article
Language:English
Published: Frontiers Media S.A. 2018-12-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnins.2018.00943/full
id doaj-26bf3bf4820442d7a820a80c7cabdf2d
record_format Article
spelling doaj-26bf3bf4820442d7a820a80c7cabdf2d2020-11-24T21:28:54ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2018-12-011210.3389/fnins.2018.00943393549An Approach for Brain-Controlled Prostheses Based on a Facial Expression ParadigmRui Li0Xiaodong Zhang1Zhufeng Lu2Chang Liu3Hanzhe Li4Weihua Sheng5Weihua Sheng6Randolph Odekhe7Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, ChinaShaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, ChinaShaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, ChinaShaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, ChinaShaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, ChinaSchool of Electrical and Computer Engineering, Oklahoma State University, Stillwater, OK, United StatesShenzhen Academy of Robotics, Shenzhen, ChinaShaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, ChinaOne of the most exciting areas of rehabilitation research is brain-controlled prostheses, which translate electroencephalography (EEG) signals into control commands that operate prostheses. However, the existing brain-control methods have an obstacle between the selection of brain computer interface (BCI) and its performance. In this paper, a novel BCI system based on a facial expression paradigm is proposed to control prostheses that uses the characteristics of theta and alpha rhythms of the prefrontal and motor cortices. A portable brain-controlled prosthesis system was constructed to validate the feasibility of the facial-expression-based BCI (FE-BCI) system. Four types of facial expressions were used in this study. An effective filtering algorithm based on noise-assisted multivariate empirical mode decomposition (NA-MEMD) and sample entropy (SampEn) was used to remove electromyography (EMG) artifacts. A wavelet transform (WT) was applied to calculate the feature set, and a back propagation neural network (BPNN) was employed as a classifier. To prove the effectiveness of the FE-BCI system for prosthesis control, 18 subjects were involved in both offline and online experiments. The grand average accuracy over 18 subjects was 81.31 ± 5.82% during the online experiment. The experimental results indicated that the proposed FE-BCI system achieved good performance and can be efficiently applied for prosthesis control.https://www.frontiersin.org/article/10.3389/fnins.2018.00943/fullfacial expressionselectroencephalography (EEG)brain computer interface (BCI)brain-controlled prosthesisthe motor cortexthe prefrontal cortex
collection DOAJ
language English
format Article
sources DOAJ
author Rui Li
Xiaodong Zhang
Zhufeng Lu
Chang Liu
Hanzhe Li
Weihua Sheng
Weihua Sheng
Randolph Odekhe
spellingShingle Rui Li
Xiaodong Zhang
Zhufeng Lu
Chang Liu
Hanzhe Li
Weihua Sheng
Weihua Sheng
Randolph Odekhe
An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm
Frontiers in Neuroscience
facial expressions
electroencephalography (EEG)
brain computer interface (BCI)
brain-controlled prosthesis
the motor cortex
the prefrontal cortex
author_facet Rui Li
Xiaodong Zhang
Zhufeng Lu
Chang Liu
Hanzhe Li
Weihua Sheng
Weihua Sheng
Randolph Odekhe
author_sort Rui Li
title An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm
title_short An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm
title_full An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm
title_fullStr An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm
title_full_unstemmed An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm
title_sort approach for brain-controlled prostheses based on a facial expression paradigm
publisher Frontiers Media S.A.
series Frontiers in Neuroscience
issn 1662-453X
publishDate 2018-12-01
description One of the most exciting areas of rehabilitation research is brain-controlled prostheses, which translate electroencephalography (EEG) signals into control commands that operate prostheses. However, the existing brain-control methods have an obstacle between the selection of brain computer interface (BCI) and its performance. In this paper, a novel BCI system based on a facial expression paradigm is proposed to control prostheses that uses the characteristics of theta and alpha rhythms of the prefrontal and motor cortices. A portable brain-controlled prosthesis system was constructed to validate the feasibility of the facial-expression-based BCI (FE-BCI) system. Four types of facial expressions were used in this study. An effective filtering algorithm based on noise-assisted multivariate empirical mode decomposition (NA-MEMD) and sample entropy (SampEn) was used to remove electromyography (EMG) artifacts. A wavelet transform (WT) was applied to calculate the feature set, and a back propagation neural network (BPNN) was employed as a classifier. To prove the effectiveness of the FE-BCI system for prosthesis control, 18 subjects were involved in both offline and online experiments. The grand average accuracy over 18 subjects was 81.31 ± 5.82% during the online experiment. The experimental results indicated that the proposed FE-BCI system achieved good performance and can be efficiently applied for prosthesis control.
topic facial expressions
electroencephalography (EEG)
brain computer interface (BCI)
brain-controlled prosthesis
the motor cortex
the prefrontal cortex
url https://www.frontiersin.org/article/10.3389/fnins.2018.00943/full
work_keys_str_mv AT ruili anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT xiaodongzhang anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT zhufenglu anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT changliu anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT hanzheli anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT weihuasheng anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT weihuasheng anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT randolphodekhe anapproachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT ruili approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT xiaodongzhang approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT zhufenglu approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT changliu approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT hanzheli approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT weihuasheng approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT weihuasheng approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
AT randolphodekhe approachforbraincontrolledprosthesesbasedonafacialexpressionparadigm
_version_ 1725968693550120960