Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study

Motor imagery (MI) is one of the most common paradigms used in brain-computer interfaces (BCIs). This mental process is defined as the imagination of movement without any motion. In some lower-limb exoskeletons controlled by BCIs, users have to perform MI continuously in order to move the exoskeleto...

Full description

Bibliographic Details
Main Authors: L. Ferrero, M. Ortiz, V. Quiles, E. Ianez, J. M. Azorin
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
EEG
Online Access:https://ieeexplore.ieee.org/document/9387300/
id doaj-bec708642ad94180896c439f67471c71
record_format Article
spelling doaj-bec708642ad94180896c439f67471c712021-04-21T23:00:18ZengIEEEIEEE Access2169-35362021-01-019491214913010.1109/ACCESS.2021.30689299387300Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of StudyL. Ferrero0https://orcid.org/0000-0003-2256-757XM. Ortiz1https://orcid.org/0000-0002-4269-1554V. Quiles2https://orcid.org/0000-0001-7000-5390E. Ianez3https://orcid.org/0000-0001-8057-5952J. M. Azorin4https://orcid.org/0000-0001-5548-9657Brain–Machine Interface Systems Laboratory, Miguel Hernández University of Elche, Elche, SpainBrain–Machine Interface Systems Laboratory, Miguel Hernández University of Elche, Elche, SpainBrain–Machine Interface Systems Laboratory, Miguel Hernández University of Elche, Elche, SpainBrain–Machine Interface Systems Laboratory, Miguel Hernández University of Elche, Elche, SpainBrain–Machine Interface Systems Laboratory, Miguel Hernández University of Elche, Elche, SpainMotor imagery (MI) is one of the most common paradigms used in brain-computer interfaces (BCIs). This mental process is defined as the imagination of movement without any motion. In some lower-limb exoskeletons controlled by BCIs, users have to perform MI continuously in order to move the exoskeleton. This makes it difficult to design a closed-loop control BCI, as it cannot be assured that the analyzed activity is not related to motion instead of imagery. A possible solution would be the employment of virtual reality (VR). During VR training phase, subjects could focus on MI avoiding any distraction. This could help the subject to create a robust model of the BCI classifier that would be used later to control the exoskeleton. This paper analyzes if gait MI can be improved when VR feedback is provided to subjects instead of visual feedback by a screen. Additionally, both types of visual feedback are analyzed while subjects are seated or standing up. From the analysis, visual feedback by VR was related to higher performances in the majority of cases, not being relevant the differences between standing and being seated. The paper also presents a case of study for the closed-loop control of the BCI in a virtual reality environment. Subjects had to perform gait MI or to be in a relaxation state and based on the output of the BCI, the immersive first person view remained static or started to move. Experiments showed an accuracy of issued commands of 91.0± 6.7, being a very satisfactory result.https://ieeexplore.ieee.org/document/9387300/Brain–computer interfaceEEGmotor imagerycommon spatial patternsvirtual reality
collection DOAJ
language English
format Article
sources DOAJ
author L. Ferrero
M. Ortiz
V. Quiles
E. Ianez
J. M. Azorin
spellingShingle L. Ferrero
M. Ortiz
V. Quiles
E. Ianez
J. M. Azorin
Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study
IEEE Access
Brain–computer interface
EEG
motor imagery
common spatial patterns
virtual reality
author_facet L. Ferrero
M. Ortiz
V. Quiles
E. Ianez
J. M. Azorin
author_sort L. Ferrero
title Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study
title_short Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study
title_full Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study
title_fullStr Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study
title_full_unstemmed Improving Motor Imagery of Gait on a Brain–Computer Interface by Means of Virtual Reality: A Case of Study
title_sort improving motor imagery of gait on a brain–computer interface by means of virtual reality: a case of study
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Motor imagery (MI) is one of the most common paradigms used in brain-computer interfaces (BCIs). This mental process is defined as the imagination of movement without any motion. In some lower-limb exoskeletons controlled by BCIs, users have to perform MI continuously in order to move the exoskeleton. This makes it difficult to design a closed-loop control BCI, as it cannot be assured that the analyzed activity is not related to motion instead of imagery. A possible solution would be the employment of virtual reality (VR). During VR training phase, subjects could focus on MI avoiding any distraction. This could help the subject to create a robust model of the BCI classifier that would be used later to control the exoskeleton. This paper analyzes if gait MI can be improved when VR feedback is provided to subjects instead of visual feedback by a screen. Additionally, both types of visual feedback are analyzed while subjects are seated or standing up. From the analysis, visual feedback by VR was related to higher performances in the majority of cases, not being relevant the differences between standing and being seated. The paper also presents a case of study for the closed-loop control of the BCI in a virtual reality environment. Subjects had to perform gait MI or to be in a relaxation state and based on the output of the BCI, the immersive first person view remained static or started to move. Experiments showed an accuracy of issued commands of 91.0± 6.7, being a very satisfactory result.
topic Brain–computer interface
EEG
motor imagery
common spatial patterns
virtual reality
url https://ieeexplore.ieee.org/document/9387300/
work_keys_str_mv AT lferrero improvingmotorimageryofgaitonabrainx2013computerinterfacebymeansofvirtualrealityacaseofstudy
AT mortiz improvingmotorimageryofgaitonabrainx2013computerinterfacebymeansofvirtualrealityacaseofstudy
AT vquiles improvingmotorimageryofgaitonabrainx2013computerinterfacebymeansofvirtualrealityacaseofstudy
AT eianez improvingmotorimageryofgaitonabrainx2013computerinterfacebymeansofvirtualrealityacaseofstudy
AT jmazorin improvingmotorimageryofgaitonabrainx2013computerinterfacebymeansofvirtualrealityacaseofstudy
_version_ 1721515536364339200