A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
Real-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2013-01-01
|
Series: | PLoS ONE |
Online Access: | http://europepmc.org/articles/PMC3622681?pdf=render |
id |
doaj-27e92d5fcfe8485598470685009cf5c9 |
---|---|
record_format |
Article |
spelling |
doaj-27e92d5fcfe8485598470685009cf5c92020-11-25T02:22:10ZengPublic Library of Science (PLoS)PLoS ONE1932-62032013-01-0184e5904910.1371/journal.pone.0059049A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.Maryam M ShanechiZiv M WilliamsGregory W WornellRollin C HuMarissa PowersEmery N BrownReal-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move the prosthetic device towards a desired target while receiving real-time sensory feedback of the state of the movement. We develop a novel real-time BMI using an optimal feedback control design that jointly estimates the movement target and trajectory of monkeys in two stages. First, the target is decoded from neural spiking activity before movement initiation. Second, the trajectory is decoded by combining the decoded target with the peri-movement spiking activity using an optimal feedback control design. This design exploits a recursive Bayesian decoder that uses an optimal feedback control model of the sensorimotor system to take into account the intended target location and the sensory feedback in its trajectory estimation from spiking activity. The real-time BMI processes the spiking activity directly using point process modeling. We implement the BMI in experiments consisting of an instructed-delay center-out task in which monkeys are presented with a target location on the screen during a delay period and then have to move a cursor to it without touching the incorrect targets. We show that the two-stage BMI performs more accurately than either stage alone. Correct target prediction can compensate for inaccurate trajectory estimation and vice versa. The optimal feedback control design also results in trajectories that are smoother and have lower estimation error. The two-stage decoder also performs better than linear regression approaches in offline cross-validation analyses. Our results demonstrate the advantage of a BMI design that jointly estimates the target and trajectory of movement and more closely mimics the sensorimotor control system.http://europepmc.org/articles/PMC3622681?pdf=render |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Maryam M Shanechi Ziv M Williams Gregory W Wornell Rollin C Hu Marissa Powers Emery N Brown |
spellingShingle |
Maryam M Shanechi Ziv M Williams Gregory W Wornell Rollin C Hu Marissa Powers Emery N Brown A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. PLoS ONE |
author_facet |
Maryam M Shanechi Ziv M Williams Gregory W Wornell Rollin C Hu Marissa Powers Emery N Brown |
author_sort |
Maryam M Shanechi |
title |
A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. |
title_short |
A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. |
title_full |
A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. |
title_fullStr |
A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. |
title_full_unstemmed |
A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. |
title_sort |
real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2013-01-01 |
description |
Real-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move the prosthetic device towards a desired target while receiving real-time sensory feedback of the state of the movement. We develop a novel real-time BMI using an optimal feedback control design that jointly estimates the movement target and trajectory of monkeys in two stages. First, the target is decoded from neural spiking activity before movement initiation. Second, the trajectory is decoded by combining the decoded target with the peri-movement spiking activity using an optimal feedback control design. This design exploits a recursive Bayesian decoder that uses an optimal feedback control model of the sensorimotor system to take into account the intended target location and the sensory feedback in its trajectory estimation from spiking activity. The real-time BMI processes the spiking activity directly using point process modeling. We implement the BMI in experiments consisting of an instructed-delay center-out task in which monkeys are presented with a target location on the screen during a delay period and then have to move a cursor to it without touching the incorrect targets. We show that the two-stage BMI performs more accurately than either stage alone. Correct target prediction can compensate for inaccurate trajectory estimation and vice versa. The optimal feedback control design also results in trajectories that are smoother and have lower estimation error. The two-stage decoder also performs better than linear regression approaches in offline cross-validation analyses. Our results demonstrate the advantage of a BMI design that jointly estimates the target and trajectory of movement and more closely mimics the sensorimotor control system. |
url |
http://europepmc.org/articles/PMC3622681?pdf=render |
work_keys_str_mv |
AT maryammshanechi arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT zivmwilliams arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT gregorywwornell arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT rollinchu arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT marissapowers arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT emerynbrown arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT maryammshanechi realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT zivmwilliams realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT gregorywwornell realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT rollinchu realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT marissapowers realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign AT emerynbrown realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign |
_version_ |
1724862901315960832 |