A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.

Real-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move...

Full description

Bibliographic Details
Main Authors: Maryam M Shanechi, Ziv M Williams, Gregory W Wornell, Rollin C Hu, Marissa Powers, Emery N Brown
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2013-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC3622681?pdf=render
id doaj-27e92d5fcfe8485598470685009cf5c9
record_format Article
spelling doaj-27e92d5fcfe8485598470685009cf5c92020-11-25T02:22:10ZengPublic Library of Science (PLoS)PLoS ONE1932-62032013-01-0184e5904910.1371/journal.pone.0059049A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.Maryam M ShanechiZiv M WilliamsGregory W WornellRollin C HuMarissa PowersEmery N BrownReal-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move the prosthetic device towards a desired target while receiving real-time sensory feedback of the state of the movement. We develop a novel real-time BMI using an optimal feedback control design that jointly estimates the movement target and trajectory of monkeys in two stages. First, the target is decoded from neural spiking activity before movement initiation. Second, the trajectory is decoded by combining the decoded target with the peri-movement spiking activity using an optimal feedback control design. This design exploits a recursive Bayesian decoder that uses an optimal feedback control model of the sensorimotor system to take into account the intended target location and the sensory feedback in its trajectory estimation from spiking activity. The real-time BMI processes the spiking activity directly using point process modeling. We implement the BMI in experiments consisting of an instructed-delay center-out task in which monkeys are presented with a target location on the screen during a delay period and then have to move a cursor to it without touching the incorrect targets. We show that the two-stage BMI performs more accurately than either stage alone. Correct target prediction can compensate for inaccurate trajectory estimation and vice versa. The optimal feedback control design also results in trajectories that are smoother and have lower estimation error. The two-stage decoder also performs better than linear regression approaches in offline cross-validation analyses. Our results demonstrate the advantage of a BMI design that jointly estimates the target and trajectory of movement and more closely mimics the sensorimotor control system.http://europepmc.org/articles/PMC3622681?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author Maryam M Shanechi
Ziv M Williams
Gregory W Wornell
Rollin C Hu
Marissa Powers
Emery N Brown
spellingShingle Maryam M Shanechi
Ziv M Williams
Gregory W Wornell
Rollin C Hu
Marissa Powers
Emery N Brown
A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
PLoS ONE
author_facet Maryam M Shanechi
Ziv M Williams
Gregory W Wornell
Rollin C Hu
Marissa Powers
Emery N Brown
author_sort Maryam M Shanechi
title A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
title_short A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
title_full A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
title_fullStr A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
title_full_unstemmed A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
title_sort real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2013-01-01
description Real-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move the prosthetic device towards a desired target while receiving real-time sensory feedback of the state of the movement. We develop a novel real-time BMI using an optimal feedback control design that jointly estimates the movement target and trajectory of monkeys in two stages. First, the target is decoded from neural spiking activity before movement initiation. Second, the trajectory is decoded by combining the decoded target with the peri-movement spiking activity using an optimal feedback control design. This design exploits a recursive Bayesian decoder that uses an optimal feedback control model of the sensorimotor system to take into account the intended target location and the sensory feedback in its trajectory estimation from spiking activity. The real-time BMI processes the spiking activity directly using point process modeling. We implement the BMI in experiments consisting of an instructed-delay center-out task in which monkeys are presented with a target location on the screen during a delay period and then have to move a cursor to it without touching the incorrect targets. We show that the two-stage BMI performs more accurately than either stage alone. Correct target prediction can compensate for inaccurate trajectory estimation and vice versa. The optimal feedback control design also results in trajectories that are smoother and have lower estimation error. The two-stage decoder also performs better than linear regression approaches in offline cross-validation analyses. Our results demonstrate the advantage of a BMI design that jointly estimates the target and trajectory of movement and more closely mimics the sensorimotor control system.
url http://europepmc.org/articles/PMC3622681?pdf=render
work_keys_str_mv AT maryammshanechi arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT zivmwilliams arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT gregorywwornell arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT rollinchu arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT marissapowers arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT emerynbrown arealtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT maryammshanechi realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT zivmwilliams realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT gregorywwornell realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT rollinchu realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT marissapowers realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
AT emerynbrown realtimebrainmachineinterfacecombiningmotortargetandtrajectoryintentusinganoptimalfeedbackcontroldesign
_version_ 1724862901315960832