Statistics > Machine Learning
[Submitted on 13 Nov 2015 (this version), latest version 14 Mar 2016 (v2)]
Title:Neuroprosthetic decoder training as imitation learning
View PDFAbstract:Neuroprosthetic brain-computer interfaces function via an algorithm which decodes neural activity of the user into movements of an end effector, such as a cursor or robotic arm. In practice, the decoder is often learned by updating its parameters while the user performs a task. When the user's intention is not directly observable, recent methods have demonstrated value in training the decoder against a surrogate for the user's intended movement. We describe how training a decoder in this way can be seen as an imitation learning problem, where an oracle or expert is employed for supervised training in lieu of direct observations, which are not available. Specifically, we adapt a generic imitation learning meta-algorithm, dataset aggregation (DAgger, [1]), to train a brain-computer interface in arbitrary dimensions. By interpreting existing learning algorithms for brain-computer interfaces in this framework, we provide analysis of regret, a standard metric of learning efficacy. Using this interpretation, we characterize the space of algorithmic variants and bounds on their regret rates. Existing approaches for decoder learning have been performed in the cursor control setting, but it has not been clear how these approaches will scale to naturalistic complexity settings, such as controlling a high degree-of-freedom robotic arm. Leveraging our proposed imitation learning interpretation, we couple parameter updating with an oracle produced by optimal control software, yielding rapid decoder learning in simulations of neuroprosthetic control of an arm.
Submission history
From: Josh Merel [view email][v1] Fri, 13 Nov 2015 04:21:33 UTC (608 KB)
[v2] Mon, 14 Mar 2016 16:39:03 UTC (1,397 KB)
Current browse context:
stat.ML
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.