-
Interactive Web Application for Exploring Matrices of Neural Connectivity
Authors:
David J. Caldwell,
Jing Wu,
Kaitlyn Casimo,
Jeffrey G. Ojemann,
Rajesh P. N. Rao
Abstract:
We present here a browser-based application for visualizing patterns of connectivity in 3D stacked data matrices with large numbers of pairwise relations. Visualizing a connectivity matrix, looking for trends and patterns, and dynamically manipulating these values is a challenge for scientists from diverse fields, including neuroscience and genomics. In particular, high-dimensional neural data inc…
▽ More
We present here a browser-based application for visualizing patterns of connectivity in 3D stacked data matrices with large numbers of pairwise relations. Visualizing a connectivity matrix, looking for trends and patterns, and dynamically manipulating these values is a challenge for scientists from diverse fields, including neuroscience and genomics. In particular, high-dimensional neural data include those acquired via electroencephalography (EEG), electrocorticography (ECoG), magnetoencephalography (MEG), and functional MRI. Neural connectivity data contains multivariate attributes for each edge between different brain regions, which motivated our lightweight, open source, easy-to-use visualization tool for the exploration of these connectivity matrices to highlight connections of interest. Here we present a client-side, mobile-compatible visualization tool written entirely in HTML5/JavaScript that allows in-browser manipulation of user-defined files for exploration of brain connectivity. Visualizations can highlight different aspects of the data simultaneously across different dimensions. Input files are in JSON format, and custom Python scripts have been written to parse MATLAB or Python data files into JSON-loadable format. We demonstrate the analysis of connectivity data acquired via human ECoG recordings as a domain-specific implementation of our application. We envision applications for this interactive tool in fields seeking to visualize pairwise connectivity.
△ Less
Submitted 21 February, 2017;
originally announced February 2017.
-
Electrocorticographic Dynamics Predict Visually Guided Motor Imagery of Grasp Shaping
Authors:
Jing Wu,
Kaitlyn Casimo,
David J. Caldwell,
Rajesh P. N. Rao,
Jeffrey G. Ojemann
Abstract:
Identification of intended movement type and movement phase of hand grasp shaping are critical features for the control of volitional neuroprosthetics. We demonstrate that neural dynamics during visually-guided imagined grasp shaping can encode intended movement. We apply Procrustes analysis and LASSO regression to achieve 72% accuracy (chance = 25%) in distinguishing between visually-guided imagi…
▽ More
Identification of intended movement type and movement phase of hand grasp shaping are critical features for the control of volitional neuroprosthetics. We demonstrate that neural dynamics during visually-guided imagined grasp shaping can encode intended movement. We apply Procrustes analysis and LASSO regression to achieve 72% accuracy (chance = 25%) in distinguishing between visually-guided imagined grasp trajectories. Further, we can predict the stage of grasp shaping in the form of elapsed time from start of trial (R2=0.4). Our approach contributes to more accurate single-trial decoding of higher-level movement goals and the phase of grasping movements in individuals not trained with brain-computer interfaces. We also find that the overall time-varying trajectory structure of imagined movements tend to be consistent within individuals, and that transient trajectory deviations within trials return to the task-dependent trajectory mean. These overall findings may contribute to the further understanding of the cortical dynamics of human motor imagery.
△ Less
Submitted 20 February, 2017;
originally announced February 2017.
-
Cortical Brain Computer Interface for Closed-Loop Deep Brain Stimulation
Authors:
Jeffrey A. Herron,
Margaret C. Thompson,
Timothy Brown,
Howard J. Chizeck,
Jeffrey G. Ojemann,
Andrew L. Ko
Abstract:
Essential Tremor is the most common neurological movement disorder. This progressive disease causes uncontrollable rhythmic motions -most often affecting the patient's dominant upper extremity- that occur during volitional movement and make it difficult for the patient to perform everyday tasks. Medication may also become ineffective as the disorder progresses. For many patients, deep brain stimul…
▽ More
Essential Tremor is the most common neurological movement disorder. This progressive disease causes uncontrollable rhythmic motions -most often affecting the patient's dominant upper extremity- that occur during volitional movement and make it difficult for the patient to perform everyday tasks. Medication may also become ineffective as the disorder progresses. For many patients, deep brain stimulation (DBS) of the thalamus is an effective means of treating this condition when medication fails. In current use, however, clinicians set the patient's stimulator to apply stimulation at all times- whether it is needed or not. This practice leads to excess power use, and more rapid depletion of batteries that require surgical replacement. In the work described here, for the first time, neural sensing of movement (using chronically-implanted cortical electrodes) is used to enable or disable stimulation for tremor. Therapeutic stimulation is delivered only when the patient is actively using their effected limb, thereby reducing the total stimulation applied, and potentially extending the lifetime of surgically-implanted batteries. This work, which involves both implanted and external subsystems, paves the way for the future fully-implanted closed-loop deep brain stimulators.
△ Less
Submitted 1 June, 2017; v1 submitted 4 December, 2016;
originally announced December 2016.
-
Multistep Model for Predicting Upper-Limb 3D Isometric Force Application from Pre-Movement Electrocorticographic Features
Authors:
Jing Wu,
Benjamin R. Shuman,
Bingni W. Brunton,
Katherine M. Steele,
Jared D. Olson,
Rajesh P. N. Rao,
Jeffrey G. Ojemann
Abstract:
Neural correlates of movement planning onset and direction may be present in human electrocorticography in the signal dynamics of both motor and non-motor cortical regions. We use a three-stage model of jPCA reduced-rank hidden Markov model (jPCA-RR-HMM), regularized shrunken-centroid discriminant analysis (RDA), and LASSO regression to extract direction-sensitive planning information and movement…
▽ More
Neural correlates of movement planning onset and direction may be present in human electrocorticography in the signal dynamics of both motor and non-motor cortical regions. We use a three-stage model of jPCA reduced-rank hidden Markov model (jPCA-RR-HMM), regularized shrunken-centroid discriminant analysis (RDA), and LASSO regression to extract direction-sensitive planning information and movement onset in an upper-limb 3D isometric force task in a human subject. This mode achieves a relatively high true positive force-onset prediction rate of 60% within 250ms, and an above-chance 36% accuracy (17% chance) in predicting one of six planned 3D directions of isometric force using pre-movement signals. We also find direction-distinguishing information up to 400ms before force onset in the pre-movement signals, captured by electrodes placed over the limb-ipsilateral dorsal premotor regions. This approach can contribute to more accurate decoding of higher-level movement goals, at earlier timescales, and inform sensor placement. Our results also contribute to further understanding of the spatiotemporal features of human motor planning.
△ Less
Submitted 17 May, 2016;
originally announced May 2016.
-
Unsupervised decoding of long-term, naturalistic human neural recordings with automated video and audio annotations
Authors:
Nancy X. R. Wang,
Jared D. Olson,
Jeffrey G. Ojemann,
Rajesh P. N. Rao,
Bingni W. Brunton
Abstract:
Fully automated decoding of human activities and intentions from direct neural recordings is a tantalizing challenge in brain-computer interfacing. Most ongoing efforts have focused on training decoders on specific, stereotyped tasks in laboratory settings. Implementing brain-computer interfaces (BCIs) in natural settings requires adaptive strategies and scalable algorithms that require minimal su…
▽ More
Fully automated decoding of human activities and intentions from direct neural recordings is a tantalizing challenge in brain-computer interfacing. Most ongoing efforts have focused on training decoders on specific, stereotyped tasks in laboratory settings. Implementing brain-computer interfaces (BCIs) in natural settings requires adaptive strategies and scalable algorithms that require minimal supervision. Here we propose an unsupervised approach to decoding neural states from human brain recordings acquired in a naturalistic context. We demonstrate our approach on continuous long-term electrocorticographic (ECoG) data recorded over many days from the brain surface of subjects in a hospital room, with simultaneous audio and video recordings. We first discovered clusters in high-dimensional ECoG recordings and then annotated coherent clusters using speech and movement labels extracted automatically from audio and video recordings. To our knowledge, this represents the first time techniques from computer vision and speech processing have been used for natural ECoG decoding. Our results show that our unsupervised approach can discover distinct behaviors from ECoG data, including moving, speaking and resting. We verify the accuracy of our approach by comparing to manual annotations. Projecting the discovered cluster centers back onto the brain, this technique opens the door to automated functional brain mapping in natural settings.
△ Less
Submitted 8 December, 2015; v1 submitted 25 November, 2015;
originally announced November 2015.
-
Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition
Authors:
Bingni W. Brunton,
Lise A. Johnson,
Jeffrey G. Ojemann,
J. Nathan Kutz
Abstract:
There is a broad need in the neuroscience community to understand and visualize large-scale recordings of neural activity, big data acquired by tens or hundreds of electrodes simultaneously recording dynamic brain activity over minutes to hours. Such dynamic datasets are characterized by coherent patterns across both space and time, yet existing computational methods are typically restricted to an…
▽ More
There is a broad need in the neuroscience community to understand and visualize large-scale recordings of neural activity, big data acquired by tens or hundreds of electrodes simultaneously recording dynamic brain activity over minutes to hours. Such dynamic datasets are characterized by coherent patterns across both space and time, yet existing computational methods are typically restricted to analysis either in space or in time separately. Here we report the adaptation of dynamic mode decomposition (DMD), an algorithm originally developed for the study of fluid physics, to large-scale neuronal recordings. DMD is a modal decomposition algorithm that describes high-dimensional dynamic data using coupled spatial-temporal modes; the resulting analysis combines key features of performing principal components analysis (PCA) in space and power spectral analysis in time. The algorithm scales easily to very large numbers of simultaneously acquired measurements. We validated the DMD approach on sub-dural electrode array recordings from human subjects performing a known motor activation task. Next, we leveraged DMD in combination with machine learning to develop a novel method to extract sleep spindle networks from the same subjects. We suggest that DMD is generally applicable as a powerful method in the analysis and understanding of large-scale recordings of neural activity.
△ Less
Submitted 18 September, 2014;
originally announced September 2014.
-
ECoG observations of power-law scaling in the human cortex
Authors:
Kai J. Miller,
Larry B. Sorensen,
Jeffrey G. Ojemann,
Marcel den Nijs
Abstract:
We report the results of our search for power-law electrical signals in the human brain, using subdural electrocorticographic recordings from the surface of the cortex. The power spectral density (PSD) of these signals has the power-law form $ P(f)\sim f^{-χ} $ from 80 to 500 Hz. This scaling index $χ= 4.0\pm 0.1$ is universal, across subjects, area in the cortex, and local neural activity level…
▽ More
We report the results of our search for power-law electrical signals in the human brain, using subdural electrocorticographic recordings from the surface of the cortex. The power spectral density (PSD) of these signals has the power-law form $ P(f)\sim f^{-χ} $ from 80 to 500 Hz. This scaling index $χ= 4.0\pm 0.1$ is universal, across subjects, area in the cortex, and local neural activity levels. The shape of the PSD does not change with local cortex activity, only its amplitude increases. We observe a knee in the spectra at $f_0\simeq 70$ Hz, implying the existence of a characteristic time scale $τ=(2πf_0)^{-1}\simeq 2-4$ msec. For $f<f_0$ we find evidence for a power-law with $χ_L\simeq 2.0\pm 0.4$.
△ Less
Submitted 5 December, 2007;
originally announced December 2007.
