Showing 1–6 of 6 results for author: Glasmachers, T

GET: A Generative EEG Transformer for Continuous Context-Based Neural Signals

Authors: Omair Ali, Muhammad Saif-ur-Rehman, Marita Metzler, Tobias Glasmachers, Ioannis Iossifidis, Christian Klaes

Abstract: Generating continuous electroencephalography (EEG) signals through advanced artificial neural networks presents a novel opportunity to enhance brain-computer interface (BCI) technology. This capability has the potential to significantly enhance applications ranging from simulating dynamic brain activity and data augmentation to improving real-time epilepsy detection and BCI inference. By harnessin… ▽ More Generating continuous electroencephalography (EEG) signals through advanced artificial neural networks presents a novel opportunity to enhance brain-computer interface (BCI) technology. This capability has the potential to significantly enhance applications ranging from simulating dynamic brain activity and data augmentation to improving real-time epilepsy detection and BCI inference. By harnessing generative transformer neural networks, specifically designed for EEG signal generation, we can revolutionize the interpretation and interaction with neural data. Generative AI has demonstrated significant success across various domains, from natural language processing (NLP) and computer vision to content creation in visual arts and music. It distinguishes itself by using large-scale datasets to construct context windows during pre-training, a technique that has proven particularly effective in NLP, where models are fine-tuned for specific downstream tasks after extensive foundational training. However, the application of generative AI in the field of BCIs, particularly through the development of continuous, context-rich neural signal generators, has been limited. To address this, we introduce the Generative EEG Transformer (GET), a model leveraging transformer architecture tailored for EEG data. The GET model is pre-trained on diverse EEG datasets, including motor imagery and alpha wave datasets, enabling it to produce high-fidelity neural signals that maintain contextual integrity. Our empirical findings indicate that GET not only faithfully reproduces the frequency spectrum of the training data and input prompts but also robustly generates continuous neural signals. By adopting the successful training strategies of the NLP domain for BCIs, the GET sets a new standard for the development and application of neural signal generation technologies. △ Less

Submitted 10 June, 2024; v1 submitted 5 June, 2024; originally announced June 2024.

Ruhr Hand Motion Catalog of Human Center-Out Transport Trajectories in 3D Task-Space Captured by a Redundant Measurement System

Authors: Tim Sziburis, Susanne Blex, Tobias Glasmachers, Ioannis Iossifidis

Abstract: Neurological conditions are a major source of movement disorders. Motion modelling and variability analysis have the potential to identify pathology but require profound data. We introduce a systematic dataset of 3D center-out task-space trajectories of human hand transport movements in a natural setting. The transport tasks of this study consist of grasping a cylindric object from a unified start… ▽ More Neurological conditions are a major source of movement disorders. Motion modelling and variability analysis have the potential to identify pathology but require profound data. We introduce a systematic dataset of 3D center-out task-space trajectories of human hand transport movements in a natural setting. The transport tasks of this study consist of grasping a cylindric object from a unified start position and transporting it to one of nine target locations in unconstrained operational space. The measurement procedure is automatized to record ten trials per target location. With that, the dataset consists of 90 movement trajectories for each hand of 31 participants without known movement disorders. The participants are aged between 21 and 78 years, covering a wide range. Data are recorded redundantly by both an optical tracking system and an IMU sensor. As opposed to the stationary capturing system, the IMU can be considered as a portable, low-cost and energy-efficient alternative to be implemented on embedded systems. △ Less

Submitted 31 December, 2023; originally announced January 2024.

ConTraNet: A single end-to-end hybrid network for EEG-based and EMG-based human machine interfaces

Authors: Omair Ali, Muhammad Saif-ur-Rehman, Tobias Glasmachers, Ioannis Iossifidis, Christian Klaes

Abstract: Objective: Electroencephalography (EEG) and electromyography (EMG) are two non-invasive bio-signals, which are widely used in human machine interface (HMI) technologies (EEG-HMI and EMG-HMI paradigm) for the rehabilitation of physically disabled people. Successful decoding of EEG and EMG signals into respective control command is a pivotal step in the rehabilitation process. Recently, several Conv… ▽ More Objective: Electroencephalography (EEG) and electromyography (EMG) are two non-invasive bio-signals, which are widely used in human machine interface (HMI) technologies (EEG-HMI and EMG-HMI paradigm) for the rehabilitation of physically disabled people. Successful decoding of EEG and EMG signals into respective control command is a pivotal step in the rehabilitation process. Recently, several Convolutional neural networks (CNNs) based architectures are proposed that directly map the raw time-series signal into decision space and the process of meaningful features extraction and classification are performed simultaneously. However, these networks are tailored to the learn the expected characteristics of the given bio-signal and are limited to single paradigm. In this work, we addressed the question that can we build a single architecture which is able to learn distinct features from different HMI paradigms and still successfully classify them. Approach: In this work, we introduce a single hybrid model called ConTraNet, which is based on CNN and Transformer architectures that is equally useful for EEG-HMI and EMG-HMI paradigms. ConTraNet uses CNN block to introduce inductive bias in the model and learn local dependencies, whereas the Transformer block uses the self-attention mechanism to learn the long-range dependencies in the signal, which are crucial for the classification of EEG and EMG signals. Main results: We evaluated and compared the ConTraNet with state-of-the-art methods on three publicly available datasets which belong to EEG-HMI and EMG-HMI paradigms. ConTraNet outperformed its counterparts in all the different category tasks (2-class, 3-class, 4-class, and 10-class decoding tasks). Significance: The results suggest that ConTraNet is robust to learn distinct features from different HMI paradigms and generalizes well as compared to the current state of the art algorithms. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Anchored-STFT and GNAA: An extension of STFT in conjunction with an adversarial data augmentation technique for the decoding of neural signals

Authors: Omair Ali, Muhammad Saif-ur-Rehman, Susanne Dyck, Tobias Glasmachers, Ioannis Iossifidis, Christian Klaes

Abstract: Brain-computer interfaces (BCIs) enable communication between humans and machines by translating brain activity into control commands. Electroencephalography (EEG) signals are one of the most used brain signals in non-invasive BCI applications but are often contaminated with noise. Therefore, it is possible that meaningful patterns for classifying EEG signals are deeply hidden. State-of-the-art de… ▽ More Brain-computer interfaces (BCIs) enable communication between humans and machines by translating brain activity into control commands. Electroencephalography (EEG) signals are one of the most used brain signals in non-invasive BCI applications but are often contaminated with noise. Therefore, it is possible that meaningful patterns for classifying EEG signals are deeply hidden. State-of-the-art deep-learning algorithms are successful in learning hidden, meaningful patterns. However, the quality and the quantity of the presented inputs is pivotal. Here, we propose a novel feature extraction method called anchored Short Time Fourier Transform (anchored-STFT), which is an advanced version of STFT, as it minimizes the trade-off between temporal and spectral resolution presented by STFT. In addition, we propose a novel augmentation method, called gradient norm adversarial augmentation (GNAA). GNAA is not only an augmentation method but is also used to harness adversarial inputs in EEG data, which not only improves the classification accuracy but also enhances the robustness of the classifier. In addition, we also propose a new CNN architecture, namely Skip-Net, for the classification of EEG signals. The proposed pipeline outperforms all state-of-the-art methods and yields an average classification accuracy of 90.7 % and 89.54 % on BCI competition II dataset III and BCI competition IV dataset 2b, respectively. △ Less

Submitted 9 August, 2021; v1 submitted 30 November, 2020; originally announced November 2020.

Comments: 29 pages, 6 figures, 4 tables

SpikeDeep-Classifier: A deep-learning based fully automatic offline spike sorting algorithm

Authors: Muhammad Saif-ur-Rehman, Omair Ali, Robin Lienkaemper, Sussane Dyck, Marita Metzler, Yaroslav Parpaley, Joerg Wellmer, Charles Liu, Brian Lee, Spencer Kellis, Richard Andersen, Ioannis Iossifidis, Tobias Glasmachers, Christian Klaes

Abstract: Objective. Recent advancements in electrode designs and micro-fabrication technology has allowed existence of microelectrode arrays with hundreds of channels for single-cell recordings. In such electrophysiological recordings, each implanted micro-electrode can record the activities of more than one neuron in its vicinity. Recording the activities of multiple neurons may also be referred to as mul… ▽ More Objective. Recent advancements in electrode designs and micro-fabrication technology has allowed existence of microelectrode arrays with hundreds of channels for single-cell recordings. In such electrophysiological recordings, each implanted micro-electrode can record the activities of more than one neuron in its vicinity. Recording the activities of multiple neurons may also be referred to as multiple unit activity. However, for any further analysis, the main goal is to isolate the activity of each recorded neuron and thus called single-unit activity. This process may also be referred to as spike sorting or spike classification. Recent approaches to extract SUA are time consuming, mainly due to the requirement of human intervention at various stages of spike sorting pipeline. Lack of standardization is another drawback of the current available approaches. Therefore, in this study we proposed a standard spike sorter: SpikeDeep-Classifier, a fully automatic spike sorting algorithm. Approach. We proposed a novel spike sorting pipeline, based on a set of supervised and unsupervised learning algorithms. We used supervised, deep learning-based algorithms for extracting meaningful channels and removing background activities (noise) from the extracted channels. We also showed that the process of clustering becomes straight-forward, once the noise/artifact is completely removed from the data. Therefore, in the next stage, we applied a simple clustering algorithm (K-mean) with predefined maximum number of clusters. Lastly, we used a similarity-based criterion to keep distinct clusters and merge similar-looking clusters. Main results. We evaluated our algorithm on a dataset collected from two different species (humans and non-human primates (NHPs)) without any retraining. We also validated our algorithm on two publicly available labeled datasets. △ Less

Submitted 23 December, 2019; originally announced December 2019.

Comments: 33 Pages, 14 Figures, 10 Tables

Universal Spike Classifier

Authors: Muhammad Saif-ur-Rehman, Robin Lienkämper, Yaroslav Parpaley, Jörg Wellmer, Charles Liu, Brian Lee, Spencer Kellis, Richard Andersen, Ioannis Iossifidis, Tobias Glasmachers, Christian Klaes

Abstract: In electrophysiology, microelectrodes are the primary source for recording neural data of single neurons (single unit activity). These microelectrodes can be implanted individually, or in the form of microelectrodes arrays, consisting of hundreds of electrodes. During recordings, some channels capture the activity of neurons, which is usually contaminated with external artifacts and noise. Another… ▽ More In electrophysiology, microelectrodes are the primary source for recording neural data of single neurons (single unit activity). These microelectrodes can be implanted individually, or in the form of microelectrodes arrays, consisting of hundreds of electrodes. During recordings, some channels capture the activity of neurons, which is usually contaminated with external artifacts and noise. Another considerable fraction of channels does not record any neural data, but external artifacts and noise. Therefore, an automatic identification and tracking of channels containing neural data is of great significance and can accelerate the process of analysis, e.g. automatic selection of meaningful channels during offline and online spike sorting. Another important aspect is the selection of meaningful channels during online decoding in brain-computer interface applications, where threshold crossing events are usually for feature extraction, even though they do not necessarily correspond to neural events. Here, we propose a novel algorithm based on the newly introduced way of feature vector extraction and a supervised deep learning method: a universal spike classifier (USC). The USC enables us to address both above-raised issues. The USC uses the standard architecture of convolutional neural networks (Conv net). It takes the batch of the waveforms, instead of a single waveform as an input, propagates it through the multilayered structure, and finally classifies it as a channel containing neural spike data or artifacts. We have trained the model of USC on data recorded from single tetraplegic patient with Utah arrays implanted in different brain areas. This trained model was then evaluated without retraining on the data collected from six epileptic patients implanted with depth electrodes and two tetraplegic patients implanted with two Utah arrays, individually. △ Less

Submitted 7 November, 2018; originally announced November 2018.

Comments: 21 Pages, 12 Figures