Showing 1–14 of 14 results for author: Müller, K

igraph enables fast and robust network analysis across programming languages

Authors: Michael Antonov, Gábor Csárdi, Szabolcs Horvát, Kirill Müller, Tamás Nepusz, Daniel Noom, Maëlle Salmon, Vincent Traag, Brooke Foucault Welles, Fabio Zanini

Abstract: Networks or graphs are widely used across the sciences to represent relationships of many kinds. igraph (https://igraph.org) is a general-purpose software library for graph construction, analysis, and visualisation, combining fast and robust performance with a low entry barrier. igraph pairs a fast core written in C with beginner-friendly interfaces in Python, R, and Mathematica. Over the last two… ▽ More Networks or graphs are widely used across the sciences to represent relationships of many kinds. igraph (https://igraph.org) is a general-purpose software library for graph construction, analysis, and visualisation, combining fast and robust performance with a low entry barrier. igraph pairs a fast core written in C with beginner-friendly interfaces in Python, R, and Mathematica. Over the last two decades, igraph has expanded substantially. It now scales to billions of edges, supports Mathematica and interactive plotting, integrates with Jupyter notebooks and other network libraries, includes new graph layouts and community detection algorithms, and has streamlined the documentation with examples and Spanish translations. Modern testing features such as continuous integration, address sanitizers, stricter typing, and memory-managed vectors have also increased robustness. Hundreds of bug reports have been fixed and a community forum has been opened to connect users and developers. Specific effort has been made to broaden use and community participation by women, non-binary people, and other demographic groups typically underrepresented in open source software. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Comments: 5 pages, 4 figures

Getting aligned on representational alignment

Authors: Ilia Sucholutsky, Lukas Muttenthaler, Adrian Weller, Andi Peng, Andreea Bobu, Been Kim, Bradley C. Love, Erin Grant, Iris Groen, Jascha Achterberg, Joshua B. Tenenbaum, Katherine M. Collins, Katherine L. Hermann, Kerem Oktar, Klaus Greff, Martin N. Hebart, Nori Jacoby, Qiuyi Zhang, Raja Marjieh, Robert Geirhos, Sherol Chen, Simon Kornblith, Sunayana Rane, Talia Konkle, Thomas P. O'Connell , et al. (5 additional authors not shown)

Abstract: Biological and artificial information processing systems form representations that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the extent to which the representations formed by these diverse systems agree? Do similarities in representations then translate into similar behavior? How can a system's representations be modified to better match those of an… ▽ More Biological and artificial information processing systems form representations that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the extent to which the representations formed by these diverse systems agree? Do similarities in representations then translate into similar behavior? How can a system's representations be modified to better match those of another system? These questions pertaining to the study of representational alignment are at the heart of some of the most active research areas in cognitive science, neuroscience, and machine learning. For example, cognitive scientists measure the representational alignment of multiple individuals to identify shared cognitive priors, neuroscientists align fMRI responses from multiple individuals into a shared representational space for group-level analyses, and ML researchers distill knowledge from teacher models into student models by increasing their alignment. Unfortunately, there is limited knowledge transfer between research communities interested in representational alignment, so progress in one field often ends up being rediscovered independently in another. Thus, greater cross-field communication would be advantageous. To improve communication between these fields, we propose a unifying framework that can serve as a common language between researchers studying representational alignment. We survey the literature from all three fields and demonstrate how prior work fits into this framework. Finally, we lay out open problems in representational alignment where progress can benefit all three of these fields. We hope that our work can catalyze cross-disciplinary collaboration and accelerate progress for all communities studying and developing information processing systems. We note that this is a working paper and encourage readers to reach out with their suggestions for future revisions. △ Less

Submitted 2 November, 2023; v1 submitted 18 October, 2023; originally announced October 2023.

Comments: Working paper, changes to be made in upcoming revisions

Accurate Machine Learned Quantum-Mechanical Force Fields for Biomolecular Simulations

Authors: Oliver T. Unke, Martin Stöhr, Stefan Ganscha, Thomas Unterthiner, Hartmut Maennel, Sergii Kashubin, Daniel Ahlin, Michael Gastegger, Leonardo Medrano Sandonas, Alexandre Tkatchenko, Klaus-Robert Müller

Abstract: Molecular dynamics (MD) simulations allow atomistic insights into chemical and biological processes. Accurate MD simulations require computationally demanding quantum-mechanical calculations, being practically limited to short timescales and few atoms. For larger systems, efficient, but much less reliable empirical force fields are used. Recently, machine learned force fields (MLFFs) emerged as an… ▽ More Molecular dynamics (MD) simulations allow atomistic insights into chemical and biological processes. Accurate MD simulations require computationally demanding quantum-mechanical calculations, being practically limited to short timescales and few atoms. For larger systems, efficient, but much less reliable empirical force fields are used. Recently, machine learned force fields (MLFFs) emerged as an alternative means to execute MD simulations, offering similar accuracy as ab initio methods at orders-of-magnitude speedup. Until now, MLFFs mainly capture short-range interactions in small molecules or periodic materials, due to the increased complexity of constructing models and obtaining reliable reference data for large molecules, where long-ranged many-body effects become important. This work proposes a general approach to constructing accurate MLFFs for large-scale molecular simulations (GEMS) by training on "bottom-up" and "top-down" molecular fragments of varying size, from which the relevant physicochemical interactions can be learned. GEMS is applied to study the dynamics of alanine-based peptides and the 46-residue protein crambin in aqueous solution, allowing nanosecond-scale MD simulations of >25k atoms at essentially ab initio quality. Our findings suggest that structural motifs in peptides and proteins are more flexible than previously thought, indicating that simulations at ab initio accuracy might be necessary to understand dynamic biomolecular processes such as protein (mis)folding, drug-protein binding, or allosteric regulation. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Evaluating deep transfer learning for whole-brain cognitive decoding

Authors: Armin W. Thomas, Ulman Lindenberger, Wojciech Samek, Klaus-Robert Müller

Abstract: Research in many fields has shown that transfer learning (TL) is well-suited to improve the performance of deep learning (DL) models in datasets with small numbers of samples. This empirical success has triggered interest in the application of TL to cognitive decoding analyses with functional neuroimaging data. Here, we systematically evaluate TL for the application of DL models to the decoding of… ▽ More Research in many fields has shown that transfer learning (TL) is well-suited to improve the performance of deep learning (DL) models in datasets with small numbers of samples. This empirical success has triggered interest in the application of TL to cognitive decoding analyses with functional neuroimaging data. Here, we systematically evaluate TL for the application of DL models to the decoding of cognitive states (e.g., viewing images of faces or houses) from whole-brain functional Magnetic Resonance Imaging (fMRI) data. We first pre-train two DL architectures on a large, public fMRI dataset and subsequently evaluate their performance in an independent experimental task and a fully independent dataset. The pre-trained models consistently achieve higher decoding accuracies and generally require less training time and data than model variants that were not pre-trained, clearly underlining the benefits of pre-training. We demonstrate that these benefits arise from the ability of the pre-trained models to reuse many of their learned features when training with new data, providing deeper insights into the mechanisms giving rise to the benefits of pre-training. Yet, we also surface nuanced challenges for whole-brain cognitive decoding with DL models when interpreting the decoding decisions of the pre-trained models, as these have learned to utilize the fMRI data in unforeseen and counterintuitive ways to identify individual cognitive states. △ Less

Submitted 1 November, 2021; originally announced November 2021.

Risk Estimation of SARS-CoV-2 Transmission from Bluetooth Low Energy Measurements

Authors: Felix Sattler, Jackie Ma, Patrick Wagner, David Neumann, Markus Wenzel, Ralf Schäfer, Wojciech Samek, Klaus-Robert Müller, Thomas Wiegand

Abstract: Digital contact tracing approaches based on Bluetooth low energy (BLE) have the potential to efficiently contain and delay outbreaks of infectious diseases such as the ongoing SARS-CoV-2 pandemic. In this work we propose a novel machine learning based approach to reliably detect subjects that have spent enough time in close proximity to be at risk of being infected. Our study is an important proof… ▽ More Digital contact tracing approaches based on Bluetooth low energy (BLE) have the potential to efficiently contain and delay outbreaks of infectious diseases such as the ongoing SARS-CoV-2 pandemic. In this work we propose a novel machine learning based approach to reliably detect subjects that have spent enough time in close proximity to be at risk of being infected. Our study is an important proof of concept that will aid the battery of epidemiological policies aiming to slow down the rapid spread of COVID-19. △ Less

Submitted 22 April, 2020; originally announced April 2020.

Resolving challenges in deep learning-based analyses of histopathological images using explanation methods

Authors: Miriam Hägele, Philipp Seegerer, Sebastian Lapuschkin, Michael Bockmayr, Wojciech Samek, Frederick Klauschen, Klaus-Robert Müller, Alexander Binder

Abstract: Deep learning has recently gained popularity in digital pathology due to its high prediction quality. However, the medical domain requires explanation and insight for a better understanding beyond standard quantitative performance evaluation. Recently, explanation methods have emerged, which are so far still rarely used in medicine. This work shows their application to generate heatmaps that allow… ▽ More Deep learning has recently gained popularity in digital pathology due to its high prediction quality. However, the medical domain requires explanation and insight for a better understanding beyond standard quantitative performance evaluation. Recently, explanation methods have emerged, which are so far still rarely used in medicine. This work shows their application to generate heatmaps that allow to resolve common challenges encountered in deep learning-based digital histopathology analyses. These challenges comprise biases typically inherent to histopathology data. We study binary classification tasks of tumor tissue discrimination in publicly available haematoxylin and eosin slides of various tumor entities and investigate three types of biases: (1) biases which affect the entire dataset, (2) biases which are by chance correlated with class labels and (3) sampling biases. While standard analyses focus on patch-level evaluation, we advocate pixel-wise heatmaps, which offer a more precise and versatile diagnostic instrument and furthermore help to reveal biases in the data. This insight is shown to not only detect but also to be helpful to remove the effects of common hidden biases, which improves generalization within and across datasets. For example, we could see a trend of improved area under the receiver operating characteristic curve by 5% when reducing a labeling bias. Explanation techniques are thus demonstrated to be a helpful and highly relevant tool for the development and the deployment phases within the life cycle of real-world applications in digital pathology. △ Less

Submitted 24 April, 2020; v1 submitted 15 August, 2019; originally announced August 2019.

Journal ref: Sci Rep 10, 6423 (2020)

Analyzing Neuroimaging Data Through Recurrent Deep Learning Models

Authors: Armin W. Thomas, Hauke R. Heekeren, Klaus-Robert Müller, Wojciech Samek

Abstract: The application of deep learning (DL) models to neuroimaging data poses several challenges, due to the high dimensionality, low sample size and complex temporo-spatial dependency structure of these datasets. Even further, DL models act as as black-box models, impeding insight into the association of cognitive state and brain activity. To approach these challenges, we introduce the DeepLight framew… ▽ More The application of deep learning (DL) models to neuroimaging data poses several challenges, due to the high dimensionality, low sample size and complex temporo-spatial dependency structure of these datasets. Even further, DL models act as as black-box models, impeding insight into the association of cognitive state and brain activity. To approach these challenges, we introduce the DeepLight framework, which utilizes long short-term memory (LSTM) based DL models to analyze whole-brain functional Magnetic Resonance Imaging (fMRI) data. To decode a cognitive state (e.g., seeing the image of a house), DeepLight separates the fMRI volume into a sequence of axial brain slices, which is then sequentially processed by an LSTM. To maintain interpretability, DeepLight adapts the layer-wise relevance propagation (LRP) technique. Thereby, decomposing its decoding decision into the contributions of the single input voxels to this decision. Importantly, the decomposition is performed on the level of single fMRI volumes, enabling DeepLight to study the associations between cognitive state and brain activity on several levels of data granularity, from the level of the group down to the level of single time points. To demonstrate the versatility of DeepLight, we apply it to a large fMRI dataset of the Human Connectome Project. We show that DeepLight outperforms conventional approaches of uni- and multivariate fMRI analysis in decoding the cognitive states and in identifying the physiologically appropriate brain regions associated with these states. We further demonstrate DeepLight's ability to study the fine-grained temporo-spatial variability of brain activity over sequences of single fMRI samples. △ Less

Submitted 5 April, 2019; v1 submitted 23 October, 2018; originally announced October 2018.

Comments: 36 pages, 9 figures

Learning from Label Proportions in Brain-Computer Interfaces: Online Unsupervised Learning with Guarantees

Authors: D Hübner, T Verhoeven, K Schmid, K-R Müller, M Tangermann, P-J Kindermans

Abstract: Objective: Using traditional approaches, a Brain-Computer Interface (BCI) requires the collection of calibration data for new subjects prior to online use. Calibration time can be reduced or eliminated e.g.~by transfer of a pre-trained classifier or unsupervised adaptive classification methods which learn from scratch and adapt over time. While such heuristics work well in practice, none of them c… ▽ More Objective: Using traditional approaches, a Brain-Computer Interface (BCI) requires the collection of calibration data for new subjects prior to online use. Calibration time can be reduced or eliminated e.g.~by transfer of a pre-trained classifier or unsupervised adaptive classification methods which learn from scratch and adapt over time. While such heuristics work well in practice, none of them can provide theoretical guarantees. Our objective is to modify an event-related potential (ERP) paradigm to work in unison with the machine learning decoder to achieve a reliable calibration-less decoding with a guarantee to recover the true class means. Method: We introduce learning from label proportions (LLP) to the BCI community as a new unsupervised, and easy-to-implement classification approach for ERP-based BCIs. The LLP estimates the mean target and non-target responses based on known proportions of these two classes in different groups of the data. We modified a visual ERP speller to meet the requirements of the LLP. For evaluation, we ran simulations on artificially created data sets and conducted an online BCI study with N=13 subjects performing a copy-spelling task. Results: Theoretical considerations show that LLP is guaranteed to minimize the loss function similarly to a corresponding supervised classifier. It performed well in simulations and in the online application, where 84.5% of characters were spelled correctly on average without prior calibration. Significance: The continuously adapting LLP classifier is the first unsupervised decoder for ERP BCIs guaranteed to find the true class means. This makes it an ideal solution to avoid a tedious calibration and to tackle non-stationarities in the data. Additionally, LLP works on complementary principles compared to existing unsupervised methods, allowing for their further enhancement when combined with LLP. △ Less

Submitted 25 January, 2017; originally announced January 2017.

Comments: The EEG data of 13 subjects is freely available online at: http://doi.org/10.5281/zenodo.192684

Neural Sampling by Irregular Gating Inhibition of Spiking Neurons and Attractor Networks

Authors: Lorenz K. Muller, Giacomo Indiveri

Abstract: A long tradition in theoretical neuroscience casts sensory processing in the brain as the process of inferring the maximally consistent interpretations of imperfect sensory input. Recently it has been shown that Gamma-band inhibition can enable neural attractor networks to approximately carry out such a sampling mechanism. In this paper we propose a novel neural network model based on irregular ga… ▽ More A long tradition in theoretical neuroscience casts sensory processing in the brain as the process of inferring the maximally consistent interpretations of imperfect sensory input. Recently it has been shown that Gamma-band inhibition can enable neural attractor networks to approximately carry out such a sampling mechanism. In this paper we propose a novel neural network model based on irregular gating inhibition, show analytically how it implements a Monte-Carlo Markov Chain (MCMC) sampler, and describe how it can be used to model networks of both neural attractors as well as of single spiking neurons. Finally we show how this model applied to spiking neurons gives rise to a new putative mechanism that could be used to implement stochastic synaptic weights in biological neural networks and in neuromorphic hardware. △ Less

Submitted 1 September, 2017; v1 submitted 23 May, 2016; originally announced May 2016.

Transcranial Focused Ultrasound for BOLD fMRI Signal Modulation in Humans

Authors: Leo Ai, Jerel K. Mueller, Andrea Grant, Yigitcan Eryaman, Wynn Legon

Abstract: Transcranial focused ultrasound (tFUS) is an emerging form of non-surgical human neuromodulation that confers advantages over existing electro and electromagnetic technologies by providing a superior spatial resolution on the millimeter scale as well as the capability to target sub-cortical structures non-invasively. An examination of the pairing of tFUS and blood oxygen level dependent (BOLD) fun… ▽ More Transcranial focused ultrasound (tFUS) is an emerging form of non-surgical human neuromodulation that confers advantages over existing electro and electromagnetic technologies by providing a superior spatial resolution on the millimeter scale as well as the capability to target sub-cortical structures non-invasively. An examination of the pairing of tFUS and blood oxygen level dependent (BOLD) functional MRI (fMRI) in humans is presented here. △ Less

Submitted 1 March, 2016; originally announced March 2016.

Comments: EMBC 2016

Highly Efficient siRNA Delivery from Core-Shell Mesoporous Silica Nanoparticles with Multifunctional Polymer Caps

Authors: Karin Moeller, Katharina Mueller, Hanna Engelke, Christoph Braeuchle, Ernst Wagner, Thomas Bein

Abstract: A new general route for siRNA delivery is presented combining porous core-shell silica nanocarriers with a modularly designed multifunctional block copolymer. Specifically, the internal storage and release of siRNA from mesoporous silica nanoparticles (MSN) with orthogonal core-shell surface chemistry was investigated as a function of pore-size, pore morphology, surface properties and pH. Very hig… ▽ More A new general route for siRNA delivery is presented combining porous core-shell silica nanocarriers with a modularly designed multifunctional block copolymer. Specifically, the internal storage and release of siRNA from mesoporous silica nanoparticles (MSN) with orthogonal core-shell surface chemistry was investigated as a function of pore-size, pore morphology, surface properties and pH. Very high siRNA loading capacities of up to 380 microg/mg MSN were obtained with charge-matched amino-functionalized mesoporous cores, and release profiles show up to 80% siRNA elution after 24 h. We demonstrate that adsorption and desorption of siRNA is mainly driven by electrostatic interactions, which allow for high loading capacities even in medium-sized mesopores with pore diameters down to 4 nm in a stellate pore morphology. The negatively charged MSN shell enabled the association with a block copolymer containing positively charged artificial amino acids and oleic acid blocks, which acts simultaneously as capping function and endosomal release agent. The potential of this multifunctional delivery platform is demonstrated by highly effective cell transfection and siRNA delivery into KB-cells. A luciferase reporter gene knock-down of up to 90% was possible using extremely low cell exposures with only 2.5 microg MSN containing 32 pM siRNA per 100 microL well. △ Less

Submitted 10 September, 2015; originally announced September 2015.

Comments: Artikel including supporting information

Rhythmic inhibition allows neural networks to search for maximally consistent states

Authors: Hesham Mostafa, Lorenz K. Muller, Giacomo Indiveri

Abstract: Gamma-band rhythmic inhibition is a ubiquitous phenomenon in neural circuits yet its computational role still remains elusive. We show that a model of Gamma-band rhythmic inhibition allows networks of coupled cortical circuit motifs to search for network configurations that best reconcile external inputs with an internal consistency model encoded in the network connectivity. We show that Hebbian p… ▽ More Gamma-band rhythmic inhibition is a ubiquitous phenomenon in neural circuits yet its computational role still remains elusive. We show that a model of Gamma-band rhythmic inhibition allows networks of coupled cortical circuit motifs to search for network configurations that best reconcile external inputs with an internal consistency model encoded in the network connectivity. We show that Hebbian plasticity allows the networks to learn the consistency model by example. The search dynamics driven by rhythmic inhibition enable the described networks to solve difficult constraint satisfaction problems without making assumptions about the form of stochastic fluctuations in the network. We show that the search dynamics are well approximated by a stochastic sampling process. We use the described networks to reproduce perceptual multi-stability phenomena with switching times that are a good match to experimental data and show that they provide a general neural framework which can be used to model other 'perceptual inference' phenomena. △ Less

Submitted 10 March, 2015; originally announced March 2015.

Journal ref: Neural Computation 27:12, (2015), pg. 2510-2547

Analysis of Transcranial Focused Ultrasound Beam Profile Sensitivity for Neuromodulation of the Human Brain

Authors: Jerel K. Mueller, Wynn Legon, William J. Tyler

Abstract: Objective. While ultrasound is largely established for use in diagnostic imaging and heating therapies, its application for neuromodulation is relatively new and not well understood. The objective of the present study was to investigate issues related to interactions between focused acoustic beams and brain tissues to better understand possible limitations of transcranial ultrasound for neuromodul… ▽ More Objective. While ultrasound is largely established for use in diagnostic imaging and heating therapies, its application for neuromodulation is relatively new and not well understood. The objective of the present study was to investigate issues related to interactions between focused acoustic beams and brain tissues to better understand possible limitations of transcranial ultrasound for neuromodulation. Approach. A computational model of transcranial focused ultrasound was constructed and validated against bench top experimental data. The models were then incrementally extended to address and investigate a number of issues related to the use of ultrasound for neuromodulation. These included the effect of variations in skull geometry and gyral anatomy, as well as the effect of transmission across multiple tissue and media layers, such as scalp, skull, CSF, and gray/white matter on ultrasound insertion behavior. In addition, a sensitivity analysis was run to characterize the influence of acoustic properties of intracranial tissues. Finally, the heating associated with ultrasonic stimulation waveforms designed for neuromodulation was modeled. Main results. Depending on factors such as acoustic frequency, the insertion behavior of a transcranial focused ultrasound beam is only subtly influenced by the geometry and acoustic properties of the underlying tissues. Significance. These issues are critical for the refinement of device design and the overall advancement of ultrasound methods for noninvasive neuromodulation. △ Less

Submitted 6 March, 2015; originally announced March 2015.

Comments: 32 pages, 14 figures, and 3 tables

Explorative Data Analysis for Changes in Neural Activity

Authors: Duncan A. J. Blythe, Frank C. Meinecke, Paul von Buenau, Klaus-Robert Mueller

Abstract: Neural recordings are nonstationary time series, i.e. their properties typically change over time. Identifying specific changes, e.g. those induced by a learning task, can shed light on the underlying neural processes. However, such changes of interest are often masked by strong unrelated changes, which can be of physiological origin or due to measurement artifacts. We propose a novel algorithm fo… ▽ More Neural recordings are nonstationary time series, i.e. their properties typically change over time. Identifying specific changes, e.g. those induced by a learning task, can shed light on the underlying neural processes. However, such changes of interest are often masked by strong unrelated changes, which can be of physiological origin or due to measurement artifacts. We propose a novel algorithm for disentangling such different causes of non-stationarity and in this manner enable better neurophysiological interpretation for a wider set of experimental paradigms. A key ingredient is the repeated application of Stationary Subspace Analysis (SSA) using different temporal scales. The usefulness of our explorative approach is demonstrated in simulations, theory and EEG experiments with 80 Brain-Computer-Interfacing (BCI) subjects. △ Less

Submitted 25 January, 2013; originally announced January 2013.