-
Information encoding and decoding in in-vitro neural networks on micro electrode arrays through stimulation timing
Authors:
Trym A. E. Lindell,
Ola H. Ramstad,
Ionna Sandvig,
Axel Sandvig,
Stefano Nichele
Abstract:
A primary challenge in utilizing in-vitro biological neural networks for computations is finding good encoding and decoding schemes for inputting and decoding data to and from the networks. Furthermore, identifying the optimal parameter settings for a given combination of encoding and decoding schemes adds additional complexity to this challenge. In this study we explore stimulation timing as an e…
▽ More
A primary challenge in utilizing in-vitro biological neural networks for computations is finding good encoding and decoding schemes for inputting and decoding data to and from the networks. Furthermore, identifying the optimal parameter settings for a given combination of encoding and decoding schemes adds additional complexity to this challenge. In this study we explore stimulation timing as an encoding method, i.e. we encode information as the delay between stimulation pulses and identify the bounds and acuity of stimulation timings which produce linearly separable spike responses. We also examine the optimal readout parameters for a linear decoder in the form of epoch length, time bin size and epoch offset. Our results suggest that stimulation timings between 36 and 436ms may be optimal for encoding and that different combinations of readout parameters may be optimal at different parts of the evoked spike response.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
Local learning through propagation delays in spiking neural networks
Authors:
Jørgen Jensen Farner,
Ola Huse Ramstad,
Stefano Nichele,
Kristine Heiney
Abstract:
We propose a novel local learning rule for spiking neural networks in which spike propagation times undergo activity-dependent plasticity. Our plasticity rule aligns pre-synaptic spike times to produce a stronger and more rapid response. Inputs are encoded by latency coding and outputs decoded by matching similar patterns of output spiking activity. We demonstrate the use of this method in a three…
▽ More
We propose a novel local learning rule for spiking neural networks in which spike propagation times undergo activity-dependent plasticity. Our plasticity rule aligns pre-synaptic spike times to produce a stronger and more rapid response. Inputs are encoded by latency coding and outputs decoded by matching similar patterns of output spiking activity. We demonstrate the use of this method in a three-layer feedfoward network with inputs from a database of handwritten digits. Networks consistently improve their classification accuracy after training, and training with this method also allowed networks to generalize to an input class unseen during training. Our proposed method takes advantage of the ability of spiking neurons to support many different time-locked sequences of spikes, each of which can be activated by different input activations. The proof-of-concept shown here demonstrates the great potential for local delay learning to expand the memory capacity and generalizability of spiking neural networks.
△ Less
Submitted 27 October, 2022;
originally announced November 2022.
-
Evolving spiking neuron cellular automata and networks to emulate in vitro neuronal activity
Authors:
Jørgen Jensen Farner,
Håkon Weydahl,
Ruben Jahren,
Ola Huse Ramstad,
Stefano Nichele,
Kristine Heiney
Abstract:
Neuro-inspired models and systems have great potential for applications in unconventional computing. Often, the mechanisms of biological neurons are modeled or mimicked in simulated or physical systems in an attempt to harness some of the computational power of the brain. However, the biological mechanisms at play in neural systems are complicated and challenging to capture and engineer; thus, it…
▽ More
Neuro-inspired models and systems have great potential for applications in unconventional computing. Often, the mechanisms of biological neurons are modeled or mimicked in simulated or physical systems in an attempt to harness some of the computational power of the brain. However, the biological mechanisms at play in neural systems are complicated and challenging to capture and engineer; thus, it can be simpler to turn to a data-driven approach to transfer features of neural behavior to artificial substrates. In the present study, we used an evolutionary algorithm (EA) to produce spiking neural systems that emulate the patterns of behavior of biological neurons in vitro. The aim of this approach was to develop a method of producing models capable of exhibiting complex behavior that may be suitable for use as computational substrates. Our models were able to produce a level of network-wide synchrony and showed a range of behaviors depending on the target data used for their evolution, which was from a range of neuronal culture densities and maturities. The genomes of the top-performing models indicate the excitability and density of connections in the model play an important role in determining the complexity of the produced activity.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
On Artificial Life and Emergent Computation in Physical Substrates
Authors:
Kristine Heiney,
Gunnar Tufte,
Stefano Nichele
Abstract:
In living systems, we often see the emergence of the ingredients necessary for computation -- the capacity for information transmission, storage, and modification -- begging the question of how we may exploit or imitate such biological systems in unconventional computing applications. What can we gain from artificial life in the advancement of computing technology? Artificial life provides us with…
▽ More
In living systems, we often see the emergence of the ingredients necessary for computation -- the capacity for information transmission, storage, and modification -- begging the question of how we may exploit or imitate such biological systems in unconventional computing applications. What can we gain from artificial life in the advancement of computing technology? Artificial life provides us with powerful tools for understanding the dynamic behavior of biological systems and capturing this behavior in manmade substrates. With this approach, we can move towards a new computing paradigm concerned with harnessing emergent computation in physical substrates not governed by the constraints of Moore's law and ultimately realize massively parallel and distributed computing technology. In this paper, we argue that the lens of artificial life offers valuable perspectives for the advancement of high-performance computing technology. We first present a brief foundational background on artificial life and some relevant tools that may be applicable to unconventional computing. Two specific substrates are then discussed in detail: biological neurons and ensembles of nanomagnets. These substrates are the focus of the authors' ongoing work, and they are illustrative of the two sides of the approach outlined here -- the close study of living systems and the construction of artificial systems to produce life-like behaviors. We conclude with a philosophical discussion on what we can learn from approaching computation with the curiosity inherent to the study of artificial life. The main contribution of this paper is to present the great potential of using artificial life methodologies to uncover and harness the inherent computational power of physical substrates toward applications in unconventional high-performance computing.
△ Less
Submitted 9 September, 2020;
originally announced September 2020.
-
A deep learning based tool for automatic brain extraction from functional magnetic resonance images in rodents
Authors:
Sidney Pontes-Filho,
Annelene Gulden Dahl,
Stefano Nichele,
Gustavo Borges Moreno e Mello
Abstract:
Removing skull artifacts from functional magnetic images (fMRI) is a well understood and frequently encountered problem. Because the fMRI field has grown mostly due to human studies, many new tools were developed to handle human data. Nonetheless, these tools are not equally useful to handle the data derived from animal studies, especially from rodents. This represents a major problem to the field…
▽ More
Removing skull artifacts from functional magnetic images (fMRI) is a well understood and frequently encountered problem. Because the fMRI field has grown mostly due to human studies, many new tools were developed to handle human data. Nonetheless, these tools are not equally useful to handle the data derived from animal studies, especially from rodents. This represents a major problem to the field because rodent studies generate larger datasets from larger populations, which implies that preprocessing these images manually to remove the skull becomes a bottleneck in the data analysis pipeline. In this study, we address this problem by implementing a neural network based method that uses a U-Net architecture to segment the brain area into a mask and removing the skull and other tissues from the image. We demonstrate several strategies to speed up the process of generating the training dataset using watershedding and several strategies for data augmentation that allowed to train faster the U-Net to perform the segmentation. Finally, we deployed the trained network freely available.
△ Less
Submitted 5 December, 2019; v1 submitted 3 December, 2019;
originally announced December 2019.
-
Assessment and manipulation of the computational capacity of in vitro neuronal networks through criticality in neuronal avalanches
Authors:
Kristine Heiney,
Ola Huse Ramstad,
Ioanna Sandvig,
Axel Sandvig,
Stefano Nichele
Abstract:
In this work, we report the preliminary analysis of the electrophysiological behavior of in vitro neuronal networks to identify when the networks are in a critical state based on the size distribution of network-wide avalanches of activity. The results presented here demonstrate the importance of selecting appropriate parameters in the evaluation of the size distribution and indicate that it is po…
▽ More
In this work, we report the preliminary analysis of the electrophysiological behavior of in vitro neuronal networks to identify when the networks are in a critical state based on the size distribution of network-wide avalanches of activity. The results presented here demonstrate the importance of selecting appropriate parameters in the evaluation of the size distribution and indicate that it is possible to perturb networks showing highly synchronized---or supercritical---behavior into the critical state by increasing the level of inhibition in the network. The classification of critical versus non-critical networks is valuable in identifying networks that can be expected to perform well on computational tasks, as criticality is widely considered to be the state in which a system is best suited for computation. This type of analysis is expected to enable the identification of networks that are well-suited for computation and the classification of networks as perturbed or healthy. This study is part of a larger research project, the overarching aim of which is to develop computational models that are able to reproduce target behaviors observed in in vitro neuronal networks. These models will ultimately be used to aid in the realization of these behaviors in nanomagnet arrays to be used in novel computing hardwares.
△ Less
Submitted 29 July, 2019;
originally announced July 2019.
-
Evaluation of the criticality of in vitro neuronal networks: Toward an assessment of computational capacity
Authors:
Kristine Heiney,
Vibeke Devold Valderhaug,
Ioanna Sandvig,
Axel Sandvig,
Gunnar Tufte,
Hugo Lewi Hammer,
Stefano Nichele
Abstract:
Novel computing hardwares are necessary to keep up with today's increasing demand for data storage and processing power. In this research project, we turn to the brain for inspiration to develop novel computing substrates that are self-learning, scalable, energy-efficient, and fault-tolerant. The overarching aim of this work is to develop computational models that are able to reproduce target beha…
▽ More
Novel computing hardwares are necessary to keep up with today's increasing demand for data storage and processing power. In this research project, we turn to the brain for inspiration to develop novel computing substrates that are self-learning, scalable, energy-efficient, and fault-tolerant. The overarching aim of this work is to develop computational models that are able to reproduce target behaviors observed in in vitro neuronal networks. These models will be ultimately be used to aid in the realization of these behaviors in a more engineerable substrate: an array of nanomagnets. The target behaviors will be identified by analyzing electrophysiological recordings of the neuronal networks. Preliminary analysis has been performed to identify when a network is in a critical state based on the size distribution of network-wide avalanches of activity, and the results of this analysis are reported here. This classification of critical versus non-critical networks is valuable in identifying networks that can be expected to perform well on computational tasks, as criticality is widely considered to be the state in which a system is best suited for computation. This type of analysis is expected to enable the identification of networks that are well-suited for computation and the classification of networks as perturbed or healthy.
△ Less
Submitted 4 July, 2019;
originally announced July 2019.
-
DeepTEGINN: Deep Learning Based Tools to Extract Graphs from Images of Neural Networks
Authors:
Gustavo Borges Moreno e Mello,
Vibeke Devold Valderhaug,
Sidney Pontes-Filho,
Evi Zouganeli,
Ioanna Sandvig,
Stefano Nichele
Abstract:
In the brain, the structure of a network of neurons defines how these neurons implement the computations that underlie the mind and the behavior of animals and humans. Provided that we can describe the network of neurons as a graph, we can employ methods from graph theory to investigate its structure or use cellular automata to mathematically assess its function. Although, software for the analysi…
▽ More
In the brain, the structure of a network of neurons defines how these neurons implement the computations that underlie the mind and the behavior of animals and humans. Provided that we can describe the network of neurons as a graph, we can employ methods from graph theory to investigate its structure or use cellular automata to mathematically assess its function. Although, software for the analysis of graphs and cellular automata are widely available. Graph extraction from the image of networks of brain cells remains difficult. Nervous tissue is heterogeneous, and differences in anatomy may reflect relevant differences in function. Here we introduce a deep learning based toolbox to extracts graphs from images of brain tissue. This toolbox provides an easy-to-use framework allowing system neuroscientists to generate graphs based on images of brain tissue by combining methods from image processing, deep learning, and graph theory. The goals are to simplify the training and usage of deep learning methods for computer vision and facilitate its integration into graph extraction pipelines. In this way, the toolbox provides an alternative to the required laborious manual process of tracing, sorting and classifying. We expect to democratize the machine learning methods to a wider community of users beyond the computer vision experts and improve the time-efficiency of graph extraction from large brain image datasets, which may lead to further understanding of the human mind.
△ Less
Submitted 1 July, 2019;
originally announced July 2019.
