-
Iterated Relevance Matrix Analysis (IRMA) for the identification of class-discriminative subspaces
Authors:
Sofie Lövdal,
Michael Biehl
Abstract:
We introduce and investigate the iterated application of Generalized Matrix Learning Vector Quantizaton for the analysis of feature relevances in classification problems, as well as for the construction of class-discriminative subspaces. The suggested Iterated Relevance Matrix Analysis (IRMA) identifies a linear subspace representing the classification specific information of the considered data s…
▽ More
We introduce and investigate the iterated application of Generalized Matrix Learning Vector Quantizaton for the analysis of feature relevances in classification problems, as well as for the construction of class-discriminative subspaces. The suggested Iterated Relevance Matrix Analysis (IRMA) identifies a linear subspace representing the classification specific information of the considered data sets using Generalized Matrix Learning Vector Quantization (GMLVQ). By iteratively determining a new discriminative subspace while projecting out all previously identified ones, a combined subspace carrying all class-specific information can be found. This facilitates a detailed analysis of feature relevances, and enables improved low-dimensional representations and visualizations of labeled data sets. Additionally, the IRMA-based class-discriminative subspace can be used for dimensionality reduction and the training of robust classifiers with potentially improved performance.
△ Less
Submitted 23 January, 2024;
originally announced January 2024.
-
Interpreting systems as solving POMDPs: a step towards a formal understanding of agency
Authors:
Martin Biehl,
Nathaniel Virgo
Abstract:
Under what circumstances can a system be said to have beliefs and goals, and how do such agency-related features relate to its physical state? Recent work has proposed a notion of interpretation map, a function that maps the state of a system to a probability distribution representing its beliefs about an external world. Such a map is not completely arbitrary, as the beliefs it attributes to the s…
▽ More
Under what circumstances can a system be said to have beliefs and goals, and how do such agency-related features relate to its physical state? Recent work has proposed a notion of interpretation map, a function that maps the state of a system to a probability distribution representing its beliefs about an external world. Such a map is not completely arbitrary, as the beliefs it attributes to the system must evolve over time in a manner that is consistent with Bayes' theorem, and consequently the dynamics of a system constrain its possible interpretations. Here we build on this approach, proposing a notion of interpretation not just in terms of beliefs but in terms of goals and actions. To do this we make use of the existing theory of partially observable Markov processes (POMDPs): we say that a system can be interpreted as a solution to a POMDP if it not only admits an interpretation map describing its beliefs about the hidden state of a POMDP but also takes actions that are optimal according to its belief state. An agent is then a system together with an interpretation of this system as a POMDP solution. Although POMDPs are not the only possible formulation of what it means to have a goal, this nevertheless represents a step towards a more general formal definition of what it means for a system to be an agent.
△ Less
Submitted 4 September, 2022;
originally announced September 2022.
-
A machine learning based approach to gravitational lens identification with the International LOFAR Telescope
Authors:
S. Rezaei,
J. P. McKean,
M. Biehl,
W. de Roo1,
A. Lafontaine
Abstract:
We present a novel machine learning based approach for detecting galaxy-scale gravitational lenses from interferometric data, specifically those taken with the International LOFAR Telescope (ILT), which is observing the northern radio sky at a frequency of 150 MHz, an angular resolution of 350 mas and a sensitivity of 90 uJy beam-1 (1 sigma). We develop and test several Convolutional Neural Networ…
▽ More
We present a novel machine learning based approach for detecting galaxy-scale gravitational lenses from interferometric data, specifically those taken with the International LOFAR Telescope (ILT), which is observing the northern radio sky at a frequency of 150 MHz, an angular resolution of 350 mas and a sensitivity of 90 uJy beam-1 (1 sigma). We develop and test several Convolutional Neural Networks to determine the probability and uncertainty of a given sample being classified as a lensed or non-lensed event. By training and testing on a simulated interferometric imaging data set that includes realistic lensed and non-lensed radio sources, we find that it is possible to recover 95.3 per cent of the lensed samples (true positive rate), with a contamination of just 0.008 per cent from non-lensed samples (false positive rate). Taking the expected lensing probability into account results in a predicted sample purity for lensed events of 92.2 per cent. We find that the network structure is most robust when the maximum image separation between the lensed images is greater than 3 times the synthesized beam size, and the lensed images have a total flux density that is equivalent to at least a 20 sigma (point-source) detection. For the ILT, this corresponds to a lens sample with Einstein radii greater than 0.5 arcsec and a radio source population with 150 MHz flux densities more than 2 mJy. By applying these criteria and our lens detection algorithm we expect to discover the vast majority of galaxy-scale gravitational lens systems contained within the LOFAR Two Metre Sky Survey.
△ Less
Submitted 21 July, 2022;
originally announced July 2022.
-
Interpretable Models Capable of Handling Systematic Missingness in Imbalanced Classes and Heterogeneous Datasets
Authors:
Sreejita Ghosh,
Elizabeth S. Baranowski,
Michael Biehl,
Wiebke Arlt,
Peter Tino,
Kerstin Bunte
Abstract:
Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among application domain experts. Medical datasets face common issues such as heterogeneous measurements, imbalanced classes with limited sample size, and missing data, which h…
▽ More
Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among application domain experts. Medical datasets face common issues such as heterogeneous measurements, imbalanced classes with limited sample size, and missing data, which hinder the straightforward application of machine learning techniques. In this paper we present a family of prototype-based (PB) interpretable models which are capable of handling these issues. The models introduced in this contribution show comparable or superior performance to alternative techniques applicable in such situations. However, unlike ensemble based models, which have to compromise on easy interpretation, the PB models here do not. Moreover we propose a strategy of harnessing the power of ensembles while maintaining the intrinsic interpretability of the PB models, by averaging the model parameter manifolds. All the models were evaluated on a synthetic (publicly available dataset) in addition to detailed analyses of two real-world medical datasets (one publicly available). Results indicated that the models and strategies we introduced addressed the challenges of real-world medical data, while remaining computationally inexpensive and transparent, as well as similar or superior in performance compared to their alternatives.
△ Less
Submitted 4 June, 2022;
originally announced June 2022.
-
Interpreting Dynamical Systems as Bayesian Reasoners
Authors:
Nathaniel Virgo,
Martin Biehl,
Simon McGregor
Abstract:
A central concept in active inference is that the internal states of a physical system parametrise probability measures over states of the external world. These can be seen as an agent's beliefs, expressed as a Bayesian prior or posterior. Here we begin the development of a general theory that would tell us when it is appropriate to interpret states as representing beliefs in this way. We focus on…
▽ More
A central concept in active inference is that the internal states of a physical system parametrise probability measures over states of the external world. These can be seen as an agent's beliefs, expressed as a Bayesian prior or posterior. Here we begin the development of a general theory that would tell us when it is appropriate to interpret states as representing beliefs in this way. We focus on the case in which a system can be interpreted as performing either Bayesian filtering or Bayesian inference. We provide formal definitions of what it means for such an interpretation to exist, using techniques from category theory.
△ Less
Submitted 27 December, 2021;
originally announced December 2021.
-
DECORAS: detection and characterization of radio-astronomical sources using deep learning
Authors:
S. Rezaei,
J. P. McKean,
M. Biehl,
A. Javadpour
Abstract:
We present DECORAS, a deep learning based approach to detect both point and extended sources from Very Long Baseline Interferometry (VLBI) observations. Our approach is based on an encoder-decoder neural network architecture that uses a low number of convolutional layers to provide a scalable solution for source detection. In addition, DECORAS performs source characterization in terms of the posit…
▽ More
We present DECORAS, a deep learning based approach to detect both point and extended sources from Very Long Baseline Interferometry (VLBI) observations. Our approach is based on an encoder-decoder neural network architecture that uses a low number of convolutional layers to provide a scalable solution for source detection. In addition, DECORAS performs source characterization in terms of the position, effective radius and peak brightness of the detected sources. We have trained and tested the network with images that are based on realistic Very Long Baseline Array (VLBA) observations at 20 cm. Also, these images have not gone through any prior de-convolution step and are directly related to the visibility data via a Fourier transform. We find that the source catalog generated by DECORAS has a better overall completeness and purity, when compared to a traditional source detection algorithm. DECORAS is complete at the 7.5$σ$ level, and has an almost factor of two improvement in reliability at 5.5$σ$. We find that DECORAS can recover the position of the detected sources to within 0.61 $\pm$ 0.69 mas, and the effective radius and peak surface brightness are recovered to within 20 per cent for 98 and 94 per cent of the sources, respectively. Overall, we find that DECORAS provides a reliable source detection and characterization solution for future wide-field VLBI surveys.
△ Less
Submitted 21 September, 2021; v1 submitted 19 September, 2021;
originally announced September 2021.
-
Experimental Evidence that Empowerment May Drive Exploration in Sparse-Reward Environments
Authors:
Francesco Massari,
Martin Biehl,
Lisa Meeden,
Ryota Kanai
Abstract:
Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the agent based on certain features of the current sensor state. An intrinsic reward function based on the principle of empowerment assigns rewards proportional to the…
▽ More
Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the agent based on certain features of the current sensor state. An intrinsic reward function based on the principle of empowerment assigns rewards proportional to the amount of control the agent has over its own sensors. We implemented a variation on a recently proposed intrinsically motivated agent, which we refer to as the 'curious' agent, and an empowerment-inspired agent. The former leverages sensor state encoding with a variational autoencoder, while the latter predicts the next sensor state via a variational information bottleneck. We compared the performance of both agents to that of an advantage actor-critic baseline in four sparse reward grid worlds. Both the empowerment agent and its curious competitor seem to benefit to similar extents from their intrinsic rewards. This provides some experimental support to the conjecture that empowerment can be used to drive exploration.
△ Less
Submitted 14 July, 2021;
originally announced July 2021.
-
Non-trivial informational closure of a Bayesian hyperparameter
Authors:
Martin Biehl,
Ryota Kanai
Abstract:
We investigate the non-trivial informational closure (NTIC) of a Bayesian hyperparameter inferring the underlying distribution of an identically and independently distributed finite random variable. For this we embed both the Bayesian hyper-parameter updating process and the random data process into a Markov chain. The original publication by Bertschinger et al. (2006) mentioned that NTIC may be a…
▽ More
We investigate the non-trivial informational closure (NTIC) of a Bayesian hyperparameter inferring the underlying distribution of an identically and independently distributed finite random variable. For this we embed both the Bayesian hyper-parameter updating process and the random data process into a Markov chain. The original publication by Bertschinger et al. (2006) mentioned that NTIC may be able to capture an abstract notion of modeling that is agnostic to the specific internal structure of and existence of explicit representations within the modeling process. The Bayesian hyperparameter is of interest since it has a well defined interpretation as a model of the data process and at the same time its dynamics can be specified without reference to this interpretation. On the one hand we show explicitly that the NTIC of the hyperparameter increases indefinitely over time. On the other hand we attempt to establish a connection between a quantity that is a feature of the interpretation of the hyperparameter as a model, namely the information gain, and the one-step pointwise NTIC which is a quantity that does not depend on this interpretation. We find that in general we cannot use the one-step pointwise NTIC as an indicator for information gain. We hope this exploratory work can lead to further rigorous studies of the relation between NTIC and modeling.
△ Less
Submitted 5 October, 2020;
originally announced October 2020.
-
Complex-valued embeddings of generic proximity data
Authors:
Maximilian Münch,
Michiel Straat,
Michael Biehl,
Frank-Michael Schleif
Abstract:
Proximities are at the heart of almost all machine learning methods. If the input data are given as numerical vectors of equal lengths, euclidean distance, or a Hilbertian inner product is frequently used in modeling algorithms. In a more generic view, objects are compared by a (symmetric) similarity or dissimilarity measure, which may not obey particular mathematical properties. This renders many…
▽ More
Proximities are at the heart of almost all machine learning methods. If the input data are given as numerical vectors of equal lengths, euclidean distance, or a Hilbertian inner product is frequently used in modeling algorithms. In a more generic view, objects are compared by a (symmetric) similarity or dissimilarity measure, which may not obey particular mathematical properties. This renders many machine learning methods invalid, leading to convergence problems and the loss of guarantees, like generalization bounds. In many cases, the preferred dissimilarity measure is not metric, like the earth mover distance, or the similarity measure may not be a simple inner product in a Hilbert space but in its generalization a Krein space. If the input data are non-vectorial, like text sequences, proximity-based learning is used or ngram embedding techniques can be applied. Standard embeddings lead to the desired fixed-length vector encoding, but are costly and have substantial limitations in preserving the original data's full information. As an information preserving alternative, we propose a complex-valued vector embedding of proximity data. This allows suitable machine learning algorithms to use these fixed-length, complex-valued vectors for further processing. The complex-valued data can serve as an input to complex-valued machine learning algorithms. In particular, we address supervised learning and use extensions of prototype-based learning. The proposed approach is evaluated on a variety of standard benchmarks and shows strong performance compared to traditional techniques in processing non-metric or non-psd proximity data.
△ Less
Submitted 31 August, 2020;
originally announced August 2020.
-
Causal blankets: Theory and algorithmic framework
Authors:
Fernando E. Rosas,
Pedro A. M. Mediano,
Martin Biehl,
Shamil Chandaria,
Daniel Polani
Abstract:
We introduce a novel framework to identify perception-action loops (PALOs) directly from data based on the principles of computational mechanics. Our approach is based on the notion of causal blanket, which captures sensory and active variables as dynamical sufficient statistics -- i.e. as the "differences that make a difference." Moreover, our theory provides a broadly applicable procedure to con…
▽ More
We introduce a novel framework to identify perception-action loops (PALOs) directly from data based on the principles of computational mechanics. Our approach is based on the notion of causal blanket, which captures sensory and active variables as dynamical sufficient statistics -- i.e. as the "differences that make a difference." Moreover, our theory provides a broadly applicable procedure to construct PALOs that requires neither a steady-state nor Markovian dynamics. Using our theory, we show that every bipartite stochastic process has a causal blanket, but the extent to which this leads to an effective PALO formulation varies depending on the integrated information of the bipartition.
△ Less
Submitted 29 September, 2020; v1 submitted 28 August, 2020;
originally announced August 2020.
-
Supervised Learning in the Presence of Concept Drift: A modelling framework
Authors:
Michiel Straat,
Fthi Abadi,
Zhuoyun Kan,
Christina Göpfert,
Barbara Hammer,
Michael Biehl
Abstract:
We present a modelling framework for the investigation of supervised learning in non-stationary environments. Specifically, we model two example types of learning systems: prototype-based Learning Vector Quantization (LVQ) for classification and shallow, layered neural networks for regression tasks. We investigate so-called student teacher scenarios in which the systems are trained from a stream o…
▽ More
We present a modelling framework for the investigation of supervised learning in non-stationary environments. Specifically, we model two example types of learning systems: prototype-based Learning Vector Quantization (LVQ) for classification and shallow, layered neural networks for regression tasks. We investigate so-called student teacher scenarios in which the systems are trained from a stream of high-dimensional, labeled data. Properties of the target task are considered to be non-stationary due to drift processes while the training is performed. Different types of concept drift are studied, which affect the density of example inputs only, the target rule itself, or both. By applying methods from statistical physics, we develop a modelling framework for the mathematical analysis of the training dynamics in non-stationary environments.
Our results show that standard LVQ algorithms are already suitable for the training in non-stationary environments to a certain extent. However, the application of weight decay as an explicit mechanism of forgetting does not improve the performance under the considered drift processes. Furthermore, we investigate gradient-based training of layered neural networks with sigmoidal activation functions and compare with the use of rectified linear units (ReLU). Our findings show that the sensitivity to concept drift and the effectiveness of weight decay differs significantly between the two types of activation function.
△ Less
Submitted 27 February, 2021; v1 submitted 21 May, 2020;
originally announced May 2020.
-
A Technical Critique of Some Parts of the Free Energy Principle
Authors:
Martin Biehl,
Felix A. Pollock,
Ryota Kanai
Abstract:
We summarize the original formulation of the free energy principle, and highlight some technical issues. We discuss how these issues affect related results involving generalised coordinates and, where appropriate, mention consequences for and reveal, up to now unacknowledged, differences to newer formulations of the free energy principle. In particular, we reveal that various definitions of the "M…
▽ More
We summarize the original formulation of the free energy principle, and highlight some technical issues. We discuss how these issues affect related results involving generalised coordinates and, where appropriate, mention consequences for and reveal, up to now unacknowledged, differences to newer formulations of the free energy principle. In particular, we reveal that various definitions of the "Markov blanket" proposed in different works are not equivalent. We show that crucial steps in the free energy argument which involve rewriting the equations of motion of systems with Markov blankets, are not generally correct without additional (previously unstated) assumptions. We prove by counterexample that the original free energy lemma, when taken at face value, is wrong. We show further that this free energy lemma, when it does hold, implies equality of variational density and ergodic conditional density. The interpretation in terms of Bayesian inference hinges on this point, and we hence conclude that it is not sufficiently justified. Additionally, we highlight that the variational densities presented in newer formulations of the free energy principle and lemma are parameterised by different variables than in older works, leading to a substantially different interpretation of the theory. Note that we only highlight some specific problems in the discussed publications. These problems do not rule out conclusively that the general ideas behind the free energy principle are worth pursuing.
△ Less
Submitted 28 February, 2021; v1 submitted 12 January, 2020;
originally announced January 2020.
-
Feature Relevance Determination for Ordinal Regression in the Context of Feature Redundancies and Privileged Information
Authors:
Lukas Pfannschmidt,
Jonathan Jakob,
Fabian Hinder,
Michael Biehl,
Peter Tino,
Barbara Hammer
Abstract:
Advances in machine learning technologies have led to increasingly powerful models in particular in the context of big data. Yet, many application scenarios demand for robustly interpretable models rather than optimum model accuracy; as an example, this is the case if potential biomarkers or causal factors should be discovered based on a set of given measurements. In this contribution, we focus on…
▽ More
Advances in machine learning technologies have led to increasingly powerful models in particular in the context of big data. Yet, many application scenarios demand for robustly interpretable models rather than optimum model accuracy; as an example, this is the case if potential biomarkers or causal factors should be discovered based on a set of given measurements. In this contribution, we focus on feature selection paradigms, which enable us to uncover relevant factors of a given regularity based on a sparse model. We focus on the important specific setting of linear ordinal regression, i.e.\ data have to be ranked into one of a finite number of ordered categories by a linear projection. Unlike previous work, we consider the case that features are potentially redundant, such that no unique minimum set of relevant features exists. We aim for an identification of all strongly and all weakly relevant features as well as their type of relevance (strong or weak); we achieve this goal by determining feature relevance bounds, which correspond to the minimum and maximum feature relevance, respectively, if searched over all equivalent models. In addition, we discuss how this setting enables us to substitute some of the features, e.g.\ due to their semantics, and how to extend the framework of feature relevance intervals to the setting of privileged information, i.e.\ potentially relevant information is available for training purposes only, but cannot be used for the prediction itself.
△ Less
Submitted 10 December, 2019;
originally announced December 2019.
-
Hidden Unit Specialization in Layered Neural Networks: ReLU vs. Sigmoidal Activation
Authors:
Elisa Oostwal,
Michiel Straat,
Michael Biehl
Abstract:
We study layered neural networks of rectified linear units (ReLU) in a modelling framework for stochastic training processes. The comparison with sigmoidal activation functions is in the center of interest. We compute typical learning curves for shallow networks with K hidden units in matching student teacher scenarios. The systems exhibit sudden changes of the generalization performance via the p…
▽ More
We study layered neural networks of rectified linear units (ReLU) in a modelling framework for stochastic training processes. The comparison with sigmoidal activation functions is in the center of interest. We compute typical learning curves for shallow networks with K hidden units in matching student teacher scenarios. The systems exhibit sudden changes of the generalization performance via the process of hidden unit specialization at critical sizes of the training set. Surprisingly, our results show that the training behavior of ReLU networks is qualitatively different from that of networks with sigmoidal activations. In networks with K >= 3 sigmoidal hidden units, the transition is discontinuous: Specialized network configurations co-exist and compete with states of poor performance even for very large training sets. On the contrary, the use of ReLU activations results in continuous transitions for all K: For large enough training sets, two competing, differently specialized states display similar generalization abilities, which coincide exactly for large networks in the limit K to infinity.
△ Less
Submitted 27 May, 2020; v1 submitted 16 October, 2019;
originally announced October 2019.
-
Information Closure Theory of Consciousness
Authors:
Acer Y. C. Chang,
Martin Biehl,
Yen Yu,
Ryota Kanai
Abstract:
Information processing in neural systems can be described and analysed at multiple spatiotemporal scales. Generally, information at lower levels is more fine-grained and can be coarse-grained in higher levels. However, information processed only at specific levels seems to be available for conscious awareness. We do not have direct experience of information available at the level of individual neu…
▽ More
Information processing in neural systems can be described and analysed at multiple spatiotemporal scales. Generally, information at lower levels is more fine-grained and can be coarse-grained in higher levels. However, information processed only at specific levels seems to be available for conscious awareness. We do not have direct experience of information available at the level of individual neurons, which is noisy and highly stochastic. Neither do we have experience of more macro-level interactions such as interpersonal communications. Neurophysiological evidence suggests that conscious experiences co-vary with information encoded in coarse-grained neural states such as the firing pattern of a population of neurons. In this article, we introduce a new informational theory of consciousness: Information Closure Theory of Consciousness (ICT). We hypothesise that conscious processes are processes which form non-trivial informational closure (NTIC) with respect to the environment at certain coarse-grained levels. This hypothesis implies that conscious experience is confined due to informational closure from conscious processing to other coarse-grained levels. ICT proposes new quantitative definitions of both conscious content and conscious level. With the parsimonious definitions and a hypothesise, ICT provides explanations and predictions of various phenomena associated with consciousness. The implications of ICT naturally reconciles issues in many existing theories of consciousness and provides explanations for many of our intuitions about consciousness. Most importantly, ICT demonstrates that information can be the common language between consciousness and physical reality.
△ Less
Submitted 11 June, 2020; v1 submitted 28 September, 2019;
originally announced September 2019.
-
Galaxy classification: A machine learning analysis of GAMA catalogue data
Authors:
Aleke Nolte,
Lingyu Wang,
Maciej Bilicki,
Benne Holwerda,
Michael Biehl
Abstract:
We present a machine learning analysis of five labelled galaxy catalogues from the Galaxy And Mass Assembly (GAMA): The SersicCatVIKING and SersicCatUKIDSS catalogues containing morphological features, the GaussFitSimple catalogue containing spectroscopic features, the MagPhys catalogue including physical parameters for galaxies, and the Lambdar catalogue, which contains photometric measurements.…
▽ More
We present a machine learning analysis of five labelled galaxy catalogues from the Galaxy And Mass Assembly (GAMA): The SersicCatVIKING and SersicCatUKIDSS catalogues containing morphological features, the GaussFitSimple catalogue containing spectroscopic features, the MagPhys catalogue including physical parameters for galaxies, and the Lambdar catalogue, which contains photometric measurements. Extending work previously presented at the ESANN 2018 conference - in an analysis based on Generalized Relevance Matrix Learning Vector Quantization and Random Forests - we find that neither the data from the individual catalogues nor a combined dataset based on all 5 catalogues fully supports the visual-inspection-based galaxy classification scheme employed to categorise the galaxies. In particular, only one class, the Little Blue Spheroids, is consistently separable from the other classes. To aid further insight into the nature of the employed visual-based classification scheme with respect to physical and morphological features, we present the galaxy parameters that are discriminative for the achieved class distinctions.
△ Less
Submitted 18 March, 2019;
originally announced March 2019.
-
On-line learning dynamics of ReLU neural networks using statistical physics techniques
Authors:
Michiel Straat,
Michael Biehl
Abstract:
We introduce exact macroscopic on-line learning dynamics of two-layer neural networks with ReLU units in the form of a system of differential equations, using techniques borrowed from statistical physics. For the first experiments, numerical solutions reveal similar behavior compared to sigmoidal activation researched in earlier work. In these experiments the theoretical results show good correspo…
▽ More
We introduce exact macroscopic on-line learning dynamics of two-layer neural networks with ReLU units in the form of a system of differential equations, using techniques borrowed from statistical physics. For the first experiments, numerical solutions reveal similar behavior compared to sigmoidal activation researched in earlier work. In these experiments the theoretical results show good correspondence with simulations. In ove-rrealizable and unrealizable learning scenarios, the learning behavior of ReLU networks shows distinctive characteristics compared to sigmoidal networks.
△ Less
Submitted 18 March, 2019;
originally announced March 2019.
-
Prototype-based classifiers in the presence of concept drift: A modelling framework
Authors:
Michael Biehl,
Fthi Abadi,
Christina Göpfert,
Barbara Hammer
Abstract:
We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered data.We consider standard winner-takes-all updates known as LVQ1. Statistical properties of the input data change on the time scale defined by the training process…
▽ More
We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered data.We consider standard winner-takes-all updates known as LVQ1. Statistical properties of the input data change on the time scale defined by the training process. We apply analytical methods borrowed from statistical physics which have been used earlier for the exact description of learning in stationary environments. The suggested framework facilitates the computation of learning curves in the presence of virtual and real concept drift. Here we focus on timedependent class bias in the training data. First results demonstrate that, while basic LVQ algorithms are suitable for the training in non-stationary environments, weight decay as an explicit mechanism of forgetting does not improve the performance under the considered drift processes.
△ Less
Submitted 18 March, 2019;
originally announced March 2019.
-
Feature Relevance Bounds for Ordinal Regression
Authors:
Lukas Pfannschmidt,
Jonathan Jakob,
Michael Biehl,
Peter Tino,
Barbara Hammer
Abstract:
The increasing occurrence of ordinal data, mainly sociodemographic, led to a renewed research interest in ordinal regression, i.e. the prediction of ordered classes. Besides model accuracy, the interpretation of these models itself is of high relevance, and existing approaches therefore enforce e.g. model sparsity. For high dimensional or highly correlated data, however, this might be misleading d…
▽ More
The increasing occurrence of ordinal data, mainly sociodemographic, led to a renewed research interest in ordinal regression, i.e. the prediction of ordered classes. Besides model accuracy, the interpretation of these models itself is of high relevance, and existing approaches therefore enforce e.g. model sparsity. For high dimensional or highly correlated data, however, this might be misleading due to strong variable dependencies. In this contribution, we aim for an identification of feature relevance bounds which - besides identifying all relevant features - explicitly differentiates between strongly and weakly relevant features.
△ Less
Submitted 20 February, 2019;
originally announced February 2019.
-
Geometry of Friston's active inference
Authors:
Martin Biehl
Abstract:
We reconstruct Karl Friston's active inference and give a geometrical interpretation of it.
We reconstruct Karl Friston's active inference and give a geometrical interpretation of it.
△ Less
Submitted 20 November, 2018;
originally announced November 2018.
-
Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop
Authors:
Martin Biehl,
Christian Guckelsberger,
Christoph Salge,
Simón C. Smith,
Daniel Polani
Abstract:
Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena, including consciousness. In active inference, action selection is driven by an objective function that evaluates possible future actions with respect to current, inf…
▽ More
Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena, including consciousness. In active inference, action selection is driven by an objective function that evaluates possible future actions with respect to current, inferred beliefs about the world. Active inference at its core is independent from extrinsic rewards, resulting in a high level of robustness across e.g.\ different environments or agent morphologies. In the literature, paradigms that share this independence have been summarised under the notion of intrinsic motivations. In general and in contrast to active inference, these models of motivation come without a commitment to particular inference and action selection mechanisms. In this article, we study if the inference and action selection machinery of active inference can also be used by alternatives to the originally included intrinsic motivation. The perception-action loop explicitly relates inference and action selection to the environment and agent memory, and is consequently used as foundation for our analysis. We reconstruct the active inference approach, locate the original formulation within, and show how alternative intrinsic motivations can be used while keeping many of the original features intact. Furthermore, we illustrate the connection to universal reinforcement learning by means of our formalism. Active inference research may profit from comparisons of the dynamics induced by alternative intrinsic motivations. Research on intrinsic motivations may profit from an additional way to implement intrinsically motivated agents that also share the biological plausibility of active inference.
△ Less
Submitted 21 June, 2018;
originally announced June 2018.
-
Being curious about the answers to questions: novelty search with learned attention
Authors:
Nicholas Guttenberg,
Martin Biehl,
Nathaniel Virgo,
Ryota Kanai
Abstract:
We investigate the use of attentional neural network layers in order to learn a `behavior characterization' which can be used to drive novelty search and curiosity-based policies. The space is structured towards answering a particular distribution of questions, which are used in a supervised way to train the attentional neural network. We find that in a 2d exploration task, the structure of the sp…
▽ More
We investigate the use of attentional neural network layers in order to learn a `behavior characterization' which can be used to drive novelty search and curiosity-based policies. The space is structured towards answering a particular distribution of questions, which are used in a supervised way to train the attentional neural network. We find that in a 2d exploration task, the structure of the space successfully encodes local sensory-motor contingencies such that even a greedy local `do the most novel action' policy with no reinforcement learning or evolution can explore the space quickly. We also apply this to a high/low number guessing game task, and find that guessing according to the learned attention profile performs active inference and can discover the correct number more quickly than an exact but passive approach.
△ Less
Submitted 1 June, 2018;
originally announced June 2018.
-
Learning body-affordances to simplify action spaces
Authors:
Nicholas Guttenberg,
Martin Biehl,
Ryota Kanai
Abstract:
Controlling embodied agents with many actuated degrees of freedom is a challenging task. We propose a method that can discover and interpolate between context dependent high-level actions or body-affordances. These provide an abstract, low-dimensional interface indexing high-dimensional and time- extended action policies. Our method is related to recent ap- proaches in the machine learning literat…
▽ More
Controlling embodied agents with many actuated degrees of freedom is a challenging task. We propose a method that can discover and interpolate between context dependent high-level actions or body-affordances. These provide an abstract, low-dimensional interface indexing high-dimensional and time- extended action policies. Our method is related to recent ap- proaches in the machine learning literature but is conceptually simpler and easier to implement. More specifically our method requires the choice of a n-dimensional target sensor space that is endowed with a distance metric. The method then learns an also n-dimensional embedding of possibly reactive body-affordances that spread as far as possible throughout the target sensor space.
△ Less
Submitted 15 August, 2017;
originally announced August 2017.
-
Action and perception for spatiotemporal patterns
Authors:
Martin Biehl,
Daniel Polani
Abstract:
This is a contribution to the formalization of the concept of agents in multivariate Markov chains. Agents are commonly defined as entities that act, perceive, and are goal-directed. In a multivariate Markov chain (e.g. a cellular automaton) the transition matrix completely determines the dynamics. This seems to contradict the possibility of acting entities within such a system. Here we present de…
▽ More
This is a contribution to the formalization of the concept of agents in multivariate Markov chains. Agents are commonly defined as entities that act, perceive, and are goal-directed. In a multivariate Markov chain (e.g. a cellular automaton) the transition matrix completely determines the dynamics. This seems to contradict the possibility of acting entities within such a system. Here we present definitions of actions and perceptions within multivariate Markov chains based on entity-sets. Entity-sets represent a largely independent choice of a set of spatiotemporal patterns that are considered as all the entities within the Markov chain. For example, the entity-set can be chosen according to operational closure conditions or complete specific integration. Importantly, the perception-action loop also induces an entity-set and is a multivariate Markov chain. We then show that our definition of actions leads to non-heteronomy and that of perceptions specialize to the usual concept of perception in the perception-action loop.
△ Less
Submitted 12 June, 2017;
originally announced June 2017.
-
Formal approaches to a definition of agents
Authors:
Martin Biehl
Abstract:
This thesis contributes to the formalisation of the notion of an agent within the class of finite multivariate Markov chains. Agents are seen as entities that act, perceive, and are goal-directed.
We present a new measure that can be used to identify entities (called $ι$-entities), some general requirements for entities in multivariate Markov chains, as well as formal definitions of actions and…
▽ More
This thesis contributes to the formalisation of the notion of an agent within the class of finite multivariate Markov chains. Agents are seen as entities that act, perceive, and are goal-directed.
We present a new measure that can be used to identify entities (called $ι$-entities), some general requirements for entities in multivariate Markov chains, as well as formal definitions of actions and perceptions suitable for such entities.
The intuition behind $ι$-entities is that entities are spatiotemporal patterns for which every part makes every other part more probable. The measure, complete local integration (CLI), is formally investigated in general Bayesian networks. It is based on the specific local integration (SLI) which is measured with respect to a partition. CLI is the minimum value of SLI over all partitions. We prove that $ι$-entities are blocks in specific partitions of the global trajectory. These partitions are the finest partitions that achieve a given SLI value. We also establish the transformation behaviour of SLI under permutations of nodes in the network.
We go on to present three conditions on general definitions of entities. These are not fulfilled by sets of random variables i.e.\ the perception-action loop, which is often used to model agents, is too restrictive. We propose that any general entity definition should in effect specify a subset (called an an entity-set) of the set of all spatiotemporal patterns of a given multivariate Markov chain. The set of $ι$-entities is such a set. Importantly the perception-action loop also induces an entity-set.
We then propose formal definitions of actions and perceptions for arbitrary entity-sets. These specialise to standard notions in case of the perception-action loop entity-set.
Finally we look at some very simple examples.
△ Less
Submitted 10 April, 2017;
originally announced April 2017.
-
Neural Coarse-Graining: Extracting slowly-varying latent degrees of freedom with neural networks
Authors:
Nicholas Guttenberg,
Martin Biehl,
Ryota Kanai
Abstract:
We present a loss function for neural networks that encompasses an idea of trivial versus non-trivial predictions, such that the network jointly determines its own prediction goals and learns to satisfy them. This permits the network to choose sub-sets of a problem which are most amenable to its abilities to focus on solving, while discarding 'distracting' elements that interfere with its learning…
▽ More
We present a loss function for neural networks that encompasses an idea of trivial versus non-trivial predictions, such that the network jointly determines its own prediction goals and learns to satisfy them. This permits the network to choose sub-sets of a problem which are most amenable to its abilities to focus on solving, while discarding 'distracting' elements that interfere with its learning. To do this, the network first transforms the raw data into a higher-level categorical representation, and then trains a predictor from that new time series to its future. To prevent a trivial solution of mapping the signal to zero, we introduce a measure of non-triviality via a contrast between the prediction error of the learned model with a naive model of the overall signal statistics. The transform can learn to discard uninformative and unpredictable components of the signal in favor of the features which are both highly predictive and highly predictable. This creates a coarse-grained model of the time-series dynamics, focusing on predicting the slowly varying latent parameters which control the statistics of the time-series, rather than predicting the fast details directly. The result is a semi-supervised algorithm which is capable of extracting latent parameters, segmenting sections of time-series with differing statistics, and building a higher-level representation of the underlying dynamics from unlabeled data.
△ Less
Submitted 1 September, 2016;
originally announced September 2016.
-
Towards information based spatiotemporal patterns as a foundation for agent representation in dynamical systems
Authors:
Martin Biehl,
Takashi Ikegami,
Daniel Polani
Abstract:
We present some arguments why existing methods for representing agents fall short in applications crucial to artificial life. Using a thought experiment involving a fictitious dynamical systems model of the biosphere we argue that the metabolism, motility, and the concept of counterfactual variation should be compatible with any agent representation in dynamical systems. We then propose an informa…
▽ More
We present some arguments why existing methods for representing agents fall short in applications crucial to artificial life. Using a thought experiment involving a fictitious dynamical systems model of the biosphere we argue that the metabolism, motility, and the concept of counterfactual variation should be compatible with any agent representation in dynamical systems. We then propose an information-theoretic notion of \emph{integrated spatiotemporal patterns} which we believe can serve as the basic building block of an agent definition. We argue that these patterns are capable of solving the problems mentioned before. We also test this in some preliminary experiments.
△ Less
Submitted 18 May, 2016;
originally announced May 2016.
-
Towards designing artificial universes for artificial agents under interaction closure
Authors:
Martin Biehl,
Christoph Salge,
Daniel Polani
Abstract:
We are interested in designing artificial universes for artifi- cial agents. We view artificial agents as networks of high- level processes on top of of a low-level detailed-description system. We require that the high-level processes have some intrinsic explanatory power and we introduce an extension of informational closure namely interaction closure to capture this. Then we derive a method to d…
▽ More
We are interested in designing artificial universes for artifi- cial agents. We view artificial agents as networks of high- level processes on top of of a low-level detailed-description system. We require that the high-level processes have some intrinsic explanatory power and we introduce an extension of informational closure namely interaction closure to capture this. Then we derive a method to design artificial universes in the form of finite Markov chains which exhibit high-level pro- cesses that satisfy the property of interaction closure. We also investigate control or information transfer which we see as an building block for networks representing artificial agents.
△ Less
Submitted 5 June, 2014;
originally announced June 2014.
-
A Behavioural Perspective on the Early Evolution of Nervous Systems: A Computational Model of Excitable Myoepithelia
Authors:
Ronald A. J. van Elburg,
Oltman O. de Wiljes,
Michael Biehl,
Fred A. Keijzer
Abstract:
How the very first nervous systems evolved remains a fundamental open question. Molecular and genomic techniques have revolutionized our knowledge of the molecular ingredients behind this transition but not yet provided a clear picture of the morphological and tissue changes involved. Here we focus on a behavioural perspective that centres on movement by muscle contraction. Building on the finding…
▽ More
How the very first nervous systems evolved remains a fundamental open question. Molecular and genomic techniques have revolutionized our knowledge of the molecular ingredients behind this transition but not yet provided a clear picture of the morphological and tissue changes involved. Here we focus on a behavioural perspective that centres on movement by muscle contraction. Building on the finding that molecules for chemical neural signalling predate multicellular animals, we investigate a gradual evolutionary scenario for nervous systems that consists of two stages: A) Chemically transmission of electrical activity between adjacent cells provided a primitive form of muscle coordination in a contractile epithelial tissue. B) This primitive form of coordination was subsequently improved upon by evolving the axodendritic processes of modern neurons. We use computer simulations to investigate the first stage. The simulations show that chemical transmission across a contractile sheet can indeed produce useful body scale patterns, but only for small-sized animals. For larger animals the noise in chemical neural signalling interferes. Our results imply that a two-stage scenario is a viable approach to nervous system evolution. The first stage could provide an initial behavioural advantage, as well as a clear scaffold for subsequent improvements in behavioural coordination.
△ Less
Submitted 14 December, 2012;
originally announced December 2012.
-
How to Evaluate Dimensionality Reduction? - Improving the Co-ranking Matrix
Authors:
Wouter Lueks,
Bassam Mokbel,
Michael Biehl,
Barbara Hammer
Abstract:
The growing number of dimensionality reduction methods available for data visualization has recently inspired the development of quality assessment measures, in order to evaluate the resulting low-dimensional representation independently from a methods' inherent criteria. Several (existing) quality measures can be (re)formulated based on the so-called co-ranking matrix, which subsumes all rank err…
▽ More
The growing number of dimensionality reduction methods available for data visualization has recently inspired the development of quality assessment measures, in order to evaluate the resulting low-dimensional representation independently from a methods' inherent criteria. Several (existing) quality measures can be (re)formulated based on the so-called co-ranking matrix, which subsumes all rank errors (i.e. differences between the ranking of distances from every point to all others, comparing the low-dimensional representation to the original data). The measures are often based on the partioning of the co-ranking matrix into 4 submatrices, divided at the K-th row and column, calculating a weighted combination of the sums of each submatrix. Hence, the evaluation process typically involves plotting a graph over several (or even all possible) settings of the parameter K. Considering simple artificial examples, we argue that this parameter controls two notions at once, that need not necessarily be combined, and that the rectangular shape of submatrices is disadvantageous for an intuitive interpretation of the parameter. We debate that quality measures, as general and flexible evaluation tools, should have parameters with a direct and intuitive interpretation as to which specific error types are tolerated or penalized. Therefore, we propose to replace K with two parameters to control these notions separately, and introduce a differently shaped weighting on the co-ranking matrix. The two new parameters can then directly be interpreted as a threshold up to which rank errors are tolerated, and a threshold up to which the rank-distances are significant for the evaluation. Moreover, we propose a color representation of local quality to visually support the evaluation process for a given mapping, where every point in the mapping is colored according to its local contribution to the overall quality.
△ Less
Submitted 18 October, 2011;
originally announced October 2011.
-
A LOFAR RFI detection pipeline and its first results
Authors:
A. R. Offringa,
A. G. de Bruyn,
S. Zaroubi,
M. Biehl
Abstract:
Radio astronomy is entering a new era with new and future radio observatories such as the Low Frequency Array and the Square Kilometer Array. We describe in detail an automated flagging pipeline and evaluate its performance. With only a fraction of the computational cost of correlation and its use of the previously introduced SumThreshold method, it is found to be both fast and unrivalled in its h…
▽ More
Radio astronomy is entering a new era with new and future radio observatories such as the Low Frequency Array and the Square Kilometer Array. We describe in detail an automated flagging pipeline and evaluate its performance. With only a fraction of the computational cost of correlation and its use of the previously introduced SumThreshold method, it is found to be both fast and unrivalled in its high accuracy. The LOFAR radio environment is analysed with the help of this pipeline. The high time and spectral resolution of LOFAR have resulted in an observatory where only a few percent of the data is lost due to RFI.
△ Less
Submitted 15 July, 2010; v1 submitted 13 July, 2010;
originally announced July 2010.
-
Post-correlation radio frequency interference classification methods
Authors:
A. R. Offringa,
A. G. de Bruyn,
M. Biehl,
S. Zaroubi,
G. Bernardi,
V. N. Pandey
Abstract:
We describe and compare several post-correlation radio frequency interference classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for radio frequency interference mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is…
▽ More
We describe and compare several post-correlation radio frequency interference classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for radio frequency interference mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is the SumThreshold method. This is a new method formed from a combination of existing techniques, including a new way of thresholding. This iterative method estimates the astronomical signal by carrying out a surface fit in the time-frequency plane. With a theoretical accuracy of 95% recognition and an approximately 0.1% false probability rate in simple simulated cases, the method is in practice as good as the human eye in finding RFI. In addition it is fast, robust, does not need a data model before it can be executed and works in almost all configurations with its default parameters. The method has been compared using simulated data with several other mitigation techniques, including one based upon the singular value decomposition of the time-frequency matrix, and has shown better results than the rest.
△ Less
Submitted 9 February, 2010;
originally announced February 2010.
-
Interplay of Strain Relaxation and Chemically Induced Diffusion Barriers: Nanostructure Formation in 2D Alloys
Authors:
T. Volkmann,
F. Much,
M. Biehl,
M. Kotrla
Abstract:
We study the formation of nanostructures with alternating stripes composed of bulk-immiscible adsorbates during submonolayer heteroepitaxy. We evaluate the influence of two mechanisms considered in the literature: (i) strain relaxation by alternating arrangement of the adsorbate species, and (ii) kinetic segregation due to chemically induced diffusion barriers. A model ternary system of two adso…
▽ More
We study the formation of nanostructures with alternating stripes composed of bulk-immiscible adsorbates during submonolayer heteroepitaxy. We evaluate the influence of two mechanisms considered in the literature: (i) strain relaxation by alternating arrangement of the adsorbate species, and (ii) kinetic segregation due to chemically induced diffusion barriers. A model ternary system of two adsorbates with opposite misfit relative to the substrate, and symmetric binding is investigated by off-lattice as well as lattice kinetic Monte Carlo simulations. We find that neither of the mechanisms (i) or (ii) alone can account for known experimental observations. Rather, a combination of both is needed. We present an off-lattice model which allows for a qualitative reproduction of stripe patterns as well as island ramification in agreement with recent experimental observations for CoAg/Ru(0001) [R. Q. Hwang, Phys. Rev. Lett. 76, 4757 (1996)]. The quantitative dependencies of stripe width and degree of island ramification on the misfit and interaction strength between the two adsorbate types are presented. Attempts to capture essential features in a simplified lattice gas model show that a detailed incorporation of non-local effects is required.
△ Less
Submitted 10 November, 2004;
originally announced November 2004.
-
Lattice gas models and Kinetic Monte Carlo simulations of epitaxial growth
Authors:
Michael Biehl
Abstract:
A brief introduction is given to Kinetic Monte Carlo (KMC) simulations of epitaxial crystal growth. Molecular Beam Epitaxy (MBE) serves as the prototype example for growth far from equilibrium. However, many of the aspects discussed hear would carry over to other techniques as well. A variety of approaches to the modeling and simulation of epitaxial growth has been applied. They range from the d…
▽ More
A brief introduction is given to Kinetic Monte Carlo (KMC) simulations of epitaxial crystal growth. Molecular Beam Epitaxy (MBE) serves as the prototype example for growth far from equilibrium. However, many of the aspects discussed hear would carry over to other techniques as well. A variety of approaches to the modeling and simulation of epitaxial growth has been applied. They range from the detailed quantum mechanics treatment of microscopic processes to the coarse grained picture in terms of stochastic differential equations or other continuum approaches. Here, the focus is on discrete representations such as lattice gas and Solid-On-Solid (SOS) models. The basic ideas of the corresponding KMC methods are presented. Strengths and weaknesses become apparent in the discussion of several levels of simplification that are possible in this context.
△ Less
Submitted 29 June, 2004;
originally announced June 2004.
-
Off-lattice Kinetic Monte Carlo simulations of strained heteroepitaxial growth
Authors:
Michael Biehl,
Florian Much,
Christian Vey
Abstract:
An off-lattice, continuous space Kinetic Monte Carlo (KMC) algorithm is discussed and applied in the investigation of strained heteroepitaxial crystal growth. As a starting point, we study a simplifying (1+1)-dimensional situation with inter-atomic interactions given by simple pair-potentials. The model exhibits the appearance of strain-induced misfit dislocations at a characteristic film thickn…
▽ More
An off-lattice, continuous space Kinetic Monte Carlo (KMC) algorithm is discussed and applied in the investigation of strained heteroepitaxial crystal growth. As a starting point, we study a simplifying (1+1)-dimensional situation with inter-atomic interactions given by simple pair-potentials. The model exhibits the appearance of strain-induced misfit dislocations at a characteristic film thickness. In our simulations we observe a power law dependence of this critical thickness on the lattice misfit, which is in agreement with experimental results for semiconductor compounds. We furthermore investigate the emergence of strain induced multilayer islands or "Dots" upon an adsorbate wetting layer in the so-called Stranski-Krastanov (SK) growth mode. At a characteristic kinetic film thickness, a transition from monolayer to multilayer islands occurs. We discuss the microscopic causes of the SK-transition and its dependence on the model parameters, i.e. lattice misfit, growth rate, and substrate temperature.
△ Less
Submitted 27 May, 2004;
originally announced May 2004.
-
Kinetic model of II-VI(001) semiconductor surfaces: Growth rates in atomic layer epitaxy
Authors:
T. Volkmann,
M. Ahr,
M. Biehl
Abstract:
We present a zinc-blende lattice gas model of II-VI(001) surfaces, which is investigated by means of Kinetic Monte Carlo (KMC) simulations. Anisotropic effective interactions between surface metal atoms allow for the description of, e.g., the sublimation of CdTe(001), including the reconstruction of Cd-terminated surfaces and its dependence on the substrate temperature T. Our model also includes…
▽ More
We present a zinc-blende lattice gas model of II-VI(001) surfaces, which is investigated by means of Kinetic Monte Carlo (KMC) simulations. Anisotropic effective interactions between surface metal atoms allow for the description of, e.g., the sublimation of CdTe(001), including the reconstruction of Cd-terminated surfaces and its dependence on the substrate temperature T. Our model also includes Te-dimerization and the potential presence of excess Te in a reservoir of weakly bound atoms at the surface. We study the self-regulation of atomic layer epitaxy (ALE) and demonstrate how the interplay of the reservoir occupation with the surface kinetics results in two different regimes: at high T the growth rate is limited to 0.5 layers per ALE cycle, whereas at low enough T each cycle adds a complete layer of CdTe. The transition between the two regimes occurs at a characteristic temperature and its dependence on external parameters is studied. Comparing the temperature dependence of the ALE growth rate in our model with experimental results for CdTe we find qualitative agreement.
△ Less
Submitted 1 December, 2003; v1 submitted 7 October, 2003;
originally announced October 2003.
-
Off-lattice Kinetic Monte Carlo simulations of Stranski-Krastanov-like growth
Authors:
Michael Biehl,
Florian Much
Abstract:
We investigate strained heteroepitaxial crystal growth in the framework of a simplifying (1+1)-dimensional model by use of off-lattice Kinetic Monte Carlo simulations. Our modified Lennard-Jones system displays the so-called Stranski-Krastanov growth mode: initial pseudomorphic growth ends by the sudden appearance of strain induced multilayer islands upon a persisting wetting layer.
We investigate strained heteroepitaxial crystal growth in the framework of a simplifying (1+1)-dimensional model by use of off-lattice Kinetic Monte Carlo simulations. Our modified Lennard-Jones system displays the so-called Stranski-Krastanov growth mode: initial pseudomorphic growth ends by the sudden appearance of strain induced multilayer islands upon a persisting wetting layer.
△ Less
Submitted 28 July, 2003;
originally announced July 2003.
-
Flat (001) surfaces of II-VI semiconductors: A lattice gas model
Authors:
M. Ahr,
M. Biehl
Abstract:
We present a two-dimensional lattice gas with anisotropic interactions which model the known properties of the surface reconstructions of CdTe and ZnSe. In constrast to an earlier publication [12], the formation of anion dimers is considered. This alters the behaviour of the model considerably. We determine the phase diagram of this model by means of transfer matrix calculations and Monte Carlo…
▽ More
We present a two-dimensional lattice gas with anisotropic interactions which model the known properties of the surface reconstructions of CdTe and ZnSe. In constrast to an earlier publication [12], the formation of anion dimers is considered. This alters the behaviour of the model considerably. We determine the phase diagram of this model by means of transfer matrix calculations and Monte Carlo simulations. We find qualitative agreement with the results of various experimental investigations.
△ Less
Submitted 7 November, 2001;
originally announced November 2001.
-
Modelling (001) surfaces of II-VI semiconductors
Authors:
M. Ahr,
M. Biehl,
T. Volkmann
Abstract:
First, we present a two-dimensional lattice gas model with anisotropic interactions which explains the experimentally observed transition from a dominant c(2x2) ordering of the CdTe(001) surface to a local (2x1) arrangement of the Cd atoms as an equilibrium phase transition. Its analysis by means of transfer-matrix and Monte Carlo techniques shows that the small energy difference of the competin…
▽ More
First, we present a two-dimensional lattice gas model with anisotropic interactions which explains the experimentally observed transition from a dominant c(2x2) ordering of the CdTe(001) surface to a local (2x1) arrangement of the Cd atoms as an equilibrium phase transition. Its analysis by means of transfer-matrix and Monte Carlo techniques shows that the small energy difference of the competing reconstructions determines to a large extent the nature of the different phases. Then, this lattice gas is extended to a model of a three-dimensional crystal which qualitatively reproduces many of the characteristic features of CdTe which have been observed during sublimation and atomic layer epitaxy.
△ Less
Submitted 31 July, 2001;
originally announced July 2001.
-
Kinetic Monte Carlo Simulations of dislocations in heteroepitaxial growth
Authors:
F. Much,
M. Ahr,
M. Biehl,
W. Kinzel
Abstract:
We determine the critical layer thickness for the appearance of misfit dislocations as a function of the misfit between the lattice constants of the substrate and the adsorbate from Kinetic Monte Carlo (KMC) simulations of heteroepitaxial growth.
To this end, an algorithm is introduced which allows the off-lattice simulation of various phenomena observed in heteroepitaxial growth including cri…
▽ More
We determine the critical layer thickness for the appearance of misfit dislocations as a function of the misfit between the lattice constants of the substrate and the adsorbate from Kinetic Monte Carlo (KMC) simulations of heteroepitaxial growth.
To this end, an algorithm is introduced which allows the off-lattice simulation of various phenomena observed in heteroepitaxial growth including critical layer thickness for the appearance of misfit dislocations, or self-assembled island formation.
The only parameters of the model are deposition flux, temperature and a pairwise interaction potential between the particles of the system.
Our results are compared with a theoretical treatment of the problem and show good agreement with a simple power law.
△ Less
Submitted 21 June, 2001;
originally announced June 2001.
-
Particle currents and the distribution of terrace sizes in unstable epitaxial growth
Authors:
M. Biehl,
M. Ahr,
M. Kinne,
W. Kinzel,
S. Schinzer
Abstract:
A solid-on-solid model of epitaxial growth in 1+1 dimensions is investigated in which slope dependent upward and downward particle currents compete on the surface. The microscopic mechanisms which give rise to these currents are the smoothening incorporation of particles upon deposition and an Ehrlich-Schwoebel barrier which hinders inter-layer transport at step edges. We calculate the distribut…
▽ More
A solid-on-solid model of epitaxial growth in 1+1 dimensions is investigated in which slope dependent upward and downward particle currents compete on the surface. The microscopic mechanisms which give rise to these currents are the smoothening incorporation of particles upon deposition and an Ehrlich-Schwoebel barrier which hinders inter-layer transport at step edges. We calculate the distribution of terrace sizes and the resulting currents on a stepped surface with a given inclination angle. The cancellation of the competing effects leads to the selection of a stable magic slope. Simulation results are in very good agreement with the theoretical findings.
△ Less
Submitted 9 February, 2001;
originally announced February 2001.
-
Learning multilayer perceptrons efficiently
Authors:
C. Bunzmann,
M. Biehl,
R. Urbanczik
Abstract:
A learning algorithm for multilayer perceptrons is presented which is based on finding the principal components of a correlation matrix computed from the example inputs and their target outputs. For large networks our procedure needs far fewer examples to achieve good generalization than traditional on-line algorithms.
A learning algorithm for multilayer perceptrons is presented which is based on finding the principal components of a correlation matrix computed from the example inputs and their target outputs. For large networks our procedure needs far fewer examples to achieve good generalization than traditional on-line algorithms.
△ Less
Submitted 10 January, 2001;
originally announced January 2001.
-
Modelling sublimation and atomic layer epitaxy in the presence of competing surface reconstructions
Authors:
M. Ahr,
M. Biehl
Abstract:
We present a solid-on-solid model of a binary AB compound, where atoms of type A in the topmost layer interact via anisotropic interactions different from those inside the bulk. Depending on temperature and particle flux, this model displays surface reconstructions similar to those of (001) surfaces of II-VI semiconductors. We show, that our model qualitatively reproduces mamy of the characteris…
▽ More
We present a solid-on-solid model of a binary AB compound, where atoms of type A in the topmost layer interact via anisotropic interactions different from those inside the bulk. Depending on temperature and particle flux, this model displays surface reconstructions similar to those of (001) surfaces of II-VI semiconductors. We show, that our model qualitatively reproduces mamy of the characteristic features of these materials which have been observed during sublimation and atomic layer epitaxy. We predict some previously unknown effects which might be observed experimentally.
△ Less
Submitted 1 December, 2000; v1 submitted 9 October, 2000;
originally announced October 2000.
-
A lattice gas model of II-VI(001) semiconductor surfaces
Authors:
Michael Biehl,
Martin Ahr,
Wolfgang Kinzel,
Moritz Sokolowski,
Thorsten Volkmann
Abstract:
We introduce an anisotropic two-dimensional lattice gas model of metal terminated II-IV(001) seminconductor surfaces. Important properties of this class of materials are represented by effective NN and NNN interactions, which result in the competition of two vacancy structures on the surface. We demonstrate that the experimentally observed c(2x2)-(2x1) transition of the CdTe(001) surface can be…
▽ More
We introduce an anisotropic two-dimensional lattice gas model of metal terminated II-IV(001) seminconductor surfaces. Important properties of this class of materials are represented by effective NN and NNN interactions, which result in the competition of two vacancy structures on the surface. We demonstrate that the experimentally observed c(2x2)-(2x1) transition of the CdTe(001) surface can be understood as a phase transition in thermal equilbrium. The model is studied by means of transfer matrix and Monte Carlo techniques. The analysis shows that the small energy difference of the competing reconstructions determines to a large extent the nature of the different phases. Possible implications for further experimental research are discussed.
△ Less
Submitted 1 August, 2000;
originally announced August 2000.
-
The influence of the crystal lattice on coarsening in unstable epitaxial growth
Authors:
M. Ahr,
M. Biehl,
M. Kinne,
W. Kinzel
Abstract:
We report the results of computer simulations of epitaxial growth in the presence of a large Schwoebel barrier on different crystal surfaces: simple cubic(001), bcc(001), simple hexagonal(001) and hcp(001). We find, that mounds coarse by a step edge diffusion driven process, if adatoms can diffuse relatively far along step edges without being hindered by kink-edge diffusion barriers. This yields…
▽ More
We report the results of computer simulations of epitaxial growth in the presence of a large Schwoebel barrier on different crystal surfaces: simple cubic(001), bcc(001), simple hexagonal(001) and hcp(001). We find, that mounds coarse by a step edge diffusion driven process, if adatoms can diffuse relatively far along step edges without being hindered by kink-edge diffusion barriers. This yields the scaling exponents alpha = 1, beta = 1/3. These exponents are independent of the symmetry of the crystal surface. The crystal lattice, however, has strong effects on the morphology of the mounds, which are by no means restricted to trivial symmetry effects: while we observe pyramidal shapes on the simple lattices, on bcc and hcp there are two fundamentally different classes of mounds, which are encompanied by characteristic diffusion currents: a metastable one with rounded corners, and an actively coarsening configuration, which breaks the symmetry given by the crystal surface.
△ Less
Submitted 29 May, 2000;
originally announced May 2000.
-
Learning structured data from unspecific reinforcement
Authors:
M. Biehl,
R. Kuehn,
I. -O. Stamatescu
Abstract:
We show that a straightforward extension of a simple learning model based on the Hebb rule, the previously introduced Association-Reinforcement-Hebb-Rule, can cope with "delayed", unspecific reinforcement also in the case of structured data and lead to perfect generalization.
We show that a straightforward extension of a simple learning model based on the Hebb rule, the previously introduced Association-Reinforcement-Hebb-Rule, can cope with "delayed", unspecific reinforcement also in the case of structured data and lead to perfect generalization.
△ Less
Submitted 27 January, 2000;
originally announced January 2000.
-
Singularity spectra of rough growing surfaces from wavelet analysis
Authors:
Martin Ahr,
Michael Biehl
Abstract:
We apply the wavelet transform modulus maxima (WTMM) method to the analysis of simulated MBE-grown surfaces. In contrast to the structure function approach commonly used in the literature, this new method permits an investigation of the complete singularity spectrum. We focus on a kinetic Monte-Carlo model with Arrhenius dynamics, which in particular takes into consideration the process of therm…
▽ More
We apply the wavelet transform modulus maxima (WTMM) method to the analysis of simulated MBE-grown surfaces. In contrast to the structure function approach commonly used in the literature, this new method permits an investigation of the complete singularity spectrum. We focus on a kinetic Monte-Carlo model with Arrhenius dynamics, which in particular takes into consideration the process of thermally activated desorption of particles. We find a wide spectrum of Hoelder exponents, which reflects the multiaffine surface morphology. Although our choice of parameters yields small desorption rates (< 3 %), we observe a dramatic change in the singularity spectrum, which is shifted towards smaller Hoelder exponents. Our results offer a mathematical foundation of anomalous scaling: We identify the global exponent alpha_g with the Hoelder exponent which maximizes the singularity soectrum.
△ Less
Submitted 3 April, 2000; v1 submitted 23 December, 1999;
originally announced December 1999.
-
Noisy regression and classification with continuous multilayer networks
Authors:
Martin Ahr,
Michael Biehl,
Robert Urbanczik
Abstract:
We investigate zero temperature Gibbs learning for two classes of unrealizable rules which play an important role in practical applications of multilayer neural networks with differentiable activation functions: classification problems and noisy regression problems. Considering one step of replica symmetry breaking, we surprisingly find that for sufficiently large training sets the stable state…
▽ More
We investigate zero temperature Gibbs learning for two classes of unrealizable rules which play an important role in practical applications of multilayer neural networks with differentiable activation functions: classification problems and noisy regression problems. Considering one step of replica symmetry breaking, we surprisingly find that for sufficiently large training sets the stable state is replica symmetric even though the target rule is unrealizable. Further, the classification problem is shown to be formally equivalent to the noisy regression problem.
△ Less
Submitted 22 July, 1999;
originally announced July 1999.
-
Unconventional MBE Strategies from Computer Simulations for Optimized Growth Conditions
Authors:
S. Schinzer,
M. Sokolowski,
M. Biehl,
W. Kinzel
Abstract:
We investigate the influence of step edge diffusion (SED) and desorption on Molecular Beam Epitaxy (MBE) using kinetic Monte-Carlo simulations of the solid-on-solid (SOS) model. Based on these investigations we propose two strategies to optimize MBE growth. The strategies are applicable in different growth regimes: During layer-by-layer growth one can exploit the presence of desorption in order…
▽ More
We investigate the influence of step edge diffusion (SED) and desorption on Molecular Beam Epitaxy (MBE) using kinetic Monte-Carlo simulations of the solid-on-solid (SOS) model. Based on these investigations we propose two strategies to optimize MBE growth. The strategies are applicable in different growth regimes: During layer-by-layer growth one can exploit the presence of desorption in order to achieve smooth surfaces. By additional short high flux pulses of particles one can increase the growth rate and assist layer-by-layer growth. If, however, mounds are formed (non-layer-by-layer growth) the SED can be used to control size and shape of the three-dimensional structures. By controlled reduction of the flux with time we achieve a fast coarsening together with smooth step edges.
△ Less
Submitted 19 March, 1999;
originally announced March 1999.
-
Weight decay induced phase transitions in multilayer neural networks
Authors:
M. Ahr,
M. Biehl,
E. Schloesser
Abstract:
We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We consider the learning of perfectly realizable rules and find that the length of student vectors becomes infinite, unless a proper weight decay term is added to the energy. Then, the system undergoes a first order phase…
▽ More
We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We consider the learning of perfectly realizable rules and find that the length of student vectors becomes infinite, unless a proper weight decay term is added to the energy. Then, the system undergoes a first order phase transition between states with very long student vectors and states where the lengths are comparable to those of the teacher vectors. Additionally in both configurations there is a phase transition between a specialized and an unspecialized phase. An anti-specialized phase with long student vectors exists in networks with a small number of hidden units.
△ Less
Submitted 19 January, 1999;
originally announced January 1999.