-
Analyzing Echo-state Networks Using Fractal Dimension
Authors:
Norbert Michael Mayer,
Oliver Obst
Abstract:
This work joins aspects of reservoir optimization, information-theoretic optimal encoding, and at its center fractal analysis. We build on the observation that, due to the recursive nature of recurrent neural networks, input sequences appear as fractal patterns in their hidden state representation. These patterns have a fractal dimension that is lower than the number of units in the reservoir. We…
▽ More
This work joins aspects of reservoir optimization, information-theoretic optimal encoding, and at its center fractal analysis. We build on the observation that, due to the recursive nature of recurrent neural networks, input sequences appear as fractal patterns in their hidden state representation. These patterns have a fractal dimension that is lower than the number of units in the reservoir. We show potential usage of this fractal dimension with regard to optimization of recurrent neural network initialization. We connect the idea of `ideal' reservoirs to lossless optimal encoding using arithmetic encoders. Our investigation suggests that the fractal dimension of the mapping from input to hidden state shall be close to the number of units in the network. This connection between fractal dimension and network connectivity is an interesting new direction for recurrent neural network initialization and reservoir computing.
△ Less
Submitted 26 May, 2022; v1 submitted 19 May, 2022;
originally announced May 2022.
-
Designing an Inertia Actuator with a Fast Rotating Gyro inside an Egg-shaped Robot
Authors:
Chun-Chi Wang,
He-Zhi Liu,
Rui-Yuan Lin,
Li-Yang Lu,
N. Michael Mayer
Abstract:
In this paper, we describe features of two new robot prototypes that are actuated by an actively controlled gyro (flywheel, symmetric rotor) inside a hollow sphere that is located in the middle of the robots. No external actuators are used. The outside structure of the robots and the gyro are connected by a gimbal, which is similar in structure to a control moment gyroscope in spacecrafts. The joi…
▽ More
In this paper, we describe features of two new robot prototypes that are actuated by an actively controlled gyro (flywheel, symmetric rotor) inside a hollow sphere that is located in the middle of the robots. No external actuators are used. The outside structure of the robots and the gyro are connected by a gimbal, which is similar in structure to a control moment gyroscope in spacecrafts. The joints of the gimbal can be actuated. In this way, the orientation of axis for the gyro in relation to the egg can be changed. Since the inertia of the fast rotating gyro is large in relation to the outside structure, a relative rotation of the axis against the outside structure results in a motion of the egg by inertia principle. In this way, we can use this principle for controlling the robot to move forward and turn around. The robots are shaped as spheroidal ellipsoids so they resemble eggs. So far, we have built and tested two robot prototypes.
△ Less
Submitted 24 May, 2019;
originally announced May 2019.
-
What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?
Authors:
Nikolaus Mayer,
Eddy Ilg,
Philipp Fischer,
Caner Hazirbas,
Daniel Cremers,
Alexey Dosovitskiy,
Thomas Brox
Abstract:
The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising algorithms to creating suitable and abundant training data for supervised learning. How to efficiently create such training data? The dominant data acquisition method…
▽ More
The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising algorithms to creating suitable and abundant training data for supervised learning. How to efficiently create such training data? The dominant data acquisition method in visual recognition is based on web data and manual annotation. Yet, for many computer vision problems, such as stereo or optical flow estimation, this approach is not feasible because humans cannot manually enter a pixel-accurate flow field. In this paper, we promote the use of synthetically generated data for the purpose of training deep networks on such tasks.We suggest multiple ways to generate such data and evaluate the influence of dataset properties on the performance and generalization properties of the resulting networks. We also demonstrate the benefit of learning schedules that use different types of data at selected stages of the training process.
△ Less
Submitted 22 March, 2018; v1 submitted 19 January, 2018;
originally announced January 2018.
-
Kinematics and dynamics of an egg-shaped robot with a gyro driven inertia actuator
Authors:
Norbert Michael Mayer
Abstract:
The manuscript discusses still preliminary considerations with regard to the dynamics and kinematics of an egg shaped robot with an gyro driven inertia actuator. The method of calculation follows the idea that we would like to express the entire dynamic equations in terms of moments instead of forces. Also we avoid to derive the equations from a Lagrange function with constraints. The result of th…
▽ More
The manuscript discusses still preliminary considerations with regard to the dynamics and kinematics of an egg shaped robot with an gyro driven inertia actuator. The method of calculation follows the idea that we would like to express the entire dynamic equations in terms of moments instead of forces. Also we avoid to derive the equations from a Lagrange function with constraints. The result of the calculations is meant to be applicable to two robot prototypes that have been build at the AES\&R Laboratory at the National Chung Cheng University in Taiwan.
△ Less
Submitted 17 June, 2018; v1 submitted 11 January, 2018;
originally announced January 2018.
-
An Integrated Conceptual Model for Information System Security Risk Management and Enterprise Architecture Management based on TOGAF, ArchiMate, IAF and DoDAF
Authors:
Nicolas Mayer,
Jocelyn Aubert,
Eric Grandry,
Christophe Feltus,
Elio Goettelmann
Abstract:
Risk management is today a major steering tool for any organization wanting to deal with Information System (IS) security. However, IS Security Risk Management (ISSRM) remains difficult to establish and maintain, mainly in a context of multi-regulations with complex and inter-connected IS. We claim that a connection with Enterprise Architecture Management (EAM) contributes to deal with these issue…
▽ More
Risk management is today a major steering tool for any organization wanting to deal with Information System (IS) security. However, IS Security Risk Management (ISSRM) remains difficult to establish and maintain, mainly in a context of multi-regulations with complex and inter-connected IS. We claim that a connection with Enterprise Architecture Management (EAM) contributes to deal with these issues. A first step towards a better integration of both domains is to define an integrated EAM-ISSRM conceptual model. Among the steps of the research method followed to define such an integrated EAM-ISSRM conceptual, this technical report presents the whole outputs (through alignment tables) of the conceptual alignment between concepts used to model EA (based on ArchiMate, TOGAF, IAF and DoDAF) and concepts of the ISSRM domain model.
△ Less
Submitted 6 January, 2017;
originally announced January 2017.
-
DeMoN: Depth and Motion Network for Learning Monocular Stereo
Authors:
Benjamin Ummenhofer,
Huizhong Zhou,
Jonas Uhrig,
Nikolaus Mayer,
Eddy Ilg,
Alexey Dosovitskiy,
Thomas Brox
Abstract:
In this paper we formulate structure from motion as a learning problem. We train a convolutional network end-to-end to compute depth and camera motion from successive, unconstrained image pairs. The architecture is composed of multiple stacked encoder-decoder networks, the core part being an iterative network that is able to improve its own predictions. The network estimates not only depth and mot…
▽ More
In this paper we formulate structure from motion as a learning problem. We train a convolutional network end-to-end to compute depth and camera motion from successive, unconstrained image pairs. The architecture is composed of multiple stacked encoder-decoder networks, the core part being an iterative network that is able to improve its own predictions. The network estimates not only depth and motion, but additionally surface normals, optical flow between the images and confidence of the matching. A crucial component of the approach is a training loss based on spatial relative differences. Compared to traditional two-frame structure from motion methods, results are more accurate and more robust. In contrast to the popular depth-from-single-image networks, DeMoN learns the concept of matching and, thus, better generalizes to structures not seen during training.
△ Less
Submitted 11 April, 2017; v1 submitted 7 December, 2016;
originally announced December 2016.
-
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Authors:
Eddy Ilg,
Nikolaus Mayer,
Tonmoy Saikia,
Margret Keuper,
Alexey Dosovitskiy,
Thomas Brox
Abstract:
The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements and real-world data, FlowNet cannot compete with variational methods. In this paper, we advance the concept of end-to-end learning of optical flow and make it…
▽ More
The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements and real-world data, FlowNet cannot compete with variational methods. In this paper, we advance the concept of end-to-end learning of optical flow and make it work really well. The large improvements in quality and speed are caused by three major contributions: first, we focus on the training data and show that the schedule of presenting data during training is very important. Second, we develop a stacked architecture that includes warping of the second image with intermediate optical flow. Third, we elaborate on small displacements by introducing a sub-network specializing on small motions. FlowNet 2.0 is only marginally slower than the original FlowNet but decreases the estimation error by more than 50%. It performs on par with state-of-the-art methods, while running at interactive frame rates. Moreover, we present faster variants that allow optical flow computation at up to 140fps with accuracy matching the original FlowNet.
△ Less
Submitted 6 December, 2016;
originally announced December 2016.
-
Critical Echo State Networks that Anticipate Input using Morphable Transfer Functions
Authors:
Norbert Michael Mayer
Abstract:
The paper investigates a new type of truly critical echo state networks where individual transfer functions for every neuron can be modified to anticipate the expected next input. Deviations from expected input are only forgotten slowly in power law fashion. The paper outlines the theory, numerically analyzes a one neuron model network and finally discusses technical and also biological implicatio…
▽ More
The paper investigates a new type of truly critical echo state networks where individual transfer functions for every neuron can be modified to anticipate the expected next input. Deviations from expected input are only forgotten slowly in power law fashion. The paper outlines the theory, numerically analyzes a one neuron model network and finally discusses technical and also biological implications of this type of approach.
△ Less
Submitted 6 March, 2017; v1 submitted 12 June, 2016;
originally announced June 2016.
-
Orthogonal Echo State Networks and stochastic evaluations of likelihoods
Authors:
Norbert Michael Mayer,
Ying-Hao Yu
Abstract:
We report about probabilistic likelihood estimates that are performed on time series using an echo state network with orthogonal recurrent connectivity. The results from tests using synthetic stochastic input time series with temporal inference indicate that the capability of the network to infer depends on the balance between input strength and recurrent activity. This balance has an influence on…
▽ More
We report about probabilistic likelihood estimates that are performed on time series using an echo state network with orthogonal recurrent connectivity. The results from tests using synthetic stochastic input time series with temporal inference indicate that the capability of the network to infer depends on the balance between input strength and recurrent activity. This balance has an influence on the network with regard to the quality of inference from the short term input history versus inference that accounts for influences that date back a long time. Sensitivity of such networks against noise and the finite accuracy of network states in the recurrent layer are investigated. In addition, a measure based on mutual information between the output time series and the reservoir is introduced. Finally, different types of recurrent connectivity are evaluated. Orthogonal matrices show the best results of all investigated connectivity types overall, but also in the way how the network performance scales with the size of the recurrent layer.
△ Less
Submitted 13 June, 2017; v1 submitted 22 January, 2016;
originally announced January 2016.
-
A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation
Authors:
Nikolaus Mayer,
Eddy Ilg,
Philip Häusser,
Philipp Fischer,
Daniel Cremers,
Alexey Dosovitskiy,
Thomas Brox
Abstract:
Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated dataset. The present paper extends the concept of optical flow estimation via convolutional networks to disparity and scene flow estimation. To this end, we pro…
▽ More
Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated dataset. The present paper extends the concept of optical flow estimation via convolutional networks to disparity and scene flow estimation. To this end, we propose three synthetic stereo video datasets with sufficient realism, variation, and size to successfully train large networks. Our datasets are the first large-scale datasets to enable training and evaluating scene flow methods. Besides the datasets, we present a convolutional network for real-time disparity estimation that provides state-of-the-art results. By combining a flow and disparity estimation network and training it jointly, we demonstrate the first scene flow estimation with a convolutional network.
△ Less
Submitted 7 December, 2015;
originally announced December 2015.
-
Echo State Condition at the Critical Point
Authors:
Norbert Michael Mayer
Abstract:
Recurrent networks with transfer functions that fulfill the Lipschitz continuity with K=1 may be echo state networks if certain limitations on the recurrent connectivity are applied. It has been shown that it is sufficient if the largest singular value of the recurrent connectivity is smaller than 1. The main achievement of this paper is a proof under which conditions the network is an echo state…
▽ More
Recurrent networks with transfer functions that fulfill the Lipschitz continuity with K=1 may be echo state networks if certain limitations on the recurrent connectivity are applied. It has been shown that it is sufficient if the largest singular value of the recurrent connectivity is smaller than 1. The main achievement of this paper is a proof under which conditions the network is an echo state network even if the largest singular value is one. It turns out that in this critical case the exact shape of the transfer function plays a decisive role in determining whether the network still fulfills the echo state condition. In addition, several examples with one neuron networks are outlined to illustrate effects of critical connectivity. Moreover, within the manuscript a mathematical definition for a critical echo state network is suggested.
△ Less
Submitted 26 December, 2016; v1 submitted 25 November, 2014;
originally announced November 2014.
-
Input anticipating critical reservoirs show power law forgetting of unexpected input events
Authors:
Norbert Michael Mayer
Abstract:
Usually, reservoir computing shows an exponential memory decay. This paper investigates under which circumstances echo state networks can show a power law forgetting. That means traces of earlier events can be found in the reservoir for very long time spans. Such a setting requires critical connectivity exactly at the limit of what is permissible according the echo state condition. However, for ge…
▽ More
Usually, reservoir computing shows an exponential memory decay. This paper investigates under which circumstances echo state networks can show a power law forgetting. That means traces of earlier events can be found in the reservoir for very long time spans. Such a setting requires critical connectivity exactly at the limit of what is permissible according the echo state condition. However, for general matrices the limit cannot be determined exactly from theory. In addition, the behavior of the network is strongly influenced by the input flow. Results are presented that use certain types of restricted recurrent connectivity and anticipation learning with regard to the input, where indeed power law forgetting can be achieved.
△ Less
Submitted 8 August, 2015; v1 submitted 25 April, 2014;
originally announced April 2014.
