Abstract
Dynamical properties of a general neural network are discussed. A condition for the neural activation dynamics being stable is derived. The stability condition does not put any symmetry restriction on the weights. The transitions from stable to non-stable dynamics are analysed and their analogy to phase transitions in statistical mechanics discussed. In general, the network dynamics can violate the stability condition. To avoid that happening, a method is introduced which makes the dynamics adaptive such that the stability condition is sustained. Relations to some previous works on stability are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Hopfield JJ. Neural networks and physical systems with emergent collective computational abilities. Proc Nat Acad Sci USA 1982; 79: 2554–2558.
Michel AN, Farell JA. Associative memories via artificial neural networks. IEEE Control Systems Mag April 1990; 6
Jordan DW, Smith PS. Nonlinear Ordinary Differential Equations. Clarendon Press, Oxford, 1989.
Pineda FJ. Generalisation of back-propagation to recurrent neural networks. Phys Rev Lett 1987; 59 (2229)
Hirsch MW. Convergent activation dynamics in continuous time networks. Neural Networks 1989; 2: 331–349
Cohen M, Grossberg S. Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Trans Systems Man Cybern 19??; 13: 815–826
Hopfield JJ. Neurons with graded response have collective computational properties like those of twostate neurons. Proc Nat Acad Sci USA 1984; 81: 3088–3092
Almeida LB. Backpropagation in non-feedforward networks. In: I Aleksander, ed., Neural Computing Architectures. North Oxford Academic, London, 1989.
Lapedes A, Farber R. A self optimising, nonsymmetrical neural net for content addressable memory and pattern recognition. Physica 1986; 22D: 247–259
Guez A, Protopopescu V, Barhen J. On the stability, storage capacity, and design of non-linear continuous neural networks. IEEE Trans Systems Man Cybern 1988; 18: 80–87
Matsuoka K. Stability conditions for non-linear continuous neural networks with asymmetric connection weights. Neural Networks 1992; 5: 495–500
Noble B, Daniel J. Applied Linear Algebra. Prentice Hall, Englewood Cliffs, NJ, 1988.
Olafsson S. Some dynamical properties of neural networks. In: R Lingardet al., eds., Neural Networks for Vision, Speech and Natural Language. Chapman & Hall, London, 1992
Brauer A. Limits for the characteristic roots of a matrix. Duke Mathematical J 1946; 13: 387–395
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Olafsson, S. On the stability of neural networks with arbitrary weights. Neural Comput & Applic 4, 2–9 (1996). https://doi.org/10.1007/BF01413864
Issue Date:
DOI: https://doi.org/10.1007/BF01413864