Abstract
Different models of attractor networks have been proposed to form cell assemblies. Among them, networks with a fixed synaptic matrix can be distinguished from those including learning dynamics, since the latter adapt the attractor landscape of the lateral connections according to the statistics of the presented stimuli, yielding a more complex behavior. We propose a new learning rule that builds internal representations of input timuli as attractors of neurons in a recurrent network. The dynamics of activation and synaptic adaptation are analyzed in experiments where representations for different input patterns are formed, focusing on the properties of the model as a memory system. The experimental results are exposed along with a survey of different Hebbian rules proposed in the literature for attractors formation. These rules are compared with the help of a new tool, the learning map, where LTP and LTD, as well as homo- and heterosynaptic competition, can be graphically interpreted.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Amaral, D. G. and Witter, M. P.: The three-dimensional organization of the hippocampal formation: a review of anatomical data, Neuroscience, 31 (1989), 571–591.
Amit, D. J.: Modeling Brain Function, Cambridge University Press, 1989.
Amit, D. J.: The Hebbian paradigm reintegrated: local reverberations as internal representations, Behavioural and Brain Sciences, 18 (1995), 617–657.
Amit, D. J. and Brunel, N.: Learning internal representations in an attractor neural network with analogue neurons, Network: Computation in Neural Systems, 6 (1995), 359.
Atkinson, R. C. and Shiffrin, R. M.: The control of short-term memory, Sci Am, 225(2) (1971), 82–90.
Baddeley, A. and Hitch, G. J.: Working memory. In: G. H. Bower (ed.), The Psychology of Learning and Motivation, 8 (1974), 47–90. New York: Academic Press.
Bienenstock, E.: Notes on the growth of a ‘composition machine’. In: Interdisciplinary Workshop on Compositionality in Cognition and Neural Models (1991).
Bienenstock, E.: A model of neocortex, Network: Computation in Neural Systems, 6 (1995), 179–224.
Bienenstock, E., Cooper, L. and Munro, P.: Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex, J. Neuroscience, 2(1) (1982), 32–48.
Braitenberg, V., and Schuz, A.: Anatomy of the cortex, Berlin: Springer-Verlag, 1991.
Brunel, N.: Dynamics of an attractor neural network converting temporal into spatial correlations, Network: Computation in Neural Systems, 5 (1994), 449–470.
Brunel, N., Carusi, F. and Fusi, S.: Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network, Network: Computation in Neural Systems, 9(1) (1998), 123–152.
Castellani, G. C., Intrator, N., Shouval, H. and Cooper, L.: Solutions of the BCM learning rule in a network of lateral interacting nonlinear neurons, Network: Computation in Neural Systems 10(2) (1999), 111–121.
Christie, B. R., Stellwagen, D. and Abraham, W. C.: Reduction of the threshold for longterm potentiation by prior theta-frequency synaptic activity, Hippocampus, 5(1) (1995), 52–59.
Courtney, S. M., Ungerleider, L. G., Keil, K. and Haxby, J. V.: Transient and sustained activity in a distributed neural system for human working memory, Nature, 386(6625) (1997), 608–611.
Fregnac, Y. and Bienenstock, E.: Correlational models of synaptic plasticity: development, learning and cortical dynamics of mental representations, Mechanistic relationships between development and learning (1998), 113–148. Wiley and Sons.
Fuster, J. M. and Alexander, G. E.: Neuron activity related to short-term memory, Science, 173(997) (1971), 652–654.
Griniasty, M., Tsodyks, M. V. and Amit, D. J.: Conversion of temporal correlations between stimuli to spatial correlations between attractors, Neural Computation, 5 (1993), 1–17.
Hebb, D. The organization of behaviour, New York: Wiley, 1949.
Hetherington, P. A. and Shapiro, M. L.: Simulating Hebb cell assemblies: the necessity for partitioned dendritic trees and a post-not-pre LTD rule, Network: Computation in Neural Systems, 4 (1993), 135–153.
Hopfield, J. J.: Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA, 79 (1982), 2554.
Hubel, D. and Wiesel, T.: Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, J. Physiology, 160 (1962), 106–154.
Hubel, D. and Wiesel, T.: Receptive fields and functional architecture of monkey striate cortex, J. Physiology, 195 (1968), 215–243.
Lorente de Nó, R.: Analysis of the activity of the chains of internuncial neurons, J. Neurophysiology, 1 (1938), 207–244.
Milner, P. M.: The cell assembly: Mark II, Psychol. Rev., 64 (1957), 242–252.
Rochester, N., Holland, J. H., Haibt, L. H. and Duda, W. L.: Tests on a cell assembly theory of the action of the brain, using a large digital computer, IRE Trans. Information Theory, IT-2 (1956), 80–93.
Rolls, E. T.: Functions of neuronal networks in the hippocampus and neocortex in memory. In: J. H. Byrne, & W. O. Berry (eds.), Neural Models of Plasticity, pp. 240–265. San Diego, CA: Academic, 1989.
Sejnowski, T. J.: Storing covariance with nonlinearly interacting neurons, J. Math. Biol., 4 (1977), 303–321.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Vico, F.J., Jerez, J.M. Stable Neural Attractors Formation: Learning Rules and Network Dynamics. Neural Processing Letters 18, 1–16 (2003). https://doi.org/10.1023/A:1026258500432
Issue Date:
DOI: https://doi.org/10.1023/A:1026258500432