Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Stable Neural Attractors Formation: Learning Rules and Network Dynamics

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Different models of attractor networks have been proposed to form cell assemblies. Among them, networks with a fixed synaptic matrix can be distinguished from those including learning dynamics, since the latter adapt the attractor landscape of the lateral connections according to the statistics of the presented stimuli, yielding a more complex behavior. We propose a new learning rule that builds internal representations of input timuli as attractors of neurons in a recurrent network. The dynamics of activation and synaptic adaptation are analyzed in experiments where representations for different input patterns are formed, focusing on the properties of the model as a memory system. The experimental results are exposed along with a survey of different Hebbian rules proposed in the literature for attractors formation. These rules are compared with the help of a new tool, the learning map, where LTP and LTD, as well as homo- and heterosynaptic competition, can be graphically interpreted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Amaral, D. G. and Witter, M. P.: The three-dimensional organization of the hippocampal formation: a review of anatomical data, Neuroscience, 31 (1989), 571–591.

    Google Scholar 

  2. Amit, D. J.: Modeling Brain Function, Cambridge University Press, 1989.

    Google Scholar 

  3. Amit, D. J.: The Hebbian paradigm reintegrated: local reverberations as internal representations, Behavioural and Brain Sciences, 18 (1995), 617–657.

    Google Scholar 

  4. Amit, D. J. and Brunel, N.: Learning internal representations in an attractor neural network with analogue neurons, Network: Computation in Neural Systems, 6 (1995), 359.

    Google Scholar 

  5. Atkinson, R. C. and Shiffrin, R. M.: The control of short-term memory, Sci Am, 225(2) (1971), 82–90.

    Google Scholar 

  6. Baddeley, A. and Hitch, G. J.: Working memory. In: G. H. Bower (ed.), The Psychology of Learning and Motivation, 8 (1974), 47–90. New York: Academic Press.

    Google Scholar 

  7. Bienenstock, E.: Notes on the growth of a ‘composition machine’. In: Interdisciplinary Workshop on Compositionality in Cognition and Neural Models (1991).

  8. Bienenstock, E.: A model of neocortex, Network: Computation in Neural Systems, 6 (1995), 179–224.

    Google Scholar 

  9. Bienenstock, E., Cooper, L. and Munro, P.: Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex, J. Neuroscience, 2(1) (1982), 32–48.

    Google Scholar 

  10. Braitenberg, V., and Schuz, A.: Anatomy of the cortex, Berlin: Springer-Verlag, 1991.

    Google Scholar 

  11. Brunel, N.: Dynamics of an attractor neural network converting temporal into spatial correlations, Network: Computation in Neural Systems, 5 (1994), 449–470.

    Google Scholar 

  12. Brunel, N., Carusi, F. and Fusi, S.: Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network, Network: Computation in Neural Systems, 9(1) (1998), 123–152.

    Google Scholar 

  13. Castellani, G. C., Intrator, N., Shouval, H. and Cooper, L.: Solutions of the BCM learning rule in a network of lateral interacting nonlinear neurons, Network: Computation in Neural Systems 10(2) (1999), 111–121.

    Google Scholar 

  14. Christie, B. R., Stellwagen, D. and Abraham, W. C.: Reduction of the threshold for longterm potentiation by prior theta-frequency synaptic activity, Hippocampus, 5(1) (1995), 52–59.

    Google Scholar 

  15. Courtney, S. M., Ungerleider, L. G., Keil, K. and Haxby, J. V.: Transient and sustained activity in a distributed neural system for human working memory, Nature, 386(6625) (1997), 608–611.

    Google Scholar 

  16. Fregnac, Y. and Bienenstock, E.: Correlational models of synaptic plasticity: development, learning and cortical dynamics of mental representations, Mechanistic relationships between development and learning (1998), 113–148. Wiley and Sons.

  17. Fuster, J. M. and Alexander, G. E.: Neuron activity related to short-term memory, Science, 173(997) (1971), 652–654.

    Google Scholar 

  18. Griniasty, M., Tsodyks, M. V. and Amit, D. J.: Conversion of temporal correlations between stimuli to spatial correlations between attractors, Neural Computation, 5 (1993), 1–17.

    Google Scholar 

  19. Hebb, D. The organization of behaviour, New York: Wiley, 1949.

    Google Scholar 

  20. Hetherington, P. A. and Shapiro, M. L.: Simulating Hebb cell assemblies: the necessity for partitioned dendritic trees and a post-not-pre LTD rule, Network: Computation in Neural Systems, 4 (1993), 135–153.

    Google Scholar 

  21. Hopfield, J. J.: Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA, 79 (1982), 2554.

    Google Scholar 

  22. Hubel, D. and Wiesel, T.: Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, J. Physiology, 160 (1962), 106–154.

    Google Scholar 

  23. Hubel, D. and Wiesel, T.: Receptive fields and functional architecture of monkey striate cortex, J. Physiology, 195 (1968), 215–243.

    Google Scholar 

  24. Lorente de Nó, R.: Analysis of the activity of the chains of internuncial neurons, J. Neurophysiology, 1 (1938), 207–244.

    Google Scholar 

  25. Milner, P. M.: The cell assembly: Mark II, Psychol. Rev., 64 (1957), 242–252.

    Google Scholar 

  26. Rochester, N., Holland, J. H., Haibt, L. H. and Duda, W. L.: Tests on a cell assembly theory of the action of the brain, using a large digital computer, IRE Trans. Information Theory, IT-2 (1956), 80–93.

    Google Scholar 

  27. Rolls, E. T.: Functions of neuronal networks in the hippocampus and neocortex in memory. In: J. H. Byrne, & W. O. Berry (eds.), Neural Models of Plasticity, pp. 240–265. San Diego, CA: Academic, 1989.

    Google Scholar 

  28. Sejnowski, T. J.: Storing covariance with nonlinearly interacting neurons, J. Math. Biol., 4 (1977), 303–321.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vico, F.J., Jerez, J.M. Stable Neural Attractors Formation: Learning Rules and Network Dynamics. Neural Processing Letters 18, 1–16 (2003). https://doi.org/10.1023/A:1026258500432

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1026258500432