Abstract
In the first section of the article, we examine some recent criticisms of the connectionist enterprise: first, that connectionist models are fundamentally behaviorist in nature (and, therefore, non-cognitive), and second that connectionist models are fundamentally associationist in nature (and, therefore, cognitively weak). We argue that, for a limited class of connectionist models (feed-forward, pattern-associator models), the first criticism is unavoidable. With respect to the second criticism, we propose that connectionist modelsare fundamentally associationist but that this is appropriate for building models of human cognition. However, we do accept the point that there are cognitive capacities for which any purely associative model cannot provide a satisfactory account. The implication that we draw from is this is not that associationist models and mechanisms should be scrapped, but rather that they should be enhanced.
In the next section of the article, we identify a set of connectionist approaches which are characterized by “active symbols” — recurrent circuits which are the basis of knowledge representation. We claim that such approaches avoid criticisms of behaviorism and are, in principle, capable of supporting full cognition. In the final section of the article, we speculate at some length about what we believe would be the characteristics of a fully realized active symbol system. This includes both potential problems and possible solutions (for example, mechanisms needed to control activity in a complex recurrent network) as well as the promise of such systems (in particular, the emergence of knowledge structures which would constitute genuine internal models).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abbott, V., Black, J. and Smith, E. (1985). The representation of scripts in memory.Journal of Memory and Language, 24, 179–199.
Barlow, H. B. (1985). Cerebral cortex as a model builder. In D. Rose and V. Dobson (eds),Models of the Visual Cortex. John Wiley.
Barsalou, L. and Sewell, D. (1985). Contrasting the representation of scripts and categories.Journal of Memory and Language, 24, 646–665.
Braitenberg, V. (1978). Cortical architectonics: general and areal. In M. A. Brazier and H. Petsche (eds),Architectonics of the Cerebral Cortex. New York: Raven Press.
Braitenberg, V. (1984).Vehicles: Experiments in Synthetic Psychology. MIT Press, Cambridge, MA.
Calvin, W. (1987).The River that Flows Uphill: A Voyage from the Big Bang to the Big Brain. New York: Macmillan.
Craik, K. J. W. (1943).The Nature of Explanation. London: Cambridge University Press.
Eccles, J. C. (1957).The Physiology of Nerve Cells. Baltimore: The Johns Hopkins Press.
Edelman, G. (1987).Neural Darwinism: The Theory of Neuronal Group Selection. Basic Books.
Farah, M. J. (1988). Is visual imagery really visual? Overlooked evidence from neuropsychology.Psychological Review, 95, 307–317.
Feldman, J. A. (1988). Connectionist representation of concepts. In D. Waltz and J. A. Feldman (eds),Connectionist Models and their Implications: Readings from Cognitive Science. Norwood, NJ: Ablex.
Fodor, J. A. and Pylyshyn, Z. W. (1988). Connectionism and cognitive architecture: a critical analysis.Cognition, 28, 3–71.
French, R. and Weaver, M. (1987). The role of categories in the generation of counterfactuals: a connectionist interpretation.Proceedings of the Ninth Annual Conference of the Cognitive Science Society, Lawrence Erlbaum Associates.
Gibson, J. J. (1941). A critical review of the concept of set in contemporary experimental psychology.Psychological Bulletin, 38, 781–817.
Grossberg, S. (1987). Competitive learning: from interactive activation to adaptive resonance.Cognitive Science, 11.
Hebb, D. O. (1949).The Organization of Behavior. John Wiley.
Hofstadter, D. R. (1979).Gödel, Escher, Bach: an Eternal Golden Braid. Basic Books.
Hume, D. (1737/1975). Of the idea of necessary connexions. InAn Enquiry Concerning Human Understanding and Concerning the Principles of Morals. Oxford: Clarendon Press.
Johnson-Laird, P. N. (1981). Comprehension as the construction of mental models.Philosophical Transactions of the Royal Society, London 295B, 353–374.
Jonides, J. (1980). Towards a model of the minds eye movement.Canadian Journal of Psychology, 34, 103.
Kahneman, D. and Tversky, A. (1973). On the psychology of prediction.Psychological Review, 80, 237–251.
Kaplan, S. (1970). The role of location processing in the perception of the environment. Inedra two (Proceedings of the second annual environmental design research association conference, Pittsburgh), J. Archea and C. Eastman (eds).
Kaplan, S. (1973). Cognitive maps in perception and thought. In R. M. Downs and D. Stea (eds),Image and Environment, Chicago: Aldine.
Kaplan, S. (1976). Adaptation, structure, and knowledge. In G. T. Moore and R. G. Golledge (eds),Environmental Knowing. Stroudsburg, PA: Dowden, Hutchinson, and Ross.
Kaplan, S. (in press). Beyond rationality: clarity based decision making. In G. Evans and T. Garling, (eds),Environmental Cognition and Assessment.
Kaplan, S. and Kaplan, R. (1982).Cognition and Environment. Praeger.
Kinsbourne, M. (1982). Hemispheric specialization and the growth of human understanding.American Psychologist, 37(4), 411–420.
Kleinmuntz, B. (1968). The processing of clinical information by man and machine. In B. Kleinmuntz (ed.),Formal Representation of Human Judgement. New York: Wiley.
Kosslyn, S. (1987). Seeing and imaging in the cerebral hemispheres: a computational approach.Psychological Review, 94(2), 148–175.
Kruglanski, A. and Ajzen, I. (1983). Bias and error in human judgement.European Journal of Social Psychology, 13, 1–44.
Lachman, J. L. and Lachman, R. (1979). Theories of memory orgnization and human evolution, In C. R. Puff (ed.),Memory Organization and Structure. Academic Press.
Lachter, J. and Bever, T. (1988). The relationship between linguistic structure and associative theories of language learning — A constructive critique of some connectionist teaching models.Cognition, 28, 195–247.
Lakoff, G. and Johnson, M. (1980).Metaphors We Live By. Chicago: University of Chicago Press.
Lashley, K. S. (1950). In search of the engram. InSociety of Experimental Biology Symposium No. 4: Psychological Mechanisms in Animal Behaviour (pp. 478–505). London: Cambridge University Press.
Lindsay, R. K. (1988). Can this treatment raise the dead?Behavioral and Brain Sciences, 10(4).
Luria, A. R. (1973).The Working Brain. Penguin Books.
Lynch, J. C., Mountcastle, V. B., Talbot, W. H. and Yin, T. C. T. (1977). Parietal lobe mechanisms for directed visual attention,Journal of Neurophysiology, 40(2), 362–389.
Macphail, E. (1987). The comparative psychology of intelligence.Behavioral and Brain Sciences, 10(4).
Margolis, H. (1979).Patterns, Thinking, and Cognition. Chicago, IL: University of Chicago Press.
Meyer, D. and Schvaneveldt, R. (1971). Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations.Journal of Experimental Psychology: General, 106, 227–234.
Miller, G., Galanter, E., and Pribram, K. (1960).Plans and the Structure of Behavior. New York: Henry Holt.
Miller, N. (1963). Some reflections on the law of effect produce a new alternative to drive reduction.Nebraska Symposium on Motivation 1963. Lincoln: University of Nebraska Press.
Milner, P. M. (1957). The cell assembly: Mark II.Psychological Review, 64.
Minsky, M. and Pappert, S. (1969).Perceptrons. Cambridge MA: MIT Press.
Nisbett, R. and Ross, L. (1980).Human Inference: Strategies and Shortcomings of Social Judgement. Englewood Cliffs, NJ: Prentice-Hall.
Norman, D. (1980). Cognitive engineering and education. In D. Tuma and F. Reif (eds),Problem Solving and Education. Hillsdale, NJ: Lawrence Erlbaum Associates.
Oakesford, M., Chater, N. and Stenning, K. Connectionism, Classical Cognitive Science and Experimental Psychology. Submitted toAI and Society.
Palm, G. (1982).Neural Assemblies: An Alternative Approach to Artificial Intelligence. Springer-Verlag, New York.
Posner, M. I. (1973). Search strategies and problem solving. InCognition: An Introduction. Scott Foresman.
Prince, A. and Pinker, S. (1988). On language and connectionism: analysis of a parallel distributed processing model of language acquisition.Cognition, 28.
Pylyshyn, Z. W. (1980). Cognition and computation: issues in the foundations of cognitive science.Behavioral and Brain Sciences, 3(1), 154–169.
Rochester, N., Holland, J. H., Haibt, and Duda, W. L. (1956). Tests on a cell assembly theory of the action of the brain, using a large digital computer.IRE Transactions on Information Theory, IT-2.
Rosch, E., Mervis, C., Gray, W., Johnson, D. and Boyes-Braem, P. (1976). Basic objects in natural categories.Cognitive Psychology, 7, 573–605.
Rosenberg, C. (1987). Revealing the structure of NETtalk's internal representations.Proceedings of the Ninth Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates.
Rumelhart, D., and McClelland, J. (1987). On learning the past tenses of English verbs. In J. McClelland and Rumelhart, D. (ed),Parallel Distributed Processing, Vol. 2. Bradford.
Sejnowski, T. and Rosenberg, C. (1986). NETtalk: A parallel network that learns to read aloud (Technical Report 86/101). Baltimore, Johns Hopkins University, Department of Electrical Engineering and Computer Science.
Shepard, R. (1975). Form, formation and transforation of representation. In R. Solso (ed.).Information Processing and Cognition, Hillsdale, NJ: Lawrence Erlbaum Associates.
Smith, E., and Medin, D. (1981).Categories and Concepts. Cambridge, MA: Harvard University Press.
Smolensky, P. (1988). The constituent structure of mental states: a reply to Fodor and Pylyshyn. Technical report CU-CS-394-88, Department of Computer Science and Institute of Cognitive Science, University of Colorado, Boulder.
Stea, D. (1978). Environment, perception and cognition: towards a model for mental maps. In S. Kaplan and R. Kaplan (eds)Humanscape: Environments for People. Belmont, CA: Duxbury.
Tolman, E. C. and Brunswick, E. (1935). The organism and the causal texture of the environment.Psychological Review, 42, 43–77.
Tolman, E. C. (1948). Cognitive maps in rats and man.Psychological Review, 55, 189.
Voss, J. F. (1969). Associative learning and thought. In J. Voss (ed.)Approaches to Thought, Columbus, OH: Charles E. Merrill.
Voss, J. F., Tyler, S. W. and Yengo, L. A. (1983). Individual differences in the solving of social science problems. In R. F. Dillon and R. R. Schmeck (eds),Individual Differences in Cognition. New York: Academic Press.
Wason, P. C. and Johnson-Laird, P. N. (1972).Psychology of Reasoning: Structure and Content. Cambridge, Mass.: Harvard University Press.
Weinert, F. and Kluwe, R. (eds) (1987).Metacognition, Motivation, and Understanding. Hillsdale, NJ: Lawrence Erlbaum Associates.
Williams, R. J. and Zipser, D. (1988). A learning algorithm for continually running, fully-recurrent neural networks. Technical Report no. 8805, Institute of Cognitive Science, University of California at San Diego, La Jolla, CA.
Wise, S. P. and Desimone, R. (1988). Behavioral neurophysiology: insights into seeing and grasping,Science, 242, 736–741.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kaplan, S., Weaver, M. & French, R. Active symbols and internal models: Towards a cognitive connectionism. AI & Soc 4, 51–71 (1990). https://doi.org/10.1007/BF01889764
Issue Date:
DOI: https://doi.org/10.1007/BF01889764