Abstract
Connectionist AI systems are large networks of extremely simple numerical processors, massively interconnected and running in parallel. There has been great progress in the connectionist approach, and while it is still unclear whether the approach will succeed, it is also unclear exactly what the implications for cognitive science would be if it did succeed. In this paper I present a view of the connectionist approach that implies that the level of analysis at which uniform formal principles of cognition can be found is the subsymbolic level, intermediate between the neural and symbolic levels. Notions such as logical inference, sequential firing of production rules, spreading activation between conceptual units, mental categories, and frames or schemata turn out to provide approximate descriptions of the coarse-grained behaviour of connectionist systems. The implication is that symbol-level structures provide only approximate accounts of cognition, useful for description but not necessarily for constructing detailed formal models.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Artificial Intelligence. (1980) Special issue on non-monotonic logic. 13, Numbers 1–2.
Boole, G. (1854/1961) An Investigation of The Laws of Thought. Dover, New York.
Cognitive Science. (1985) Special issue on connectionist models and their applications. 9, Number 1.
Dell, G. S. (1985) Positive feedback in hierarchical connectionist models: applications to language production. Cognitive Science, 9, 3–23.
Feldman, J. A. (1981) A connectionist model of visual memory. In: Parallel Models of Associative Memory (eds G. E.Hinton & J. A.Anderson), Erlbaum, Hillsdale, NJ, USA.
Feldman, J. A. & Ballard, D. H. (1982) Connectionist models and their properties. Cognitive Science, 6, 205–254.
Feldman, J. A., Ballard, D. H., Brown, C. M. & Dell, G. S. (1985) Rochester connectionist papers: 1979–1985. Technical Report TR 172, Department of Computer Science, University of Rochester.
Fodor, J. A. (1975) The Language of Thought. Crowell, New York.
Hebb, D. O. (1949) The Organization of Behavior, Wiley, New York.
Hinton, G. E. & Anderson, J. A. (Eds) (1981) Parallel Models of Associative Memory. Erlbaum, Hillsdale, NJ, USA.
Hinton, G. E. & Sejnowski, T. J. (1983) Analyzing cooperative computation. Proceedings of the Fifth Annual Conference of the Cognitive Science Society. Rochester, NY, USA.
Hofstadter, D. R. (1985) Waking up from the Boolean dream, or, subcognition as computation. In: Metamagical Themas, 631–665. Basic Books, New York.
Kant, E. (1787/1963) Critique of Pure Reason. N. Kemp Smith, translator; 2nd edn, McMillan, London.
McClelland, J. L. & Rumelhart, D. E. (1981) An interactive activation model of context effects in letter perception: part 1. An account of the basic findings. Psychological Review, 88, 375–407.
McClelland, J. L., Rumelhart, D. E. & the PDP Research Group. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models. MIT Press/Bradford Books, Cambridge, MA, USA.
Newell, A. (1980) Physical symbol systems. Cognitive Science, 4, 135–183.
Newell, A. (1982). The Knowledge level. Artificial Intelligence, 18, 87–127.
Newell, A. & Simon, H. A. (1972) Human Problem Solving. Prentice-Hall, Englewood Cliffs, NJ, USA.
Riley, M. S. & Smolensky, P. (1984) A parallel model of (sequential) problem solving, Proceedings of the Sixth Annual Conference of the Cognitive Science Society. Boulder, CO, USA.
Rumelhart, D. E. (1980) Schemata: the building blocks of cognition. In: Theoretical Issues in Reading Comprehension (eds R.Spiro, B.Bruce & W.Brewer) Erlbaum, Hillsdale, NJ, USA.
Rumelhart, D. E. & McClelland, J. L. (1982) An interactive activation model of context effects in letter perception: part 2. The contextual enhancement effect and some tests and extensions of the model. Psychological Review, 89, 60–94.
Rumelhart, D. E., McClelland, J. L. & the PDP Research Group. (1986) Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations. MIT Press/Bradford Books, Cambridge, MA, USA.
Rumelhart, D. E., Smolensky, P., McClelland, J. L. & Hinton, G. E. (1986) Schemata and sequential thought processes in parallel distributed processing models. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models (eds J. L.McClelland, D. E.Rumelhart & the PDP Research Group) MIT Press/Bradford Books, Cambridge, MA, USA.
Smolensky, P. (1983) Schema selection and stochastic inference in modular environments. Proceedings of the National Conference on Artificial Intelligence. Washington, DC, USA.
Smolensky, P. (1984a) Harmony theory: thermal parallel models in a computational context. In: Harmony theory: Problem Solving, Parallel Cognitive Models, and Thermal Physics. Technical Report 8404 (eds P.Smolensky & M. S.Riley) Institute for Cognitive Science, University of California at San Diego, USA.
Smolensky, P. (1984b) The mathematical role of self-consistency in parallel computation. Proceedings of the Sixth Annual Conference of the Cognitive Science Society. Boulder, CO, USA.
Smolensky, P. (1986a) Information processing in dynamical systems: foundations of harmony theory. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations (eds D. E.Rumelhart, J. L.McClelland & the PDP Research Group) MIT Press/Bradford Books, Cambridge, MA, USA.
Smolensky, P. (1986b) Neural and conceptual interpretations of parallel distributed processing models. In: Parallel Distributed Processing: Explorations in The Microstructureof Cognition. Volume 2: Psychological and Biological Models (eds J. L.McClelland, D. E.Rumelhart & the PDP Research Group) MIT Press/Bradford Books, Cambridge, MA, USA.
Smolensky, P. (1986c) Formal modeling of subsymbolic processes: an introduction to harmony theory. In: Directions in the Science of Cognition (ed N. E.Sharkey), Ellis Horwood, UK.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Smolensky, P. Connectionist AI, symbolic AI, and the brain. Artif Intell Rev 1, 95–109 (1987). https://doi.org/10.1007/BF00130011
Issue Date:
DOI: https://doi.org/10.1007/BF00130011