Recursive distributed representations

JB Pollack - Artificial Intelligence, 1990 - Elsevier
Artificial Intelligence, 1990Elsevier
A longstanding difficulty for connectionist modeling has been how to represent variable-
sized recursive data structures, such as trees and lists, in fixed-width patterns. This paper
presents a connectionist architecture which automatically develops compact distributed
representations for such compositional structures, as well as efficient accessing
mechanisms for them. Patterns which stand for the internal nodes of fixed-valence trees are
devised through the recursive use of backpropagation on three-layer auto-associative …
Abstract
A longstanding difficulty for connectionist modeling has been how to represent variable-sized recursive data structures, such as trees and lists, in fixed-width patterns. This paper presents a connectionist architecture which automatically develops compact distributed representations for such compositional structures, as well as efficient accessing mechanisms for them. Patterns which stand for the internal nodes of fixed-valence trees are devised through the recursive use of backpropagation on three-layer auto-associative encoder networks. The resulting representations are novel, in that they combine apparently immiscible aspects of features, pointers, and symbol structures. They form a bridge between the data structures necessary for high-level cognitive tasks and the associative, pattern recognition machinery provided by neural networks.
Elsevier