Abstract
We have previously introduced [2, 5] a neural implementation of Canonical Correlation Analysis (CCA). In this paper, we re-derive the learning method from a probabilistic perspective and then show that similar networks can be derived based on the pioneering work of Becker [1] if certain simplifying assumptions are made. Becker has shown that her network is able to find depth information from an abstraction of random dot stereogram data and so finally we note the similarity of the derived methods with those of Stone [3] which was used with a smooth stereo disparity data set to extract depth information.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Becker, S.: An Information-theoretic Unsupervised Learning Algorithm for Neural Networks, PhD thesis, October 1992.
Lai, P. L. and Fyfe, C.: A neural network implementation of canonical correlation analysis, Neural Networks 12(10) (1999), 1391–1397.
Stone, J. V.: Learning spatio-temporal invariances. In: L. S. Smith and P. J. B. Hancock, (eds), In: Neural Computation and Psychology Proceedings, Springer-Verlag, Berlin, 1995, pp. 75–85.
Stone, J.: Learning perpetually salient visual parameters using spationtemporal smoothness constraints, Neural Computation 8(7) (1996), 1463–1492.
Lai, P. L. and Fyfe, C.: Canonical correlation analysis using artificial neural networks, In: European Symposium on Artificial Neural Networks, ESANN98, 1998.
Lai, P. L.: A Neural Implementation of Canonical correlation analysis, PhD Thesis, University of Paisley, 2000.
Mardia, K. V., Kent, J. T. and Bibby, J. M.: Multivariate Analysis, Academic Press, 1979.
Baram, Y. and Roth, Z.: Density shaping by neural networks with application to classification, estimation and forecasting, Technical Report 9420, Centre for Intelligent Systems, Technion, Israel, 1994.
Smola, A. J. and Scholkopf, B.: A tutorial on support vector regression, Technical Report NC2-TR-1998-030, NeuroCOLT2 Technical Report Series, Oct. 1998.
Bishop, C.: Neural Networks for Pattern Recognition, Oxford: Clarendon Press, 1995.
Oja, E.: A simplified neuron model as a principal component analyser, Journal of Mathematical Biology 16 (1982), 267–273.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lai, P.L., Fyfe, C. A Family of Canonical Correlation Networks. Neural Processing Letters 14, 93–105 (2001). https://doi.org/10.1023/A:1012412014706
Issue Date:
DOI: https://doi.org/10.1023/A:1012412014706