Abstract
The deteriorating effect of old history in asynchronous iterations is investigated on an application based on the specialization of parallel variable distribution approach of Ferris and Mangasarian [4] to linear least squares problem. A partially asynchronous algorithm is developed which employs a combination of synchronization, a relaxation parameter and a certain form of overlap between subproblems. It is shown by numerical experiments that this combined effort to decrease the effect of old history is more effective than the single attempts considered in [9,11].
Work is a part of the first author’s Dr. Scient. thesis completed at the University of Bergen, Department of Informatics, Bergen, Norway
Chapter PDF
Similar content being viewed by others
References
Dennis Jr., J.E., Steihaug, T.: On the successive projections approach to least squares problems. SIAM J. Numer. Anal. 23, 717–733 (1986)
Dennis Jr., J.E., Steihaug, T.: A Ferris-Mangasarian technique applied to linear least squares problems. Tech.Rep. No. 150, Department of Informatics, University of Bergen, Norway (1998)
Duff, I.S., Van der Vorst, H.A.: Developments and trends in the parallel solution of linear systems. Parallel Comput. 25, 1931–1970 (1999)
Ferris, M.C., Mangasarian, O.L.: Parallel variable distribution. SIAM J. Optim. 4, 815–832 (1994)
Frommer, A., Pohl, B.: A comparison result for multisplittings and waveform relaxation methods. Numer. Linear Algebra Appl. 2, 335–346 (1995)
Frommer, A., Renaut, R.A.: A unified approach to parallel space decomposition methods. J. Comput. Appl. Math. 110, 205–223 (1999)
Frommer, A., Szyld, D.B.: On asynchronous iterations. J. Comput. Appl. Math. 123, 201–216 (2000)
Renaut, R.A.: A parallel multisplitting solution of the least squares problem. Numer. Linear Algebra Appl. 5, 11–31 (1998)
Steihaug, T., Yalçınkaya, Y.: Deteriorating convergence for asynchronous methods on linear least squares problem. In: Lengauer, C., Griebl, M., Gorlatch, S. (eds.) Euro-Par 1997. LNCS, vol. 1300, pp. 750–759. Springer, Heidelberg (1997)
Yalçınkaya, Y.: Reducing the Effect of Old History in Asynchronous Iterations: An Empirical Study. Dr. Scient.Thesis, Department of Informatics, University of Bergen, Norway (2003)
Yalçınkaya, Y., Steihaug, T.: Asynchronous methods and least squares: An example of deteriorating convergence. In: Sydow, A. (ed.) Proc. of the 15th IMACS World Congress on Scientific Computation, Modeling and Applied Mathematics. Computational Mathematics, vol. 1, pp. 535–540. Wissenschaft & Technik Verlag (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yalçınkaya, Y., Steihaug, T. (2004). Reducing the Deteriorating Effect of Old History in Asynchronous Iterations. In: Danelutto, M., Vanneschi, M., Laforenza, D. (eds) Euro-Par 2004 Parallel Processing. Euro-Par 2004. Lecture Notes in Computer Science, vol 3149. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27866-5_92
Download citation
DOI: https://doi.org/10.1007/978-3-540-27866-5_92
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22924-7
Online ISBN: 978-3-540-27866-5
eBook Packages: Springer Book Archive