research-article

Blocked algorithms for the reduction to Hessenberg-triangular form revisited

Authors:

E.S. Quintana-Ortí,

G. Quintana-OrtíAuthors Info & Claims

Volume 48, Issue 3

Pages 563 - 584

https://doi.org/10.1007/s10543-008-0180-1

Published: 01 September 2008 Publication History

Abstract

We present two variants of Moler and Stewart’s algorithm for reducing a matrix pair to Hessenberg-triangular (HT) form with increased data locality in the access to the matrices. In one of these variants, a careful reorganization and accumulation of Givens rotations enables the use of efficient level 3 BLAS. Experimental results on four different architectures, representative of current high performance processors, compare the performances of the new variants with those of the implementation of Moler and Stewart’s algorithm in subroutine DGGHRD from LAPACK, Dackland and Kågström’s two-stage algorithm for the HT form, and a modified version of the latter which requires considerably less flops.

References

[1]

E. Anderson, Z. Bai, C. H. Bischof, S. Blackford, J. W. Demmel, J. J. Dongarra, J. Du Croz, A. Greenbaum, S. Hammarling, A. McKenney, and D. C. Sorensen, LAPACK Users’ Guide, 3rd edn., SIAM, Philadelphia, PA, 1999.

Digital Library

[2]

C. H. Bischof, B. Lang, and X. Sun, A framework for symmetric band reduction, ACM Trans. Math. Softw., 26 (2000), pp. 581–601.

Digital Library

[3]

C. H. Bischof and C. F. Van Loan, The WY representation for products of Householder matrices, SIAM J. Sci. Stat. Comput., 8 (1987), pp. S2–S13.

Digital Library

[4]

K. Braman, R. Byers, and R. Mathias, The multishift QR algorithm. I. Maintaining well-focused shifts and level 3 performance, SIAM J. Matrix Anal. Appl., 23 (2002), pp. 929–947.

Digital Library

[5]

M. Cosnard, J.-M. Muller, and Y. Robert, Parallel QR decomposition of a rectangular matrix, Numer. Math., 48 (1986), pp. 239–249.

Digital Library

[6]

K. Dackland and B. Kågström, Blocked algorithms and software for reduction of a regular matrix pair to generalized Schur form, ACM Trans. Math. Softw., 25 (1999), pp. 425–454.

Digital Library

[7]

J. J. Dongarra, D. C. Sorensen, and S. J. Hammarling, Block reduction of matrices to condensed forms for eigenvalue computations, J. Comput. Appl. Math., 27 (1989), pp. 215–227. (Reprinted in Parallel algorithms for numerical linear algebra, North-Holland, Amsterdam, 1990, pp. 215–227)

[8]

G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd edn., Johns Hopkins University Press, Baltimore, MD, 1996.

Digital Library

[9]

K. Goto and R. van de Geijn, High-performance implementation of the level-3 BLAS, ACM Trans. Math. Software, 35 (2008).

[10]

B. Kågström, P. Ling, and C. F. Van Loan, GEMM-based level 3 BLAS: Algorithms for the model implementations, ACM Trans. Math. Softw., 24 (1999), pp. 268–302.

[11]

B. Kågström, P. Ling, and C. F. Van Loan, GEMM-based level 3 BLAS: High-performance model implementations and performance evaluation benchmark, ACM Trans. Math. Softw., 24 (1999), pp. 303–316.

[12]

B. Kågström and D. Kressner, Multishift variants of the QZ algorithm with aggressive early deflation, SIAM J. Matrix Anal. Appl., 29 (2006), pp. 199–227. (Also appeared as LAPACK working note 173.)

Digital Library

[13]

D. Kressner, Numerical Methods and Software for General and Structured Eigenvalue Problems, PhD thesis, TU Berlin, Institut für Mathematik, Berlin, Germany, 2004.

[14]

B. Lang, Effiziente Orthogonaltransformationen bei der Eigen- und Singulärwertzerlegung. Habilitationsschrift, 1997.

[15]

B. Lang, Using level 3 BLAS in rotation-based algorithms, SIAM J. Sci. Comput., 19 (1998), pp. 626–634.

Digital Library

[16]

H. P. Märchy, On a modification of the QZ algorithm with fast Givens rotations, Computing, 38 (1987), pp. 247–259.

[17]

J. J. Modi and M. R. B. Clarke, An alternative Givens ordering, Numer. Math., 43 (1984), pp. 83–90.

Digital Library

[18]

C. B. Moler and G. W. Stewart, An algorithm for generalized matrix eigenvalue problems, SIAM J. Numer. Anal., 10 (1973), pp. 241–256.

Digital Library

[19]

G. Quintana-Ortí and R. A. van de Geijn, Improving the performance of reduction to Hessenberg form, ACM Trans. Math. Softw., 32 (2006), pp. 180–194.

Digital Library

[20]

H. Rutishauser, On Jacobi rotation patterns, in Proc. Sympos. Appl. Math., vol. XV, pp. 219–239, Amer. Math. Soc., Providence, R.I., 1963.

[21]

R. Schreiber and C. F. Van Loan, A storage-efficient WY representation for products of Householder transformations, SIAM J. Sci. Stat. Comput., 10 (1989), pp. 53–57.

Digital Library

[22]

H.-R. Schwarz, Die Reduktion einer symmetrischen Bandmatrix auf tridiagonale Form, Z. Angew. Math. Mech., 45 (1965), pp. T75–T77.

Cited By

Bosner N(2021)Parallel reduction of four matrices to condensed form for a generalized matrix eigenvalue algorithmNumerical Algorithms10.1007/s11075-020-00883-z86:1(153-178)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1007/s11075-020-00883-z
Kabir KHaidar ATomov SDongarra JWatson LWeinbub JSosonkina MThacker W(2015)Performance analysis and design of a hessenberg reduction using stabilized blocked elementary transformations for new architecturesProceedings of the Symposium on High Performance Computing10.5555/2872599.2872616(135-142)Online publication date: 12-Apr-2015
https://dl.acm.org/doi/10.5555/2872599.2872616
Bosner N(2015)Efficient algorithm for simultaneous reduction to the $$m$$-Hessenberg-triangular-triangular formBIT10.1007/s10543-014-0516-y55:3(677-703)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1007/s10543-014-0516-y

Recommendations

Multishift Variants of the QZ Algorithm with Aggressive Early Deflation

New variants of the QZ algorithm for solving the generalized eigenvalue problem are proposed. An extension of the small-bulge multishift QR algorithm is developed, which chases chains of many small bulges instead of only one bulge in each QZ iteration. ...
Blocked algorithms and software for reduction of a regular matrix pair to generalized Schur form

A two-stage blocked algorithm for reduction of a regular matrix pair (A , B ) to upper Hessenberg-triangular form is presented. In stage 1 (A, B is reduced to block upper Hessenberg-triangular form using mainly level 3 (matrix-matrix) operations that ...
Recursive blocked algorithms for solving periodic triangular Sylvester-type matrix equations
PARA'06: Proceedings of the 8th international conference on Applied parallel computing: state of the art in scientific computing

Recently, recursive blocked algorithms for solving triangular one-sided and two-sided Sylvester-type equations were introduced by Jonsson and Kågström. This elegant yet simple technique enables an automatic variable blocking that has the potential of ...

Comments

Information & Contributors

Information

Published In

cover image BIT

BIT Volume 48, Issue 3

Sep 2008

216 pages

ISSN:0006-3835

Issue’s Table of Contents

Copyright © 2008 Springer Science + Business Media B.V.

Publisher

BIT Computer Science and Numerical Mathematics

United States

Publication History

Published: 01 September 2008

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bosner N(2021)Parallel reduction of four matrices to condensed form for a generalized matrix eigenvalue algorithmNumerical Algorithms10.1007/s11075-020-00883-z86:1(153-178)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1007/s11075-020-00883-z
Kabir KHaidar ATomov SDongarra JWatson LWeinbub JSosonkina MThacker W(2015)Performance analysis and design of a hessenberg reduction using stabilized blocked elementary transformations for new architecturesProceedings of the Symposium on High Performance Computing10.5555/2872599.2872616(135-142)Online publication date: 12-Apr-2015
https://dl.acm.org/doi/10.5555/2872599.2872616
Bosner N(2015)Efficient algorithm for simultaneous reduction to the $$m$$-Hessenberg-triangular-triangular formBIT10.1007/s10543-014-0516-y55:3(677-703)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1007/s10543-014-0516-y

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents