research-article

SYM-ILDL: Incomplete LDL^T Factorization of Symmetric Indefinite and Skew-Symmetric Matrices

Authors:

Paul LiuAuthors Info & Claims

ACM Transactions on Mathematical Software (TOMS), Volume 44, Issue 1

Article No.: 1, Pages 1 - 21

https://doi.org/10.1145/3054948

Published: 11 April 2017 Publication History

Abstract

SYM-ILDL is a numerical software package that computes incomplete LDL^T (ILDL) factorizations of symmetric indefinite and real skew-symmetric matrices. The core of the algorithm is a Crout variant of incomplete LU (ILU), originally introduced and implemented for symmetric matrices by Li and Saad [2005]. Our code is economical in terms of storage, and it deals with real skew-symmetric matrices as well as symmetric ones. The package is written in C++ and is templated, is open source, and includes a Matlab^™ interface. The code includes built-in RCM and AMD reordering, two equilibration strategies, threshold Bunch-Kaufman pivoting, and rook pivoting, as well as a wrapper to MC64, a popular matching-based equilibration and reordering algorithm. We also include two built-in iterative solvers: SQMR, preconditioned with ILDL, and MINRES, preconditioned with a symmetric positive definite preconditioner based on the ILDL factorization.

References

[1]

Patrick R. Amestoy, Timothy A. Davis, and Iain S. Duff. 1996. An approximate minimum degree ordering algorithm. SIAM Journal on Matrix Analysis and Applications 17, 4, 886--905.

Digital Library

[2]

James R. Bunch. 1971. Equilibration of symmetric matrices in the max-norm. Journal of the ACM 18, 4, 566--572.

Digital Library

[3]

James R. Bunch. 1982. A note on the stable decomposition of skew-symmetric matrices. Mathematics of Computation 38, 158, 475--479.

[4]

James R. Bunch and Linda Kaufman. 1977. Some stable methods for calculating inertia and solving symmetric linear systems. Mathematics of Computation 31, 137, 163--179.

[5]

Timothy A. Davis and Yifan Hu. 2011. The University of Florida sparse matrix collection. ACM Transactions on Mathematical Software 38, 1, Article No. 1.

Digital Library

[6]

I. S. Duff. 2009. The design and use of a sparse direct solver for skew symmetric matrices. Journal of Computational and Applied Mathematics 226, 1, 50--54.

Digital Library

[7]

I. S. Duff, A. M. Erisman, and J. K. Reid. 1989. Direct Methods for Sparse Matrices (2nd ed.). Clarendon Press, New York, NY.

Digital Library

[8]

I. S. Duff, N. I. M. Gould, J. K. Reid, J. A. Scott, and K. Turner. 1991. The factorization of sparse symmetric indefinite matrices. IMA Journal of Numerical Analysis 11, 2, 181--204.

[9]

I. S. Duff and J. Koster. 2001. On algorithms for permuting large entries to the diagonal of a sparse matrix. SIAM Journal on Matrix Analysis and Applications 22, 4, 973--996.

Digital Library

[10]

I. S. Duff and S. Pralet. 2005. Strategies for scaling and pivoting for sparse symmetric indefinite problems. SIAM Journal on Matrix Analysis and Applications 27, 2, 313--340.

Digital Library

[11]

Stanley C. Eisenstat, Martin H. Schultz, and Andrew H. Sherman. 1981. Algorithms and data structures for sparse symmetric Gaussian elimination. SIAM Journal on Scientific and Statistical Computing 2, 2, 225--237.

Digital Library

[12]

R. W. Freund and N. M. Nachtigal. 1994. A new Krylov-subspace method for symmetric indefinite linear systems. In Proceedings of the 14th IMACS World Congress on Computational and Applied Mathematics.

[13]

Alan George and Joseph W. H. Liu. 1981. Computer Solution of Large Sparse Positive Definite Systems. Prentice Hall Series in Computational Mathematics. Prentice Hall, Englewood Cliffs, NJ.

Digital Library

[14]

Philip E. Gill, Walter Murray, Dulce B. Ponceleón, and Michael A. Saunders. 1992. Preconditioners for indefinite systems arising in optimization. SIAM Journal on Matrix Analysis and Applications 13, 1, 292--311.

Digital Library

[15]

Chen Greif and James M. Varah. 2009. Iterative solution of skew-symmetric linear systems. SIAM Journal on Matrix Analysis and Applications 31, 2, 584--601.

Digital Library

[16]

Michael Hagemann and Olaf Schenk. 2006. Weighted matchings for preconditioning symmetric indefinite linear systems. SIAM Journal on Scientific Computing 28, 2, 403--420.

Digital Library

[17]

Nicholas J. Higham. 2002. Accuracy and Stability of Numerical Algorithms (2nd ed.). Society for Industrial and Applied Mathematics, Philadelphia, PA.

Digital Library

[18]

J. D. Hogg and J. A. Scott. 2014. Compressed threshold pivoting for sparse symmetric indefinite systems. SIAM Journal on Matrix Analysis and Applications 35, 2, 783--817.

[19]

Mark T. Jones and Paul E. Plassmann. 1995. An improved incomplete Cholesky factorization. ACM Transactions on Mathematical Software 21, 1, 5--17.

Digital Library

[20]

Igor E. Kaporin. 1998. High quality preconditioning of a general symmetric positive definite matrix based on its U^TU + U^TR + R^TU-decomposition. Numerical Linear Algebra with Applications 5, 6, 483--509.

[21]

Na Li and Yousef Saad. 2005. Crout versions of ILU factorization with pivoting for sparse symmetric matrices. Electronic Transactions on Numerical Analysis 20, 75--85.

[22]

Na Li, Yousef Saad, and Edmond Chow. 2003. Crout versions of ILU for general sparse matrices. SIAM Journal on Scientific Computing 25, 2, 716--728.

Digital Library

[23]

Chih-Jen Lin and Jorge J. Moré. 1999. Incomplete Cholesky factorizations with limited memory. SIAM Journal on Scientific Computing 21, 1, 24--45.

Digital Library

[24]

Dominique Orban. 2014. Limited-memory LDL^T factorization of symmetric quasi-definite matrices with application to constrained optimization. Numerical Algorithms 70, 1, 9--41.

Digital Library

[25]

Daniel Ruiz. 2001. A Scaling Algorithm to Equilibrate Both Rows and Columns Norms in Matrices. Technical Report RAL-TR-2001-034. ENSEEIHT.

[26]

Olaf Schenk and Klaus Gärtner. 2006. On fast factorization pivoting methods for sparse symmetric indefinite systems. Electronic Transactions on Numerical Analysis 23, 158--179.

[27]

J. A. Scott and M. Tuma. 2014a. On signed incomplete Cholesky factorization preconditioners for saddle-point systems. SIAM Journal on Scientific Computing 36, 6, A2984--A3010.

[28]

J. A. Scott and M. Tuma. 2014b. On positive semidefinite modification schemes for incomplete Cholesky factorization. SIAM Journal on Scientific Computing 36, 2, A609--A633.

[29]

M. Tismenetsky. 1991. A new preconditioning technique for solving large sparse linear systems. Linear Algebra and Its Applications 154/156, 331--353.

Cited By

Rosen D(2022)Accelerating Certifiable Estimation with Preconditioned EigensolversIEEE Robotics and Automation Letters10.1109/LRA.2022.32201547:4(12507-12514)Online publication date: Oct-2022
https://doi.org/10.1109/LRA.2022.3220154
Ghannad AOrban DSaunders M(2021)Linear systems arising in interior methods for convex optimization: a symmetric formulation with bounded condition numberOptimization Methods and Software10.1080/10556788.2021.196559937:4(1344-1369)Online publication date: 8-Oct-2021
https://doi.org/10.1080/10556788.2021.1965599
Bharali RLarsson FJänicke R(2021)Computational aspects of the weak micro‐periodicity saddle point problemPAMM10.1002/pamm.20200025920:1Online publication date: 25-Jan-2021
https://doi.org/10.1002/pamm.202000259
Show More Cited By

Index Terms

SYM-ILDL: Incomplete LDL^T Factorization of Symmetric Indefinite and Skew-Symmetric Matrices
1. Mathematics of computing
  1. Mathematical analysis
    1. Numerical analysis
      1. Computations on matrices
  2. Mathematical software
    1. Mathematical software performance
    2. Solvers

Recommendations

Non-GPU-resident symmetric indefinite factorization

We study various algorithms to factorize a symmetric indefinite matrix that does not fit in the core memory of a computer. There are two sources of the data movement into the memory: one needed for selecting and applying pivots and the other needed to ...
Preconditioners for nonsymmetric linear systems with low-rank skew-symmetric part
Abstract
We present a preconditioning technique for solving nonsymmetric linear systems A x = b, where the coefficient matrix A has a skew-symmetric part that can be well approximated with a skew-symmetric low-rank matrix. The method consists ...
Computing the MDM^T decomposition

The MDM^T factorization of an n×n symmetric indefinite matrix A can be used to solve a linear system with A as the coefficient matrix. This factorization can be computed efficiently using an algorithm given in 1977 by Bunch and Kaufman. The LAPACK ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Mathematical Software

ACM Transactions on Mathematical Software Volume 44, Issue 1

March 2018

308 pages

ISSN:0098-3500

EISSN:1557-7295

DOI:10.1145/3071076

Editor:
Daniel Kressner
EPF Lausanne, Switzerland

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 April 2017

Accepted: 01 December 2016

Revised: 01 November 2016

Received: 01 May 2015

Published in TOMS Volume 44, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
277
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rosen D(2022)Accelerating Certifiable Estimation with Preconditioned EigensolversIEEE Robotics and Automation Letters10.1109/LRA.2022.32201547:4(12507-12514)Online publication date: Oct-2022
https://doi.org/10.1109/LRA.2022.3220154
Ghannad AOrban DSaunders M(2021)Linear systems arising in interior methods for convex optimization: a symmetric formulation with bounded condition numberOptimization Methods and Software10.1080/10556788.2021.196559937:4(1344-1369)Online publication date: 8-Oct-2021
https://doi.org/10.1080/10556788.2021.1965599
Bharali RLarsson FJänicke R(2021)Computational aspects of the weak micro‐periodicity saddle point problemPAMM10.1002/pamm.20200025920:1Online publication date: 25-Jan-2021
https://doi.org/10.1002/pamm.202000259
Chen QGhai AJiao X(2021)HILUCSI: Simple, robust, and fast multilevel ILU for large‐scale saddle‐point problems from PDEsNumerical Linear Algebra with Applications10.1002/nla.240028:6Online publication date: 14-Jun-2021
https://doi.org/10.1002/nla.2400
Sanan PMay DBollhöfer MSchenk O(2020)Pragmatic solvers for 3D Stokes and elasticity problems with heterogeneous coefficients: evaluating modern incomplete LDL<sup><i>T</i></sup> preconditionersSolid Earth10.5194/se-11-2031-202011:6(2031-2045)Online publication date: 10-Nov-2020
https://doi.org/10.5194/se-11-2031-2020
Pearson JPestana J(2020)Preconditioners for Krylov subspace methods: An overviewGAMM-Mitteilungen10.1002/gamm.20200001543:4Online publication date: 21-Oct-2020
https://doi.org/10.1002/gamm.202000015
Manguoğlu MMehrmann V(2019)A Robust Iterative Scheme for Symmetric Indefinite SystemsSIAM Journal on Scientific Computing10.1137/18M119086041:3(A1733-A1752)Online publication date: 21-May-2019
https://doi.org/10.1137/18M1190860
Thuerck D(2019)Stretching Jacobi: Two-Stage Pivoting in Block-Based Factorization2019 IEEE/ACM 9th Workshop on Irregular Applications: Architectures and Algorithms (IA3)10.1109/IA349570.2019.00014(51-58)Online publication date: Nov-2019
https://doi.org/10.1109/IA349570.2019.00014

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents