Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article
Free access

An improved incomplete Cholesky factorization

Published: 01 March 1995 Publication History

Abstract

Incomplete factorization has been shown to be a good preconditioner for the conjugate gradient method on a wide variety of problems. It is well known that allowing some fill-in during the incomplete factorization can significantly reduce the number of iterations needed for convergence. Allowing fill-in, however, increases the time for the factorization and for the triangular system solutions. Additionally, it is difficult to predict a priori how much fill-in to allow and how to allow it. The unpredictability of the required storage/work and the unknown benefits of the additional fill-in make such strategies impractical to use in many situations. In this article we motivate, and then present, two “black-box” strategies that significantly increase the effectiveness of incomplete Cholesky factorization as a preconditioner. These strategies require no parameters from the user and do not increase the cost of the triangular system solutions. Efficient implementations for these algorithms are described. These algorithms are shown to be successful for a variety of problems from the Harwell-Boeing sparse matrix collection.

References

[1]
AXELSSON, O. AND MUNKSGAARD, N. 1983. Analysis of incomplete factorizations with fixed storage allocation. In Preconditioning Methods Theory and Appltcations, D. Evans, Ed. Gordon and Breach, New York, 219-241.
[2]
DUFF, I. S. AND MEUP~NT, G.A. 1989. The effect of ordering on preconditioned conjugate gradients. BIT 29, 4 (Dec.), 635-657.
[3]
DUFF, I. S., GRIMES, R., LEwis, J., AND POOLE, B. 1989. Sparse matrix test problems. ACM Trans. Math. Softw. 15, i (Mar.), 1-14.
[4]
FREUND, R. W. AND NACHTIGAL, N. M. 1990. An implementation of the look-ahead Lanczos algorithm for non-Hermitian matrices: Part II. Tech. Rep. RIACS.
[5]
GROPP, W. D., FOULSER, D. E., AND CHANG, S. 1989. CLAM User's Guide. Scientific Computing Associates, New Haven, Conn.
[6]
GUSTAFSSON, I. 1978. A class of first order factorization methods. BIT 18, 2 (June), 142-156.
[7]
HESTENES, M. R. AND STmFEL, E. 1952. Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bur. Stand. 49, 6 (Dec.), 409-436.
[8]
JONES, M. T. AND PLASSMANN, P.E. 1994. Scalable iterative solution of sparse linear systems. Parallel Comput. 20, 5 (May), 753-773.
[9]
KANmL, S. 1966. Estimates for some computational techniques in linear algebra. Math. Comput. 20, 95 (July), 369-378.
[10]
KERSHAW, D.S. 1978. The incomplete Cholesky-conjugate gradient method for the iterative solution of systems of linear equations. J. Comput. Phys. 26, i (Jan.), 43-65.
[11]
MANTEUFFEL, T.A. 1980. An incomplete factorization technique for positive definite linear systems. Math. Comput. 34, 150 (Apr.), 473-497.
[12]
MEIJERINK, J. AND VAN DER VORST, H.A. 1981. Guidelines for the usage of incomplete decompositions in solving sets of linear equations as they occur in practical problems. J. Comput. Phys. 44, 1 (Nov.), 134-155.
[13]
MEIJERINK, J. AND VAN DER VORST, H.A. 1977. An iterative solution method for linear systems of which the coefficient matrix is a symmetric M-matrix. Math. Comput. 31, 137 (Jan.), 148-162.
[14]
MUNKSGAARD, N. 1980. Solving sparse symmetric sets of linear equations by preconditioned conjugate gradients. ACM Trans. Math. Softw. 6, 2 (June), 206-219.

Cited By

View all
  • (2024)Avoiding Breakdown in Incomplete Factorizations in Low Precision ArithmeticACM Transactions on Mathematical Software10.1145/365115550:2(1-25)Online publication date: 12-Mar-2024
  • (2023)Scalable Approximate NonSymmetric Autoencoder for Collaborative FilteringProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608827(763-770)Online publication date: 14-Sep-2023
  • (2023)Incomplete FactorizationsAlgorithms for Sparse Linear Systems10.1007/978-3-031-25820-6_10(185-203)Online publication date: 11-Jan-2023
  • Show More Cited By

Recommendations

Reviews

Maurice W. Benson

Two new incomplete Cholesky factorization algorithms suitable for “black-boxed” implementation are motivated with a brief theoretical discussion, described in detail (including pseudocode), and demonstrated to be effective for the generation of preconditioners for a variety of sparse problems. The new approaches do not require any user-supplied parameters and retain the same number of nonzero elements in the factors as in the original matrix (in a row or column manner depending on the method). This ensures the same computational cost for the use of the new factors as with those from the standard incomplete Cholesky factorization. The methods retain the required number of nonzeros in the factors by keeping only larger-magnitude values, while not enforcing any sparsity pattern. A good review of related work is provided, and the new features of the methods presented are described clearly. Extensive experimental results illustrate the utility of the new strategies. Iteration counts for the preconditioned conjugate gradient algorithm demonstrate behavior superior to that of the standard incomplete Cholesky factorization. Efficiency and the effect of varied orderings of the original system are among the features examined. This report should interest specialists developing new algorithms and researchers interested in applications of new, more efficient preconditioners. The presentation is clear, and the references provide a good base for anyone needing more detail.

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Mathematical Software
ACM Transactions on Mathematical Software  Volume 21, Issue 1
March 1995
156 pages
ISSN:0098-3500
EISSN:1557-7295
DOI:10.1145/200979
  • Editor:
  • Ronald F. Boisvert
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 1995
Published in TOMS Volume 21, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. incomplete Cholesky
  2. incomplete factorization
  3. preconditioners
  4. sparse matrices

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)354
  • Downloads (Last 6 weeks)37
Reflects downloads up to 22 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Avoiding Breakdown in Incomplete Factorizations in Low Precision ArithmeticACM Transactions on Mathematical Software10.1145/365115550:2(1-25)Online publication date: 12-Mar-2024
  • (2023)Scalable Approximate NonSymmetric Autoencoder for Collaborative FilteringProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608827(763-770)Online publication date: 14-Sep-2023
  • (2023)Incomplete FactorizationsAlgorithms for Sparse Linear Systems10.1007/978-3-031-25820-6_10(185-203)Online publication date: 11-Jan-2023
  • (2022)A 3D fully thermo–hydro–mechanical coupling model for saturated poroelastic mediumComputer Methods in Applied Mechanics and Engineering10.1016/j.cma.2022.114939394(114939)Online publication date: May-2022
  • (2022)Linear Solvers for Reservoir Simulation Problems: An Overview and Recent DevelopmentsArchives of Computational Methods in Engineering10.1007/s11831-022-09739-229:6(4341-4378)Online publication date: 11-Apr-2022
  • (2021)Approximate High Dimensional Graph Mining With Matrix Polar Factorization: A Twitter Application2021 IEEE International Conference on Big Data (Big Data)10.1109/BigData52589.2021.9671926(4441-4449)Online publication date: 15-Dec-2021
  • (2021)A high performance level-block approximate LU factorization preconditioner algorithmApplied Numerical Mathematics10.1016/j.apnum.2020.12.023Online publication date: Jan-2021
  • (2021)Energy-Based Discontinuous Galerkin Difference Methods for Second-Order Wave EquationsCommunications on Applied Mathematics and Computation10.1007/s42967-021-00149-y4:3(855-879)Online publication date: 7-Oct-2021
  • (2021)Modified controlled Cholesky factorization for preconditioning linear systems from the interior-point methodComputational and Applied Mathematics10.1007/s40314-021-01544-040:4Online publication date: 28-May-2021
  • (2021)HILUCSI: Simple, robust, and fast multilevel ILU for large‐scale saddle‐point problems from PDEsNumerical Linear Algebra with Applications10.1002/nla.240028:6Online publication date: 14-Jun-2021
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media