Abstract
Many optimization algorithms involve repeated processing of a fixed set of linear constraints. If we pre-process the constraint matrixA to be sparser, then algebraic operations onA will become faster. We consider the problem of making a given matrix as sparse as possible, theSparsity Problem (SP). In a companion paper with S. Frank Chang, we developed some theoretical algorithms for SP under a non-degeneracy assumption (McCormick and Chang, 1988). Here we investigate what must be done to make those algorithms applicable in practice. We report encouraging computational results in making linear programming constraint matrices sparser. We also find that the Simplex Algorithm can solve the reduced LPs faster. Comparisons are made to a heuristic algorithm for SP of Adler et al. (1989).
Similar content being viewed by others
References
I. Adler, N. Karmarkar, M.G.C. Resende and G. Veiga, “Data structures and programming techniques for the implementation of Karmarkar's algorithm,”ORSA Journal on Computing 1 (1989), to appear.
R.E. Bixby and W.H. Cunningham, “Converting linear programs to network problems,”Mathematics of Operations Research 5 (1980) 321–357.
S.F. Chang and S.T. McCormick, “The hierarchical algorithm for making sparse matrices sparser,” Columbia University IE/OR Technical Report (New York, 1989a).
S.F. Chang and S.T. McCormick, “MakingAA T sparser for interior-point algorithms: Complexity and heuristics,” Columbia University IE/OR Technical Report (New York, 1989b).
I.S. Duff, “MA28—a set of FORTRAN Subroutines for Sparse Unsymmetric Linear Equations,” A.E.R.E. Harwell Report 8730 (1977).
M.R. Garey and D.S. Johnson,Computers and Intractability (Freeman, San Francisco, CA, 1979).
F.G. Gustavson, “Finding the block triangular form of a sparse matrix,” in: J.R. Bunch and D.J. Rose, eds.,Sparse Matrix Computations (Academic Press, New York, 1976) pp. 41–52.
A.J. Hoffman and S.T. McCormick, “A fast algorithm that makes matrices optimally sparse,” in: W.R. Pulleyblank, ed.,Progress in Combinatorial Optimization (Academic Press, London and New York, 1984) pp. 185–196.
J.E. Hopcroft and R.M. Karp, “Ann 5/2 algorithm for maximum matching in graphs,”SIAM Journal on Computing 2(4) (1973) pp. 225–231.
E.L. Lawler,Combinatorial Optimization (Holt, Rinehart and Winston, New York, 1976).
H.M. Markowitz, “The elimination form of the inverse and its application to linear programming,”Management Science 3 (1957) 255–269.
S.T. McCormick, “A combinatorial approach to some sparse matrix problems,” Ph.D. Thesis, Stanford University (Stanford, CA, 1983).
S.T. McCormick and S.F. Chang, “Weighted sparsity problem: complexity and algorithms,” Columbia University IE/OR Technical Report (New York, 1988), submitted for publication.
K. Murota, “Some recent results in combinatorial approach to dynamical systems,” Research Memorandum RMI88-08, Department of Mathematical Engineering and Instrumentation Physics, University of Tokyo (Tokyo, 1988).
B.A. Murtagh,Advanced Linear Programming and Practice (McGraw-Hill, New York, 1981).
C.H. Papadimitriou and K. Stieglitz,Combinatorial Optimization: Algorithms and Complexity (Prentice-Hall, Englewood Cliffs, NJ, 1982).
M.A. Saunders, “MINOS system manual,” Stanford Systems Optimization Laboratory Report SOL 77-31 (Stanford, CA, 1977).
Author information
Authors and Affiliations
Additional information
This work was partially supported by NSF Grants ECS-84-04350 and CDR-84-21402, and by ONR Contract N0014-87-K0214.
Rights and permissions
About this article
Cite this article
McCormick, S.T. Making sparse matrices sparser: Computational results. Mathematical Programming 49, 91–111 (1990). https://doi.org/10.1007/BF01588780
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01588780