Projected Newton methods for optimization problems with simple constraints

DP Bertsekas - SIAM Journal on control and Optimization, 1982 - SIAM
SIAM Journal on control and Optimization, 1982SIAM
We consider the problem \min{f(x)|x\geqq0\}, and propose algorithms of the form x_k+1=x_k-
α_kD_k∇f(x_k)^+, where ⋅^+ denotes projection on the positive orthant, α_k is a stepsize
chosen by an Armijo-like rule and D_k is a positive definite symmetric matrix which is partly
diagonal. We show that D_k can be calculated simply on the basis of second derivatives of f
so that the resulting Newton-like algorithm has a typically superlinear rate of convergence.
With other choices of D_k convergence at a typically linear rate is obtained. The algorithms …
We consider the problem , and propose algorithms of the form , where denotes projection on the positive orthant, is a stepsize chosen by an Armijo-like rule and is a positive definite symmetric matrix which is partly diagonal. We show that can be calculated simply on the basis of second derivatives of f so that the resulting Newton-like algorithm has a typically superlinear rate of convergence. With other choices of convergence at a typically linear rate is obtained. The algorithms are almost as simple as their unconstrained counterparts. They are well suited for problems of large dimension such as those arising in optimal control while being competitive with existing methods for low-dimensional problems. The effectiveness of the Newton-like algorithm is demonstrated via computational examples involving as many as 10,000 variables. Extensions to general linearly constrained problems are also provided. These extensions utilize a notion of an active generalized rectangle patterned after the notion of an active manifold used in manifold suboptimization methods. By contrast with these methods, many constraints can be added or subtracted from the binding set at each iteration without the need to solve a quadratic programming problem.
Society for Industrial and Applied Mathematics