Abstract
For solving the generalized equation \(f(x)+F(x) \ni 0\), where \(f\) is a smooth function and \(F\) is a set-valued mapping acting between Banach spaces, we study the inexact Newton method described by
where \(Df\) is the derivative of \(f\) and the sequence of mappings \(R_k\) represents the inexactness. We show how regularity properties of the mappings \(f+F\) and \(R_k\) are able to guarantee that every sequence generated by the method is convergent either q-linearly, q-superlinearly, or q-quadratically, according to the particular assumptions. We also show there are circumstances in which at least one convergence sequence is sure to be generated. As a byproduct, we obtain convergence results about inexact Newton methods for solving equations, variational inequalities and nonlinear programming problems.
Similar content being viewed by others
Notes
Actually, in his pioneering work [15] Robinson considered variational inequalities only.
Since our analysis is local, one could localize these assumptions around a solution \(\bar{x}\) of (1). Also, in some of the presented results, in particular those involving strong metric subregularity, it is sufficient to assume continuity of \(Df\) only at \(\bar{x}\). Since the paper is already quite involved technically, we will not go into these refinements in order to simplify the presentation as much as possible.
The classical inverse function theorem actually gives us more: it shows that the single-valued localization of the inverse is smooth and provides also the form of its derivative.
References
Aragón Artacho, F.J., Dontchev, A.L., Gaydu, M., Geoffroy, M.H., Veliov, V.M.: Metric regularity of Newton’s iteration. SIAM J. Control Optim. 49, 339–362 (2011)
Argyros, I.K., Hilout, S.: Inexact Newton-type methods. J. Complex. 26, 577–590 (2010)
Argyros, I.K., Hilout, S.: A Newton-like method for nonsmooth variational inequalities. Nonlinear Anal. 72, 3857–3864 (2010)
Bonnans, J.F.: Local analysis of Newton-type methods for variational inequalities and nonlinear programming. Appl. Math. Optim. 29, 161–186 (1994)
Dembo, R.S., Eisenstat, S.C., Steihaug, T.: Inexact Newton methods. SIAM J. Numer. Anal. 19, 400–408 (1982)
Dontchev, A.L.: Local convergence of the Newton method for generalized equation. C. R. Acad. Sci. Paris Sér. I 322, 327–331 (1996)
Dontchev, A.L., Frankowska, H.: Lyusternik-Graves theorem and fixed points II. J. Convex Anal. 19, 955–973 (2012)
Dontchev, A.L., Rockafellar, R.T.: Characterizations of strong regularity for variational inequalities over polyhedral convex sets. SIAM J. Optim. 6, 1087–1105 (1996)
Dontchev, A.L., Rockafellar, R.T.: Implicit Functions and Solution Mappings. Springer Mathematics Monographs, Springer, Dordrecht (2009)
Fernández, D., Solodov, M.: On local convergence of sequential quadratically-constrained quadratic-programming type methods, with an extension to variational problems. Comput. Optim. Appl. 39, 143–160 (2008)
Geoffroy, M.H., Piétrus, A.: Local convergence of some iterative methods for generalized equations. J. Math. Anal. Appl. 290, 497–505 (2004)
Izmailov, A.F., Solodov, M.V.: Inexact Josephy-Newton framework for generalized equations and its applications to local analysis of Newtonian methods for constrained optimization. Comput. Optim. Appl. 46, 347–368 (2010)
Josephy, N. H.: Newton’s method for generalized equations. Technical Summary Report 1965, University of Wisconsin, Madison (1979)
Kelley, C.T.: Solving Nonlinear Equations with Newton’s Method, Fundamentals of Algorithms. SIAM, Philadelphia (2003)
Robinson, S.M.: Strongly regular generalized equations. Math. Oper. Res. 5, 43–62 (1980)
Acknowledgments
The authors wish to thank the referees for their valuable comments on the original submission.
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to Jon Borwein on the occasion of his 60th birthday.
This work is supported by the National Science Foundation Grant DMS 1008341 through the University of Michigan.
Rights and permissions
About this article
Cite this article
Dontchev, A.L., Rockafellar, R.T. Convergence of inexact Newton methods for generalized equations. Math. Program. 139, 115–137 (2013). https://doi.org/10.1007/s10107-013-0664-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-013-0664-x
Keywords
- Inexact Newton method
- Generalized equations
- Metric regularity
- Metric subregularity
- Variational inequality
- Nonlinear programming